Today I want to talk about task flows inside Microsoft Fabric—what they can be used for, how we can change them, how we can add them, and how we can make sense of our projects and make them a bit less messy. Let’s dive in and find out what tasks are all about. That Gray …
Can ChatGPT actually help you build a complete data platform in Microsoft Fabric if you pretend to know absolutely nothing? That’s exactly what I set out to test. I gave myself a simple scenario: I’m a data engineer with a SQL database that needs to be transformed into a proper medallion architecture with bronze, silver, …
Microsoft recently made a change that caught a lot of people off guard: they disabled V-Ordering by default for new Fabric lakehouses. If you’re using Power BI Direct Lake mode, this matters—a lot. V-Ordering can dramatically improve your query performance, but it comes with tradeoffs. Today I’m going to show you how to check if …
Lakehouses are the foundation of data engineering in Microsoft Fabric. They’re where you store your raw data, your transformed tables, and everything in between. But if you’re new to Fabric, lakehouses can be a bit confusing. What’s the difference between tables and files? What are shortcuts? How do you actually work with the data once …
Recently, Microsoft came out with a private preview for OneLake Security in Microsoft Fabric lakehouses. This is amazing, it is a feature I have been waiting for now for a long time. The promise with Fabric would be that security in the most detailed grain (both row-level and column-level) would be implemented in OneLake. However, …
Materialized Lake Views in Fabric lakehouses are a very cool option to start introducing data virtualisation patterns within Microsoft Fabric. In today’s post I will show you how you can create MLVs and how you can manage them. Views vs Tables Let’s get this out of the way first. What is the difference between a …
Introduction In this guide, we’ll dive straight into the practical steps of how to implement Medallion Lakehouses using Microsoft Fabric. If you’re unfamiliar with the Medallion Architecture, or need a refresher, check out our previous post on the theory behind the Medallion Architecture. This post focuses on hands-on implementation, guiding you through each step of …
The medallion architecture is maybe the most important concept to grasp when you start building lakehouse solutions on Microsoft Fabric. Data products should never be built ‘right away’ or on their own. There’s a structure and process to follow. Luckily, we don’t have to figure out that structure by ourselves. Rather, I’d suggest using what …