Data Engineering · 9 min read
Metadata Driven Ingestion into Fabric with Pipelines
Today I’m going into how you can set up the start of a metadata-driven processing framework for Microsoft Fabric. Let’s dive in.
Blog
Articles
Articles on Microsoft Fabric, Power BI and data engineering, newest first. Talks have their own page.
Data Engineering · 7 min read
Vibe Coding in Microsoft Fabric
Can ChatGPT actually help you build a complete data platform in Microsoft Fabric if you pretend to know absolutely nothing? That’s exactly what I set out to test.
Data Engineering · 5 min read
Write Delta Tables Using Python Notebooks
You can now write data to delta tables using Python notebooks, without using expensive Spark compute in Microsoft Fabric!
Data Engineering · 5 min read
Setting V-Order for delta tables in Microsoft Fabric
Microsoft recently made a change that caught a lot of people off guard: they disabled V-Ordering by default for new Fabric lakehouses. If you’re using Power BI Direct Lake mode, this matters—a lot.
Power BI · 7 min read
New Way to Build Semantic Models in Microsoft Fabric (Without Power BI!)
Did you know you can create Power BI semantic models directly from the Fabric web portal? No Power BI Desktop required. This is a game-changer if you’re working on a MacBook, dealing with a…
Data Engineering · 9 min read
All about Lakehouse in Microsoft Fabric
Lakehouses are the foundation of data engineering in Microsoft Fabric. They’re where you store your raw data, your transformed tables, and everything in between.
Data Engineering · 7 min read
Stop wasting money in Microsoft Fabric: Dataflows vs Notebooks
There’s a common debate in the Fabric community: should you use low-code tools like Dataflows Gen2, or should you write pro-code solutions with PySpark notebooks? Today I’m going to settle this…
Data Engineering · 7 min read
Conversational AI with Microsoft Fabric Data Agents
Microsoft Fabric Data Agents are the ChatGPT for your data. Now you don't need dashboards anymore, you can talk to your data!
Data Engineering · 5 min read
Case Sensitivity in Microsoft Fabric Spark
I recently ran into a sneaky issue while migrating a customer from SQL Server to Microsoft Fabric. We were doing what every lazy developer does—copy-pasting code—and suddenly our joins stopped…