Category

Data Engineering

Notebooks, Spark, Delta Lake and pipelines: building data platforms on Microsoft Fabric, newest first.

Data Engineering · · 5 min read

Delta Tables in Microsoft Fabric Explained

Learn about delta tables in Microsoft Fabric. In this post I go into what delta is, why we use it, and what Fabric has to do with it.

delta lake

Data Engineering · · 5 min read

Merging Dataframes in PySpark

Today I’m going to teach you how the Python merge statement works, and we use it a lot in Microsoft Fabric.

notebooks

Data Engineering · · 8 min read

Microsoft Fabric with a MacBook

Microsoft Fabric with a MacBook is certainly possible. I never use Windows, even though I'm always working on Microsoft products. See how!

developer

Data Engineering · · 9 min read

How to use Task Flows in Microsoft Fabric

Today I want to talk about task flows inside Microsoft Fabric—what they can be used for, how we can change them, how we can add them, and how we can make sense of our projects and make them a bit…

medallion

Data Engineering · · 6 min read

How to change Microsoft Fabric Python resources

A couple of weeks ago, I showed you how we can use DuckDB as a Python library in Microsoft Fabric to do Python notebooks on Delta Lake instead of using Spark notebooks.

costs

Data Engineering · · 9 min read

Metadata Driven Ingestion into Fabric with Pipelines

Today I’m going into how you can set up the start of a metadata-driven processing framework for Microsoft Fabric. Let’s dive in.

metadata

Data Engineering · · 7 min read

Vibe Coding in Microsoft Fabric

Can ChatGPT actually help you build a complete data platform in Microsoft Fabric if you pretend to know absolutely nothing? That’s exactly what I set out to test.

AI

Data Engineering · · 5 min read

Write Delta Tables Using Python Notebooks

You can now write data to delta tables using Python notebooks, without using expensive Spark compute in Microsoft Fabric!

delta lake

Data Engineering · · 5 min read

Setting V-Order for delta tables in Microsoft Fabric

Microsoft recently made a change that caught a lot of people off guard: they disabled V-Ordering by default for new Fabric lakehouses. If you’re using Power BI Direct Lake mode, this matters—a lot.

delta lake

↑↓to move ↵to open escto close