Category

Data Engineering

Notebooks, Spark, Delta Lake and pipelines: building data platforms on Microsoft Fabric, newest first.

Data Engineering · · 9 min read

All about Lakehouse in Microsoft Fabric

Lakehouses are the foundation of data engineering in Microsoft Fabric. They’re where you store your raw data, your transformed tables, and everything in between.

delta lake

Data Engineering · · 7 min read

Stop wasting money in Microsoft Fabric: Dataflows vs Notebooks

There’s a common debate in the Fabric community: should you use low-code tools like Dataflows Gen2, or should you write pro-code solutions with PySpark notebooks? Today I’m going to settle this…

costs

Data Engineering · · 7 min read

Conversational AI with Microsoft Fabric Data Agents

Microsoft Fabric Data Agents are the ChatGPT for your data. Now you don't need dashboards anymore, you can talk to your data!

AI

Data Engineering · · 5 min read

Case Sensitivity in Microsoft Fabric Spark

I recently ran into a sneaky issue while migrating a customer from SQL Server to Microsoft Fabric. We were doing what every lazy developer does—copy-pasting code—and suddenly our joins stopped…

notebooks

Data Engineering · · 9 min read

OneLake Security Preview in Microsoft Fabric

Recently, Microsoft came out with a private preview for OneLake Security in Microsoft Fabric lakehouses. This is amazing, it is a feature I have been waiting for now for a long time.

delta lake

Data Engineering · · 4 min read

Materialized Lake Views in Microsoft Fabric Lakehouse

Materialized Lake Views in Microsoft Fabric can be used to create a more dynamic data platform. Learn more in this article!

delta lake

Data Engineering · · 2 min read

Keep Spark Sessions Alive in Microsoft Fabric

Perhaps I’m somewhat late to the party, however, last Saturday I found something that really helps me as a data engineer working with Microsoft Fabric.

spark

Data Engineering · · 7 min read

VS Code Notebooks to Improve Your Microsoft Fabric Experience

When you’re using PySpark notebooks in Microsoft Fabric data engineering, you can develop straight from the web browser. While that is interesting, a browser is usually not the most perfect software…

python

↑↓to move ↵to open escto close