Data Engineering · 5 min read
Merging Dataframes in PySpark
Today I’m going to teach you how the Python merge statement works, and we use it a lot in Microsoft Fabric.
Tag
notebooks
Posts tagged notebooks, newest first.
Data Engineering · 6 min read
How to change Microsoft Fabric Python resources
A couple of weeks ago, I showed you how we can use DuckDB as a Python library in Microsoft Fabric to do Python notebooks on Delta Lake instead of using Spark notebooks.
Data Engineering · 7 min read
Vibe Coding in Microsoft Fabric
Can ChatGPT actually help you build a complete data platform in Microsoft Fabric if you pretend to know absolutely nothing? That’s exactly what I set out to test.
Data Engineering · 5 min read
Case Sensitivity in Microsoft Fabric Spark
I recently ran into a sneaky issue while migrating a customer from SQL Server to Microsoft Fabric. We were doing what every lazy developer does—copy-pasting code—and suddenly our joins stopped…
Data Engineering · 9 min read
OneLake Security Preview in Microsoft Fabric
Recently, Microsoft came out with a private preview for OneLake Security in Microsoft Fabric lakehouses. This is amazing, it is a feature I have been waiting for now for a long time.
Public Speaking · 2 min read
Speaking at Fabric Cafe – Don’t Repeat Yourself
I had the pleasure of speaking at Fabric Cafe, an online community aimed at sharing knowledge about Microsoft Fabric. And I’m all in favour of that!
Data Engineering · 9 min read
Let the Notebook Write Itself (Sorta): My Experience Using Supermaven in Fabric
Discover how I use AI copilots to speed up Microsoft Fabric notebook development with smarter code, faster prototyping, and fewer headaches.
Data Engineering · 7 min read
Delta Lake Liquid Clustering vs Partitioning
Learn how Liquid Clustering compares to Partitioning in Delta Lake. Boost MS Fabric performance with the right optimisation strategy.
Data Engineering · 6 min read
Extracting Paginating APIs Without NextPage Metadata with Microsoft Fabric Notebooks
Learn how to handle paginated APIs without metadata in Microsoft Fabric. This guide shows how to find the pagecount using Python.