Today I’ll be diving deep into the Fabric Capacity Metrics app. With this Power BI app, you can find out what items in your Fabric capacity are using a lot of compute resources, and you’ll use this to find out what your spending baseline is. I’ve created another video on how Fabric is licensed and …
A couple of weeks ago, I showed you how we can use DuckDB as a Python library in Microsoft Fabric to do Python notebooks on Delta Lake instead of using Spark notebooks. The benefits of using Python over Spark: Python is more lightweight, your session startup times are much lower, and these notebooks use less …
Microsoft recently made a change that caught a lot of people off guard: they disabled V-Ordering by default for new Fabric lakehouses. If you’re using Power BI Direct Lake mode, this matters—a lot. V-Ordering can dramatically improve your query performance, but it comes with tradeoffs. Today I’m going to show you how to check if …
There’s a common debate in the Fabric community: should you use low-code tools like Dataflows Gen2, or should you write pro-code solutions with PySpark notebooks? Today I’m going to settle this debate with actual performance and cost data. Spoiler alert: low-code is easier, but you’re paying for that convenience with significantly higher compute costs. Let …
I Just wrapped up an online session at Fabric Cafe:“Delta Table Optimisation: Improvig Queries using Delta Partitioning and Liquid Clustering” We talked about the stuff that actually matters when your lakehouse starts dragging:• Why and when partitioning helps (until it doesn’t)• How clustering fixes what partitioning can’t• Why small files are silent query killers• How …
I Just wrapped up a session at Data Toboggan:“Delta Table Optimisation: Improvig Queries using Delta Partitioning and Liquid Clustering” We talked about the stuff that actually matters when your lakehouse starts dragging:• Why and when partitioning helps (until it doesn’t)• How clustering fixes what partitioning can’t• Why small files are silent query killers• How to …
Introduction to Delta Lake Liquid Clustering As your Delta tables grow in size, the need for performance tuning in Microsoft Fabric becomes essential. In this post, I’ll explore two powerful optimisation techniques — Delta Lake Partitioning and Liquid Clustering. Both can help improve query speed and reduce costs, but they work in very different ways. …