Data Engineering · 7 min read
Delta Lake Liquid Clustering vs Partitioning
Learn how Liquid Clustering compares to Partitioning in Delta Lake. Boost MS Fabric performance with the right optimisation strategy.
Category
Data Engineering
Notebooks, Spark, Delta Lake and pipelines: building data platforms on Microsoft Fabric, newest first.
Data Engineering · 10 min read
Delta Lake Partitioning for Microsoft Fabric
Learn how Delta Lake partitioning boosts query performance and reduces costs in Microsoft Fabric. Optimise your data lake today!
Data Engineering · 6 min read
Extracting Paginating APIs Without NextPage Metadata with Microsoft Fabric Notebooks
Learn how to handle paginated APIs without metadata in Microsoft Fabric. This guide shows how to find the pagecount using Python.
Data Engineering · 10 min read
Implementing the DRY Principle in Microsoft Fabric
Implementing the DRY principle in Microsoft Fabric makes developing more efficient and easier to maintain!
Data Engineering · 5 min read
Notebook Orchestration in Microsoft Fabric
In this post we will look at notebook orchestration, using PySpark notebooks with runMultiple in Microsoft Fabric.
Data Engineering · 7 min read
Spark Dataframes are Views, not Tables
In Microsoft Fabric data engineering, we use Spark to apply transformations to our data. Just like you would write T-SQL to transform data in SQL Server, you would write PySpark or SparkSQL to…