Metadata-Driven Processing with Notebooks in Microsoft Fabric
Build an orchestrator notebook that turns a metadata table into a runMultiple DAG and fans out to one generic child notebook.
Tutorials, deep dives and opinions from 12+ years in the Microsoft data stack. Written by Bas Land, Microsoft Data Platform MVP and Certified Trainer.
Build an orchestrator notebook that turns a metadata table into a runMultiple DAG and fans out to one generic child notebook.
Data Engineering · 13 min read
From a fresh macOS VM to Claude Code that can see your Fabric tenant, with Git, Python 3.13, the Azure and Fabric CLIs, skills and MCP.
Data Engineering · 7 min read
Connect Microsoft Fabric to SharePoint, shortcut a document library into a lakehouse and read an Excel file into Spark, without copying it into OneLake.
Data Architecture · 21 min read
What belongs in bronze, silver and gold, and why business rules never go in silver. One rule, the system columns and a four-cell gold notebook.
Data Engineering · 6 min read
Create a shortcut from a Fabric lakehouse to Azure Blob Storage with a SAS token and read the CSV from a notebook, without copying it into OneLake.
Data Engineering · 7 min read
Claude Code can query your lakehouse over OneLake to check its own work. How I set that up, and why the query results leave Microsoft when it does.
Data Engineering · 7 min read
Mirror an Azure SQL database into Microsoft Fabric with a workspace identity, shortcut the schemas into a lakehouse and query them from a notebook.