pipelines

Metadata Driven Ingestion into Fabric with Pipelines

by

Today I’m going into how you can set up the start of a metadata-driven processing framework for Microsoft Fabric. Let’s dive in. What Is Metadata-Driven Processing? Before we go into all the technicalities with the database setup and the Data Factory pipelines and notebooks, let’s first look at what metadata-driven processing actually is. Metadata is …

Read more

Vibe Coding in Microsoft Fabric

by

Can ChatGPT actually help you build a complete data platform in Microsoft Fabric if you pretend to know absolutely nothing? That’s exactly what I set out to test. I gave myself a simple scenario: I’m a data engineer with a SQL database that needs to be transformed into a proper medallion architecture with bronze, silver, …

Read more