Yesterday, I was thrilled to deliver my first public speaking session in years! I was invited by the friendly people of the Dutch Fabric User Group to present my story to a group of about 35 people interested in Microsoft Fabric..
My session, titled ‘Fabric Lakehouses for SQL Data Engineers’, was focused on helping data engineers with mainly SQL experience make the move to Microsoft Fabric, delta lake, Spark, and Medallion.
Afterwards I had the pleasure of connecting to lots of existing and new friends and discuss data engineering. Call me a nerd, but that sounds like an event well spent 🙂
If you’re based in The Netherlands and interested in Fabric (why else would you read this?), then you should attend one of their meetings. They’re free, in different locations across the country, and are always presented in English. What are you waiting for?
Fabric Lakehouses for SQL Data Engineers
In this session, Bas, a seasoned data engineer with over a decade of expertise in SQL Server, Azure SQL, and now Fabric, shares his transition journey and insights from building data warehouses with SQL to building them with lakehouses in Microsoft Fabric.
We dive into the changes required from traditional SQL data warehousing to using Fabric to build lakehouses.
The session is filled with practical examples, such as a comparison between (high-level) overviews of data warehousing using SQL and Fabric Lakehouses, the role of PySpark and all the good stuff we get with that (data transformations using a combination of SQL, python, and spark is awesome!). We also discuss the reusability of code (never again write a MERGE statement for every table you need to load) and some of the current pitfalls, such as Spark cluster startup times and frequent disconnects, that Bas found out during his first Fabric implementations.
After this session you’ll have a head start in creating your first Fabric lakehouse implementation.