Data Engineering · 5 min read
Merging Dataframes in PySpark
Today I’m going to teach you how the Python merge statement works, and we use it a lot in Microsoft Fabric.
Tag
python
Posts tagged python, newest first.
Data Engineering · 6 min read
How to change Microsoft Fabric Python resources
A couple of weeks ago, I showed you how we can use DuckDB as a Python library in Microsoft Fabric to do Python notebooks on Delta Lake instead of using Spark notebooks.
Data Engineering · 5 min read
Write Delta Tables Using Python Notebooks
You can now write data to delta tables using Python notebooks, without using expensive Spark compute in Microsoft Fabric!
Public Speaking · 2 min read
Speaking at Fabric Cafe – Don’t Repeat Yourself
I had the pleasure of speaking at Fabric Cafe, an online community aimed at sharing knowledge about Microsoft Fabric. And I’m all in favour of that!
Data Engineering · 9 min read
Let the Notebook Write Itself (Sorta): My Experience Using Supermaven in Fabric
Discover how I use AI copilots to speed up Microsoft Fabric notebook development with smarter code, faster prototyping, and fewer headaches.
Data Engineering · 7 min read
VS Code Notebooks to Improve Your Microsoft Fabric Experience
When you’re using PySpark notebooks in Microsoft Fabric data engineering, you can develop straight from the web browser. While that is interesting, a browser is usually not the most perfect software…
Data Engineering · 6 min read
Extracting Paginating APIs Without NextPage Metadata with Microsoft Fabric Notebooks
Learn how to handle paginated APIs without metadata in Microsoft Fabric. This guide shows how to find the pagecount using Python.
Data Engineering · 10 min read
Implementing the DRY Principle in Microsoft Fabric
Implementing the DRY principle in Microsoft Fabric makes developing more efficient and easier to maintain!