Skip to content
  • About
  • Speaking
  • Consultancy
  • Contact

That Fabric Guy

dataframe

Spark Dataframes are Views, not Tables

17 October 202414 October 2024 by Bas Land

In Microsoft Fabric data engineering, we use Spark to apply transformations to our data. Just like you would write T-SQL to transform data in SQL Server, you would write PySpark or SparkSQL to transform data in a Fabric lakehouse. There are a lot of parallels between Spark en SQL in the way you can process …

Read more

Categories Data Engineering Tags dataframe, spark Leave a comment
© 2025 by Kimura Data Intelligence B.V., The Netherlands.