Hosted on MSN

Open-source Databricks medallion pipeline debuts on GitHub

A GitHub project now offers an Azure Databricks medallion architecture pipeline built with PySpark, Python, and SQL. It processes e-commerce data through Bronze, Silver, and Gold layers, adding ...
GitHub

read_write_usecases.py

# MAGIC /Volumes/telecom_catalog_assign/landing_zone/landing_vol/customer/ # MAGIC /Volumes/telecom_catalog_assign/landing_zone/landing_vol/usage/ # MAGIC /Volumes ...
GitHub

data-skew

Databricks PySpark Certification Prep Lab: Build an e-commerce analytics pipeline covering Spark DataFrame API, Structured Streaming, data skew handling with salting, broadcast joins, and Pandas UDFs.