Azure Databricks end to end project with Unity Catalog CICD

Azure Databricks Mastery: Hands-on project with Unity Catalog , Delta lake, CI/CD implementing Medallion Architecture

Created by: Shanmukh Sattiraju
Azure Data Engineer

What Will I Learn?

• Understand and implement Unity Catalog
• Implement project with incremental loading
• Understanding the Spark Structured Streaming
• Implement Continuous Integration and Continuous Deployment in project
• Real time hands-on project experience
• Implement and work with Delta Lake
• Understand the features of Delta Lake
• Implement Medallion Architecture in your project
• Evolution of Delta lake from Datalake
• Understand workflows in Azure Databricks
• Simulate real time environment with Unity Catalog
• Implement and understand the governance with Unity Catalog
• Master the compute cluster creation and Management
• How spark structured streaming works
• Implement structured streaming in Azure databricks
• Understand incremental loading with Autoloader
• Code that can run in any environment
• Understand and implement the Unity Catalog Object Model
• Build an end to end CICD pipeline
• Understand the implementation of Delta Live tables
• Practise tests to check your knowledge

Requirements

• Basic knowledge on Python and SQL
• Basic knowledge on Azure Cloud
• An Azure account to implement the end to end project

Target audience

• Data Engineers who want to get real time experience using Azure Databricks
• Data professionals who want to build an end to end project in Azure Databricks
• Engineers who want to learn Azure Databricks and its implementation