Master Data Engineering using Azure Data Analytics

Learn Azure Storage for Data Lake, ADF for ETL, Synapse for Data Warehouse, Databricks for Big Data Pipeline, etc

Created by: Durga Viswanatha Raju Gadiraju
CEO at ITVersity and CTO at Analytiqs, Inc

Created by: Pratik Kumar

Created by: Madhuri Gadiraju

Created by: Sai Varma

Created by: Phani Bhushan Bozzam
Aspiring Project Manager & Creative UI/UX Designer

Created by: Raghu Raman Bhattathirippad
Mentor, SME and passionate content creator - All about Data

Created by: Anushka Chakraborty

What Will I Learn?

• Data Engineering leveraging Services under Azure Data Analytics such as Azure Storage, Data Factory, Azure SQL, Synapse, Databricks, etc.
• Setup Development Environment using Visual Studio Code on Windows
• Building Data Lake using Azure Storage (Blob and ADLS)
• Build Data Warehouse using Azure Synapse
• Implement ETL Logic using ADF Data Flow with Azure Storage as Source and Target
• In Depth Coverage of Orchestration using ADF Pipeline
• Overview of Azure SQL and Azure Synapse Serverless and Dedicated Pool Features
• Implement ETL Logic using ADF Data Flow with Azure SQL as Source and Azure Synapse as Target
• Using Data Copy to copy data between different sources and targets
• Performance Tuning Scenarios of ADF Data Flow and Pipelines
• Build Big Data Solutions using Azure Databricks
• Overview of Spark SQL and Pyspark Data Frame APIs
• Build ELT Pipelines using Databricks Jobs and Workflows
• Orchestrate Databricks Notebooks using ADF Pipelines

Requirements

• A Computer with at least 8 GB RAM
• Programming Experience using Python is highly desired as some of the topics are demonstrated using Python
• SQL Experience is highly desired as some of the topics are demonstrated using SQL
• Nice to have Data Engineering Experience using Pandas or Pyspark
• This course is ideal for experienced data engineers to add GCP Analytics Services as key skills to their profile

Target audience

• Beginner or Intermediate Data Engineers who want to learn Key Azure Analytics Services for Data Engineering such as Azure Storage, ADF, Synapse, Databricks, etc
• Intermediate Application Engineers who want to explore Data Engineering using Azure Analytics Services for Data Engineering such as Azure Storage, ADF, Synapse, Databricks, etc
• Data and Analytics Engineers who want to learn Data Engineering Azure Analytics Services for Data Engineering such as Azure Storage, ADF, Synapse, Databricks, etc
• Testers who want to learn key skills to test Data Engineering applications built using Azure Analytics Services for Data Engineering such as Azure Storage, ADF, Synapse, Databricks, etc