Masterclass on Azure Data Factory – Data Engineer for 2024

Learn ETL & Big Data Processing - Azure Data Factory(ADF), SQL Server, Blob, Datalake, REST API, PySpark, Databricks

Created by: Atchyut Kumar
Renowned GATE CS Expert | Data Engineer | Programming Mentor

Created by: Edufulness EFN
Empowering Learners with Quality Education in Computer Scien

What Will I Learn?

• You will learn how to build a real time data pipeline in Azure Data Factory (ADF).
• You will learn how to transform data using Data Flows in Azure Data Factory (ADF) and load into ADLS2, Blob storage.
• You will learn how to ingest JSON data from SQL Server to API end point.
• You will learn how to build production ready pipelines and good practices and naming standards.
• You will learn how to monitor pipelines using Azure Data Factory (ADF), Azure Monitor and Log Analytics with a real-world project.
• You will learn about manual/Triggers in Azure Data Factory (ADF) and how to use them to schedule the data pipelines.
• Create Data driven, fully integrated, dynamic and automated production grade pipeline creation and orchestration.
• Data Warehousing Concepts like Fact & dimension tables, SCD type1, type2, Incremental loading and implement using ADF.
• Connect & copy data from On Premise data stores, On premise SQL server via Self Hosted Integration Runtime to cloud.
• How to ingest data from sources such as REST API, Azure Blob Storage, SQL DB into Azure Data Lake Gen2 using Azure Data Factory (ADF)
• Learn Azure Data Factory(ADF) with real time projects - ADF, SQL Server, Blob Storage, Datalake G1,G2, REST API.

Requirements

• Basic concepts about cloud computing will be useful, but not mandatory.
• An Azure Account is required, If not, we will create a free account in the course.

Target audience

• For all levels.
• Students, Working Professionals