Basics to Advanced: Azure Synapse Analytics Hands-On Project

Build complete project only with Azure Synapse Analytics focused on PySpark includes delta lake and spark Optimizations

Created by: Shanmukh Sattiraju
Azure Data Engineer

What Will I Learn?

• Understand Azure Synapse Analytics Services Practically
• Complete basic to advanced understanding on Azure Synapse Analytics
• Gain hands-on experience in applying Spark optimization techniques to real-world scenarios, achieving faster insights.
• Understand 50+ most commonly used PySpark Transformations
• Acquire a comprehensive library of 45+ PySpark notebooks for data cleansing, enrichment, and transformation.
• Understand Data Lakehouse and implement it
• Hands-on learning on building a modern data warehouse using Azure Synapse
• Explore the capabilities of Spark Pools and their role in processing large-scale data workloads
• Understand how python is used in Data Engineering
• Understand and transform data with Serverless SQL pool
• Understand the principles and advantages of Delta Lake as a reliable data storage and management solution.
• Explore the capabilities of Spark Pools and their role in processing large-scale data workloads
• Learn How Spark is evolved and its growth
• Provides insights on services that needed to clear DP-203
• Create and configure a Serverless SQL pool
• Create External DataSource, External Files, External Tables in Serverless SQL pool
• Configure Spark Pools and understand the working of them
• Explore the capabilities of Spark Pools and their role in processing large-scale data workloads
• Understand the Integration of Power BI with Azure Synapse Analytics
• Explore the capabilities of Spark Pools and their role in processing large-scale data workloads
• Create and work with Dedicated SQL pool on a high level
• Optimize your PySpark with Spark Optimization techniques
• Learn history and data processing before Spark
• Implement the incremental UPSERT using Delta Lake
• Understand and implement versioning in delta lake
• Implement MSSpark Utils and the uses of its utilities
• How we can mount Data lake to Synapse Notebooks

Requirements

• No Azure Synapse Analytics experience needed. You will learning everything you needed
• Basics of Python programming
• Basics of SQL language

Target audience

• Beginners who want to step into the world of Data Engineers
• Professional Data Engineers who want to advance their data analysis skills
• Students who are keen to learn Data Analytics
• Data Engineers who want to learn data warehousing in Cloud using Azure Synapse Analytics