AWS Glue – The Complete Masterclass

Master building complete AWS Glue ETL Pipelines, Glue Data Quality, Glue Data Brew along with other AWS resources

Created by: Data Soup
Data Engineer

What Will I Learn?

• Understanding of AWS Glue Data Catalog and creating AWS Glue Database, Glue Tables and Crawlers
• Using AWS Glue Studio, creating the ETL pipeline along with scheduled triggers, conditional triggers and glue workflow
• KMS, IAM Role, SNS, S3 and other associated AWS resources associated with Glue. Understanding and creation of all the resources
• Understanding of AWS Glue Data Quality and creating the associated Glue ETL pipeline
• Understanding AWS Glue Data Brew , creating the recipe, project and job to curate the dataset
• Understanding the AWS Glue streaming, creating the stream using the Python shell job and load the stream using the Spark streaming
• Different ways AWS Glue job can fail and debugging the failure and fix
• Creating the AWS resources for AWS Glue Pipeline using the AWS console and cloudformation

Requirements

• Understanding of ETL concepts
• AWS account to perform all the labs
• No cloud experience is required

Target audience

• Data Engineer, ETL Developer, Data warehouse developer or BI Develper who is moving from on premised to AWS cloud for ETL
• Data Scientists who want to understand the Glue ETL concepts and curate the data
• Software Development Engineer who wants to do ETL in the AWS cloud