Mastering AWS Elastic Map Reduce (EMR) for Data Engineers

Build Pyspark and Spark SQL Applications on AWS EMR, Orchestrate using Step Functions, Manage EMR using Boto3 and more

Created by: Durga Viswanatha Raju Gadiraju
CEO at ITVersity and CTO at Analytiqs, Inc

Created by: Pratik Kumar

Created by: Sathvika Dandu

Created by: Madhuri Gadiraju

Created by: Sai Varma

Created by: Phani Bhushan Bozzam
Aspiring Project Manager & Creative UI/UX Designer

Created by: Anushka Chakraborty

What Will I Learn?

• Creating Clusters using AWS Elastic Map Reduce Web Console
• Setup Remote Application Development using AWS Elastic Map Reduce (EMR) and Visual Studio Code
• Develop and Validate Simple Spark Application using Visual Studio Code and AWS Elastic Map Reduce (EMR)
• Deploy Spark Application as Step to AWS Elastic Map Reduce (EMR)
• Manage AWS Elastic Map Reduce (EMR) based Pipelines using Boto3 and Python
• Build End to End AWS Elastic Map Reduce (EMR) based Pipelines using AWS Step Functions
• Develop Applications using Spark SQL on AWS EMR Cluster
• Build State Machine or Pipeline using AWS Step Functions using Spark SQL Script on AWS EMR Cluster
• Understand how to pass parameters to Spark SQL Scripts deployed on EMR

Requirements

• A computer science or IT Degree or 1 or 2 years of IT Experience
• Basic Linux Skills with ability to run commands using Terminal
• Programming Skills using Python is required
• Valid AWS Account to use the AWS Services to learn how to build Data Pipelines using AWS Lambda Functions

Target audience

• University Students who want to learn AWS Elastic Map Reduce to process heavy volumes of data with hands on and real time examples
• Aspiring Data Engineers and Data Scientists who want to master building data pipelines using AWS Elastic Map Reduce for large scale Data Processing
• Experienced Application Developers who would like to explore how to build end to end Data Pipelines using Python and AWS Services such as AWS Elastic Map Reduce
• Experienced Data Engineers to build end to end data pipelines using Python and AWS Elastic Map Reduce
• Any IT Professional who is keen to deep dive into AWS Elastic Map Reduce (EMR) for heavy weight Data Processing