AWS Data Automation: Glue & Lambda Integration
Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.
Ask Coursera
Recommended experience
Recommended experience
What you'll learn
Describe the key features and components of AWS Glue for data integration.
Analyze how AWS Glue improves data cataloging and ETL processes.
Design a basic workflow for setting up and using AWS Glue and Lambda integration in a data project.
Evaluate best practices and potential challenges for responsible AWS Glue implementation.
Skills you'll gain
Tools you'll learn
Details to know
See how employees at top companies are mastering in-demand skills
There is 1 module in this course
Data automation is essential for modern cloud computing, and AWS Glue simplifies ETL processes, data cataloging, and integration with serverless services like AWS Lambda. You will gain hands-on experience in configuring AWS Glue, optimizing ETL pipelines, and triggering workflows with Lambda, enabling learners to create efficient and automated data solutions.
This course introduces AWS Glue and its powerful ETL capabilities, including how to crawl data sources, build a centralized data catalog, and transform raw data into structured formats for analytics. Using a practical example with customer and order datasets, you'll learn how to create and schedule ETL jobs that clean, standardize, and organize this data for downstream reporting. The course then shifts to AWS Lambda, where you’ll build serverless functions, configure event-based triggers (like when a new order file is uploaded to an S3 bucket), and integrate them with Glue to automate data workflows in real time. Through hands-on exercises and projects—including building an ETL job and setting up an incremental data loading pipeline into Amazon Redshift—you’ll gain the skills to design, deploy, and manage robust, cloud-native data pipelines using AWS services. This course is designed for data analysts and data engineers who are responsible for creating, managing, and optimizing data pipelines. It also serves IT professionals aiming to enhance their skills in automated data processing using modern cloud tools. Additionally, AWS newcomers interested in building foundational knowledge of cloud-based data workflows will find this course an accessible and practical starting point. Whether you work in a startup or an enterprise setting, the skills taught here are applicable across industries that rely on cloud-based data automation. To succeed in this course, learners should have a basic understanding of data-related concepts such as databases, structured data, and ETL (Extract, Transform, Load) processes. Familiarity with general cloud computing terminology and principles is also expected. However, no prior experience with AWS Glue, Lambda, or programming is required, making this course beginner-friendly and approachable for a wide range of learners. Anyone with a foundational understanding of data systems will be well-equipped to follow along with the hands-on exercises and examples. By the end of the course, learners will be able to describe the core features and architecture of AWS Glue as it relates to data integration. They will analyze how Glue enhances ETL operations and centralizes data cataloging. Learners will also gain the ability to design simple workflows that integrate AWS Glue with Lambda functions and evaluate best practices for implementing these tools effectively and responsibly within a cloud data ecosystem. These skills will empower learners to automate data workflows, reduce manual processing, and build scalable solutions using AWS services.
In this course, you’ll explore how to automate data workflows using AWS Glue and Lambda, focusing on real-world applications like processing daily sales data from multiple sources. Through hands-on experience, you’ll learn to configure Glue crawlers, build ETL pipelines, and trigger workflows using serverless Lambda functions. You’ll also design and deploy a data integration project—including incremental loading into Amazon Redshift—while evaluating best practices for scalable and efficient cloud-native data automation.
What's included
14 videos4 readings1 assignment4 peer reviews2 discussion prompts
14 videos•Total 79 minutes
- Welcome to AWS Data Automation: Glue & Lambda Integration •3 minutes
- What is AWS Glue•5 minutes
- Setting Up AWS Glue •9 minutes
- AWS Glue Data Catalog •5 minutes
- Creating Tables and Crawlers in AWS Glue •11 minutes
- What is AWS Glue ETL Job•7 minutes
- Glue ETL Demo •7 minutes
- Viewing Your Data on AWS Console •4 minutes
- Creating Your First Lambda Function •4 minutes
- S3 Trigger Generation and Testing •6 minutes
- ETL Flow Generation and Testing •5 minutes
- Automating ETL with Lambda •4 minutes
- Final Testing and Best Practices •7 minutes
- Congratulations and Continuous Learning Journey •2 minutes
4 readings•Total 20 minutes
- Welcome to the Course: Course Overview•5 minutes
- AWS Glue Best Practices •5 minutes
- AWS Lambda Documentation •5 minutes
- Best Practices for Working with AWS Lambda Functions •5 minutes
1 assignment•Total 20 minutes
- AWS Data Automation: Glue & Lambda Integration•20 minutes
4 peer reviews•Total 90 minutes
- Hands-On-Learning: Creating Dynamic Data Catalogs Using AWS Glue Crawlers and S3 •10 minutes
- Hands-On-Learning: Create a Simple ETL Job •10 minutes
- Hands-On-Learning: Incremental Data Loading Pipeline with AWS Glue & Lambda •10 minutes
- Project: Real-Time Web Traffic Analytics Pipeline with AWS Glue & Lambda•60 minutes
2 discussion prompts•Total 10 minutes
- Designing a Secure and Maintainable ETL Workflow for Sensitive Data •5 minutes
- Building a Scalable Lambda-Triggered ETL Pipeline •5 minutes
Instructors
Why people choose Coursera for their career
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.
More questions
Financial aid available,
