Python Project for Data Engineering
Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.
Python Project for Data Engineering
This course is part of multiple programs.
Instructor: Joseph Santarcangelo
74,536 already enrolled
Included with
Ask Coursera
855 reviews
Recommended experience
855 reviews
Recommended experience
What you'll learn
Demonstrate your skills in Python for working with and manipulating data
Implement webscraping and use APIs to extract data with Python
Play the role of a Data Engineer working on a real project to extract, transform, and load data
Use Jupyter notebooks and IDEs to complete your project
Skills you'll gain
Details to know
See how employees at top companies are mastering in-demand skills
Build your subject-matter expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate
There are 3 modules in this course
Showcase your Python skills in this Data Engineering Project! This short course is designed to apply your basic Python skills through the implementation of various techniques for gathering and manipulating data.
You will take on the role of a Data Engineer by extracting data from multiple sources, and converting the data into specific formats and making it ready for loading into a database for analysis. You will also demonstrate your knowledge of web scraping and utilizing APIs to extract data. By the end of this hands-on project, you will have shown your proficiency with important skills to Extract Transform and Load (ETL) data using an IDE, and of course, Python Programming. Upon completion of this course, you will also have a great new addition to your portfolio! PRE-REQUISITE: **Python for Data Science, AI and Development** course from IBM is a pre-requisite for this project course. Please ensure that before taking this course you have either completed the Python for Data Science, AI and Development course from IBM or have equivalent proficiency in working with Python and data. NOTE: This course is not intended to teach you Python and does not have too much new instructional content. It is intended for you to mostly apply prior Python knowledge.
Module 1 introduces you to Extract, Transform, and Load operations basics. You will learn to extract required information from web pages using web scraping techniques and APIs. You will also access databases using Python and save the processed information as a table in a database.
What's included
5 videos3 readings2 assignments4 app items1 plugin
5 videos•Total 25 minutes
- Course Introduction•3 minutes
- Demo: Working with an IDE •6 minutes
- Extract, Transform, Load (ETL)•7 minutes
- (Optional) Web Scraping •5 minutes
- [Optional] REST APIs & HTTP Requests•5 minutes
3 readings•Total 13 minutes
- Helpful Tips for Course Completion•2 minutes
- Pre-requisites and Course Syllabus•10 minutes
- Module Summary: Extract, Transform, Load (ETL)•1 minute
2 assignments•Total 25 minutes
- Graded Quiz: Extract, Transform, Load (ETL)•15 minutes
- Practice Quiz: Extract, Transform, Load (ETL)•10 minutes
4 app items•Total 120 minutes
- Hands-on Lab: Getting Started with IDE •15 minutes
- Hands-on Lab: Extract, Transform, Load (ETL)•30 minutes
- Hands-on Lab: Web scraping and Extracting Data using APIs•45 minutes
- Hands-on Lab: Accessing Databases using Python script•30 minutes
1 plugin•Total 5 minutes
- Reading: Querying SQLite3 database•5 minutes
In this lesson, you will complete two projects, one for practice and one for assessment to apply what you’ve learned. These projects have you implement your skills learned in the previous course and the last module regarding the Extract, Transform, and Load process using web scraping and accessing databases using REST APIs and Python.
What's included
2 readings1 assignment1 peer review3 app items3 plugins
2 readings•Total 15 minutes
- Congratulations and Next Steps•10 minutes
- Thanks from the Course Team•5 minutes
1 assignment•Total 15 minutes
- Graded Quiz: Final Project •15 minutes
1 peer review•Total 60 minutes
- Option 2 - Peer Graded: Final Project - Submission and Evaluation•60 minutes
3 app items•Total 180 minutes
- Practice Project: Extract, Transform and Load GDP data•60 minutes
- Final Project: Acquiring and processing information on world's largest banks•60 minutes
- Option 1 - AI Graded: Final Project - Submission and Evaluation•60 minutes
3 plugins•Total 25 minutes
- Practice Project Overview•5 minutes
- Final Project Overview•5 minutes
- Reading: Final Project Submission Guidelines and Deliverables•15 minutes
In this bonus module, you will become familiar with the best practices for coding as documented in the Python Enhancement Proposal (PEP8) style guide. You will learn about static code analysis, ensuring that your code adheres to the coding rules. Next, you will learn how to create and run unit tests. Finally, you will learn how to create, verify, and run Python packages.
What's included
3 videos2 readings1 assignment3 app items2 plugins
3 videos•Total 19 minutes
- Python Style Guide and Coding Practices •6 minutes
- Unit Testing •7 minutes
- Packaging •5 minutes
2 readings•Total 7 minutes
- Module Introduction•2 minutes
- Module Summary: Python Coding Practices and Packaging Concepts •5 minutes
1 assignment•Total 10 minutes
- Practice Quiz: Python Coding Practices and Packaging Concepts•10 minutes
3 app items•Total 90 minutes
- Hands-on Lab: Static Code Analysis•30 minutes
- Hands-on Lab: Practice Session and Assignment on Unit Testing•30 minutes
- Hands-on Lab: Practice Session and Assignment on Python Packaging•30 minutes
2 plugins•Total 7 minutes
- Reading: Static Code Analysis Resources•2 minutes
- Cheatsheet: Python Coding Practices and Packaging Concepts•5 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructor
Explore more from Data Management
- Status: Free TrialD
Duke University
Specialization
- Status: Free Trial
Course
- Status: Free TrialD
Duke University
Course
- Status: Free TrialD
Duke University
Course
Why people choose Coursera for their career
Learner reviews
- 5 stars
77.59%
- 4 stars
14.35%
- 3 stars
3.61%
- 2 stars
1.75%
- 1 star
2.68%
Showing 3 of 855
Reviewed on Jun 2, 2023
Very informative and educative course that I would recommend to any one pursuing a career in Data Engineering with Python
Reviewed on Feb 17, 2025
There were some minor issues along the way and I wish there was more guidance practice but, overall, I enjoyed the course and am loving this certificate. Thank you IBM!
Reviewed on May 18, 2023
Challenging and informative. Some difficulty interacting with the IBM Cloud unrelated to Coursera.
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
More questions
Financial aid available,
¹ Some assignments in this course are AI-graded. For these assignments, your data will be used in accordance with Coursera's Privacy Notice.