VOOZH about

URL: https://www.coursera.org/learn/scripting-with-python-sql-for-data-engineering-duke

⇱ Scripting with Python and SQL for Data Engineering | Coursera

Scripting with Python and SQL for Data Engineering

Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.

Scripting with Python and SQL for Data Engineering

16,183 already enrolled

Included with

Ask Coursera

Gain insight into a topic and learn the fundamentals.
4.4

112 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
95%
Most learners liked this course
Gain insight into a topic and learn the fundamentals.
4.4

112 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
95%
Most learners liked this course

What you'll learn

  • Extract data from different sources and map it to Python data structures.

  • Design Scripts to connect and query a SQL database from within Python.

  • Apply scraping techniques to read and extract data from a website.

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

5 assignments

Taught in English

Build your subject-matter expertise

This course is part of the Python, Bash and SQL Essentials for Data Engineering Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 4 modules in this course

In this third course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will explore techniques to work effectively with Python and SQL. We will go through useful data structures in Python scripting and connect to databases like MySQL. Additionally, you will learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. Finally, you will use extracted data from websites using scraping techniques. These skills will allow you to work effectively when data is not readily available, or when spatial queries are required to extract useful information from databases.

In this module, you will learn how to effectively use Python’s data structures to load, persist, and iterate over data. You will apply these data structures to solve different problems when working with popular data formats like JSON.

What's included

19 videos9 readings2 assignments1 discussion prompt2 ungraded labs

19 videos•Total 62 minutes
  • Welcome to Scripting with Python and SQL for Data Engineering•1 minute
  • Meet your Course Instructor: Alfredo Deza•0 minutes
  • Overview of Key Concepts•4 minutes
  • Introduction to Working with Data in Python•0 minutes
  • Introduction to Python Data Structures•1 minute
  • Using Lists to Save and Retrieve Data in Python•5 minutes
  • Using Dictionaries to Save and Retrieve Data in Python•7 minutes
  • Overview of Less Common Data Structures in Python•4 minutes
  • Recap of Data Structures in Python•1 minute
  • Introduction to Choosing Data Structures in Python•1 minute
  • Iterating Over Lists and Dictionaries in Python•8 minutes
  • Iterating Over Other Data Structures in Python•2 minutes
  • Storing Data Between Data Structures in Python•6 minutes
  • Recap of Mapping Data Structures in Python•1 minute
  • Introduction to Data Sources and Formats in Python•1 minute
  • Loading Data from Files and File Paths in Python•6 minutes
  • Working with JSON in Python•7 minutes
  • Saving Data from Python to Disk•4 minutes
  • Recap of Persisting and Loading Data in Python•1 minute
9 readings•Total 90 minutes
  • Connect with your instructor•10 minutes
  • Meet your Supporting Instructors: Kennedy Behrman and Noah Gift•10 minutes
  • Course Structure and Discussion Etiquette•10 minutes
  • Report a problem with the course•10 minutes
  • Key Terms•10 minutes
  • Python Lists and Dictionaries•10 minutes
  • Key Terms•10 minutes
  • Key Terms•10 minutes
  • Build a notebook that reformats data into JSON•10 minutes
2 assignments•Total 60 minutes
  • Using Data Structures in Python•30 minutes
  • Working with Data in Python•30 minutes
1 discussion prompt•Total 10 minutes
  • Meet and Greet (optional)•10 minutes
2 ungraded labs•Total 120 minutes
  • Looping Over Lists and Dictionaries in Python•60 minutes
  • Loading and Saving JSON Files•60 minutes

In this module, you will learn how to use Python scripting techniques to work with SQL. You will create a database, store data, and query that data with SQL from Python.

What's included

15 videos7 readings1 assignment3 ungraded labs

15 videos•Total 56 minutes
  • Introduction to Python Scripting and SQL•1 minute
  • Introduction to Scripting in Python•1 minute
  • Creating a Script as a Module in Python•6 minutes
  • Traversing the File System with a Script in Python•7 minutes
  • Recap of Python Scripting Basics•1 minute
  • Introduction to Embedded Databases•1 minute
  • What is SQLite?•2 minutes
  • Creating and Connecting to a SQLite Database in Python•6 minutes
  • Saving and Querying from a SQLite Database in Python•10 minutes
  • Recap of SQLite and Python•1 minute
  • Introduction to Querying with SQL in Python•1 minute
  • Basic SQL Commands in Python•7 minutes
  • Extracting Distinct Data using SQL in Python•7 minutes
  • Searching with SQL in Python•6 minutes
  • Recap of Querying with SQL in Python•1 minute
7 readings•Total 70 minutes
  • Key Terms•10 minutes
  • Minimal Python, Chapter 2: Learn to Store Data•10 minutes
  • Key Terms•10 minutes
  • Example GitHub Repository •10 minutes
  • Key Terms•10 minutes
  • Example GitHub Repository•10 minutes
  • Create a Reporting Script for File Sizes•10 minutes
1 assignment•Total 30 minutes
  • Python Scripting and SQL•30 minutes
3 ungraded labs•Total 180 minutes
  • Build a Script to Find Large Files•60 minutes
  • Create a SQLite Database and Store Data•60 minutes
  • Querying a SQLite Database•60 minutes

In this module, you will learn how to efficiently extract data from the web. You will learn how to use a scraping library to read data from websites and identify and extract specific values from it.

What's included

15 videos7 readings1 assignment2 ungraded labs

15 videos•Total 65 minutes
  • Introduction to Web Scraping using Python•1 minute
  • Introduction to Extracting Data from Unstructured HTML•1 minute
  • Challenges with Web Data•3 minutes
  • Parsing HTML with HTMLParser in Python•5 minutes
  • Recap of Web Scraping Techniques in Python•1 minute
  • Introduction to Scrapy and XPath in Python•1 minute
  • Creating a Web Scraping Project with Scrapy in Python•7 minutes
  • Parsing Data with XPath and Scrapy Shell•12 minutes
  • Using Scrapy Spider for Web Scraping•5 minutes
  • Recap of Scrapy and XPath in Python•1 minute
  • Overview of Challenges with Web Scraping•3 minutes
  • Scraping Locally•9 minutes
  • Persisting Data in CSV and JSON Formats•10 minutes
  • Persisting Data to a SQLite Database•7 minutes
  • Recap of Persistence and Efficacy with Web Scraping•1 minute
7 readings•Total 70 minutes
  • Key Terms•10 minutes
  • Parsing Techniques with HTMLParser•10 minutes
  • Key Terms•10 minutes
  • Codespaces Lab: Parse HTML with Scrapy and XPath•10 minutes
  • Key Terms•10 minutes
  • Efficient Scraping Techniques•10 minutes
  • Build a Web Scraping Tool•10 minutes
1 assignment•Total 30 minutes
  • Web Scraping using Python•30 minutes
2 ungraded labs•Total 120 minutes
  • Parse HTML with HTMLParser•60 minutes
  • Parse HTML and Persist it to a SQLite Database•60 minutes

In this module, you will learn how to use a modern development environment and editor to connect to a MySQL database server, execute queries and perform database operations.

What's included

18 videos8 readings1 assignment5 ungraded labs

18 videos•Total 70 minutes
  • Introduction to Working with MySQL•1 minute
  • Introduction to VSCode with MySQL•1 minute
  • Connecting to a MySQL Server•8 minutes
  • Recap of VSCode with MySQL•1 minute
  • Challenges of Running MySQL Queries•2 minutes
  • Using VSCode to Execute MySQL Queries•6 minutes
  • Recap of Running MySQL Queries•1 minute
  • Challenges with Importing to Databases•2 minutes
  • Importing CSV Data into MySQL•7 minutes
  • Exporting Data from MySQL•6 minutes
  • Recap of Importing and Exporting Data in MySQL•1 minute
  • MySQL Hacking Overview•3 minutes
  • MySQL from Terminal•3 minutes
  • Archive and Drop Database•5 minutes
  • Import external database Sakila•7 minutes
  • Modify database Sakila•5 minutes
  • Bash pipelines with MySQL•5 minutes
  • MySQL to Python Standard Library Web Server•4 minutes
8 readings•Total 80 minutes
  • Key terms•10 minutes
  • Key terms•10 minutes
  • Working with VSCode and MySQL•10 minutes
  • Key Terms•10 minutes
  • Lesson Reflection•10 minutes
  • Loading and Exporting Data using MySQL•10 minutes
  • Next Steps•10 minutes
  • Share your learning experience•10 minutes
1 assignment•Total 30 minutes
  • Working with MySQL•30 minutes
5 ungraded labs•Total 300 minutes
  • Connect to a Running MySQL Server•60 minutes
  • Running Queries Repository•60 minutes
  • Export and Import Data in MySQL•60 minutes
  • Linux Hacking with MySQL•60 minutes
  • MySQL Sandbox•60 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructors

Instructor ratings
4.4 (15 ratings)
Duke University
29 Courses•185,984 learners

Explore more from Data Analysis

Why people choose Coursera for their career

👁 Image

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
👁 Image

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
👁 Image

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
👁 Image

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

  • 5 stars

    66.96%

  • 4 stars

    19.64%

  • 3 stars

    6.25%

  • 2 stars

    1.78%

  • 1 star

    5.35%

Showing 3 of 112

PB
·

Reviewed on May 25, 2023

Training is clear and interactive and labs are good

MB
·

Reviewed on Aug 28, 2022

This provides the essentials of data engineering and analysis.

CQ
·

Reviewed on Oct 20, 2022

C​overed great Python. data engineering techniques as well as using SQLite and MySQL in VSCode

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Financial aid available,