VOOZH about

URL: https://www.coursera.org/learn/unsupervised-learning-recommenders-reinforcement-learning?specialization=machine-learning-introduction

⇱ Unsupervised Learning, Recommenders, Reinforcement Learning | Coursera


Unsupervised Learning, Recommenders, Reinforcement Learning

Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.

Unsupervised Learning, Recommenders, Reinforcement Learning

This course is part of Machine Learning Specialization

334,587 already enrolled

Ask Coursera

Gain insight into a topic and learn the fundamentals.
4.9

5,642 reviews

Beginner level

Recommended experience

Flexible schedule
3 weeks at 10 hours a week
Learn at your own pace
96%
Most learners liked this course

Gain insight into a topic and learn the fundamentals.
4.9

5,642 reviews

Beginner level

Recommended experience

Flexible schedule
3 weeks at 10 hours a week
Learn at your own pace
96%
Most learners liked this course

What you'll learn

  • Use unsupervised learning techniques for unsupervised learning: including clustering and anomaly detection

  • Build recommender systems with a collaborative filtering approach and a content-based deep learning method

  • Build a deep reinforcement learning model

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

8 assignments

Taught in English

Build your subject-matter expertise

This course is part of the Machine Learning Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 3 modules in this course

In the third course of the Machine Learning Specialization, you will:

β€’ Use unsupervised learning techniques for unsupervised learning: including clustering and anomaly detection. β€’ Build recommender systems with a collaborative filtering approach and a content-based deep learning method. β€’ Build a deep reinforcement learning model. The Machine Learning Specialization is a foundational online program created in collaboration between DeepLearning.AI and Stanford Online. In this beginner-friendly program, you will learn the fundamentals of machine learning and how to use these techniques to build real-world AI applications. This Specialization is taught by Andrew Ng, an AI visionary who has led critical research at Stanford University and groundbreaking work at Google Brain, Baidu, and Landing.AI to advance the AI field. This 3-course Specialization is an updated and expanded version of Andrew’s pioneering Machine Learning course, rated 4.9 out of 5 and taken by over 4.8 million learners since it launched in 2012. It provides a broad introduction to modern machine learning, including supervised learning (multiple linear regression, logistic regression, neural networks, and decision trees), unsupervised learning (clustering, dimensionality reduction, recommender systems), and some of the best practices used in Silicon Valley for artificial intelligence and machine learning innovation (evaluating and tuning models, taking a data-centric approach to improving performance, and more.) By the end of this Specialization, you will have mastered key concepts and gained the practical know-how to quickly and powerfully apply machine learning to challenging real-world problems. If you’re looking to break into AI or build a career in machine learning, the new Machine Learning Specialization is the best place to start.

This week, you will learn two key unsupervised learning algorithms: clustering and anomaly detection

What's included

13 videos1 reading2 assignments2 programming assignments

13 videosβ€’Total 120 minutes
  • Welcome!β€’3 minutes
  • What is clustering?β€’4 minutes
  • K-means intuitionβ€’7 minutes
  • K-means algorithmβ€’10 minutes
  • Optimization objectiveβ€’11 minutes
  • Initializing K-meansβ€’9 minutes
  • Choosing the number of clustersβ€’7 minutes
  • Finding unusual eventsβ€’12 minutes
  • Gaussian (normal) distributionβ€’11 minutes
  • Anomaly detection algorithmβ€’12 minutes
  • Developing and evaluating an anomaly detection systemβ€’12 minutes
  • Anomaly detection vs. supervised learningβ€’8 minutes
  • Choosing what features to useβ€’15 minutes
1 readingβ€’Total 2 minutes
  • Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!β€’2 minutes
2 assignmentsβ€’Total 60 minutes
  • Clusteringβ€’30 minutes
  • Anomaly detectionβ€’30 minutes
2 programming assignmentsβ€’Total 360 minutes
  • k-meansβ€’180 minutes
  • Anomaly Detectionβ€’180 minutes

What's included

15 videos3 assignments2 programming assignments1 ungraded lab

15 videosβ€’Total 150 minutes
  • Making recommendationsβ€’6 minutes
  • Using per-item featuresβ€’11 minutes
  • Collaborative filtering algorithmβ€’14 minutes
  • Binary labels: favs, likes and clicksβ€’8 minutes
  • Mean normalizationβ€’9 minutes
  • TensorFlow implementation of collaborative filteringβ€’12 minutes
  • Finding related itemsβ€’7 minutes
  • Collaborative filtering vs Content-based filteringβ€’10 minutes
  • Deep learning for content-based filteringβ€’10 minutes
  • Recommending from a large catalogueβ€’8 minutes
  • Ethical use of recommender systemsβ€’11 minutes
  • TensorFlow implementation of content-based filteringβ€’5 minutes
  • Reducing the number of features (optional)β€’12 minutes
  • PCA algorithm (optional)β€’18 minutes
  • PCA in code (optional)β€’11 minutes
3 assignmentsβ€’Total 90 minutes
  • Collaborative Filteringβ€’30 minutes
  • Recommender systems implementationβ€’30 minutes
  • Content-based filteringβ€’30 minutes
2 programming assignmentsβ€’Total 360 minutes
  • Collaborative Filtering Recommender Systemsβ€’180 minutes
  • Deep Learning for Content-Based Filteringβ€’180 minutes
1 ungraded labβ€’Total 30 minutes
  • PCA and data visualization (optional)β€’30 minutes

This week, you will learn about reinforcement learning, and build a deep Q-learning neural network in order to land a virtual lunar lander on Mars!

What's included

18 videos3 readings3 assignments1 programming assignment1 ungraded lab

18 videosβ€’Total 163 minutes
  • What is Reinforcement Learning?β€’9 minutes
  • Mars rover exampleβ€’7 minutes
  • The Return in reinforcement learningβ€’10 minutes
  • Making decisions: Policies in reinforcement learningβ€’3 minutes
  • Review of key conceptsβ€’6 minutes
  • State-action value function definitionβ€’11 minutes
  • State-action value function exampleβ€’5 minutes
  • Bellman Equationβ€’13 minutes
  • Random (stochastic) environment (Optional)β€’8 minutes
  • Example of continuous state space applicationsβ€’6 minutes
  • Lunar landerβ€’6 minutes
  • Learning the state-value functionβ€’17 minutes
  • Algorithm refinement: Improved neural network architectureβ€’3 minutes
  • Algorithm refinement: Ο΅-greedy policyβ€’9 minutes
  • Algorithm refinement: Mini-batch and soft updates (optional)β€’12 minutes
  • The state of reinforcement learningβ€’3 minutes
  • Summary and thank youβ€’3 minutes
  • Andrew Ng and Chelsea Finn on AI and Roboticsβ€’33 minutes
3 readingsβ€’Total 5 minutes
  • [IMPORTANT] Reminder about end of access to Lab Notebooksβ€’2 minutes
  • Acknowledgmentsβ€’2 minutes
  • (Optional) Opportunity to Mentor Other Learnersβ€’1 minute
3 assignmentsβ€’Total 90 minutes
  • Reinforcement learning introductionβ€’30 minutes
  • State-action value functionβ€’30 minutes
  • Continuous state spacesβ€’30 minutes
1 programming assignmentβ€’Total 180 minutes
  • Reinforcement Learningβ€’180 minutes
1 ungraded labβ€’Total 60 minutes
  • State-action value function (optional lab)β€’60 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructors

Instructor ratings
5.0 (1,686 ratings)

Top Instructor

DeepLearning.AI
51 Coursesβ€’9,810,663 learners

Explore more from Machine Learning

Why people choose Coursera for their career

πŸ‘ Image

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
πŸ‘ Image

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
πŸ‘ Image

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
πŸ‘ Image

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

  • 5 stars

    91.79%

  • 4 stars

    7.01%

  • 3 stars

    0.74%

  • 2 stars

    0.17%

  • 1 star

    0.26%

Showing 3 of 5642

AS
Β·

Reviewed on Oct 9, 2024

This is a good beginner course . I have been reading around topics and when you jumble around it is hard to follow. This course structure was what i was looking for. i would recommend this to others

SA
Β·

Reviewed on Sep 22, 2025

Thank you so much this is a great course, and thanks for the financial aid that enabled me to study the course and improve my skills and career. this specialization is so valuable and useful.

MW
Β·

Reviewed on Dec 12, 2024

Andrew was a great teacher, explaining complicated topics in a simple and intuitive way. The programming assignments helped to put theory into practice. A great place to start learning a new field!

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Financial aid available,