VOOZH about

URL: https://www.coursera.org/learn/deep-neural-network?specialization=deep-learning

⇱ Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization | Coursera


Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.

Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

This course is part of Deep Learning Specialization

633,366 already enrolled

Ask Coursera

Gain insight into a topic and learn the fundamentals.
4.9

63,534 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
96%
Most learners liked this course

Gain insight into a topic and learn the fundamentals.
4.9

63,534 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
96%
Most learners liked this course

Build your subject-matter expertise

This course is part of the Deep Learning Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 3 modules in this course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically.

By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI.

Discover and experiment with a variety of different initialization methods, apply L2 regularization and dropout to avoid model overfitting, then apply gradient checking to identify errors in a fraud detection model.

What's included

15 videos5 readings1 assignment3 programming assignments

15 videosβ€’Total 131 minutes
  • Train / Dev / Test setsβ€’12 minutes
  • Bias / Varianceβ€’9 minutes
  • Basic Recipe for Machine Learning β€’6 minutes
  • Regularizationβ€’10 minutes
  • Why Regularization Reduces Overfitting?β€’7 minutes
  • Dropout Regularizationβ€’9 minutes
  • Understanding Dropoutβ€’7 minutes
  • Other Regularization Methodsβ€’8 minutes
  • Normalizing Inputsβ€’5 minutes
  • Vanishing / Exploding Gradientsβ€’6 minutes
  • Weight Initialization for Deep Networksβ€’6 minutes
  • Numerical Approximation of Gradientsβ€’7 minutes
  • Gradient Checkingβ€’7 minutes
  • Gradient Checking Implementation Notesβ€’5 minutes
  • Yoshua Bengio Interviewβ€’26 minutes
5 readingsβ€’Total 10 minutes
  • Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!β€’2 minutes
  • Clarification about Upcoming Regularization Videoβ€’1 minute
  • Clarification about Upcoming Understanding Dropout Videoβ€’1 minute
  • Lecture Notes W1β€’1 minute
  • (Optional) Downloading your Notebook, Downloading your Workspace and Refreshing your Workspaceβ€’5 minutes
1 assignmentβ€’Total 50 minutes
  • Practical Aspects of Deep Learning β€’50 minutes
3 programming assignmentsβ€’Total 540 minutes
  • Initializationβ€’180 minutes
  • Regularizationβ€’180 minutes
  • Gradient Checkingβ€’180 minutes

Develop your deep learning toolbox by adding more advanced optimizations, random minibatching, and learning rate decay scheduling to speed up your models.

What's included

11 videos3 readings1 assignment1 programming assignment

11 videosβ€’Total 92 minutes
  • Mini-batch Gradient Descentβ€’11 minutes
  • Understanding Mini-batch Gradient Descentβ€’11 minutes
  • Exponentially Weighted Averagesβ€’6 minutes
  • Understanding Exponentially Weighted Averagesβ€’10 minutes
  • Bias Correction in Exponentially Weighted Averagesβ€’4 minutes
  • Gradient Descent with Momentumβ€’9 minutes
  • RMSpropβ€’8 minutes
  • Adam Optimization Algorithmβ€’7 minutes
  • Learning Rate Decayβ€’7 minutes
  • The Problem of Local Optimaβ€’5 minutes
  • Yuanqing Lin Interviewβ€’14 minutes
3 readingsβ€’Total 3 minutes
  • Clarification about Upcoming Adam Optimization Videoβ€’1 minute
  • Clarification about Learning Rate Decay Videoβ€’1 minute
  • Lecture Notes W2β€’1 minute
1 assignmentβ€’Total 50 minutes
  • Optimization Algorithms β€’50 minutes
1 programming assignmentβ€’Total 180 minutes
  • Optimization Methodsβ€’180 minutes

Explore TensorFlow, a deep learning framework that allows you to build neural networks quickly and easily, then train a neural network on a TensorFlow dataset.

What's included

11 videos7 readings1 assignment1 programming assignment

11 videosβ€’Total 103 minutes
  • Tuning Processβ€’7 minutes
  • Using an Appropriate Scale to pick Hyperparametersβ€’9 minutes
  • Hyperparameters Tuning in Practice: Pandas vs. Caviarβ€’7 minutes
  • Normalizing Activations in a Networkβ€’9 minutes
  • Fitting Batch Norm into a Neural Networkβ€’13 minutes
  • Why does Batch Norm work?β€’12 minutes
  • Batch Norm at Test Timeβ€’6 minutes
  • Softmax Regressionβ€’12 minutes
  • Training a Softmax Classifierβ€’10 minutes
  • Deep Learning Frameworksβ€’4 minutes
  • TensorFlowβ€’15 minutes
7 readingsβ€’Total 26 minutes
  • Clarification about Upcoming Normalizing Activations in a Network Videoβ€’1 minute
  • Clarifications about Upcoming Softmax Videoβ€’1 minute
  • (Optional) Learn about Gradient Tape and Moreβ€’1 minute
  • Lecture Notes W3β€’1 minute
  • [IMPORTANT] Reminder about end of access to Lab Notebooksβ€’2 minutes
  • Referencesβ€’10 minutes
  • Acknowledgmentsβ€’10 minutes
1 assignmentβ€’Total 50 minutes
  • Hyperparameter tuning, Batch Normalization, Programming Frameworks β€’50 minutes
1 programming assignmentβ€’Total 180 minutes
  • TensorFlow Introductionβ€’180 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructors

Instructor ratings
4.9 (4,919 ratings)

Top Instructor

DeepLearning.AI
51 Coursesβ€’9,808,201 learners

Explore more from Machine Learning

Why people choose Coursera for their career

πŸ‘ Image

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
πŸ‘ Image

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
πŸ‘ Image

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
πŸ‘ Image

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

  • 5 stars

    88.21%

  • 4 stars

    10.57%

  • 3 stars

    1.02%

  • 2 stars

    0.11%

  • 1 star

    0.07%

Showing 3 of 63534

BT
Β·

Reviewed on Oct 19, 2017

loved it. the structure of the course, the assignments, tutorials were great!particularly, the tensorflow tutorial was a hit!!Cheers to Andrew who made it look much easier that I thought it would be!

RR
Β·

Reviewed on Jun 12, 2020

Could have increased assignments and some more indepth knowledge of tensorflow and proper installation way of tensorflow cause mine is showing error when iam trying to practice as shown in the video

DH
Β·

Reviewed on Apr 26, 2020

Everything, Everyparameter in neural networks looks familiar to me now. I feel like I can optimize them for better accuracy. Overall I learned some new things and the way of teaching was really nice.

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Financial aid available,