VOOZH about

URL: https://www.coursera.org/learn/sequence-models-in-nlp?specialization=natural-language-processing

⇱ Natural Language Processing with Sequence Models | Coursera


Natural Language Processing with Sequence Models

Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.

Natural Language Processing with Sequence Models

80,242 already enrolled

Gain insight into a topic and learn the fundamentals.
4.5

1,183 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
93%
Most learners liked this course

Gain insight into a topic and learn the fundamentals.
4.5

1,183 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
93%
Most learners liked this course

What you'll learn

  • Use recurrent neural networks, LSTMs, GRUs & Siamese networks in TensorFlow for sentiment analysis, text generation & named entity recognition.

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

3 assignments

Taught in English

Build your subject-matter expertise

This course is part of the Natural Language Processing Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 3 modules in this course

In Course 3 of the Natural Language Processing Specialization, you will:

a) Train a neural network with word embeddings to perform sentiment analysis of tweets, b) Generate synthetic Shakespeare text using a Gated Recurrent Unit (GRU) language model, c) Train a recurrent neural network to perform named entity recognition (NER) using LSTMs with linear layers, and d) Use so-called β€˜Siamese’ LSTM models to compare questions in a corpus and identify those that are worded differently but have the same meaning. By the end of this Specialization, you will have designed NLP applications that perform question-answering and sentiment analysis, created tools to translate languages and summarize text! This Specialization is designed and taught by two experts in NLP, machine learning, and deep learning. Younes Bensouda Mourri is an Instructor of AI at Stanford University who also helped build the Deep Learning Specialization. Łukasz Kaiser is a Staff Research Scientist at Google Brain and the co-author of Tensorflow, the Tensor2Tensor and Trax libraries, and the Transformer paper.

Learn about the limitations of traditional language models and see how RNNs and GRUs use sequential data for text prediction. Then build your own next-word generator using a simple RNN on Shakespeare text data!

What's included

15 videos16 readings1 assignment2 programming assignments4 ungraded labs

15 videosβ€’Total 42 minutes
  • Course 3 Introductionβ€’3 minutes
  • Lesson Introductionβ€’1 minute
  • Neural Networks for Sentiment Analysisβ€’4 minutes
  • Dense Layers and ReLUβ€’2 minutes
  • Embedding and Mean Layers β€’3 minutes
  • Lesson Introductionβ€’1 minute
  • Traditional Language modelsβ€’3 minutes
  • Recurrent Neural Networksβ€’4 minutes
  • Applications of RNNsβ€’4 minutes
  • Math in Simple RNNsβ€’3 minutes
  • Cost Function for RNNsβ€’2 minutes
  • Implementation Note β€’2 minutes
  • Gated Recurrent Unitsβ€’4 minutes
  • Deep and Bi-directional RNNs β€’4 minutes
  • Week Conclusionβ€’1 minute
16 readingsβ€’Total 86 minutes
  • Lesson Introduction Clarificationβ€’10 minutes
  • Neural Networks for Sentiment Analysisβ€’7 minutes
  • Dense Layers and ReLUβ€’5 minutes
  • Embedding and Mean Layers β€’3 minutes
  • Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!β€’2 minutes
  • (Optional) Downloading your Notebook, Downloading your Workspace and Refreshing your Workspaceβ€’5 minutes
  • Traditional Language modelsβ€’5 minutes
  • Recurrent Neural Networksβ€’4 minutes
  • Application of RNNsβ€’3 minutes
  • Math in Simple RNNsβ€’6 minutes
  • Cost Function for RNNsβ€’5 minutes
  • Implementation Noteβ€’3 minutes
  • Gated Recurrent Unitsβ€’7 minutes
  • Deep and Bi-directional RNNsβ€’10 minutes
  • Calculating Perplexityβ€’10 minutes
  • Lecture Notes W1β€’1 minute
1 assignmentβ€’Total 30 minutes
  • RNNs for Language Modellingβ€’30 minutes
2 programming assignmentsβ€’Total 360 minutes
  • Sentiment with Deep Neural Networksβ€’180 minutes
  • Deep N-gramsβ€’180 minutes
4 ungraded labsβ€’Total 90 minutes
  • Introduction to TensorFlowβ€’30 minutes
  • Hidden State Activationβ€’20 minutes
  • Vanilla RNNs, GRUs and the scan functionβ€’20 minutes
  • Calculating Perplexityβ€’20 minutes

Learn about how long short-term memory units (LSTMs) solve the vanishing gradient problem, and how Named Entity Recognition systems quickly extract important information from text. Then build your own Named Entity Recognition system using an LSTM and data from Kaggle!

What's included

8 videos9 readings1 assignment1 programming assignment1 ungraded lab

8 videosβ€’Total 25 minutes
  • Week Introductionβ€’1 minute
  • RNNs and Vanishing Gradientsβ€’6 minutes
  • Introduction to LSTMsβ€’4 minutes
  • LSTM Architectureβ€’3 minutes
  • Introduction to Named Entity Recognitionβ€’4 minutes
  • Training NERs: Data Processing β€’4 minutes
  • Computing Accuracyβ€’2 minutes
  • Week Conclusionβ€’1 minute
9 readingsβ€’Total 43 minutes
  • RNNs and Vanishing Gradientsβ€’6 minutes
  • (Optional) Intro to optimization in deep learning: Gradient Descentβ€’10 minutes
  • Introduction to LSTMsβ€’3 minutes
  • LSTM Architectureβ€’4 minutes
  • Introduction to Named Entity Recognitionβ€’2 minutes
  • Training NERs: Data Processingβ€’5 minutes
  • Long Short-Term Memory (Deep Learning Specialization C5)β€’10 minutes
  • Computing Accuracyβ€’2 minutes
  • Lecture Notes W2β€’1 minute
1 assignmentβ€’Total 30 minutes
  • LSTMs and Named Entity Recognitionβ€’30 minutes
1 programming assignmentβ€’Total 180 minutes
  • Named Entity Recognition (NER)β€’180 minutes
1 ungraded labβ€’Total 15 minutes
  • Vanishing Gradientsβ€’15 minutes

Learn about Siamese networks, a special type of neural network made of two identical networks that are eventually merged together, then build your own Siamese network that identifies question duplicates in a dataset from Quora.

What's included

10 videos10 readings1 assignment1 programming assignment3 ungraded labs

10 videosβ€’Total 35 minutes
  • Week Introductionβ€’1 minute
  • Siamese Networksβ€’3 minutes
  • Architectureβ€’3 minutes
  • Cost Functionβ€’3 minutes
  • Tripletsβ€’6 minutes
  • Computing The Cost Iβ€’6 minutes
  • Computing The Cost IIβ€’7 minutes
  • One Shot Learningβ€’3 minutes
  • Training / Testingβ€’3 minutes
  • Week Conclusionβ€’1 minute
10 readingsβ€’Total 50 minutes
  • Siamese Networkβ€’5 minutes
  • Architectureβ€’3 minutes
  • Cost Functionβ€’6 minutes
  • Tripletsβ€’6 minutes
  • Computing the Cost Iβ€’6 minutes
  • Computing the Cost IIβ€’5 minutes
  • One Shot Learningβ€’4 minutes
  • Training / Testingβ€’4 minutes
  • Lecture Notes W3β€’1 minute
  • Acknowledgmentsβ€’10 minutes
1 assignmentβ€’Total 30 minutes
  • Siamese Networksβ€’30 minutes
1 programming assignmentβ€’Total 180 minutes
  • Question Duplicatesβ€’180 minutes
3 ungraded labsβ€’Total 70 minutes
  • Creating a Siamese Modelβ€’20 minutes
  • Implementing the Modified Triplet Loss in TensorFlowβ€’30 minutes
  • Evaluate a Siamese Modelβ€’20 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructors

Instructor ratings
4.4 (236 ratings)
DeepLearning.AI
5 Coursesβ€’251,156 learners

Explore more from Machine Learning

Why people choose Coursera for their career

πŸ‘ Image

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
πŸ‘ Image

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
πŸ‘ Image

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
πŸ‘ Image

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

  • 5 stars

    71.30%

  • 4 stars

    16.11%

  • 3 stars

    6.58%

  • 2 stars

    3.29%

  • 1 star

    2.70%

Showing 3 of 1183

MB
Β·

Reviewed on Jan 25, 2021

Concise, to the point, and very insightful/educational. Take it in conjunction with the general Deep Learning Specialization, you'll not regret it.

BS
Β·

Reviewed on Sep 25, 2020

Great Course as usual. Tried siamese models but got a very different results. Will need to study more on the conceptual side and implementation behind them. But overall, I am glad I touched LSTMs.

AG
Β·

Reviewed on Sep 20, 2020

Absolutely satisfied with the tons of things I learnt. Professor Jounes and his team did a great work. Looking forward to enrolling to next course.

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Financial aid available,