Natural Language Processing with Sequence Models
Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.
Natural Language Processing with Sequence Models
This course is part of Natural Language Processing Specialization
80,242 already enrolled
1,183 reviews
Recommended experience
1,183 reviews
Recommended experience
What you'll learn
Use recurrent neural networks, LSTMs, GRUs & Siamese networks in TensorFlow for sentiment analysis, text generation & named entity recognition.
Skills you'll gain
Tools you'll learn
Details to know
3 assignments
See how employees at top companies are mastering in-demand skills
Build your subject-matter expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate
There are 3 modules in this course
In Course 3 of the Natural Language Processing Specialization, you will:
a) Train a neural network with word embeddings to perform sentiment analysis of tweets, b) Generate synthetic Shakespeare text using a Gated Recurrent Unit (GRU) language model, c) Train a recurrent neural network to perform named entity recognition (NER) using LSTMs with linear layers, and d) Use so-called βSiameseβ LSTM models to compare questions in a corpus and identify those that are worded differently but have the same meaning. By the end of this Specialization, you will have designed NLP applications that perform question-answering and sentiment analysis, created tools to translate languages and summarize text! This Specialization is designed and taught by two experts in NLP, machine learning, and deep learning. Younes Bensouda Mourri is an Instructor of AI at Stanford University who also helped build the Deep Learning Specialization. Εukasz Kaiser is a Staff Research Scientist at Google Brain and the co-author of Tensorflow, the Tensor2Tensor and Trax libraries, and the Transformer paper.
Learn about the limitations of traditional language models and see how RNNs and GRUs use sequential data for text prediction. Then build your own next-word generator using a simple RNN on Shakespeare text data!
What's included
15 videos16 readings1 assignment2 programming assignments4 ungraded labs
15 videosβ’Total 42 minutes
- Course 3 Introductionβ’3 minutes
- Lesson Introductionβ’1 minute
- Neural Networks for Sentiment Analysisβ’4 minutes
- Dense Layers and ReLUβ’2 minutes
- Embedding and Mean Layers β’3 minutes
- Lesson Introductionβ’1 minute
- Traditional Language modelsβ’3 minutes
- Recurrent Neural Networksβ’4 minutes
- Applications of RNNsβ’4 minutes
- Math in Simple RNNsβ’3 minutes
- Cost Function for RNNsβ’2 minutes
- Implementation Note β’2 minutes
- Gated Recurrent Unitsβ’4 minutes
- Deep and Bi-directional RNNs β’4 minutes
- Week Conclusionβ’1 minute
16 readingsβ’Total 86 minutes
- Lesson Introduction Clarificationβ’10 minutes
- Neural Networks for Sentiment Analysisβ’7 minutes
- Dense Layers and ReLUβ’5 minutes
- Embedding and Mean Layers β’3 minutes
- Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!β’2 minutes
- (Optional) Downloading your Notebook, Downloading your Workspace and Refreshing your Workspaceβ’5 minutes
- Traditional Language modelsβ’5 minutes
- Recurrent Neural Networksβ’4 minutes
- Application of RNNsβ’3 minutes
- Math in Simple RNNsβ’6 minutes
- Cost Function for RNNsβ’5 minutes
- Implementation Noteβ’3 minutes
- Gated Recurrent Unitsβ’7 minutes
- Deep and Bi-directional RNNsβ’10 minutes
- Calculating Perplexityβ’10 minutes
- Lecture Notes W1β’1 minute
1 assignmentβ’Total 30 minutes
- RNNs for Language Modellingβ’30 minutes
2 programming assignmentsβ’Total 360 minutes
- Sentiment with Deep Neural Networksβ’180 minutes
- Deep N-gramsβ’180 minutes
4 ungraded labsβ’Total 90 minutes
- Introduction to TensorFlowβ’30 minutes
- Hidden State Activationβ’20 minutes
- Vanilla RNNs, GRUs and the scan functionβ’20 minutes
- Calculating Perplexityβ’20 minutes
Learn about how long short-term memory units (LSTMs) solve the vanishing gradient problem, and how Named Entity Recognition systems quickly extract important information from text. Then build your own Named Entity Recognition system using an LSTM and data from Kaggle!
What's included
8 videos9 readings1 assignment1 programming assignment1 ungraded lab
8 videosβ’Total 25 minutes
- Week Introductionβ’1 minute
- RNNs and Vanishing Gradientsβ’6 minutes
- Introduction to LSTMsβ’4 minutes
- LSTM Architectureβ’3 minutes
- Introduction to Named Entity Recognitionβ’4 minutes
- Training NERs: Data Processing β’4 minutes
- Computing Accuracyβ’2 minutes
- Week Conclusionβ’1 minute
9 readingsβ’Total 43 minutes
- RNNs and Vanishing Gradientsβ’6 minutes
- (Optional) Intro to optimization in deep learning: Gradient Descentβ’10 minutes
- Introduction to LSTMsβ’3 minutes
- LSTM Architectureβ’4 minutes
- Introduction to Named Entity Recognitionβ’2 minutes
- Training NERs: Data Processingβ’5 minutes
- Long Short-Term Memory (Deep Learning Specialization C5)β’10 minutes
- Computing Accuracyβ’2 minutes
- Lecture Notes W2β’1 minute
1 assignmentβ’Total 30 minutes
- LSTMs and Named Entity Recognitionβ’30 minutes
1 programming assignmentβ’Total 180 minutes
- Named Entity Recognition (NER)β’180 minutes
1 ungraded labβ’Total 15 minutes
- Vanishing Gradientsβ’15 minutes
Learn about Siamese networks, a special type of neural network made of two identical networks that are eventually merged together, then build your own Siamese network that identifies question duplicates in a dataset from Quora.
What's included
10 videos10 readings1 assignment1 programming assignment3 ungraded labs
10 videosβ’Total 35 minutes
- Week Introductionβ’1 minute
- Siamese Networksβ’3 minutes
- Architectureβ’3 minutes
- Cost Functionβ’3 minutes
- Tripletsβ’6 minutes
- Computing The Cost Iβ’6 minutes
- Computing The Cost IIβ’7 minutes
- One Shot Learningβ’3 minutes
- Training / Testingβ’3 minutes
- Week Conclusionβ’1 minute
10 readingsβ’Total 50 minutes
- Siamese Networkβ’5 minutes
- Architectureβ’3 minutes
- Cost Functionβ’6 minutes
- Tripletsβ’6 minutes
- Computing the Cost Iβ’6 minutes
- Computing the Cost IIβ’5 minutes
- One Shot Learningβ’4 minutes
- Training / Testingβ’4 minutes
- Lecture Notes W3β’1 minute
- Acknowledgmentsβ’10 minutes
1 assignmentβ’Total 30 minutes
- Siamese Networksβ’30 minutes
1 programming assignmentβ’Total 180 minutes
- Question Duplicatesβ’180 minutes
3 ungraded labsβ’Total 70 minutes
- Creating a Siamese Modelβ’20 minutes
- Implementing the Modified Triplet Loss in TensorFlowβ’30 minutes
- Evaluate a Siamese Modelβ’20 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructors
Offered by
Explore more from Machine Learning
- Status: Free TrialD
DeepLearning.AI
Course
- Status: Free TrialD
DeepLearning.AI
Course
- Status: Free Trial
Course
- Status: Free TrialD
DeepLearning.AI
Course
Why people choose Coursera for their career
Learner reviews
- 5 stars
71.30%
- 4 stars
16.11%
- 3 stars
6.58%
- 2 stars
3.29%
- 1 star
2.70%
Showing 3 of 1183
Reviewed on Jan 25, 2021
Concise, to the point, and very insightful/educational. Take it in conjunction with the general Deep Learning Specialization, you'll not regret it.
Reviewed on Sep 25, 2020
Great Course as usual. Tried siamese models but got a very different results. Will need to study more on the conceptual side and implementation behind them. But overall, I am glad I touched LSTMs.
Reviewed on Sep 20, 2020
Absolutely satisfied with the tons of things I learnt. Professor Jounes and his team did a great work. Looking forward to enrolling to next course.
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Yes. In select learning programs, you can apply for financial aid or a scholarship if you canβt afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, youβll find a link to apply on the description page.
More questions
Financial aid available,
