Generative AI with Large Language Models
Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.
Generative AI with Large Language Models
438,741 already enrolled
Ask Coursera
3,619 reviews
Recommended experience
3,619 reviews
Recommended experience
What you'll learn
Gain foundational knowledge, practical skills, and a functional understanding of how generative AI works
Dive into the latest research on Gen AI to understand how companies are creating value with cutting-edge technology
Instruction from expert AWS AI practitioners who actively build and deploy AI in business use-cases today
Skills you'll gain
Tools you'll learn
Details to know
3 assignments
See how employees at top companies are mastering in-demand skills
There are 3 modules in this course
In Generative AI with Large Language Models (LLMs), youβll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications.
By taking this course, you'll learn to: - Deeply understand generative AI, describing the key steps in a typical LLM-based generative AI lifecycle, from data gathering and model selection, to performance evaluation and deployment - Describe in detail the transformer architecture that powers LLMs, how theyβre trained, and how fine-tuning enables LLMs to be adapted to a variety of specific use cases - Use empirical scaling laws to optimize the model's objective function across dataset size, compute budget, and inference requirements - Apply state-of-the art training, tuning, inference, tools, and deployment methods to maximize the performance of models within the specific constraints of your project - Discuss the challenges and opportunities that generative AI creates for businesses after hearing stories from industry researchers and practitioners Developers who have a good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology. This is an intermediate course, so you should have some experience coding in Python to get the most out of it. You should also be familiar with the basics of machine learning, such as supervised and unsupervised learning, loss functions, and splitting data into training, validation, and test sets. If you have taken the Machine Learning Specialization or Deep Learning Specialization from DeepLearning.AI, youβll be ready to take this course and dive deeper into the fundamentals of generative AI.
Generative AI use cases, project lifecycle, and model pre-training
What's included
17 videos7 readings1 assignment2 app items
17 videosβ’Total 116 minutes
- Course Introductionβ’7 minutes
- Introduction - Week 1β’5 minutes
- Generative AI & LLMsβ’4 minutes
- LLM use cases and tasksβ’3 minutes
- Text generation before transformersβ’2 minutes
- Transformers architectureβ’8 minutes
- Generating text with transformersβ’5 minutes
- Prompting and prompt engineeringβ’6 minutes
- Generative configurationβ’8 minutes
- Generative AI project lifecycleβ’5 minutes
- Introduction to AWS labsβ’5 minutes
- Lab 1 walkthroughβ’14 minutes
- Pre-training large language modelsβ’9 minutes
- Computational challenges of training LLMsβ’10 minutes
- Optional video: Efficient multi-GPU compute strategiesβ’9 minutes
- Scaling laws and compute-optimal modelsβ’9 minutes
- Pre-training for domain adaptationβ’6 minutes
7 readingsβ’Total 47 minutes
- Contributor Acknowledgmentsβ’10 minutes
- Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!β’1 minute
- Transformers: Attention is all you needβ’10 minutes
- [IMPORTANT] Guidelines before you start the labs in this courseβ’5 minutes
- Domain-specific training: BloombergGPTβ’10 minutes
- Week 1 resourcesβ’10 minutes
- Lecture Notes Week 1β’1 minute
1 assignmentβ’Total 60 minutes
- Week 1 quizβ’60 minutes
2 app itemsβ’Total 121 minutes
- Intake Surveyβ’1 minute
- Lab 1 - Generative AI Use Case: Summarize Dialogueβ’120 minutes
Fine-tuning and evaluating large language models
What's included
10 videos3 readings1 assignment1 app item
10 videosβ’Total 78 minutes
- Introduction - Week 2β’5 minutes
- Instruction fine-tuningβ’8 minutes
- Fine-tuning on a single taskβ’3 minutes
- Multi-task instruction fine-tuningβ’9 minutes
- Model evaluationβ’11 minutes
- Benchmarksβ’5 minutes
- Parameter efficient fine-tuning (PEFT)β’4 minutes
- PEFT techniques 1: LoRAβ’8 minutes
- PEFT techniques 2: Soft promptsβ’7 minutes
- Lab 2 walkthroughβ’17 minutes
3 readingsβ’Total 21 minutes
- Scaling instruct modelsβ’10 minutes
- Week 2 Resourcesβ’10 minutes
- Lecture Notes Week 2β’1 minute
1 assignmentβ’Total 60 minutes
- Week 2 quizβ’60 minutes
1 app itemβ’Total 120 minutes
- Lab 2 - Fine-tune a generative AI model for dialogue summarizationβ’120 minutes
Reinforcement learning and LLM-powered applications
What's included
21 videos7 readings1 assignment1 app item
21 videosβ’Total 141 minutes
- Introduction - Week 3β’4 minutes
- Aligning models with human valuesβ’3 minutes
- Reinforcement learning from human feedback (RLHF)β’8 minutes
- RLHF: Obtaining feedback from humansβ’7 minutes
- RLHF: Reward modelβ’2 minutes
- RLHF: Fine-tuning with reinforcement learningβ’4 minutes
- Optional video: Proximal policy optimizationβ’14 minutes
- RLHF: Reward hackingβ’6 minutes
- Scaling human feedbackβ’6 minutes
- Lab 3 walkthroughβ’18 minutes
- Model optimizations for deploymentβ’8 minutes
- Generative AI Project Lifecycle Cheat Sheetβ’3 minutes
- Using the LLM in applicationsβ’10 minutes
- Interacting with external applicationsβ’5 minutes
- Helping LLMs reason and plan with chain-of-thoughtβ’5 minutes
- Program-aided language models (PAL)β’8 minutes
- ReAct: Combining reasoning and actionβ’9 minutes
- LLM application architecturesβ’5 minutes
- Optional video: AWS Sagemaker JumpStartβ’6 minutes
- Responsible AIβ’9 minutes
- Course conclusionβ’3 minutes
7 readingsβ’Total 39 minutes
- KL divergenceβ’10 minutes
- [IMPORTANT] Reminder about end of access to Lab Notebooksβ’2 minutes
- ReAct: Reasoning and actionβ’10 minutes
- Week 3 resourcesβ’10 minutes
- Lecture Notes Week 3β’1 minute
- Acknowledgmentsβ’1 minute
- (Optional) Opportunity to Mentor Other Learnersβ’5 minutes
1 assignmentβ’Total 60 minutes
- Week 3 Quizβ’60 minutes
1 app itemβ’Total 120 minutes
- Lab 3 - Fine-tune FLAN-T5 with reinforcement learning to generate more-positive summariesβ’120 minutes
Instructors
Explore more from Algorithms
- Status: Free Trial
Course
- Status: Free Trial
- Status: Free TrialA
Alberta Machine Intelligence Institute
Course
Course
Why people choose Coursera for their career
Learner reviews
- 5 stars
81.64%
- 4 stars
14.84%
- 3 stars
2.31%
- 2 stars
0.52%
- 1 star
0.66%
Showing 3 of 3619
Reviewed on Oct 12, 2024
Pretty good overview for Product Managers and leaders who are interested in learning about Generative AI with hands-on labs that are not too detailed, yet help you develop the intuition.
Reviewed on Jul 10, 2023
A very good course covering many different areas, from use cases, to the mathematical underpinnings and the societal impacts. And having the labs to actually get to play around with the algorithms.
Reviewed on Mar 17, 2024
Excellent, A lot of things covered. No words to describe how the complex topics explained in such a simple manner. One suggestion is to include more hands-on labs with different kind of tasks.
Frequently asked questions
Developers who have a good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology.
We recommend starting with a beginner course such as Machine Learning Specialization.
Yes! This course is perfect for anyone with a background in Python ready to dive deeper into large language models and generative AI.
More questions
Financial aid available,
