VOOZH about

URL: https://www.coursera.org/learn/generative-ai-with-llms

⇱ Generative AI with Large Language Models | Coursera


Generative AI with Large Language Models

Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.

Generative AI with Large Language Models

438,741 already enrolled

Ask Coursera

Gain insight into a topic and learn the fundamentals.
4.8

3,619 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
94%
Most learners liked this course

Gain insight into a topic and learn the fundamentals.
4.8

3,619 reviews

Intermediate level

Recommended experience

Flexible schedule
2 weeks at 10 hours a week
Learn at your own pace
94%
Most learners liked this course

What you'll learn

  • Gain foundational knowledge, practical skills, and a functional understanding of how generative AI works

  • Dive into the latest research on Gen AI to understand how companies are creating value with cutting-edge technology

  • Instruction from expert AWS AI practitioners who actively build and deploy AI in business use-cases today

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

3 assignments

Taught in English

There are 3 modules in this course

In Generative AI with Large Language Models (LLMs), you’ll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications.

By taking this course, you'll learn to: - Deeply understand generative AI, describing the key steps in a typical LLM-based generative AI lifecycle, from data gathering and model selection, to performance evaluation and deployment - Describe in detail the transformer architecture that powers LLMs, how they’re trained, and how fine-tuning enables LLMs to be adapted to a variety of specific use cases - Use empirical scaling laws to optimize the model's objective function across dataset size, compute budget, and inference requirements - Apply state-of-the art training, tuning, inference, tools, and deployment methods to maximize the performance of models within the specific constraints of your project - Discuss the challenges and opportunities that generative AI creates for businesses after hearing stories from industry researchers and practitioners Developers who have a good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology. This is an intermediate course, so you should have some experience coding in Python to get the most out of it. You should also be familiar with the basics of machine learning, such as supervised and unsupervised learning, loss functions, and splitting data into training, validation, and test sets. If you have taken the Machine Learning Specialization or Deep Learning Specialization from DeepLearning.AI, you’ll be ready to take this course and dive deeper into the fundamentals of generative AI.

Generative AI use cases, project lifecycle, and model pre-training

What's included

17 videos7 readings1 assignment2 app items

17 videosβ€’Total 116 minutes
  • Course Introductionβ€’7 minutes
  • Introduction - Week 1β€’5 minutes
  • Generative AI & LLMsβ€’4 minutes
  • LLM use cases and tasksβ€’3 minutes
  • Text generation before transformersβ€’2 minutes
  • Transformers architectureβ€’8 minutes
  • Generating text with transformersβ€’5 minutes
  • Prompting and prompt engineeringβ€’6 minutes
  • Generative configurationβ€’8 minutes
  • Generative AI project lifecycleβ€’5 minutes
  • Introduction to AWS labsβ€’5 minutes
  • Lab 1 walkthroughβ€’14 minutes
  • Pre-training large language modelsβ€’9 minutes
  • Computational challenges of training LLMsβ€’10 minutes
  • Optional video: Efficient multi-GPU compute strategiesβ€’9 minutes
  • Scaling laws and compute-optimal modelsβ€’9 minutes
  • Pre-training for domain adaptationβ€’6 minutes
7 readingsβ€’Total 47 minutes
  • Contributor Acknowledgmentsβ€’10 minutes
  • Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!β€’1 minute
  • Transformers: Attention is all you needβ€’10 minutes
  • [IMPORTANT] Guidelines before you start the labs in this courseβ€’5 minutes
  • Domain-specific training: BloombergGPTβ€’10 minutes
  • Week 1 resourcesβ€’10 minutes
  • Lecture Notes Week 1β€’1 minute
1 assignmentβ€’Total 60 minutes
  • Week 1 quizβ€’60 minutes
2 app itemsβ€’Total 121 minutes
  • Intake Surveyβ€’1 minute
  • Lab 1 - Generative AI Use Case: Summarize Dialogueβ€’120 minutes

Fine-tuning and evaluating large language models

What's included

10 videos3 readings1 assignment1 app item

10 videosβ€’Total 78 minutes
  • Introduction - Week 2β€’5 minutes
  • Instruction fine-tuningβ€’8 minutes
  • Fine-tuning on a single taskβ€’3 minutes
  • Multi-task instruction fine-tuningβ€’9 minutes
  • Model evaluationβ€’11 minutes
  • Benchmarksβ€’5 minutes
  • Parameter efficient fine-tuning (PEFT)β€’4 minutes
  • PEFT techniques 1: LoRAβ€’8 minutes
  • PEFT techniques 2: Soft promptsβ€’7 minutes
  • Lab 2 walkthroughβ€’17 minutes
3 readingsβ€’Total 21 minutes
  • Scaling instruct modelsβ€’10 minutes
  • Week 2 Resourcesβ€’10 minutes
  • Lecture Notes Week 2β€’1 minute
1 assignmentβ€’Total 60 minutes
  • Week 2 quizβ€’60 minutes
1 app itemβ€’Total 120 minutes
  • Lab 2 - Fine-tune a generative AI model for dialogue summarizationβ€’120 minutes

Reinforcement learning and LLM-powered applications

What's included

21 videos7 readings1 assignment1 app item

21 videosβ€’Total 141 minutes
  • Introduction - Week 3β€’4 minutes
  • Aligning models with human valuesβ€’3 minutes
  • Reinforcement learning from human feedback (RLHF)β€’8 minutes
  • RLHF: Obtaining feedback from humansβ€’7 minutes
  • RLHF: Reward modelβ€’2 minutes
  • RLHF: Fine-tuning with reinforcement learningβ€’4 minutes
  • Optional video: Proximal policy optimizationβ€’14 minutes
  • RLHF: Reward hackingβ€’6 minutes
  • Scaling human feedbackβ€’6 minutes
  • Lab 3 walkthroughβ€’18 minutes
  • Model optimizations for deploymentβ€’8 minutes
  • Generative AI Project Lifecycle Cheat Sheetβ€’3 minutes
  • Using the LLM in applicationsβ€’10 minutes
  • Interacting with external applicationsβ€’5 minutes
  • Helping LLMs reason and plan with chain-of-thoughtβ€’5 minutes
  • Program-aided language models (PAL)β€’8 minutes
  • ReAct: Combining reasoning and actionβ€’9 minutes
  • LLM application architecturesβ€’5 minutes
  • Optional video: AWS Sagemaker JumpStartβ€’6 minutes
  • Responsible AIβ€’9 minutes
  • Course conclusionβ€’3 minutes
7 readingsβ€’Total 39 minutes
  • KL divergenceβ€’10 minutes
  • [IMPORTANT] Reminder about end of access to Lab Notebooksβ€’2 minutes
  • ReAct: Reasoning and actionβ€’10 minutes
  • Week 3 resourcesβ€’10 minutes
  • Lecture Notes Week 3β€’1 minute
  • Acknowledgmentsβ€’1 minute
  • (Optional) Opportunity to Mentor Other Learnersβ€’5 minutes
1 assignmentβ€’Total 60 minutes
  • Week 3 Quizβ€’60 minutes
1 app itemβ€’Total 120 minutes
  • Lab 3 - Fine-tune FLAN-T5 with reinforcement learning to generate more-positive summariesβ€’120 minutes

Instructors

Instructor ratings
4.8 (1,140 ratings)
DeepLearning.AI
6 Coursesβ€’475,481 learners

Explore more from Algorithms

Why people choose Coursera for their career

πŸ‘ Image

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
πŸ‘ Image

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
πŸ‘ Image

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
πŸ‘ Image

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

  • 5 stars

    81.64%

  • 4 stars

    14.84%

  • 3 stars

    2.31%

  • 2 stars

    0.52%

  • 1 star

    0.66%

Showing 3 of 3619

SM
Β·

Reviewed on Oct 12, 2024

Pretty good overview for Product Managers and leaders who are interested in learning about Generative AI with hands-on labs that are not too detailed, yet help you develop the intuition.

C
Β·

Reviewed on Jul 10, 2023

A very good course covering many different areas, from use cases, to the mathematical underpinnings and the societal impacts. And having the labs to actually get to play around with the algorithms.

AB
Β·

Reviewed on Mar 17, 2024

Excellent, A lot of things covered. No words to describe how the complex topics explained in such a simple manner. One suggestion is to include more hands-on labs with different kind of tasks.

Frequently asked questions

Developers who have a good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology.

We recommend starting with a beginner course such as Machine Learning Specialization.

Yes! This course is perfect for anyone with a background in Python ready to dive deeper into large language models and generative AI.

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Financial aid available,