Fine-tuning Image Models with Diffusion
Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.
Fine-tuning Image Models with Diffusion
This course is part of Open Generative AI: Build with Open Models and Tools Professional Certificate
Included with
Ask Coursera
Recommended experience
Recommended experience
Skills you'll gain
Tools you'll learn
Details to know
February 2026
See how employees at top companies are mastering in-demand skills
Build your Machine Learning expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate from Coursera
There are 4 modules in this course
The Fine-Tuning Image Models with Diffusion course is designed for developers, engineers, and technical product builders who are new to Generative AI but already have intermediate machine learning knowledge, basic Python proficiency, and familiarity with development environments such as VS Code, and who want to engineer, customize, and deploy open generative AI solutions while avoiding vendor lock-in.
The course gives learners hands-on experience adapting generative image models for custom styles and applications. The course begins with the foundations of diffusion models, explaining forward and reverse diffusion processes and exploring the key components of Stable Diffusion architectures, including U-Net, VAE, and text encoders. Learners then apply Low-Rank Adaptation (LoRA) techniques to train efficiently on consumer hardware, comparing performance and trade-offs with full fine-tuning. In the second module, learners implement DreamBooth, a methodology for training on limited datasets to personalize models with custom concepts and artistic styles. Learners practice dataset preparation, hyperparameter tuning, and checkpoint management while preserving model generalization. The third module introduces ComfyUI, where learners design and execute node-based workflows that integrate fine-tuned models with advanced extensions like ControlNet. And, in the final module, learners will optimize fine-tuned diffusion models for production by systematically adjusting inference parameters to achieve optimal trade-offs between image quality, generation speed, and resource efficiency. By the end of the course, learners will have produced a custom fine-tuned diffusion model, integrated it into ComfyUI pipelines, and optimized it for production-quality image generation.
Learn the fundamentals of diffusion models and why they play such a critical role in modern image generation. You’ll explore the key architectural components of Stable Diffusion, U-Net, VAE, and text encoders, and see how LoRA adapts these models efficiently for fine-tuning. You’ll also analyze memory optimization techniques and compare LoRA with full fine-tuning approaches, giving you practical principles for deciding which method to use depending on your goals and constraints.
What's included
3 videos2 readings1 assignment1 ungraded lab
3 videos•Total 22 minutes
- Podcast: What Really Happens When You Fine-Tune a Diffusion Model •4 minutes
- How LoRA Connects to Stable Diffusion•7 minutes
- Training and Applying LoRA: Dataset Prep, Training Loop, and Inference•10 minutes
2 readings•Total 34 minutes
- Code Demonstration Transcripts•4 minutes
- How Stable Diffusion Works•30 minutes
1 assignment•Total 30 minutes
- Diffusion & LoRA Basics•30 minutes
1 ungraded lab•Total 60 minutes
- Run Your First LoRA Adapter•60 minutes
Learn how to personalize diffusion models using the DreamBooth methodology. You’ll prepare small, targeted datasets for training custom concepts and styles, and understand how prior-preservation loss helps maintain model generalization. You’ll also apply hyperparameter strategies to balance creativity with stability and practice managing checkpoints and merging techniques. These skills give you the ability to adapt diffusion models to unique styles and use cases, making fine-tuning directly relevant to real-world creative and professional projects.
What's included
3 videos1 reading1 assignment1 ungraded lab
3 videos•Total 23 minutes
- Podcast - Personalizing Diffusion: DreamBooth in Action•3 minutes
- Prepping Your Dataset (and Avoiding Overfitting) in DreamBooth•9 minutes
- Merging & Managing Checkpoints •11 minutes
1 reading•Total 12 minutes
- How DreamBooth Works•12 minutes
1 assignment•Total 30 minutes
- DreamBooth Troubleshooting•30 minutes
1 ungraded lab•Total 60 minutes
- Train a Style Concept with DreamBooth•60 minutes
Learn how to use ComfyUI to design and manage advanced workflows for diffusion models. You’ll set up the environment, navigate the node-based interface, and load custom fine-tuned models into your pipelines. You’ll also practice building complex generation workflows with extensions like ControlNet, giving you a flexible, visual way to experiment and produce consistent, high-quality results. These skills make workflow design more efficient and directly applicable to real-world creative and production settings.
What's included
3 videos2 readings1 assignment
3 videos•Total 26 minutes
- How ComfyUI Simplifies Diffusion Fine-Tuning•9 minutes
- Setting Up ComfyUI and Building Your First Workflow•6 minutes
- Adding ControlNet to Your ComfyUI Workflow•10 minutes
2 readings•Total 20 minutes
- The Must-Know Basics of ComfyUI•10 minutes
- Create a Workflow in ComfyUI•10 minutes
1 assignment•Total 30 minutes
- ComfyUI Workflow Design•30 minutes
Learn how to optimize fine-tuned diffusion models so they’re reliable in real production environments. You’ll adjust inference settings like steps, CFG scale, and batch size to balance speed, quality, and resource use, and practice testing how small tweaks can dramatically improve results. You’ll also adapt workflows for deployment, gaining practical skills to deliver outputs that are both efficient and production-ready. These techniques give you the ability to make informed trade-offs that directly impact performance in real-world projects.
What's included
2 videos1 reading1 assignment1 ungraded lab
2 videos•Total 10 minutes
- Testing & Optimizing Outputs •8 minutes
- Podcast: Bringing It All Together: Fine-Tuning Diffusion Models That Work •3 minutes
1 reading•Total 9 minutes
- Practical Optimization for Diffusion Models•9 minutes
1 assignment•Total 60 minutes
- End-to-End Diffusion Fine-Tuning Check•60 minutes
1 ungraded lab•Total 60 minutes
- Optimize Your Fine-Tuned Model•60 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructor
Explore more from Machine Learning
- Status: Free TrialB
Board Infinity
Course
- Status: PreviewF
Fractal Analytics
Course
- Status: Free TrialC
Coursera
Course
- G
Google Cloud
Course
Why people choose Coursera for their career
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
More questions
Financial aid available,
¹ Some assignments in this course are AI-graded. For these assignments, your data will be used in accordance with Coursera's Privacy Notice.
