VOOZH about

URL: https://www.coursera.org/learn/linear-models

⇱ Advanced Linear Models for Data Science 1: Least Squares | Coursera


Advanced Linear Models for Data Science 1: Least Squares

Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.

Advanced Linear Models for Data Science 1: Least Squares

31,312 already enrolled

Included with

β€’

Learn more

Ask Coursera

Gain insight into a topic and learn the fundamentals.
4.5

192 reviews

Advanced level
Designed for those already in the industry
8 hours to complete
Flexible schedule
Learn at your own pace

Gain insight into a topic and learn the fundamentals.
4.5

192 reviews

Advanced level
Designed for those already in the industry
8 hours to complete
Flexible schedule
Learn at your own pace

Build your subject-matter expertise

This course is part of the Advanced Statistics for Data Science Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 6 modules in this course

Welcome to the Advanced Linear Models for Data Science Class 1: Least Squares. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following:

- A basic understanding of linear algebra and multivariate calculus. - A basic understanding of statistics and regression models. - At least a little familiarity with proof based mathematics. - Basic knowledge of the R programming language. After taking this course, students will have a firm foundation in a linear algebraic treatment of regression modeling. This will greatly augment applied data scientists' general understanding of regression models.

We cover some basic matrix algebra results that we will need throughout the class. This includes some basic vector derivatives. In addition, we cover some some basic uses of matrices to create summary statistics from data. This includes calculating and subtracting means from observations (centering) as well as calculating the variance.

What's included

7 videos4 readings1 assignment

7 videosβ€’Total 28 minutes
  • Introductionβ€’3 minutes
  • Matrix derivativesβ€’5 minutes
  • Coding exampleβ€’2 minutes
  • Centering by matrix multiplicationβ€’7 minutes
  • Coding exampleβ€’2 minutes
  • Variance via matrix multiplicationβ€’7 minutes
  • Coding exampleβ€’2 minutes
4 readingsβ€’Total 40 minutes
  • Welcome to the classβ€’10 minutes
  • Course textbookβ€’10 minutes
  • Gradingβ€’10 minutes
  • In this moduleβ€’10 minutes
1 assignmentβ€’Total 30 minutes
  • Background Quizβ€’30 minutes

In this module, we cover the basics of regression through the origin and linear regression. Regression through the origin is an interesting case, as one can build up all of multivariate regression with it.

What's included

6 videos2 readings1 assignment

6 videosβ€’Total 29 minutes
  • Regression through the originβ€’5 minutes
  • Centering firstβ€’8 minutes
  • Coding exampleβ€’2 minutes
  • Connection with linear regressionβ€’8 minutes
  • Coding exampleβ€’2 minutes
  • Fitted values and residualsβ€’5 minutes
2 readingsβ€’Total 20 minutes
  • Before you beginβ€’10 minutes
  • Before you beginβ€’10 minutes
1 assignmentβ€’Total 30 minutes
  • One Parameter Regression Quizβ€’30 minutes

In this lecture, we focus on linear regression, the most standard technique for investigating unconfounded linear relationships.

What's included

8 videos2 readings1 assignment

8 videosβ€’Total 23 minutes
  • Least squaresβ€’5 minutes
  • Coding exampleβ€’1 minute
  • Predictionβ€’2 minutes
  • Coding exampleβ€’2 minutes
  • Residualsβ€’2 minutes
  • Coding exampleβ€’2 minutes
  • Generalizationsβ€’6 minutes
  • Generalizations exampleβ€’2 minutes
2 readingsβ€’Total 20 minutes
  • Before you beginβ€’10 minutes
  • Generalizationsβ€’10 minutes
1 assignmentβ€’Total 30 minutes
  • Linear Regression Quizβ€’30 minutes

We now move on to general least squares where an arbitrary full rank design matrix is fit to a vector outcome.

What's included

6 videos1 reading1 assignment

6 videosβ€’Total 39 minutes
  • Least squaresβ€’4 minutes
  • Coding exampleβ€’3 minutes
  • Second derivation of least squaresβ€’5 minutes
  • Projectionsβ€’10 minutes
  • Third derivation of least squaresβ€’12 minutes
  • Coding exampleβ€’5 minutes
1 readingβ€’Total 10 minutes
  • Before you beginβ€’10 minutes
1 assignmentβ€’Total 30 minutes
  • General Least Squares Quizβ€’30 minutes

Here we give some canonical examples of linear models to relate them to techniques that you may already be using.

What's included

4 videos1 assignment

4 videosβ€’Total 44 minutes
  • Basic examples of design matrices and fitsβ€’25 minutes
  • Group effectsβ€’4 minutes
  • Change of parameterizationβ€’5 minutes
  • ANCOVAβ€’11 minutes
1 assignmentβ€’Total 30 minutes
  • Least Squares Examples Quizβ€’30 minutes

Here we give a very useful kind of linear model, that is decomposing a signal into a basis expansion.

What's included

6 videos2 assignments

6 videosβ€’Total 44 minutes
  • Bases, introductionβ€’4 minutes
  • Bases 2, Fourierβ€’5 minutes
  • Bases 3, SVDsβ€’9 minutes
  • Bases, coding exampleβ€’10 minutes
  • Introduction to residualsβ€’6 minutes
  • Partitioning variabilityβ€’10 minutes
2 assignmentsβ€’Total 60 minutes
  • Bases Quizβ€’30 minutes
  • Residuals Quizβ€’30 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Instructor ratings
4.7 (21 ratings)
Johns Hopkins University
30 Coursesβ€’1,718,383 learners

Explore more from Probability and Statistics

Why people choose Coursera for their career

πŸ‘ Image

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
πŸ‘ Image

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
πŸ‘ Image

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
πŸ‘ Image

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

  • 5 stars

    64.06%

  • 4 stars

    24.47%

  • 3 stars

    7.29%

  • 2 stars

    3.12%

  • 1 star

    1.04%

Showing 3 of 192

JR
Β·

Reviewed on Nov 6, 2017

Great, detailed walk-through of least squares. Linear Algebra is a must for this course. To follow the last part requires knowledge of matrix (eigen?)decomposition, which derailed me somewhat.

SP
Β·

Reviewed on Apr 29, 2017

Good mathematical rigour for the analysis of linear models. Builds some good intuition for the geometry of least squares which helps in model result interpretation.

SS
Β·

Reviewed on Sep 26, 2016

chapter on bases showing four equivalent forms was brilliant! Hoping to learn BLUE, GAMs in part 2.

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Financial aid available,