Advanced Linear Models for Data Science 1: Least Squares
Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.
Advanced Linear Models for Data Science 1: Least Squares
This course is part of Advanced Statistics for Data Science Specialization
Instructor: Brian Caffo, PhD
31,312 already enrolled
Included with
Learn more
Ask Coursera
192 reviews
192 reviews
Skills you'll gain
Tools you'll learn
Details to know
7 assignments
See how employees at top companies are mastering in-demand skills
Build your subject-matter expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate
There are 6 modules in this course
Welcome to the Advanced Linear Models for Data Science Class 1: Least Squares. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following:
- A basic understanding of linear algebra and multivariate calculus. - A basic understanding of statistics and regression models. - At least a little familiarity with proof based mathematics. - Basic knowledge of the R programming language. After taking this course, students will have a firm foundation in a linear algebraic treatment of regression modeling. This will greatly augment applied data scientists' general understanding of regression models.
We cover some basic matrix algebra results that we will need throughout the class. This includes some basic vector derivatives. In addition, we cover some some basic uses of matrices to create summary statistics from data. This includes calculating and subtracting means from observations (centering) as well as calculating the variance.
What's included
7 videos4 readings1 assignment
7 videosβ’Total 28 minutes
- Introductionβ’3 minutes
- Matrix derivativesβ’5 minutes
- Coding exampleβ’2 minutes
- Centering by matrix multiplicationβ’7 minutes
- Coding exampleβ’2 minutes
- Variance via matrix multiplicationβ’7 minutes
- Coding exampleβ’2 minutes
4 readingsβ’Total 40 minutes
- Welcome to the classβ’10 minutes
- Course textbookβ’10 minutes
- Gradingβ’10 minutes
- In this moduleβ’10 minutes
1 assignmentβ’Total 30 minutes
- Background Quizβ’30 minutes
In this module, we cover the basics of regression through the origin and linear regression. Regression through the origin is an interesting case, as one can build up all of multivariate regression with it.
What's included
6 videos2 readings1 assignment
6 videosβ’Total 29 minutes
- Regression through the originβ’5 minutes
- Centering firstβ’8 minutes
- Coding exampleβ’2 minutes
- Connection with linear regressionβ’8 minutes
- Coding exampleβ’2 minutes
- Fitted values and residualsβ’5 minutes
2 readingsβ’Total 20 minutes
- Before you beginβ’10 minutes
- Before you beginβ’10 minutes
1 assignmentβ’Total 30 minutes
- One Parameter Regression Quizβ’30 minutes
In this lecture, we focus on linear regression, the most standard technique for investigating unconfounded linear relationships.
What's included
8 videos2 readings1 assignment
8 videosβ’Total 23 minutes
- Least squaresβ’5 minutes
- Coding exampleβ’1 minute
- Predictionβ’2 minutes
- Coding exampleβ’2 minutes
- Residualsβ’2 minutes
- Coding exampleβ’2 minutes
- Generalizationsβ’6 minutes
- Generalizations exampleβ’2 minutes
2 readingsβ’Total 20 minutes
- Before you beginβ’10 minutes
- Generalizationsβ’10 minutes
1 assignmentβ’Total 30 minutes
- Linear Regression Quizβ’30 minutes
We now move on to general least squares where an arbitrary full rank design matrix is fit to a vector outcome.
What's included
6 videos1 reading1 assignment
6 videosβ’Total 39 minutes
- Least squaresβ’4 minutes
- Coding exampleβ’3 minutes
- Second derivation of least squaresβ’5 minutes
- Projectionsβ’10 minutes
- Third derivation of least squaresβ’12 minutes
- Coding exampleβ’5 minutes
1 readingβ’Total 10 minutes
- Before you beginβ’10 minutes
1 assignmentβ’Total 30 minutes
- General Least Squares Quizβ’30 minutes
Here we give some canonical examples of linear models to relate them to techniques that you may already be using.
What's included
4 videos1 assignment
4 videosβ’Total 44 minutes
- Basic examples of design matrices and fitsβ’25 minutes
- Group effectsβ’4 minutes
- Change of parameterizationβ’5 minutes
- ANCOVAβ’11 minutes
1 assignmentβ’Total 30 minutes
- Least Squares Examples Quizβ’30 minutes
Here we give a very useful kind of linear model, that is decomposing a signal into a basis expansion.
What's included
6 videos2 assignments
6 videosβ’Total 44 minutes
- Bases, introductionβ’4 minutes
- Bases 2, Fourierβ’5 minutes
- Bases 3, SVDsβ’9 minutes
- Bases, coding exampleβ’10 minutes
- Introduction to residualsβ’6 minutes
- Partitioning variabilityβ’10 minutes
2 assignmentsβ’Total 60 minutes
- Bases Quizβ’30 minutes
- Residuals Quizβ’30 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructor
Offered by
Explore more from Probability and Statistics
- Status: Free TrialJ
Johns Hopkins University
Course
- Status: Free TrialU
University of Pittsburgh
Course
- Status: PreviewS
Simplilearn
Course
- Status: Free TrialI
Illinois Tech
Course
Why people choose Coursera for their career
Learner reviews
- 5 stars
64.06%
- 4 stars
24.47%
- 3 stars
7.29%
- 2 stars
3.12%
- 1 star
1.04%
Showing 3 of 192
Reviewed on Nov 6, 2017
Great, detailed walk-through of least squares. Linear Algebra is a must for this course. To follow the last part requires knowledge of matrix (eigen?)decomposition, which derailed me somewhat.
Reviewed on Apr 29, 2017
Good mathematical rigour for the analysis of linear models. Builds some good intuition for the geometry of least squares which helps in model result interpretation.
Reviewed on Sep 26, 2016
chapter on bases showing four equivalent forms was brilliant! Hoping to learn BLUE, GAMs in part 2.
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Yes. In select learning programs, you can apply for financial aid or a scholarship if you canβt afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, youβll find a link to apply on the description page.
More questions
Financial aid available,
