Reinforcement Learning in Finance
Ends soon! Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.
Reinforcement Learning in Finance
This course is part of Machine Learning and Reinforcement Learning in Finance Specialization
Instructor: Igor Halperin
22,824 already enrolled
Included with
Learn more
Ask Coursera
134 reviews
134 reviews
Details to know
See how employees at top companies are mastering in-demand skills
Build your subject-matter expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate
There are 4 modules in this course
This course aims at introducing the fundamental concepts of Reinforcement Learning (RL), and develop use cases for applications of RL for option valuation, trading, and asset management.
By the end of this course, students will be able to - Use reinforcement learning to solve classical problems of Finance such as portfolio optimization, optimal trading, and option pricing and risk management. - Practice on valuable examples such as famous Q-learning using financial problems. - Apply their knowledge acquired in the course to a simple model for market dynamics that is obtained using reinforcement learning as the course project. Prerequisites are the courses "Guided Tour of Machine Learning in Finance" and "Fundamentals of Machine Learning in Finance". Students are expected to know the lognormal process and how it can be simulated. Knowledge of option pricing is not assumed but desirable.
What's included
14 videos2 readings1 programming assignment1 ungraded lab
14 videosβ’Total 107 minutes
- Introduction to the Specializationβ’5 minutes
- Prerequisitesβ’7 minutes
- Welcome to the Courseβ’6 minutes
- Introduction to Markov Decision Processes and Reinforcement Learning in Financeβ’10 minutes
- MDP and RL: Decision Policiesβ’10 minutes
- MDP & RL: Value Function and Bellman Equationβ’8 minutes
- MDP & RL: Value Iteration and Policy Iterationβ’5 minutes
- MDP & RL: Action Value Functionβ’9 minutes
- Options and Option pricingβ’8 minutes
- Black-Scholes-Merton (BSM) Modelβ’8 minutes
- BSM Model and Riskβ’10 minutes
- Discrete Time BSM Modelβ’7 minutes
- Discrete Time BSM Hedging and Pricingβ’8 minutes
- Discrete Time BSM BS Limitβ’6 minutes
2 readingsβ’Total 20 minutes
- Jupyter Notebook FAQβ’10 minutes
- Hedged Monte Carlo: low variance derivative pricing with objective probabilitiesβ’10 minutes
1 programming assignmentβ’Total 80 minutes
- Discrete-time Black Scholes modelβ’80 minutes
1 ungraded labβ’Total 60 minutes
- Discrete-time Black Scholes modelβ’60 minutes
What's included
7 videos2 readings1 programming assignment1 ungraded lab
7 videosβ’Total 59 minutes
- MDP Formulationβ’11 minutes
- Action-Value Functionβ’6 minutes
- Optimal Action From Q Functionβ’7 minutes
- Backward Recursion for Q Starβ’8 minutes
- Basis Functionsβ’9 minutes
- Optimal Hedge With Monte-Carloβ’9 minutes
- Optimal Q Function With Monte-Carloβ’10 minutes
2 readingsβ’Total 20 minutes
- Jupyter Notebook FAQβ’10 minutes
- QLBS: Q-Learner in the Black-Scholes(-Merton) Worldsβ’10 minutes
1 programming assignmentβ’Total 90 minutes
- QLBS Model Implementationβ’90 minutes
1 ungraded labβ’Total 60 minutes
- QLBS Model Implementationβ’60 minutes
What's included
8 videos3 readings1 programming assignment1 ungraded lab
8 videosβ’Total 71 minutes
- Week Introductionβ’2 minutes
- Batch Reinforcement Learningβ’9 minutes
- Stochastic Approximationsβ’9 minutes
- Q-Learningβ’9 minutes
- Fitted Q-Iterationβ’10 minutes
- Fitted Q-Iteration: the Ξ¨-basisβ’10 minutes
- Fitted Q-Iteration at Workβ’11 minutes
- RL Solution: Discussion and Examplesβ’12 minutes
3 readingsβ’Total 30 minutes
- Jupyter Notebook FAQβ’10 minutes
- QLBS: Q-Learner in the Black-Scholes(-Merton) Worlds and The QLBS Learner Goes NuQLearβ’10 minutes
- Course Project Reading: Global Portfolio Optimizationβ’10 minutes
1 programming assignmentβ’Total 90 minutes
- Fitted Q-Iterationβ’90 minutes
1 ungraded labβ’Total 60 minutes
- Fitted Q-Iterationβ’60 minutes
What's included
10 videos2 readings1 peer review1 ungraded lab
10 videosβ’Total 82 minutes
- Week Welcome Videoβ’2 minutes
- Introduction to RL for Tradingβ’13 minutes
- Portfolio Modelβ’8 minutes
- One Period Rewardsβ’6 minutes
- Forward and Inverse Optimisationβ’10 minutes
- Reinforcement Learning for Portfoliosβ’9 minutes
- Entropy Regularized RLβ’9 minutes
- RL Equationsβ’10 minutes
- RL and Inverse Reinforcement Learning Solutionsβ’11 minutes
- Course Summaryβ’3 minutes
2 readingsβ’Total 20 minutes
- Jupyter Notebook FAQβ’10 minutes
- Multi-period trading via Convex Optimizationβ’10 minutes
1 peer reviewβ’Total 120 minutes
- IRL Market Model Calibrationβ’120 minutes
1 ungraded labβ’Total 60 minutes
- IRL Market Model Calibrationβ’60 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructor
Offered by
Explore more from Machine Learning
- Status: Free TrialN
New York Institute of Finance
Course
- Status: Free TrialN
New York University
Course
- Status: Free TrialN
New York University
Specialization
- Status: Free TrialU
University of Alberta
Course
Why people choose Coursera for their career
Learner reviews
- 5 stars
48.50%
- 4 stars
13.43%
- 3 stars
5.22%
- 2 stars
10.44%
- 1 star
22.38%
Showing 3 of 134
Reviewed on Jun 23, 2021
Challenging course as a non-finance person, but learned a lot.
Reviewed on Jun 5, 2019
Excellent course. The peer reviewed evaluation is very interisting and it is definitely worth the time to do it in detail but does not take two hours with luck a week.
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Yes. In select learning programs, you can apply for financial aid or a scholarship if you canβt afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, youβll find a link to apply on the description page.
More questions
Financial aid available,
