Udacity part of Accenture logo

Deep Reinforcement Learning

From foundational concepts to advanced algorithms, this Nanodegree equips you with the tools to build intelligent agents using Python, neural networks, and state-of-the-art RL frameworks across robotics, finance, and beyond.

  • Nanodegree Program
  • Advanced
  • 83 hours
  • 4.6 (357)
  • Updated: Aug 13, 2025

Subscription · Monthly

  • Cancel Anytime
  • Unlimited access to hundreds of top-rated courses
  • Hands-on projects with expert feedback
  • Personalized career coaching and interview prep
  • Program Certificates

Skills you'll learn

22 skills

  • Value-based reinforcement learning
  • Stochastic policy gradients
  • Reinforce algorithm
  • Exploration-exploitation dilemma
  • Markov decision processes

Prerequisites

5 prerequisites

Prior to enrolling, you should have the following knowledge:

  • Intermediate Python
  • Deep learning framework proficiency
  • Neural network basics
  • Object-oriented programming basics
  • Reinforcement learning fundamentals

You will also need to be able to communicate fluently and professionally in written and spoken English.

Program Outline

  • 8 courses
  • 38 lessons
  • 3 projects

Program Instructors

9 instructors

Unlike typical professors, our instructors come from Fortune 500 and Global 2000 companies and have demonstrated leadership and expertise in their professions:

Mat Leonard

Content Developer

Miguel Morales

Content Developer

Chhavi Yadav

Content Developer

Dana Sheahan

Content Developer

Cezanne Camacho

Curriculum Lead

Alexis Cook

Curriculum Lead

Arpan Chakraborty

Instructor

Luis Serrano

ML Engineer

Juan Delgado

Computational Physicist

Mat Leonard

Content Developer

Miguel Morales

Content Developer

Chhavi Yadav

Content Developer

Dana Sheahan

Content Developer

Cezanne Camacho

Curriculum Lead

Reviews

Average Rating: 4.6 (357 Reviews)

The content is great although a bit dated on some topic, and sometimes the videos seems to come from other modules and refer to content not seen in the nano-degree, however overall the experience is good and the exercise helps a lot.

Edgar Maucourant

Jun 18, 2025

Great course to understand modern algorithms in RL.

Andrei

Sep 9, 2024

Considering that to buy this course you need to pay Udacity subscription at least one month (250$), this course is simply a scam: Pytorch codes from 6 years ago! That is, the course is still exactly the same from the day it was released, and today (as of 2024) it is outdated. What's more, in some videos they name certain Git hub repositories that have changed. This appears in the actor-critic methods section, which is literally a man marketing himself and reading the code without explaining it, as if he were reading poems. Generally poor explanations of videos of less than 5 minutes, unless you consult the papers and the book that offers, if you start watching the videos you learn rather little. Very poor explanations of programming codes. Unpractical exercises. You have to solve DL problems from already built environments, that is, the practical part is limited to solve video game type environments that have no real life utility. Anywhere is there an example of how to build your own environment? → NO, Impossible deliverables. If you give me a few GPU hours and I have to build my own models and test infinite hyperparameters how am I going to perform that task, if all I can do is copy a code from the internet that I know works so I don't spend those hours? They give very few GPU hours to solve the problems, and these have a lot to do with launching a model, waiting, changing hyperparameters etc. The only good thing about the course is the papers and github repos it redirects to, which are useful. I mean, you pay an absurd amount of money for some internet links. My first and last course at Udacity :)

Angela G

Apr 12, 2024

Amazing course with the most advanced knowledge about deep RL, yet presented in so pleasant way, that it was such a great adventure to learn and gain new skills with Deep Reinforcement Learning Course! Thank you very much.

Agnieszka L

Nov 15, 2023

The course explains even the heavy concepts very easily.

Anuj P

Aug 22, 2023

Subscription · Monthly

  • Cancel Anytime
  • Unlimited access to hundreds of top-rated courses
  • Hands-on projects with expert feedback
  • Personalized career coaching and interview prep
  • Program Certificates

Other programs you might like:

Udacity Accenture logo

Company

  • Facebook
  • Twitter
  • LinkedIn
  • Instagram

© 2011-2026 Udacity, Inc. "Nanodegree" is a registered trademark of Udacity. © 2011-2026 Udacity, Inc.
We use cookies and other data collection technologies to provide the best experience for our customers.