Udacity part of Accenture logo

Value-Based Methods

Combine cutting-edge reinforcement learning techniques with deep learning architectures. Use Q-networks and experience replay to train agents capable of navigating and adapting to real-time environments.

  • Course
  • Advanced
  • 10 hours
  • Updated: Aug 13, 2025

Subscription · Monthly

  • Cancel Anytime
  • Unlimited access to hundreds of top-rated courses
  • Hands-on projects with expert feedback
  • Personalized career coaching and interview prep
  • Program Certificates

Skills you'll learn

5 skills

  • Value-based reinforcement learning
  • Prioritized experience replay
  • Deep q-networks
  • Double deep q-networks
  • Dueling deep q-networks

Prerequisites

5 prerequisites

Prior to enrolling, you should have the following knowledge:

  • Reinforcement learning fundamentals
  • Deep learning framework proficiency
  • Neural network basics
  • Object-oriented programming basics
  • Intermediate Python

You will also need to be able to communicate fluently and professionally in written and spoken English.

Course Outline

  • 3 lessons
  • 1 project

Program Instructors

3 instructors

Unlike typical professors, our instructors come from Fortune 500 and Global 2000 companies and have demonstrated leadership and expertise in their professions:

Dana Sheahen

Content Developer

Arpan Chakraborty

Instructor

Kelvin Lwin

AI | Knowledge Architect

Dana Sheahen

Content Developer

Arpan Chakraborty

Instructor

Kelvin Lwin

AI | Knowledge Architect

Subscription · Monthly

  • Cancel Anytime
  • Unlimited access to hundreds of top-rated courses
  • Hands-on projects with expert feedback
  • Personalized career coaching and interview prep
  • Program Certificates

Other programs you might like:

Udacity Accenture logo

Company

  • Facebook
  • Twitter
  • LinkedIn
  • Instagram

© 2011-2026 Udacity, Inc. "Nanodegree" is a registered trademark of Udacity. © 2011-2026 Udacity, Inc.
We use cookies and other data collection technologies to provide the best experience for our customers.