Markov Decision Process - Pendulum Control

Creates a Markov Decision Process model of a pendulum, then finds optimal swing-up policy.
376 Downloads
Updated 21 Feb 2016

Takes a single pendulum (with a torque actuator) and models it as a Markov Decision Process (MDP), using linear barycentric interpolation over a uniform grid. Then, value iteration is used to compute the optimal policy, which is then displayed as a plot. Finally, a simulation is run to demonstrate how to evaluate the optimal policy.

Cite As

Matthew Kelly (2024). Markov Decision Process - Pendulum Control (https://github.com/MatthewPeterKelly/MDP_Pendulum), GitHub. Retrieved .

MATLAB Release Compatibility
Created with R2014a
Compatible with any release
Platform Compatibility
Windows macOS Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Versions that use the GitHub default branch cannot be downloaded

Version Published Release Notes
1.4.0.0

Changed name

1.3.0.0

updated photo

1.2.0.0

added a photo.

1.1.0.0

Improved error handling regarding the MEX functions.

1.0.0.0

To view or report issues in this GitHub add-on, visit the GitHub Repository.
To view or report issues in this GitHub add-on, visit the GitHub Repository.