PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Evaluation of policy gradient methods and variants on the cart-pole benchmark
Martin Riedmiller, Jan Peters and Stefan Schaal
In: 2007 IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning(2007).


In this paper, we evaluate different versions from the three main kinds of model-free policy gradient methods, i.e., finite difference gradients, `vanilla' policy gradients and natural policy gradients. Each of these methods is first presented in its simple form and subsequently refined and optimized. By carrying out numerous experiments on the cart pole regulator benchmark we aim to provide a useful baseline for future research on parameterized policy search algorithms. Portable C++ code is provided for both plant and algorithms; thus, the results in this paper can be reevaluated, reused and new algorithms can be inserted with ease.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
ID Code:3599
Deposited By:Jan Peters
Deposited On:13 February 2008