PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Planning with Noisy Probabilistic Relational Rules
Tobias Lang and Marc Toussaint
Journal of Artificial Intelligence Research 2010.

Abstract

Noisy probabilistic relational rules are a promising world model representation for several reasons. They are compact and generalize over world instantiations. They are usually interpretable and they can be learned eectively from the action experiences in complex worlds. We investigate reasoning with such rules in grounded relational domains. Our algorithms exploit the compactness of rules for ecient and exible decision-theoretic planning. As a rst approach, we combine these rules with the Upper Condence Bounds applied to Trees (UCT) algorithm based on look-ahead trees. Our second approach converts these rules into a structured dynamic Bayesian network representation and predicts the eects of action sequences using approximate inference and beliefs over world states. We evaluate the eectiveness of our approaches for planning in a simulated complex 3D robot manipulation scenario with an articulated manipulator and realistic physics and in domains of the probabilistic planning competition. Empirical results show that our methods can solve problems where existing methods fail.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
ID Code:8016
Deposited By:Marc Toussaint
Deposited On:17 March 2011