PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Information, Utility & Bounded Rationality
Pedro Ortega and Daniel A. Braun
In: The Fourth Conference on General Artificial Intelligence, 3-6 Aug 2011, Mountain View, California, USA.

This is the latest version of this eprint.

Abstract

Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here we employ an axiomatic framework for bounded rational decision-making based on a thermodynamic interpretation of resource costs as information costs. This leads to a variational "free utility" principle akin to thermodynamical free energy that trades off utility and information costs. We show that bounded optimal control solutions can be derived from this variational principle, which leads in general to stochastic policies. Furthermore, we show that risk-sensitive and robust (minimax) control schemes fall out naturally from this framework if the environment is considered as a bounded rational and perfectly rational opponent, respectively. When resource costs are ignored, the maximum expected utility principle is recovered.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Theory & Algorithms
ID Code:8295
Deposited By:Pedro Ortega
Deposited On:28 August 2011

Available Versions of this Item

  • Information, Utility & Bounded Rationality (deposited 28 August 2011) [Currently Displayed]