PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Predictive Search Distributions
Edwin Bonilla, Christopher Williams, Felix Agakov, John Cavazos, John Thompson and Michael F. P. O'Boyle
In: 23rd International Conference on Machine Learning, Pittsburgh, USA(2006).


Estimation of Distribution Algorithms (EDAs) are a popular approach to learn a probability distribution over the "good" solutions to a combinatorial optimization problem. Here we consider the case where there is a collection of such optimization problems with learned distributions, and where each problem can be characterized by some vector of features. Now we can define a machine learning problem to predict the distribution of good solutions q(s|x) for a new problem with features x, where s denotes a solution. This predictive distri- bution is then used to focus the search. We demonstrate the utility of our method on a compiler optimization task where the goal is to find a sequence of code transformations to make the code run fastest. Results on a set of 12 different benchmarks on two distinct architectures show that our approach consis- tently leads to significant improvements in performance.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
ID Code:2407
Deposited By:Christopher Williams
Deposited On:22 November 2006