PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

A Bayesian Approach to Graph Regression with Relevant Subgraph Selection
Silvia Chiappa, Hiroto Saigo and Koji Tsuda
In: 2009 SIAM International Conference on Data Mining, 30 Apr - 02 May 2009, Sparks, USA.


Many real-world applications with graph data require the so- lution of a given regression task as well as the identification of the subgraphs which are relevant for the task. In these cases graphs are commonly represented as high dimensional binary vectors of indicators of subgraphs. However, since the dimensionality of such indicator vectors can be high even for small datasets, traditional regression algorithms become in- tractable and past approaches used to preselect a feasible subset of subgraphs. A different approach was recently pro- posed by a Lasso-type method where the objective function optimization with a large number of variables is reformulated as a dual mathematical programming problem with a small number of variables but a large number of constraints. The dual problem is then solved by column generation, where the subgraphs corresponding to the most violated constraints are found by weighted subgraph mining. This paper proposes an extension of this method to a Bayesian approach in which the regression parameters are considered as random variables and integrated out from the model likelihood, thus provid- ing a posterior distribution on the target variable as opposed to a point estimate. We focus on a linear regression model with a Gaussian prior distribution on the parameters. We evaluate our approach on several molecular graph datasets and analyze whether the uncertainty in the target estimate given by the target posterior distribution variance can be used to improve model performance and therefore provides useful additional information.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Theory & Algorithms
ID Code:4404
Deposited By:Koji Tsuda
Deposited On:13 March 2009