PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Accumulative prediction error and the selection of time series models
Eric-Jan Wagenmakers, Peter Grünwald and Mark Steijvers
Journal of Mathematical Psychology Volume (under submission), Number -, 2005.


This article outlines the rationale for using accumulative one--step--ahead prediction error (APE) as a data--driven method for model selection. Theoretically, APE is closely related to Bayesian model selection and minimum description length (MDL). The sole requirement for using APE is that the models under consideration are capable of generating a prediction for the next, unseen data point. This means that APE may be readily applied to selection problems involving very complex models. APE automatically takes the functional form of parameters into account, and the `plug--in' version of APE does not require the specification of priors. APE is particularly easy to compute for data that have a natural ordering, such as time series. Here we explore the possibility of using APE to discriminate the short--range ARMA(1,1) model from the long--range ARFIMA$(0,d,0)$ model. We also illustrate how APE may be used for {\em model meta-selection}, allowing one to choose between different model selection methods.

EPrint Type:Article
Additional Information:Tentatively Accepted for Journal of Mathematical Psychology
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
ID Code:1311
Deposited By:Peter Grünwald
Deposited On:28 November 2005