PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Variational Bayes for Continuous-Time Nonlinear State-Space Models
Antti Honkela, Matti Tornio and Tapani Raiko
In: NIPS*2006 Workshop on Dynamical Systems, Stochastic Processes and Bayesian Inference, 9 Dec 2006, Whistler, B.C., Canada.


We present an extension of the variational Bayesian nonlinear state-space model introduced by Valpola and Karhunen in 2002 for continuous-time models. The model is based on using multilayer perceptron (MLP) networks to model the nonlinearities. Moving to continuous-time requires solving a stochastic differential equation (SDE) to evaluate the predictive distribution of the states, but otherwise all computation happens as in the discrete-time case. The close connection between the methods allows utilising our new improved state inference method for both discrete-time and continuous-time modelling.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Talk)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:3221
Deposited By:Antti Honkela
Deposited On:21 January 2008