Information Theory for Angular Data
In this paper we study various aspect of information theory for data with values on a circle or on a sphere. We develop rate distortion theory with squared Euclidian distance as distortion function. It is shown that some ideas related to the minimum description length principle does not apply in this context. Various inequalities are proved. Pointwise convergence of a sequence of information projections is conjectured and some evidence is provided.