Strict MML (SMML)

Strict Minimum Message Length (SMML) inference (Wallace & Boulton 1975) constructs a mapping from the data space to the set of models (parameters) so as to minimise the expected length of a two-part message:  ‘model; (data|model)’. Note that the mapping defines a partition of the data space, each part being the data values that map to a particular model (parameter value). SMML estimators are, in an important sense, as good as it is possible to be (Wallace 1989, 1996).

SMML is invariant and consistent, and handles model selection, parameter estimation and hypothesis testing. Unfortunately SMML inference is NP-hard for most problems, although a polynomial-time algorithm exists for the Binomial distribution (Farr & Wallace 1997, 2002). Fortunately, MML (Wallace & Boulton 1968, Wallace & Freeman 1987) is a feasible approximation to SMML.