Two Problems for Sophistication

Kolmogorov complexity measures the amount of information in data, but does not distinguish structure from noise. Kolmogorov’s definition of the structure function was the first attempt to measure only the structural information in data, by measuring the complexity of the smallest model that allows for optimal compression of the data. Since then, many variations of this idea have been proposed, for which we use sophistication as an umbrella term. We describe two fundamental problems with existing proposals, showing many of them to be unsound. Consequently, we put forward the view that the problem is fundamental: it may be impossible to objectively quantify the sophistication.

• Type: Journal
• Year: 2015
• Where: ALT
• Authors: Peter Bloem, Steven de Rooij, Pieter Adriaans
• Keywords: ALT 2015, Machine Learning