Non-enumerable but limit-computable! No oracles!
Kolmogorov centennial (2003)
Kolmogorov meeting at Dagstuhl (2003)
Latest Kolmogorov meeting at Dagstuhl (2006)
Believe it or not - Kolmogorov complexity theory is also relevant for explaining the entire universe! Check out our work on minimal digital physics.
Also check out the complexity-based theory of beauty!
What if we allow for nonhalting computations on nonstandard
Turing machines?
It turns out that some things then become much more
compactly describable. This leads to generalizations
of the concept of Kolmogorov complexity, and
has consequences for
Solomonoff's
theory of algorithmic probability and
universal prediction. It also leads to "Super Omegas"
that are computable in the limit -
generalizations of Chaitin's halting probability
Omega of a Turing machine with random input.
.
J. Schmidhuber. Discovering neural nets with low Kolmogorov complexity and high generalization capability. Neural Networks, 10(5):857-873, 1997. PS.GZ. PDF. HTML.
J. Schmidhuber. Discovering solutions with low Kolmogorov complexity and high generalization capability. In Proc. ICML'95, pages 488-496. Morgan Kaufmann, San Francisco, CA, 1995. PS.GZ. PDF. HTML.
More recent work of 2013: Compressed Network Search Finds Complex Neural Controllers with a Million Weights, learns to drive without a teacher from raw high-dimensional video input
More recent paper on this topic (2006):
A. Chernov, J. Schmidhuber.
Prefix-like Complexities and Computability in the Limit.
Proc. of Second Conference on Computability in Europe, CiE 2006, LNCS 3988, pp. 85-93.
Based on TR IDSIA-11-05: PDF.
Abstract:
Generalized Turing machines (GTMs) are a variant of non-halting Turing machines, by
computational power similar to machines with the oracle for the halting problem. GTMs allow
a definition of a kind of descriptive (Kolmogorov) complexity that is uniform for finite and
infinite sequences. There are several natural modifications of the definition (as there are
several monotone complexities). This paper studies these definitions and compares complexities
defined with the help of GTMs and complexities defined with the help of oracle machines.
Communicated by P. M. B. Vitanyi; available online as preprint IDSIA-05-04: PDF
There even is an art form based on short programs: Low-Complexity Art.