Sequence Prediction based on Monotone Complexity
Marcus Hutter
Abstract
This paper studies sequence prediction based on the monotone Kolmogorov complexity Km=-log m, i.e. based on universal deterministic/one-part MDL. m is extremely close to Solomonoff's prior M, the latter being an excellent predictor in deterministic as well as probabilistic environments, where performance is measured in terms of convergence of posteriors or losses. Despite this closeness to M, it is difficult to assess the prediction quality of m, since little is known about the closeness of their posteriors, which are the important quantities for prediction. We show that for deterministic computable environments, the "posterior" and losses of m converge, but rapid convergence could only be shown on-sequence; the off-sequence behavior is unclear. In probabilistic environments, neither the posterior nor the losses converge, in general.
Create a lesson
Related papers
From AutoResearch to Continual AutoResearch: Do Agents Learn Across Tasks?
Jeremy Qin, Ruizhi Deng, Mohamed Osama Ahmed et al.
The Platonic Brain: Representational Convergence in EEG Foundation Models
Nicolas Waehner, Enzo Tagliazucchi, Jacobo Sitt et al.
LatentTriad: Pre-Action Risk Representations for Malicious Agent Skill Detection
Zhe Yu, Yi Liu, Ying Zhang et al.
ALBI: LLM-Guided Inductive Logic Programming via Iterative Generate-Test-Constrain Refineme
Aboubaker Seddiq Benterki, Jüri Vain, Gert Kanter et al.
Artifact-to-Capability: Diagnosing Breaks in Capability Formation of Self-Evolving Agents in a Controlled Environment
Ziqian Ban, Haoxiang Yang, Yanfei Zhang et al.
FourSight: Stable FP4 RL Post-Training via Sequence Filtering and Sparse Channel Compensation
Yining Wei, Tianyuan Wu, Gu Gong et al.