Global Information Lookup Global Information

Kolmogorov structure function information


In 1973, Andrey Kolmogorov proposed a non-probabilistic approach to statistics and model selection. Let each datum be a finite binary string and a model be a finite set of binary strings. Consider model classes consisting of models of given maximal Kolmogorov complexity. The Kolmogorov structure function of an individual data string expresses the relation between the complexity level constraint on a model class and the least log-cardinality of a model in the class containing the data. The structure function determines all stochastic properties of the individual data string: for every constrained model class it determines the individual best-fitting model in the class irrespective of whether the true model is in the model class considered or not. In the classical case we talk about a set of data with a probability distribution, and the properties are those of the expectations. In contrast, here we deal with individual data strings and the properties of the individual string focused on. In this setting, a property holds with certainty rather than with high probability as in the classical case. The Kolmogorov structure function precisely quantifies the goodness-of-fit of an individual model with respect to individual data.

The Kolmogorov structure function is used in the algorithmic information theory, also known as the theory of Kolmogorov complexity, for describing the structure of a string by use of models of increasing complexity.

and 23 Related for: Kolmogorov structure function information

Request time (Page generated in 0.8731 seconds.)

Kolmogorov structure function

Last Update:

classes consisting of models of given maximal Kolmogorov complexity. The Kolmogorov structure function of an individual data string expresses the relation...

Word Count : 2704

Andrey Kolmogorov

Last Update:

described by Kolmogorov's turbulence law Kolmogorov structure function Kolmogorov–Uspenskii machine model Kolmogorov's zero–one law Kolmogorov–Zurbenko filter...

Word Count : 2780

Kolmogorov complexity

Last Update:

information theory (a subfield of computer science and mathematics), the Kolmogorov complexity of an object, such as a piece of text, is the length of a shortest...

Word Count : 7151

Kolmogorov space

Last Update:

mathematics, a topological space X is a T0 space or Kolmogorov space (named after Andrey Kolmogorov) if for every pair of distinct points of X, at least...

Word Count : 1797

Sufficient statistic

Last Update:

statistic, although it is restricted to linear estimators. The Kolmogorov structure function deals with individual finite data; the related notion there...

Word Count : 6668

Function space

Last Update:

mathematics, a function space is a set of functions between two fixed sets. Often, the domain and/or codomain will have additional structure which is inherited...

Word Count : 1177

Injective function

Last Update:

between algebraic structures is a function that is compatible with the operations of the structures. For all common algebraic structures, and, in particular...

Word Count : 2499

Stochastic process

Last Update:

distributions going back to the 1920s. In a 1932 paper, Kolmogorov derived a characteristic function for random variables associated with Lévy processes....

Word Count : 17935

Empirical distribution function

Last Update:

{F}}_{n}-F\|_{\infty }>z{\Big )}\leq 2e^{-2z^{2}}.} In fact, Kolmogorov has shown that if the cumulative distribution function F is continuous, then the expression n ‖ F...

Word Count : 1519

Turbulence

Last Update:

the "Kolmogorov −5/3 spectrum" is generally observed in turbulence. However, for high order structure functions, the difference with the Kolmogorov scaling...

Word Count : 5400

Minimum description length

Last Update:

Rissanen bases the mathematical underpinning of MDL on the Kolmogorov structure function. According to the MDL philosophy, Bayesian methods should be...

Word Count : 2924

Trophic function

Last Update:

A trophic function was first introduced in the differential equations of the Kolmogorov predator–prey model. It generalizes the linear case of predator–prey...

Word Count : 578

Kolmogorov Medal

Last Update:

The Kolmogorov Medal is a prize awarded to distinguished researchers with life-long contributions to one of the fields initiated by Andrey Kolmogorov. The...

Word Count : 238

List of terms relating to algorithms and data structures

Last Update:

Knuth–Morris–Pratt algorithm Königsberg bridges problem Kolmogorov complexity Kraft's inequality Kripke structure Kruskal's algorithm kth order Fibonacci numbers...

Word Count : 3134

Likelihood function

Last Update:

likelihood function (often simply called the likelihood) is the joint probability mass (or probability density) of observed data viewed as a function of the...

Word Count : 8542

Universal approximation theorem

Last Update:

estimates depending on the regularity of the target function and of the activation function. The Kolmogorov–Arnold representation theorem is similar in spirit...

Word Count : 4909

Computability theory

Last Update:

characteristic function of a subset of the natural numbers) is random or not by invoking a notion of randomness for finite objects. Kolmogorov complexity...

Word Count : 6419

Energy cascade

Last Update:

result is equivalent to a Fourier transform of Kolmogorov's 1941 result for the turbulent structure function. The pressure fluctuations in a turbulent flow...

Word Count : 1397

Computable function

Last Update:

finitary functions on the natural numbers is uncountable so most are not computable. Concrete examples of such functions are Busy beaver, Kolmogorov complexity...

Word Count : 3393

No free lunch in search and optimization

Last Update:

possible functions (in the set-theoretic sense of "function") are Kolmogorov random, and hence the NFL theorems apply to a set of functions almost all...

Word Count : 3264

History of the function concept

Last Update:

completely arbitrary function can be expanded in Fourier series, even if its Fourier coefficients are well-defined. For example, Kolmogorov (1922) constructed...

Word Count : 10640

Tychonoff space

Last Update:

regular spaces and Tychonoff spaces are related through the notion of Kolmogorov equivalence. A topological space is Tychonoff if and only if it's both...

Word Count : 1895

Algorithmic information theory

Last Update:

Recursive Functions". Journal of the ACM. 14 (2): 322–336. doi:10.1145/321386.321395. S2CID 15710280. Burgin, M. (1982). "Generalized Kolmogorov complexity...

Word Count : 2611

PDF Search Engine © AllGlobal.net