American inventor of algorithmic probability and artificial intelligence researcher
Ray Solomonoff (July 25, 1926 – December 7, 2009)[1][2] was an American mathematician who invented algorithmic probability,[3] his General Theory of Inductive Inference (also known as Universal Inductive Inference),[4] and was a founder of algorithmic information theory.[5] He was an originator of the branch of artificial intelligence based on machine learning, prediction and probability. He circulated the first report on non-semantic machine learning in 1956.[6]
Solomonoff first described algorithmic probability in 1960, publishing the theorem that launched Kolmogorov complexity and algorithmic information theory. He first described these results at a conference at Caltech in 1960,[7] and in a report, Feb. 1960, "A Preliminary Report on a General Theory of Inductive Inference."[8] He clarified these ideas more fully in his 1964 publications, "A Formal Theory of Inductive Inference," Part I[9] and Part II.[10]
Algorithmic probability is a mathematically formalized combination of Occam's razor,[11][12][13][14] and the Principle of Multiple Explanations.[15]
It is a machine independent method of assigning a probability value to each hypothesis (algorithm/program) that explains a given observation, with the simplest hypothesis (the shortest program) having the highest probability and the increasingly complex hypotheses receiving increasingly small probabilities.
Solomonoff founded the theory of universal inductive inference, which is based on solid philosophical foundations[4] and has its root in Kolmogorov complexity and algorithmic information theory. The theory uses algorithmic probability in a Bayesian framework. The universal prior is taken over the class of all computable measures; no hypothesis will have a zero probability. This enables Bayes' rule (of causation) to be used to predict the most likely next event in a series of events, and how likely it will be.[10]
Although he is best known for algorithmic probability and his general theory of inductive inference, he made many other important discoveries throughout his life, most of them directed toward his goal in artificial intelligence: to develop a machine that could solve hard problems using probabilistic methods.
^"Ray Solomonoff, 1926–2009 « The Third Conference on Artificial General Intelligence". Archived from the original on 2011-08-07. Retrieved 2009-12-12.
^Markoff, John (January 9, 2010). "Ray Solomonoff, Pioneer in Artificial Intelligence, Dies at 83". The New York Times. Retrieved January 11, 2009.
^ abSamuel Rathmanner and Marcus Hutter. A philosophical treatise of universal induction. Entropy, 13(6):1076–1136, 2011.
^Vitanyi, P. "Obituary: Ray Solomonoff, Founding Father of Algorithmic Information Theory"
^"An Inductive Inference Machine", Dartmouth College, N.H., version of Aug. 14, 1956. (pdf scanned copy of the original)
^Paper from conference on "Cerebral Systems and Computers", California Institute of Technology, Feb 8–11, 1960, cited in "A Formal Theory of Inductive Inference, Part 1, 1964, p. 1.
^Solomonoff, R., "A Preliminary Report on a General Theory of Inductive Inference", Report V-131, Zator Co., Cambridge, Ma. Feb 4, 1960, revision, Nov., 1960.
^Solomonoff, R., "A Formal Theory of Inductive Inference, Part I" Information and Control, Vol 7, No. 1 pp 1–22, March 1964.
^ abSolomonoff, R., "A Formal Theory of Inductive Inference, Part II" Information and Control, Vol 7, No. 2 pp 224–254, June 1964.
^Induction: From Kolmogorov and Solomonoff to De Finetti and Back to Kolmogorov
JJ McCall – Metroeconomica, 2004 – Wiley Online Library.
^Foundations of Occam's razor and parsimony in learning
from ricoh.com D Stork – NIPS 2001 Workshop, 2001
^Occam's razor as a formal basis for a physical theory
from arxiv.org AN Soklakov – Foundations of Physics Letters, 2002 – Springer
^Beyond the Turing Test from uclm.es J HERNANDEZ-ORALLO – Journal of Logic, Language, and …, 2000 – dsi.uclm.es
^Ming Li and Paul Vitanyi, An Introduction to Kolmogorov Complexity and Its Applications. Springer-Verlag, N.Y., 2008p 339 ff.
RaySolomonoff (July 25, 1926 – December 7, 2009) was an American mathematician who invented algorithmic probability, his General Theory of Inductive Inference...
There were 47 people listed. Solomonoff, however, made a complete list in his notes of the summer project: RaySolomonoff Marvin Minsky John McCarthy Claude...
as algorithmic (Solomonoff–Kolmogorov–Chaitin, Kolmogorov or program-size) complexity together with Andrei Kolmogorov and RaySolomonoff. Along with the...
known as Solomonoff probability, is a mathematical method of assigning a prior probability to a given observation. It was invented by RaySolomonoff in the...
ISBN 9789332543515. RaySolomonoff, An Inductive Inference Machine, IRE Convention Record, Section on Information Theory, Part 2, pp., 56–62, 1957. RaySolomonoff, An...
founders of the algebraic theory of error detection and correction RaySolomonoff, algorithmic information theory Richard Stallman, designed the GNU operating...
(in fact it is normal). Algorithmic information theory was founded by RaySolomonoff, who published the basic ideas on which the field is based as part of...
Vapnik and Alexey Chervonenkis; Inductive inference as developed by RaySolomonoff; Algorithmic learning theory, from the work of E. Mark Gold; Online...
Scale of Artificial Intelligence", artificial intelligence researcher RaySolomonoff articulated mathematically the related notion of what he called an "infinity...
ISBN 0-471-03003-1. RaySolomonoff, An Inductive Inference Machine, IRE Convention Record, Section on Information Theory, Part 2, pp., 56–62, 1957. RaySolomonoff, "An...
Intelligence". In 1956, at the original Dartmouth AI summer conference, RaySolomonoff wrote a report on unsupervised probabilistic machine learning: "An Inductive...
characterisation until, perhaps, a stable situation is reached. Around 1960, RaySolomonoff founded the theory of universal inductive inference, a theory of prediction...
the random model. Another use, under the name "random net", was by RaySolomonoff and Anatol Rapoport in 1951, using a model of directed graphs with fixed...
cybernetics and the influence of Norbert Wiener. The participants included RaySolomonoff, Oliver Selfridge, Trenchard More, Arthur Samuel, Allen Newell and Herbert...
Herbert A. Simon – Edward Feigenbaum – Raj Reddy – Seymour Papert – RaySolomonoff – Douglas Hofstadter – Judea Pearl – Rodney Brooks – Yoshua Bengio –...
this field include Andrey Kolmogorov and his student Per Martin-Löf, RaySolomonoff, and Gregory Chaitin. For the notion of infinite sequence, mathematicians...
after Andrey Kolmogorov, he said that the seeds of that idea are due to RaySolomonoff. Andrey Kolmogorov contributed a lot to this area but in later articles...
to specify the object. The concept was independently introduced by RaySolomonoff, Andrey Kolmogorov and Gregory Chaitin in the 1960s. Early 1960s: The...
probabilities. It was unclear where these prior probabilities should come from. RaySolomonoff developed algorithmic probability which gave an explanation for what...
the 50th year meeting of the Dartmouth Conference with Marvin Minsky, RaySolomonoff, Geoffrey Hinton and Simon Osindero he presented The Future of Network...
Sheffield (born 1973) Albert Shiryaev (born 1934) Yakov Sinai (born 1935) RaySolomonoff (1926–2009) Frank Spitzer (1926–1992) Ruslan L. Stratonovich (1930–1997)...
House of Representatives Troy Smith – Heisman Trophy winner, NFL player RaySolomonoff – Founder of Artificial Intelligence Ollie Welf – Major League Baseball...
known as Solomonoff probability, is a mathematical method of assigning a prior probability to a given observation. It was invented by RaySolomonoff in the...
needed to specify the object, and is also known as algorithmic complexity, Solomonoff–Kolmogorov–Chaitin complexity, program-size complexity, descriptive complexity...
Virginia (sponsored by the AAAI and Ray Kurzweil's KurzweilAI.net); Lugano, Switzerland (In Memoriam RaySolomonoff and sponsored by the AAAI and KurzweilAI);...
opera and concert (d. 2022) Beatriz Segall, Brazilian actress (d. 2018) RaySolomonoff, American inventor (d. 2009) July 26 – James Best, American actor and...
Solich, football player and current head coach for Ohio University RaySolomonoff, founder of artificial intelligence Charles Somers, coal and baseball...
Global Information