For broader coverage of this topic, see Bayesian statistics.
Part of a series on
Bayesian statistics
Posterior = Likelihood × Prior ÷ Evidence
Background
Bayesian inference
Bayesian probability
Bayes' theorem
Bernstein–von Mises theorem
Coherence
Cox's theorem
Cromwell's rule
Principle of indifference
Principle of maximum entropy
Model building
Weak prior ... Strong prior
Conjugate prior
Linear regression
Empirical Bayes
Hierarchical model
Posterior approximation
Markov chain Monte Carlo
Laplace's approximation
Integrated nested Laplace approximations
Variational inference
Approximate Bayesian computation
Estimators
Bayesian estimator
Credible interval
Maximum a posteriori estimation
Evidence approximation
Evidence lower bound
Nested sampling
Model evaluation
Bayes factor
Model averaging
Posterior predictive
Mathematics portal
v
t
e
Interpretation of probability
Bayesian probability (/ˈbeɪziən/BAY-zee-ən or /ˈbeɪʒən/BAY-zhən)[1] is an interpretation of the concept of probability, in which, instead of frequency or propensity of some phenomenon, probability is interpreted as reasonable expectation[2] representing a state of knowledge[3] or as quantification of a personal belief.[4]
The Bayesian interpretation of probability can be seen as an extension of propositional logic that enables reasoning with hypotheses;[5][6] that is, with propositions whose truth or falsity is unknown. In the Bayesian view, a probability is assigned to a hypothesis, whereas under frequentist inference, a hypothesis is typically tested without being assigned a probability.
Bayesian probability belongs to the category of evidential probabilities; to evaluate the probability of a hypothesis, the Bayesian probabilist specifies a prior probability. This, in turn, is then updated to a posterior probability in the light of new, relevant data (evidence).[7] The Bayesian interpretation provides a standard set of procedures and formulae to perform this calculation.
The term Bayesian derives from the 18th-century mathematician and theologian Thomas Bayes, who provided the first mathematical treatment of a non-trivial problem of statistical data analysis using what is now known as Bayesian inference.[8]: 131 Mathematician Pierre-Simon Laplace pioneered and popularized what is now called Bayesian probability.[8]: 97–98
^"Bayesian". Merriam-Webster.com Dictionary.
^Cox, R.T. (1946). "Probability, Frequency, and Reasonable Expectation". American Journal of Physics. 14 (1): 1–10. Bibcode:1946AmJPh..14....1C. doi:10.1119/1.1990764.
^Jaynes, E.T. (1986). "Bayesian Methods: General Background". In Justice, J. H. (ed.). Maximum-Entropy and Bayesian Methods in Applied Statistics. Cambridge: Cambridge University Press. CiteSeerX 10.1.1.41.1055.
^de Finetti, Bruno (2017). Theory of Probability: A critical introductory treatment. Chichester: John Wiley & Sons Ltd. ISBN 9781119286370.
^Hailperin, Theodore (1996). Sentential Probability Logic: Origins, Development, Current Status, and Technical Applications. London: Associated University Presses. ISBN 0934223459.
^Howson, Colin (2001). "The Logic of Bayesian Probability". In Corfield, D.; Williamson, J. (eds.). Foundations of Bayesianism. Dordrecht: Kluwer. pp. 137–159. ISBN 1-4020-0223-8.
^Paulos, John Allen (5 August 2011). "The Mathematics of Changing Your Mind [by Sharon Bertsch McGrayne]". Book Review. New York Times. Archived from the original on 2022-01-01. Retrieved 2011-08-06.
^ abStigler, Stephen M. (March 1990). The history of statistics. Harvard University Press. ISBN 9780674403413.
and 27 Related for: Bayesian probability information
Bayesianprobability (/ˈbeɪziən/ BAY-zee-ən or /ˈbeɪʒən/ BAY-zhən) is an interpretation of the concept of probability, in which, instead of frequency...
compute the probabilities of the presence of various diseases. Efficient algorithms can perform inference and learning in Bayesian networks. Bayesian networks...
is used to update the probability for a hypothesis as more evidence or information becomes available. Fundamentally, Bayesian inference uses prior knowledge...
in Bayesian inference, Bayes' theorem can be used to estimate the parameters of a probability distribution or statistical model. Since Bayesian statistics...
posterior probability may serve as the prior in another round of Bayesian updating. In the context of Bayesian statistics, the posterior probability distribution...
variable. In Bayesian statistics, Bayes' rule prescribes how to update the prior with new information to obtain the posterior probability distribution...
payoffs are not common knowledge. Bayesian games model the outcome of player interactions using aspects of Bayesianprobability. They are notable because they...
can work with the naive Bayes model without accepting Bayesianprobability or using any Bayesian methods. Despite their naive design and apparently oversimplified...
Bayesian epistemology is a formal approach to various topics in epistemology that has its roots in Thomas Bayes' work in the field of probability theory...
was his sharp criticism of the alternative "inverse" (subjective, Bayesian) probability interpretation. Any criticism by Gauss or Laplace was muted and...
In Bayesian statistics, a credible interval is an interval used to characterize a probability distribution. It is defined such that an unobserved parameter...
estimate. It is the Bayesian estimate for the same case if certain assumptions are made for the prior distribution of the probability. If a trial yields...
the method of inverse probability (assigning a probability distribution to an unobserved variable) is called Bayesianprobability, the distribution of...
In game theory, a Perfect Bayesian Equilibrium (PBE) is a solution with Bayesianprobability to a turn-based game with incomplete information. More specifically...
reduction is used to find the probability of type I and type II errors. As a point of reference, the complement to this in Bayesian statistics is the minimum...
those of Popper, Miller, Giere and Fetzer). Evidential probability, also called Bayesianprobability, can be assigned to any statement whatsoever, even when...
interpretation is distinguished by its use of a subjective Bayesian account of probabilities to understand the quantum mechanical Born rule as a normative...
Variational Bayesian methods are a family of techniques for approximating intractable integrals arising in Bayesian inference and machine learning. They...
has been integrated over the parameter space. In Bayesian statistics, it represents the probability of generating the observed sample for all possible...
conditional probability and the individual events, is known as Bayes' theorem. This simple expression encapsulates the technical core of Bayesian inference...
series was published posthumously. Bayesianprobability is the name given to several related interpretations of probability as an amount of epistemic confidence...
{\beta }}} . In the Bayesian approach, the data are supplemented with additional information in the form of a prior probability distribution. The prior...
Bayesian inference of phylogeny combines the information in the prior and in the data likelihood to create the so-called posterior probability of trees...
Bayesian experimental design provides a general probability-theoretical framework from which other theories on experimental design can be derived. It...
In probability theory, statistics, and machine learning, recursive Bayesian estimation, also known as a Bayes filter, is a general probabilistic approach...
processing of sensory information using methods approximating those of Bayesianprobability. This field of study has its historical roots in numerous disciplines...