Estimator or decision rule that minimizes the posterior expected value of a loss function
This article includes a list of general references, but it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations.(November 2009) (Learn how and when to remove this message)
Part of a series on
Bayesian statistics
Posterior = Likelihood × Prior ÷ Evidence
Background
Bayesian inference
Bayesian probability
Bayes' theorem
Bernstein–von Mises theorem
Coherence
Cox's theorem
Cromwell's rule
Principle of indifference
Principle of maximum entropy
Model building
Weak prior ... Strong prior
Conjugate prior
Linear regression
Empirical Bayes
Hierarchical model
Posterior approximation
Markov chain Monte Carlo
Laplace's approximation
Integrated nested Laplace approximations
Variational inference
Approximate Bayesian computation
Estimators
Bayesian estimator
Credible interval
Maximum a posteriori estimation
Evidence approximation
Evidence lower bound
Nested sampling
Model evaluation
Bayes factor
Model averaging
Posterior predictive
Mathematics portal
v
t
e
In estimation theory and decision theory, a Bayes estimator or a Bayes action is an estimator or decision rule that minimizes the posterior expected value of a loss function (i.e., the posterior expected loss). Equivalently, it maximizes the posterior expectation of a utility function. An alternative way of formulating an estimator within Bayesian statistics is maximum a posteriori estimation.
In estimation theory and decision theory, a Bayesestimator or a Bayes action is an estimator or decision rule that minimizes the posterior expected value...
high-dimensional. Empirical Bayes methods can be seen as an approximation to a fully Bayesian treatment of a hierarchical Bayes model. In, for example, a...
unique Bayesestimator, it is also the unique minimax estimator. π {\displaystyle \pi \,\!} is least favorable. Corollary: If a Bayesestimator has constant...
\\\end{cases}}} as c {\displaystyle c} goes to 0, the Bayesestimator approaches the MAP estimator, provided that the distribution of θ {\displaystyle \theta...
relate to statistical methods based on Bayes' theorem, or a follower of these methods. Bayes action – Estimator or decision rule that minimizes the posterior...
and religious leader Walter Bayes (1869–1956), British painter Bayesian probability, Bayes' theorem, and Bayesestimator, concepts in probability and...
posterior mean estimator is: p ^ b = x + α n + α + β . {\displaystyle {\widehat {p}}_{b}={\frac {x+\alpha }{n+\alpha +\beta }}.} The Bayesestimator is asymptotically...
naive Bayes models are known under a variety of names, including simple Bayes and independence Bayes. All these names reference the use of Bayes' theorem...
errors, the Bayes Decision rule can be reformulated as: h Bayes = a r g m a x w [ P ( x ∣ w ) P ( w ) ] , {\displaystyle h_{\text{Bayes}}={\underset...
not be improper since the Bayes factor will be undefined if either of the two integrals in its ratio is not finite. The Bayes factor is the ratio of two...
In statistics, the bias of an estimator (or bias function) is the difference between this estimator's expected value and the true value of the parameter...
MMSE estimator. Commonly used estimators (estimation methods) and topics related to them include: Maximum likelihood estimatorsBayesestimators Method...
algorithm. Out of sample prediction in regression and classification models. Admissible decision rule Bayesestimator Classification rule Scoring rule...
interested in estimating the shape of this function ƒ. Its kernel density estimator is f ^ h ( x ) = 1 n ∑ i = 1 n K h ( x − x i ) = 1 n h ∑ i = 1 n K ( x...
theoretic framework is the Bayesestimator in the presence of a prior distribution Π . {\displaystyle \Pi \ .} An estimator is Bayes if it minimizes the average...
Hodges–Lehmann estimator is a robust and highly efficient estimator of the population median; for non-symmetric distributions, the Hodges–Lehmann estimator is a...
is called a Bayes rule with respect to π ( θ ) {\displaystyle \pi (\theta )\,\!} . There may be more than one such Bayes rule. If the Bayes risk is infinite...