Global Information Lookup Global Information

Exponential family information


In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special form is chosen for mathematical convenience, including the enabling of the user to calculate expectations, covariances using differentiation based on some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural sets of distributions to consider. The term exponential class is sometimes used in place of "exponential family",[1] or the older term Koopman–Darmois family. Sometimes loosely referred to as "the" exponential family, this class of distributions is distinct because they all possess a variety of desirable properties, most importantly the existence of a sufficient statistic.

The concept of exponential families is credited to[2] E. J. G. Pitman,[3] G. Darmois,[4] and B. O. Koopman[5] in 1935–1936. Exponential families of distributions provide a general framework for selecting a possible alternative parameterisation of a parametric family of distributions, in terms of natural parameters, and for defining useful sample statistics, called the natural sufficient statistics of the family.

  1. ^ Kupperman, M. (1958). "Probabilities of hypotheses and information-statistics in sampling from exponential-class populations". Annals of Mathematical Statistics. 9 (2): 571–575. doi:10.1214/aoms/1177706633. JSTOR 2237349.
  2. ^ Andersen, Erling (September 1970). "Sufficiency and Exponential Families for Discrete Sample Spaces". Journal of the American Statistical Association. 65 (331). Journal of the American Statistical Association: 1248–1255. doi:10.2307/2284291. JSTOR 2284291. MR 0268992.
  3. ^ Pitman, E.; Wishart, J. (1936). "Sufficient statistics and intrinsic accuracy". Mathematical Proceedings of the Cambridge Philosophical Society. 32 (4): 567–579. Bibcode:1936PCPS...32..567P. doi:10.1017/S0305004100019307. S2CID 120708376.
  4. ^ Darmois, G. (1935). "Sur les lois de probabilites a estimation exhaustive". C. R. Acad. Sci. Paris (in French). 200: 1265–1266.
  5. ^ Koopman, B. (1936). "On distribution admitting a sufficient statistic". Transactions of the American Mathematical Society. 39 (3). American Mathematical Society: 399–409. doi:10.2307/1989758. JSTOR 1989758. MR 1501854.

and 28 Related for: Exponential family information

Request time (Page generated in 0.8193 seconds.)

Exponential family

Last Update:

In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special...

Word Count : 11136

Natural exponential family

Last Update:

natural exponential family (NEF) is a class of probability distributions that is a special case of an exponential family (EF). The natural exponential families...

Word Count : 1995

Exponential distribution

Last Update:

In probability theory and statistics, the exponential distribution or negative exponential distribution is the probability distribution of the distance...

Word Count : 6567

Exponential

Last Update:

Look up exponential or exponentially in Wiktionary, the free dictionary. Exponential may refer to any of several mathematical topics related to exponentiation...

Word Count : 235

Posterior predictive distribution

Last Update:

plugged in. Most, but not all, common families of distributions are exponential families. Exponential families have a large number of useful properties...

Word Count : 2510

Exponential family random graph models

Last Update:

Exponential Random Graph Models (ERGMs) are a family of statistical models for analyzing data from social and other networks. Examples of networks examined...

Word Count : 3553

Exponential smoothing

Last Update:

Exponential smoothing or exponential moving average (EMA) is a rule of thumb technique for smoothing time series data using the exponential window function...

Word Count : 4308

List of probability distributions

Last Update:

distribution The Marshall–Olkin exponential distribution The continuous-categorical distribution, an exponential family supported on the simplex that generalizes...

Word Count : 2609

Moving average

Last Update:

the weights in the exponential moving average which follows. An exponential moving average (EMA), also known as an exponentially weighted moving average...

Word Count : 2856

Sufficient statistic

Last Update:

theorem, among families of probability distributions whose domain does not vary with the parameter being estimated, only in exponential families is there a...

Word Count : 6668

Exponential dispersion model

Last Update:

probability and statistics, the class of exponential dispersion models (EDM), also called exponential dispersion family (EDF), is a set of probability distributions...

Word Count : 871

Generalized linear model

Last Update:

=g^{-1}(\eta )} . An overdispersed exponential family of distributions is a generalization of an exponential family and the exponential dispersion model of distributions...

Word Count : 4224

Likelihood function

Last Update:

particular since most common probability distributions—notably the exponential family—are only logarithmically concave, and concavity of the objective function...

Word Count : 8522

Gamma distribution

Last Update:

distribution is a versatile two-parameter family of continuous probability distributions. The exponential distribution, Erlang distribution, and chi-squared...

Word Count : 8739

Nonlinear regression

Last Update:

strongly discouraged. For error distributions that belong to the exponential family, a link function may be used to transform the parameters under the...

Word Count : 1394

Laplace distribution

Last Update:

It is also sometimes called the double exponential distribution, because it can be thought of as two exponential distributions (with an additional location...

Word Count : 3033

Variational Bayesian methods

Last Update:

general result whenever the prior distributions are members of the exponential family, which is the case for most of the standard distributions. The above...

Word Count : 11212

List of exponential topics

Last Update:

equation Exponential dispersion model Exponential distribution Exponential error Exponential factorial Exponential family Exponential field Exponential formula...

Word Count : 281

Uniformly most powerful test

Last Update:

problems for which the theorem holds. In particular, the one-dimensional exponential family of probability density functions or probability mass functions with...

Word Count : 1264

Normal distribution

Last Update:

The family of normal distributions not only forms an exponential family (EF), but in fact forms a natural exponential family (NEF) with quadratic...

Word Count : 22383

Rejection sampling

Last Update:

algorithm can be very inefficient. The Natural Exponential Family (if it exists), also known as exponential tilting, provides a class of proposal distributions...

Word Count : 4464

Markov random field

Last Update:

for the network. Any positive Markov random field can be written as exponential family in canonical form with feature functions f k {\displaystyle f_{k}}...

Word Count : 2777

Negative binomial distribution

Last Update:

cases of the Panjer distribution. They are also members of a natural exponential family. Suppose p is unknown and an experiment is conducted where it is decided...

Word Count : 8513

Exponentially modified Gaussian distribution

Last Update:

an exponentially modified Gaussian distribution (EMG, also known as exGaussian distribution) describes the sum of independent normal and exponential random...

Word Count : 1708

Least squares

Last Update:

from an exponential family with identity as its natural sufficient statistics and mild-conditions are satisfied (e.g. for normal, exponential, Poisson...

Word Count : 5515

Exponential tilting

Last Update:

different exponential tiltings of a random variable X {\displaystyle X} is known as the natural exponential family of X {\displaystyle X} . Exponential Tilting...

Word Count : 3855

Pareto distribution

Last Update:

Lomax distribution as a special case. This family also contains both the unshifted and shifted exponential distributions. The Pareto distribution with...

Word Count : 5982

Beta distribution

Last Update:

, n ) = Exponential ⁡ ( 1 ) {\displaystyle \lim _{n\to \infty }n\operatorname {Beta} (1,n)=\operatorname {Exponential} (1)} the exponential distribution...

Word Count : 40380

PDF Search Engine © AllGlobal.net