Family of probability distributions related to the normal distribution
Not to be confused with the exponential distribution.
"Natural parameter" redirects here. For use of this term in differential geometry, see Natural parametrization.
In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special form is chosen for mathematical convenience, including the enabling of the user to calculate expectations, covariances using differentiation based on some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural sets of distributions to consider. The term exponential class is sometimes used in place of "exponential family",[1] or the older term Koopman–Darmois family.
Sometimes loosely referred to as "the" exponential family, this class of distributions is distinct because they all possess a variety of desirable properties, most importantly the existence of a sufficient statistic.
The concept of exponential families is credited to[2] E. J. G. Pitman,[3] G. Darmois,[4] and B. O. Koopman[5] in 1935–1936. Exponential families of distributions provide a general framework for selecting a possible alternative parameterisation of a parametric family of distributions, in terms of natural parameters, and for defining useful sample statistics, called the natural sufficient statistics of the family.
^Kupperman, M. (1958). "Probabilities of hypotheses and information-statistics in sampling from exponential-class populations". Annals of Mathematical Statistics. 9 (2): 571–575. doi:10.1214/aoms/1177706633. JSTOR 2237349.
^Andersen, Erling (September 1970). "Sufficiency and Exponential Families for Discrete Sample Spaces". Journal of the American Statistical Association. 65 (331). Journal of the American Statistical Association: 1248–1255. doi:10.2307/2284291. JSTOR 2284291. MR 0268992.
^Pitman, E.; Wishart, J. (1936). "Sufficient statistics and intrinsic accuracy". Mathematical Proceedings of the Cambridge Philosophical Society. 32 (4): 567–579. Bibcode:1936PCPS...32..567P. doi:10.1017/S0305004100019307. S2CID 120708376.
^Darmois, G. (1935). "Sur les lois de probabilites a estimation exhaustive". C. R. Acad. Sci. Paris (in French). 200: 1265–1266.
^Koopman, B. (1936). "On distribution admitting a sufficient statistic". Transactions of the American Mathematical Society. 39 (3). American Mathematical Society: 399–409. doi:10.2307/1989758. JSTOR 1989758. MR 1501854.
and 28 Related for: Exponential family information
In probability and statistics, an exponentialfamily is a parametric set of probability distributions of a certain form, specified below. This special...
natural exponentialfamily (NEF) is a class of probability distributions that is a special case of an exponentialfamily (EF). The natural exponential families...
In probability theory and statistics, the exponential distribution or negative exponential distribution is the probability distribution of the distance...
Look up exponential or exponentially in Wiktionary, the free dictionary. Exponential may refer to any of several mathematical topics related to exponentiation...
plugged in. Most, but not all, common families of distributions are exponentialfamilies. Exponentialfamilies have a large number of useful properties...
Exponential Random Graph Models (ERGMs) are a family of statistical models for analyzing data from social and other networks. Examples of networks examined...
Exponential smoothing or exponential moving average (EMA) is a rule of thumb technique for smoothing time series data using the exponential window function...
distribution The Marshall–Olkin exponential distribution The continuous-categorical distribution, an exponentialfamily supported on the simplex that generalizes...
the weights in the exponential moving average which follows. An exponential moving average (EMA), also known as an exponentially weighted moving average...
theorem, among families of probability distributions whose domain does not vary with the parameter being estimated, only in exponentialfamilies is there a...
probability and statistics, the class of exponential dispersion models (EDM), also called exponential dispersion family (EDF), is a set of probability distributions...
=g^{-1}(\eta )} . An overdispersed exponentialfamily of distributions is a generalization of an exponentialfamily and the exponential dispersion model of distributions...
particular since most common probability distributions—notably the exponentialfamily—are only logarithmically concave, and concavity of the objective function...
distribution is a versatile two-parameter family of continuous probability distributions. The exponential distribution, Erlang distribution, and chi-squared...
strongly discouraged. For error distributions that belong to the exponentialfamily, a link function may be used to transform the parameters under the...
It is also sometimes called the double exponential distribution, because it can be thought of as two exponential distributions (with an additional location...
general result whenever the prior distributions are members of the exponentialfamily, which is the case for most of the standard distributions. The above...
equation Exponential dispersion model Exponential distribution Exponential error Exponential factorial ExponentialfamilyExponential field Exponential formula...
problems for which the theorem holds. In particular, the one-dimensional exponentialfamily of probability density functions or probability mass functions with...
algorithm can be very inefficient. The Natural ExponentialFamily (if it exists), also known as exponential tilting, provides a class of proposal distributions...
for the network. Any positive Markov random field can be written as exponentialfamily in canonical form with feature functions f k {\displaystyle f_{k}}...
cases of the Panjer distribution. They are also members of a natural exponentialfamily. Suppose p is unknown and an experiment is conducted where it is decided...
an exponentially modified Gaussian distribution (EMG, also known as exGaussian distribution) describes the sum of independent normal and exponential random...
from an exponentialfamily with identity as its natural sufficient statistics and mild-conditions are satisfied (e.g. for normal, exponential, Poisson...
different exponential tiltings of a random variable X {\displaystyle X} is known as the natural exponentialfamily of X {\displaystyle X} . Exponential Tilting...
Lomax distribution as a special case. This family also contains both the unshifted and shifted exponential distributions. The Pareto distribution with...