Global Information Lookup Global Information

Mean reciprocal rank information


The mean reciprocal rank is a statistic measure for evaluating any process that produces a list of possible responses to a sample of queries, ordered by probability of correctness. The reciprocal rank of a query response is the multiplicative inverse of the rank of the first correct answer: 1 for first place, 12 for second place, 13 for third place and so on. The mean reciprocal rank is the average of the reciprocal ranks of results for a sample of queries Q:[1][2]

where refers to the rank position of the first relevant document for the i-th query.

The reciprocal value of the mean reciprocal rank corresponds to the harmonic mean of the ranks.

  1. ^ E.M. Voorhees (1999). "Proceedings of the 8th Text Retrieval Conference" (PDF). TREC-8 Question Answering Track Report. pp. 77–82.
  2. ^ D. R. Radev; H. Qi; H. Wu; W. Fan (2002). "Evaluating web-based question answering systems" (PDF). Proceedings of LREC.

and 23 Related for: Mean reciprocal rank information

Request time (Page generated in 0.8602 seconds.)

Mean reciprocal rank

Last Update:

The mean reciprocal rank is a statistic measure for evaluating any process that produces a list of possible responses to a sample of queries, ordered by...

Word Count : 311

Knowledge graph embedding

Last Update:

{1}{|Q|}}\sum _{q\in Q}{q}} The smaller the value, the better the model. Mean reciprocal rank measures the number of triples predicted correctly. If the first...

Word Count : 6011

Learning to rank

Last Update:

denotes that the metrics are evaluated only on top n documents; Mean reciprocal rank; Kendall's tau; Spearman's rho. DCG and its normalized variant NDCG...

Word Count : 3789

Inverse distribution

Last Update:

mean μ {\displaystyle \mu } is real-valued. The mean of this transformed random variable (reciprocal shifted normal distribution) is then indeed the scaled...

Word Count : 1710

MRR

Last Update:

(A4540) in England Mackay Ring Road, a proposed bypass route of Mackay Mean reciprocal rank, a search quality measure in information retrieval Modulating retro-reflector...

Word Count : 234

Harmonic mean

Last Update:

average rate is desired. The harmonic mean can be expressed as the reciprocal of the arithmetic mean of the reciprocals of the given set of observations....

Word Count : 5959

List of statistics articles

Last Update:

(disambiguation) Mean difference Mean integrated squared error Mean of circular quantities Mean percentage error Mean preserving spread Mean reciprocal rank Mean signed...

Word Count : 8290

Central tendency

Last Update:

absolutely on a strictly positive scale. Harmonic mean the reciprocal of the arithmetic mean of the reciprocals of the data values. This measure too is valid...

Word Count : 1718

Zugzwang

Last Update:

does not mean the loss of the game. A draw by agreement was reached eleven moves later. Hooper 1970, p. 21 A special case of zugzwang is reciprocal zugzwang...

Word Count : 4933

Standard deviation

Last Update:

random variable expected about its mean. A low standard deviation indicates that the values tend to be close to the mean (also called the expected value)...

Word Count : 7602

Normal distribution

Last Update:

{\displaystyle \sigma ^{2}} . The precision is normally defined as the reciprocal of the variance, 1 / σ 2 {\displaystyle 1/\sigma ^{2}} . The formula for...

Word Count : 22359

Linkback

Last Update:

along with a reciprocal link; trackback is used most often for this purpose. Also, the word trackback is often used colloquially to mean any kind of linkback...

Word Count : 205

Thermal conductivity and resistivity

Last Update:

dependence of the mean free path has an exponential form e Θ / b T {\displaystyle {e}^{\Theta /bT}} . The presence of the reciprocal lattice wave vector...

Word Count : 8353

Coefficient of variation

Last Update:

statistics, the coefficient of variation (CV), also known as normalized root-mean-square deviation (NRMSD), percent RMS, and relative standard deviation (RSD)...

Word Count : 4017

Inverse function theorem

Last Update:

the derivative of the inverse function at b {\displaystyle b} is the reciprocal of the derivative of f {\displaystyle f} at a {\displaystyle a} : ( f...

Word Count : 6894

Bias of an estimator

Last Update:

not always exist. For example, there is no unbiased estimator for the reciprocal of the parameter of a binomial random variable. Suppose we have a statistical...

Word Count : 5349

Propagation of uncertainty

Last Update:

a reciprocal standard normal distribution, and there is no definable variance. However, in the slightly more general case of a shifted reciprocal function...

Word Count : 3982

Level of measurement

Last Update:

Kothari, 2004). The median, i.e. middle-ranked, item is allowed as the measure of central tendency; however, the mean (or average) as the measure of central...

Word Count : 4671

Multivariate normal distribution

Last Update:

correlated real-valued random variables, each of which clusters around a mean value. The multivariate normal distribution of a k-dimensional random vector...

Word Count : 9474

Order of operations

Last Update:

left to right. If each division is replaced with multiplication by the reciprocal (multiplicative inverse) then the associative and commutative laws of...

Word Count : 4367

Parameter

Last Update:

extended uses, especially in non-scientific contexts, where it is used to mean defining characteristics or boundaries, as in the phrases 'test parameters'...

Word Count : 2944

Order of magnitude

Last Update:

method is suitable directly, but the generalized order of magnitude of the reciprocal can be considered. Similar to the logarithmic scale one can have a double...

Word Count : 1700

Median absolute deviation

Last Update:

k=1/\left(\Phi ^{-1}(3/4)\right)\approx 1/0.67449\approx 1.4826,} i.e., the reciprocal of the quantile function Φ − 1 {\displaystyle \Phi ^{-1}} (also known...

Word Count : 1095

PDF Search Engine © AllGlobal.net