This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. Find sources: "Mean reciprocal rank" – news · newspapers · books · scholar · JSTOR(June 2007) (Learn how and when to remove this message)
The mean reciprocal rank is a statistic measure for evaluating any process that produces a list of possible responses to a sample of queries, ordered by probability of correctness. The reciprocal rank of a query response is the multiplicative inverse of the rank of the first correct answer: 1 for first place, 1⁄2 for second place, 1⁄3 for third place and so on. The mean reciprocal rank is the average of the reciprocal ranks of results for a sample of queries Q:[1][2]
where refers to the rank position of the first relevant document for the i-th query.
The reciprocal value of the mean reciprocal rank corresponds to the harmonic mean of the ranks.
^E.M. Voorhees (1999). "Proceedings of the 8th Text Retrieval Conference" (PDF). TREC-8 Question Answering Track Report. pp. 77–82.
^D. R. Radev; H. Qi; H. Wu; W. Fan (2002). "Evaluating web-based question answering systems" (PDF). Proceedings of LREC.
and 23 Related for: Mean reciprocal rank information
The meanreciprocalrank is a statistic measure for evaluating any process that produces a list of possible responses to a sample of queries, ordered by...
{1}{|Q|}}\sum _{q\in Q}{q}} The smaller the value, the better the model. Meanreciprocalrank measures the number of triples predicted correctly. If the first...
denotes that the metrics are evaluated only on top n documents; Meanreciprocalrank; Kendall's tau; Spearman's rho. DCG and its normalized variant NDCG...
mean μ {\displaystyle \mu } is real-valued. The mean of this transformed random variable (reciprocal shifted normal distribution) is then indeed the scaled...
(A4540) in England Mackay Ring Road, a proposed bypass route of Mackay Meanreciprocalrank, a search quality measure in information retrieval Modulating retro-reflector...
average rate is desired. The harmonic mean can be expressed as the reciprocal of the arithmetic mean of the reciprocals of the given set of observations....
(disambiguation) Mean difference Mean integrated squared error Mean of circular quantities Mean percentage error Mean preserving spread MeanreciprocalrankMean signed...
absolutely on a strictly positive scale. Harmonic mean the reciprocal of the arithmetic mean of the reciprocals of the data values. This measure too is valid...
does not mean the loss of the game. A draw by agreement was reached eleven moves later. Hooper 1970, p. 21 A special case of zugzwang is reciprocal zugzwang...
random variable expected about its mean. A low standard deviation indicates that the values tend to be close to the mean (also called the expected value)...
{\displaystyle \sigma ^{2}} . The precision is normally defined as the reciprocal of the variance, 1 / σ 2 {\displaystyle 1/\sigma ^{2}} . The formula for...
along with a reciprocal link; trackback is used most often for this purpose. Also, the word trackback is often used colloquially to mean any kind of linkback...
dependence of the mean free path has an exponential form e Θ / b T {\displaystyle {e}^{\Theta /bT}} . The presence of the reciprocal lattice wave vector...
statistics, the coefficient of variation (CV), also known as normalized root-mean-square deviation (NRMSD), percent RMS, and relative standard deviation (RSD)...
the derivative of the inverse function at b {\displaystyle b} is the reciprocal of the derivative of f {\displaystyle f} at a {\displaystyle a} : ( f...
not always exist. For example, there is no unbiased estimator for the reciprocal of the parameter of a binomial random variable. Suppose we have a statistical...
a reciprocal standard normal distribution, and there is no definable variance. However, in the slightly more general case of a shifted reciprocal function...
Kothari, 2004). The median, i.e. middle-ranked, item is allowed as the measure of central tendency; however, the mean (or average) as the measure of central...
correlated real-valued random variables, each of which clusters around a mean value. The multivariate normal distribution of a k-dimensional random vector...
left to right. If each division is replaced with multiplication by the reciprocal (multiplicative inverse) then the associative and commutative laws of...
extended uses, especially in non-scientific contexts, where it is used to mean defining characteristics or boundaries, as in the phrases 'test parameters'...
method is suitable directly, but the generalized order of magnitude of the reciprocal can be considered. Similar to the logarithmic scale one can have a double...
k=1/\left(\Phi ^{-1}(3/4)\right)\approx 1/0.67449\approx 1.4826,} i.e., the reciprocal of the quantile function Φ − 1 {\displaystyle \Phi ^{-1}} (also known...