Software tool designed to detect statistical reporting errors
Statcheck is an R package designed to detect statistical errors in peer-reviewed psychology articles[1] by searching papers for statistical results, redoing the calculations described in each paper, and comparing the two values to see if they match.[2] It takes advantage of the fact that psychological research papers tend to report their results in accordance with the guidelines published by the American Psychological Association (APA).[3] This leads to several disadvantages: it can only detect results reported completely and in exact accordance with the APA's guidelines,[4] and it cannot detect statistics that are only included in tables in the paper.[5] Another limitation is that Statcheck cannot deal with statistical corrections to test statistics, like Greenhouse–Geisser or Bonferroni corrections, which actually make tests more conservative.[6] Some journals have begun piloting Statcheck as part of their peer review process. Statcheck is free software published under the GNU GPL v3.[7]
^Nuijten, Michèle B. (2017-02-28). "BayesMed and statcheck". Aps Observer. 30 (3). Retrieved 2018-10-18.
^Wren, Jonathan D. (2018-06-15). "Algorithmically outsourcing the detection of statistical errors and other problems". The EMBO Journal. 37 (12): e99651. doi:10.15252/embj.201899651. ISSN 0261-4189. PMC 6003655. PMID 29794111.
^van der Zee, Tim; Anaya, Jordan; Brown, Nicholas J. L. (2017-07-10). "Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab". BMC Nutrition. 3 (1): 54. doi:10.1186/s40795-017-0167-x. ISSN 2055-0928. PMC 7050813. PMID 32153834.
^Schmidt, Thomas (2016). "Sources of false positives and false negatives in the Statcheck algorithm". arXiv:1610.01010 [q-bio.QM].
^"Statcheck/DESCRIPTION at master · MicheleNuijten/Statcheck". GitHub.
Statcheck is an R package designed to detect statistical errors in peer-reviewed psychology articles by searching papers for statistical results, redoing...
Elsevier journal content. The data was collected using the R package "statcheck". Elsevier is one of the most prolific publishers of books aimed at expanding...
Misuse of p-values Misleading graph Post hoc analysis Simpson's paradox Statcheck Some data on accuracy of polls is available. Regarding one important poll...
bias Reporting bias Scholarly method Sternberg peer review controversy Statcheck Kupferschmidt K (August 14, 2018). "Researcher at the center of an epic...
runs the Meta-Research Center at his university. Work by the group on Statcheck has been featured in The Guardian. Wicherts received his master's degree...