Statistical analyses that were not specified before the data were seen
Not to be confused with Post hoc theorizing.
In a scientific study, post hoc analysis (from Latin post hoc, "after this") consists of statistical analyses that were specified after the data were seen.[1][2] They are usually used to uncover specific differences between three or more group means when an analysis of variance (ANOVA) test is significant.[3] This typically creates a multiple testing problem because each potential analysis is effectively a statistical test. Multiple testing procedures are sometimes used to compensate, but that is often difficult or impossible to do precisely. Post hoc analysis that is conducted and interpreted without adequate consideration of this problem is sometimes called data dredging by critics because the statistical associations that it finds are often spurious.[4]
Post hoc analyses are not inherently bad or good;[5]: 12–13 rather, the main requirement for their ethical use is simply that their results not be mispresented as the original hypothesis.[5]: 12–13 Modern editions of scientific manuals have clarified this point; for example, APA style now specifies that "hypotheses should now be stated in three groupings: preplanned–primary, preplanned–secondary, and exploratory (post hoc). Exploratory hypotheses are allowable, and there should be no pressure to disguise them as if they were preplanned."[5]: 12–13
^"What is the significance and use of post-hoc analysis studies?". www.cwauthors.com. Retrieved 2022-12-09.
^"11.8: Post Hoc Tests". Statistics LibreTexts. 2019-11-12. Retrieved 2022-12-09.
^"SAGE Research Methods - The SAGE Encyclopedia of Communication Research Methods". methods.sagepub.com. Retrieved 2022-12-09.
^Zhang, Yiran; Hedo, Rita; Rivera, Anna; Rull, Rudolph; Richardson, Sabrina; Tu, Xin M. (2019-08-01). "Post hoc power analysis: is it an informative and meaningful analysis?". General Psychiatry. 32 (4): e100069. doi:10.1136/gpsych-2019-100069. ISSN 2517-729X. PMC 6738696.
^ abcAmerican Psychological Association (2020). Publication Manual of the American Psychological Association: the Official Guide to APA Style (7th ed.). Washington, DC: American Psychological Association. ISBN 978-1433832178.
In a scientific study, posthocanalysis (from Latin posthoc, "after this") consists of statistical analyses that were specified after the data were seen...
event". Posthoc may refer to: Posthocanalysis or posthoc test, statistical analyses that were not specified before the data were seen Posthoc theorizing...
small. Power analysis can either be done before (a priori or prospective power analysis) or after (posthoc or retrospective power analysis) data are collected...
post-hocanalysis after Friedman. Friedman, Milton (December 1937). "The use of ranks to avoid the assumption of normality implicit in the analysis of...
interest, but any contributing competing equilibria associated to it. A post-hocanalysis can be performed to determine the buffer or solvent-independent enthalpy...
results of their test; inappropriate forms of posthocanalysis or posthoc theorizing then may lead to a posthoc hypothesis. Several types of HARKing have...
phrase cum hoc ergo propter hoc ('with this, therefore because of this'). This differs from the fallacy known as posthoc ergo propter hoc ("after this...
any change point(s) occurred in the series. This is an example of posthocanalysis and is often approached using hypothesis testing methods. By contrast...
require researchers to decide on a procedure and analysis before data has been collected (see posthocanalysis and #Misuse). Many regression methods are naturally...
"Effect of monthly vitamin D on diverticular disease hospitalization: Post-hocanalysis of a randomized controlled trial - Clinical Nutrition". Jovani M,...
statin therapy had a lower risk of all-cause mortality. However, data (posthocanalysis) on atorvastatin has revealed that it may still be beneficial in reducing...
data verification on data quality in clinical trials: an empirical posthocanalysis of three phase 3 randomized clinical trials". Br J Clin Pharmacol...
in mortality and hospitalization in heart failure: a comprehensive posthocanalysis of the DIG trial". European Heart Journal. 27 (2): 178–86. doi:10...
intervals can be easily extracted. Preserving the PDF also allows for post-hocanalysis (e.g., pair-wise comparisons of gene set activity) while maintaining...
that encourage publication bias and inappropriate/excessive forms of posthocanalysis; it involves two peer review steps: one before results reporting (to...
particles, under which conditions atheroma growth rates are high. A posthocanalysis of the IDEAL and the EPIC prospective studies found an association...
(June 2014). "Effect of cessation interventions on hookah smoking: post-hocanalysis of a cluster-randomized controlled trial". Nicotine & Tobacco Research...
PMC 4242982. PMID 24699894. Levesque V, Chong EM, Moneuse P (2013). "Post-hocanalysis of pharmacodynamic interaction of PA21 with statins in a Phase 3 study...
Wigal SB, Spencer TJ, McGough JJ, Mays DA (February 2006). "A posthoc subgroup analysis of an 18-day randomized controlled trial comparing the tolerability...
random or vague stimuli Posthocanalysis – Statistical analyses that were not specified before the data were seen Posthoc theorizing – Problem of circular...
segmentation analysis, especially if they lack the statistical skills to undertake the analysis. Some segmentation, especially post-hocanalysis, relies on...
concerns over meta-analysis in science and medicine also apply to problems present in parapsychological meta-analysis. As a post-hocanalysis, critics emphasize...
2012.09.057. PMID 23391196. Retrieved 5 April 2016. We undertook a post-hocanalysis of data from the ROCKET AF (Rivaroxaban Once-Daily, Oral, Direct Factor...