This article is about the reproducibility of scientific research results. For reproductive capacity of organisms, see fertility and fecundity. For reproducibility in the context of computer software, see Reproducible builds.
Reproducibility, closely related to replicability and repeatability, is a major principle underpinning the scientific method. For the findings of a study to be reproducible means that results obtained by an experiment or an observational study or in a statistical analysis of a data set should be achieved again with a high degree of reliability when the study is replicated. There are different kinds of replication[1] but typically replication studies involve different researchers using the same methodology. Only after one or several such successful replications should a result be recognized as scientific knowledge.
With a narrower scope, reproducibility has been defined in computational sciences as having the following quality: the results should be documented by making all data and code available in such a way that the computations can be executed again with identical results.
In recent decades, there has been a rising concern that many published scientific results fail the test of reproducibility, evoking a reproducibility or replication crisis.
^Tsang, Eric W. K.; Kwan, Kai-man (1999). "Replication and Theory Development in Organizational Science: A Critical Realist Perspective". Academy of Management Review. 24 (4): 759–780. doi:10.5465/amr.1999.2553252. ISSN 0363-7425.
fail the test of reproducibility, evoking a reproducibility or replication crisis. The first to stress the importance of reproducibility in science was...
Not to Be Reproduced (La reproduction interdite, 1937) is a painting by the Belgian surrealist René Magritte. It is currently owned by the Museum Boijmans...
The Reproducibility Project is a series of crowdsourced collaborations aiming to reproduce published scientific studies, finding high rates of results...
empirical research practice. Considerations about reproducibility fall into two categories. Reproducibility in the narrow sense refers to re-examining and...
replicability and reproducibility. Alternative taxonomies have proposed to make do entirely with the ambiguity of reproducibility/replicability/repeatability...
official packages reproducible. According to the Reproducible Builds project, timestamps are "the biggest source of reproducibility issues. Many build...
In computing, a minimal reproducible example (abbreviated MRE) is a collection of source code and other data files which allow a bug or problem to be demonstrated...
work in reproducibility of psychology research, with the large-scale initiative Reproducibility Project: Psychology. A second reproducibility project...
The original essay, "The Work of Art in the Age of its Technological Reproducibility", was published in three editions: (i) the German edition, "Das Kunstwerk...
In functional analysis (a branch of mathematics), a reproducing kernel Hilbert space (RKHS) is a Hilbert space of functions in which point evaluation...
journals, reproducibility and replicability of the scientific results are core concepts that allow other scientists to check and reproduce the results...
Retrieved 2018-05-25. Reproducibility is key in science. In The Logic of Scientific Discovery, Karl Popper wrote, "non-reproducible single occurrences are...
inventor in Germany, Edwin Welte, was working on a player which would reproduce all aspects of a performance automatically, so that the machine would...
claiming that this has led to a reproducibility crisis in recommender systems publications. The topic of reproducibility seems to be a recurrent issue in...
coefficient measures the agreement between two variables, e.g., to evaluate reproducibility or for inter-rater reliability. The form of the concordance correlation...
reproduction: asexual and sexual. In asexual reproduction, an organism can reproduce without the involvement of another organism. Asexual reproduction is not...
crystallography. Researchers demonstrated a way of semi-automated testing for reproducibility: statements about experimental results were extracted from, as of 2022...
research. Some psychological research has suffered from bias, problematic reproducibility, and misuse of statistics. These findings have led to calls for reform...
race, reproductive justice, and law. She is best known for her book, Reproducing Race: An Ethnography of Pregnancy as a Site of Racialization, in which...
Unicellular eukaryotes are sometimes called protists. Eukaryotes can reproduce both asexually through mitosis and sexually through meiosis and gamete...
designed to simultaneously evaluate the impact of repeatability and reproducibility on accuracy. It allows the analyst to examine the responses from multiple...
not consistent and reproducible at the present time. (...) Internal inconsistencies and lack of predictability and reproducibility remain serious concerns...
models hardware agnostic. In 2019, Lightning was adopted by the NeurIPS Reproducibility Challenge as a standard for submitting PyTorch code to the conference...
cephalometric plane should have good reliability, good individual reproducibility, and be as close to true horizontal plane and true vertical plane as...
A male organism cannot reproduce sexually without access to at least one ovum from a female, but some organisms can reproduce both sexually and asexually...
Global Information