man in dark background with the words "open data" floating with blue lines and illustrations

Open and Reproducible Research Terms and Definitions

ORR Terms and Definitions

Open science in the form of open publication, open data, and open code supports the ability of researchers to confirm and reproduce findings. 
 

— National Academies of Sciences, Engineering, and Medicine

We define reproducible research as work that can be independently recreated from the same data and the same code that the original team used. Reproducible is distinct from replicable, robust and generalisable as described in the figure below.

Reproducible matrix

Source: The Turing Way

Reproducibility

Reproducibility is obtaining consistent results using the same input data, computational steps, methods, and code, and conditions of analysis. This definition is synonymous with “computational reproducibility.

National Academies of Sciences, Engineering, and Medicine. (2019). 

Reproducibility and Replicability in Science. National Academies Press.

Replicability

Replicability is obtaining consistent results across studies aimed at answering the same scientific question, each of which has obtained its own data. Two studies may be considered to have replicated if they obtain consistent results given the level of uncertainty inherent in the system under study

National Academies of Sciences, Engineering, and Medicine. (2019). 

Reproducibility and Replicability in Science. National Academies Press

Open Science

Open science is a global movement that aims to make scientific research and its outcomes freely accessible to everyone.

Center for Open Science

Open Research Practices

By fostering practices like data sharing and preregistration, open science not only accelerates scientific progress but also strengthens trust in research findings.

Center for Open Science

Gold Standards Science

As detailed in Executive Order 14303, Gold Standard Science refers to science conducted in a manner that is:

  • Reproducible
  • Transparent
  • Communicative of error and uncertainty
  • Collaborative and interdisciplinary
  • Skeptical of its findings and assumptions
  • Structured for falsifiability of hypotheses
  • Subject to unbiased peer review
  • Accepting of negative results as positive outcomes
  • Without conflicts of interest.

What is Gold Standard Science?

Schedule Office Hours

Schedule yours today and we will be in touch quickly to assist you.

Schedule office hours

Email Us

Contact us to learn how we can support your research journey.

Email us