Science Forum: How failure to falsify in high-volume science contributes to the replication crisis

  1. Sarah M Rajtmajer
  2. Timothy M Errington
  3. Frank G Hillary  Is a corresponding author
  1. Pennsylvania State University, United States
  2. Center for Open Science, United States

Abstract

The number of scientific papers published every year continues to increase, but scientific knowledge is not progressing at the same rate. Here we argue that a greater emphasis on falsification - the direct testing of strong hypotheses - would lead to faster progress by allowing well-specified hypotheses to be eliminated. We describe an example from neuroscience where there has been little work to directly test two prominent but incompatible hypotheses related to traumatic brain injury. Based on this example, we discuss how building strong hypotheses and then setting out to falsify them can bring greater precision to the clinical neurosciences, and argue that this approach could be beneficial to all areas of science.

Data availability

There are no data associated with this article.

Article and author information

Author details

  1. Sarah M Rajtmajer

    College of Information Sciences and Technology, Pennsylvania State University, University Park, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-1464-0848
  2. Timothy M Errington

    Center for Open Science, Charlottesville, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-4959-5143
  3. Frank G Hillary

    Department of Psychology, Pennsylvania State University, University Park, United States
    For correspondence
    fhillary@psu.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-1427-0218

Funding

The authors declare that there was no funding for this work.

Copyright

© 2022, Rajtmajer et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,031
    views
  • 489
    downloads
  • 7
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Sarah M Rajtmajer
  2. Timothy M Errington
  3. Frank G Hillary
(2022)
Science Forum: How failure to falsify in high-volume science contributes to the replication crisis
eLife 11:e78830.
https://doi.org/10.7554/eLife.78830
  1. Further reading

Further reading

    1. Neuroscience
    William T Redman, Santiago Acosta-Mendoza ... Michael J Goard
    Research Article

    Although grid cells are one of the most well-studied functional classes of neurons in the mammalian brain, whether there is a single orientation and spacing value per grid module has not been carefully tested. We analyze a recent large-scale recording of medial entorhinal cortex to characterize the presence and degree of heterogeneity of grid properties within individual modules. We find evidence for small, but robust, variability and hypothesize that this property of the grid code could enhance the encoding of local spatial information. Performing analysis on synthetic populations of grid cells, where we have complete control over the amount heterogeneity in grid properties, we demonstrate that grid property variability of a similar magnitude to the analyzed data leads to significantly decreased decoding error. This holds even when restricted to activity from a single module. Our results highlight how the heterogeneity of the neural response properties may benefit coding and opens new directions for theoretical and experimental analysis of grid cells.

    1. Neuroscience
    Maren Klingelhöfer-Jens, Katharina Hutterer ... Tina B Lonsdorf
    Research Article

    Childhood adversity is a strong predictor of developing psychopathological conditions. Multiple theories on the mechanisms underlying this association have been suggested which, however, differ in the operationalization of ‘exposure.’ Altered (threat) learning mechanisms represent central mechanisms by which environmental inputs shape emotional and cognitive processes and ultimately behavior. 1402 healthy participants underwent a fear conditioning paradigm (acquisition training, generalization), while acquiring skin conductance responses (SCRs) and ratings (arousal, valence, and contingency). Childhood adversity was operationalized as (1) dichotomization, and following (2) the specificity model, (3) the cumulative risk model, and (4) the dimensional model. Individuals exposed to childhood adversity showed blunted physiological reactivity in SCRs, but not ratings, and reduced CS+/CS- discrimination during both phases, mainly driven by attenuated CS+ responding. The latter was evident across different operationalizations of ‘exposure’ following the different theories. None of the theories tested showed clear explanatory superiority. Notably, a remarkably different pattern of increased responding to the CS- is reported in the literature for anxiety patients, suggesting that individuals exposed to childhood adversity may represent a specific sub-sample. We highlight that theories linking childhood adversity to (vulnerability to) psychopathology need refinement.