Science Forum: How failure to falsify in high-volume science contributes to the replication crisis
Abstract
The number of scientific papers published every year continues to increase, but scientific knowledge is not progressing at the same rate. Here we argue that a greater emphasis on falsification - the direct testing of strong hypotheses - would lead to faster progress by allowing well-specified hypotheses to be eliminated. We describe an example from neuroscience where there has been little work to directly test two prominent but incompatible hypotheses related to traumatic brain injury. Based on this example, we discuss how building strong hypotheses and then setting out to falsify them can bring greater precision to the clinical neurosciences, and argue that this approach could be beneficial to all areas of science.
Data availability
There are no data associated with this article.
Article and author information
Author details
Funding
The authors declare that there was no funding for this work.
Copyright
© 2022, Rajtmajer et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,031
- views
-
- 489
- downloads
-
- 7
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Although grid cells are one of the most well-studied functional classes of neurons in the mammalian brain, whether there is a single orientation and spacing value per grid module has not been carefully tested. We analyze a recent large-scale recording of medial entorhinal cortex to characterize the presence and degree of heterogeneity of grid properties within individual modules. We find evidence for small, but robust, variability and hypothesize that this property of the grid code could enhance the encoding of local spatial information. Performing analysis on synthetic populations of grid cells, where we have complete control over the amount heterogeneity in grid properties, we demonstrate that grid property variability of a similar magnitude to the analyzed data leads to significantly decreased decoding error. This holds even when restricted to activity from a single module. Our results highlight how the heterogeneity of the neural response properties may benefit coding and opens new directions for theoretical and experimental analysis of grid cells.
-
- Neuroscience
Childhood adversity is a strong predictor of developing psychopathological conditions. Multiple theories on the mechanisms underlying this association have been suggested which, however, differ in the operationalization of ‘exposure.’ Altered (threat) learning mechanisms represent central mechanisms by which environmental inputs shape emotional and cognitive processes and ultimately behavior. 1402 healthy participants underwent a fear conditioning paradigm (acquisition training, generalization), while acquiring skin conductance responses (SCRs) and ratings (arousal, valence, and contingency). Childhood adversity was operationalized as (1) dichotomization, and following (2) the specificity model, (3) the cumulative risk model, and (4) the dimensional model. Individuals exposed to childhood adversity showed blunted physiological reactivity in SCRs, but not ratings, and reduced CS+/CS- discrimination during both phases, mainly driven by attenuated CS+ responding. The latter was evident across different operationalizations of ‘exposure’ following the different theories. None of the theories tested showed clear explanatory superiority. Notably, a remarkably different pattern of increased responding to the CS- is reported in the literature for anxiety patients, suggesting that individuals exposed to childhood adversity may represent a specific sub-sample. We highlight that theories linking childhood adversity to (vulnerability to) psychopathology need refinement.