Neuroscout, a unified platform for generalizable andreproducible fMRI research
Abstract
Functional magnetic resonance imaging (fMRI) has revolutionized cognitive neuroscience, but methodological barriers limit the generalizability of findings from the lab to the real world. Here, we present Neuroscout, an end-to-end platform for analysis of naturalistic fMRI data designed to facilitate the adoption of robust and generalizable research practices. Neuroscout leverages state-of-the-art machine learning models to automatically annotate stimuli from dozens of fMRI studies using naturalistic stimuli-such as movies and narratives-allowing researchers to easily test neuroscientific hypotheses across multiple ecologically-valid datasets. In addition, Neuroscout builds on a robust ecosystem of open tools and standards to provide an easy-to-use analysis builder and a fully automated execution engine that reduce the burden of reproducible research. Through a series of meta-analytic case studies, we validate the automatic feature extraction approach and demonstrate its potential to support more robust fMRI research. Owing to its ease of use and a high degree of automation, Neuroscout makes it possible to overcome modeling challenges commonly arising in naturalistic analysis and to easily scale analyses within and across datasets, democratizing generalizable fMRI research.
Data availability
All code from our processing pipeline and core infrastructure is available online (https://www.github.com/neuroscout/neuroscout). An online supplement including all analysis code and resulting images is available as a public GitHub repository (https://github.com/neuroscout/neuroscout-paper).All analysis results are made publicly available in a public GitHub repository
-
studyforrestOpenNeuro, doi:10.18112/ openneuro.ds000113 .v1.3.0.
-
Learning Temporal StructureOpenNeuro, doi:10.18112/ openneuro.ds001545.v1.1.1.
-
SherlockOpenNeuro, doi:10.18112/ openneuro.ds001132.v1.0.0.
-
Schematic NarrativeOpenNeuro, doi:10.18112/ openneuro.ds001510.v2.0.2.
-
ParanoiaStoryOpenNeuro, doi:10.18112/openneuro.ds001338 .v1.0.0.
-
BudapestOpenNeuro, doi:10.18112/ openneuro.ds003017.v1.0.3.
-
Naturalistic Neuroimaging Databasedoi:10.18112/openneuro.ds002837.v2.0.0OpenNeuro,.
-
NarrativesOpenNeuro, doi:10.18112/openneuro.ds002345 .v1.1.4.
Article and author information
Author details
Funding
National Institute of Mental Health (R01MH109682)
- Alejandro de la Vega
- Roberta Rocca
- Ross W Blair
- Christopher J Markiewicz
- Jeff Mentch
- James D Kent
- Peer Herholz
- Satrajit S Ghosh
- Russell A Poldrack
- Tal Yarkoni
National Institute of Mental Health (R01MH096906)
- Alejandro de la Vega
- James D Kent
- Tal Yarkoni
National Institute of Mental Health (R24MH117179)
- Peer Herholz
- Satrajit S Ghosh
National Institute of Mental Health (R24MH117179)
- Ross W Blair
- Christopher J Markiewicz
- Russell A Poldrack
Canada First Research Excellence Fund
- Peer Herholz
Brain Canada Fondation
- Peer Herholz
Unifying Neuroscience and Artificial Intelligence - Québec
- Peer Herholz
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Copyright
© 2022, de la Vega et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,326
- views
-
- 233
- downloads
-
- 6
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
The brain predicts regularities in sensory inputs at multiple complexity levels, with neuronal mechanisms that remain elusive. Here, we monitored auditory cortex activity during the local-global paradigm, a protocol nesting different regularity levels in sound sequences. We observed that mice encode local predictions based on stimulus occurrence and stimulus transition probabilities, because auditory responses are boosted upon prediction violation. This boosting was due to both short-term adaptation and an adaptation-independent surprise mechanism resisting anesthesia. In parallel, and only in wakefulness, VIP interneurons responded to the omission of the locally expected sound repeat at the sequence ending, thus providing a chunking signal potentially useful for establishing global sequence structure. When this global structure was violated, by either shortening the sequence or ending it with a locally expected but globally unexpected sound transition, activity slightly increased in VIP and PV neurons, respectively. Hence, distinct cellular mechanisms predict different regularity levels in sound sequences.
-
- Neuroscience
Multisensory integration (MSI) combines information from multiple sensory modalities to create a coherent perception of the world. In contexts where sensory information is limited or equivocal, it also allows animals to integrate individually ambiguous stimuli into a clearer or more accurate percept and, thus, react with a more adaptive behavioral response. Although responses to multisensory stimuli have been described at the neuronal and behavioral levels, a causal or direct link between these two is still missing. In this study, we studied the integration of audiovisual inputs in the Mauthner cell, a command neuron necessary and sufficient to trigger a stereotypical escape response in fish. We performed intracellular recordings in adult goldfish while presenting a diverse range of stimuli to determine which stimulus properties affect their integration. Our results show that stimulus modality, intensity, temporal structure, and interstimulus delay affect input summation. Mechanistically, we found that the distinct decay dynamics of FFI triggered by auditory and visual stimuli can account for certain aspects of input integration. Altogether, this is a rare example of the characterization of MSI in a cell with clear behavioral relevance, providing both phenomenological and mechanistic insights into how MSI depends on stimulus properties.