Uncertainty alters the balance between incremental learning and episodic memory
Abstract
A key question in decision making is how humans arbitrate between competing learning and memory systems to maximize reward. We address this question by probing the balance between the effects, on choice, of incremental trial-and-error learning versus episodic memories of individual events. Although a rich literature has studied incremental learning in isolation, the role of episodic memory in decision making has only recently drawn focus, and little research disentangles their separate contributions. We hypothesized that the brain arbitrates rationally between these two systems, relying on each in circumstances to which it is most suited, as indicated by uncertainty. We tested this hypothesis by directly contrasting contributions of episodic and incremental influence to decisions, while manipulating the relative uncertainty of incremental learning using a well-established manipulation of reward volatility. Across two large, independent samples of young adults, participants traded these influences off rationally, depending more on episodic information when incremental summaries were more uncertain. These results support the proposal that the brain optimizes the balance between different forms of learning and memory according to their relative uncertainties and elucidate the circumstances under which episodic memory informs decisions.
Data availability
All code, data, and software needed to reproduce the manuscript can be found here: https://codeocean.com/capsule/2024716/tree/v1; DOI: https://doi.org/10.24433/CO.1266819.v1
-
Uncertainty alters the balance between incremental learning and episodic memoryCode Ocean, https://doi.org/10.24433/CO.1266819.v1.
Article and author information
Author details
Funding
National Science Foundation (1644869)
- Jonathan Nicholas
National Science Foundation (1822619)
- Nathaniel D Daw
National Science Foundation (1822619)
- Daphna Shohamy
National Institutes of Health (MH121093)
- Nathaniel D Daw
National Institutes of Health (MH121093)
- Daphna Shohamy
John Templeton Foundation (60844)
- Daphna Shohamy
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Ethics
Human subjects: Informed consent was obtained online with approval from the Columbia University Institutional Review Board (IRB #1488)
Copyright
© 2022, Nicholas et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,290
- views
-
- 361
- downloads
-
- 11
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Sleep loss increases AMPA-synaptic strength and number in the neocortex. However, this is only part of the synaptic sleep loss response. We report an increased AMPA/NMDA EPSC ratio in frontal-cortical pyramidal neurons of layers 2–3. Silent synapses are absent, decreasing the plastic potential to convert silent NMDA to active AMPA synapses. These sleep loss changes are recovered by sleep. Sleep genes are enriched for synaptic shaping cellular components controlling glutamate synapse phenotype, overlap with autism risk genes, and are primarily observed in excitatory pyramidal neurons projecting intra-telencephalically. These genes are enriched with genes controlled by the transcription factor, MEF2c, and its repressor, HDAC4. Sleep genes can thus provide a framework within which motor learning and training occur mediated by the sleep-dependent oscillation of glutamate-synaptic phenotypes.
-
- Neuroscience
The amygdala is a subcortical region in the mesiotemporal lobe that plays a key role in emotional and sensory functions. Conventional neuroimaging experiments treat this structure as a single, uniform entity, but there is ample histological evidence for subregional heterogeneity in microstructure and function. The current study characterized subregional structure-function coupling in the human amygdala, integrating post-mortem histology and in vivo MRI at ultra-high fields. Core to our work was a novel neuroinformatics approach that leveraged multiscale texture analysis as well as non-linear dimensionality reduction techniques to identify salient dimensions of microstructural variation in a 3D post-mortem histological reconstruction of the human amygdala. We observed two axes of subregional variation in this region, describing inferior-superior as well as mediolateral trends in microstructural differentiation that in part recapitulated established atlases of amygdala subnuclei. Translating our approach to in vivo MRI data acquired at 7 Tesla, we could demonstrate the generalizability of these spatial trends across 10 healthy adults. We then cross-referenced microstructural axes with functional blood-oxygen-level dependent (BOLD) signal analysis obtained during task-free conditions, and revealed a close association of structural axes with macroscale functional network embedding, notably the temporo-limbic, default mode, and sensory-motor networks. Our novel multiscale approach consolidates descriptions of amygdala anatomy and function obtained from histological and in vivo imaging techniques.