Response-based outcome predictions and confidence regulate feedback processing and learning
Abstract
Influential theories emphasize the importance of predictions in learning: we learn from feedback to the extent that it is surprising, and thus conveys new information. Here we explore the hypothesis that surprise depends not only on comparing current events to past experience, but also on online evaluation of performance via internal monitoring. Specifically, we propose that people leverage insights from response-based performance monitoring – outcome predictions and confidence – to control learning from feedback. In line with predictions from a Bayesian inference model, we find that people who are better at calibrating their confidence to the precision of their outcome predictions learn more quickly. Further in line with our proposal, EEG signatures of feedback processing are sensitive to the accuracy of, and confidence in, post-response outcome predictions. Taken together, our results suggest that online predictions and confidence serve to calibrate neural error signals to improve the efficiency of learning.
Data availability
Scripts and source data for all analyses are available under https://github.com/froemero/Outcome-Predictions-and-Confidence-Regulate-Learning.
Article and author information
Author details
Funding
NIH Office of the Director (R00 AG054732)
- Matthew R Nassar
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Ethics
Human subjects: The study was performed following the guidelines of the ethics committee of the department of Psychology at Humboldt University. Participants gave informed consent to the experiment and were remunerated with course credits or 8 € per hour.
Copyright
© 2021, Frömer et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 3,439
- views
-
- 487
- downloads
-
- 32
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Evolutionary Biology
- Neuroscience
The first complete 3D reconstruction of the compound eye of a minute wasp species sheds light on the nuts and bolts of size reduction.
-
- Neuroscience
Early-life stress can have lifelong consequences, enhancing stress susceptibility and resulting in behavioural and cognitive deficits. While the effects of early-life stress on neuronal function have been well-described, we still know very little about the contribution of non-neuronal brain cells. Investigating the complex interactions between distinct brain cell types is critical to fully understand how cellular changes manifest as behavioural deficits following early-life stress. Here, using male and female mice we report that early-life stress induces anxiety-like behaviour and fear generalisation in an amygdala-dependent learning and memory task. These behavioural changes were associated with impaired synaptic plasticity, increased neural excitability, and astrocyte hypofunction. Genetic perturbation of amygdala astrocyte function by either reducing astrocyte calcium activity or reducing astrocyte network function was sufficient to replicate cellular, synaptic, and fear memory generalisation associated with early-life stress. Our data reveal a role of astrocytes in tuning emotionally salient memory and provide mechanistic links between early-life stress, astrocyte hypofunction, and behavioural deficits.