1. Neuroscience
Download icon

Response-based outcome predictions and confidence regulate feedback processing and learning

  1. Romy Frömer  Is a corresponding author
  2. Matthew R Nassar
  3. Rasmus Bruckner
  4. Birgit Stürmer
  5. Werner Sommer
  6. Nick Yeung
  1. Brown University, United States
  2. Freie University, Germany
  3. International Psychoanalytic University Berlin, Germany
  4. Humboldt Universität zu Berlin, Germany
  5. University of Oxford, United Kingdom
Research Article
  • Cited 0
  • Views 767
  • Annotations
Cite this article as: eLife 2021;10:e62825 doi: 10.7554/eLife.62825

Abstract

Influential theories emphasize the importance of predictions in learning: we learn from feedback to the extent that it is surprising, and thus conveys new information. Here we explore the hypothesis that surprise depends not only on comparing current events to past experience, but also on online evaluation of performance via internal monitoring. Specifically, we propose that people leverage insights from response-based performance monitoring – outcome predictions and confidence – to control learning from feedback. In line with predictions from a Bayesian inference model, we find that people who are better at calibrating their confidence to the precision of their outcome predictions learn more quickly. Further in line with our proposal, EEG signatures of feedback processing are sensitive to the accuracy of, and confidence in, post-response outcome predictions. Taken together, our results suggest that online predictions and confidence serve to calibrate neural error signals to improve the efficiency of learning.

Data availability

Scripts and source data for all analyses are available under https://github.com/froemero/Outcome-Predictions-and-Confidence-Regulate-Learning.

Article and author information

Author details

  1. Romy Frömer

    Cognitive, Linguistic & Psychological Sciences, Brown University, Providence, United States
    For correspondence
    romy_fromer@brown.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9468-4014
  2. Matthew R Nassar

    Robert J and Nancy D Carney Institute for Brain Science, Brown University, Providence, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-5397-535X
  3. Rasmus Bruckner

    Department of Education and Psychology, Freie University, Berlin, Germany
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-3033-6299
  4. Birgit Stürmer

    General Psychology and Neurocognitive Psychology, International Psychoanalytic University Berlin, Berlin, Germany
    Competing interests
    The authors declare that no competing interests exist.
  5. Werner Sommer

    Psychology, Humboldt Universität zu Berlin, Berlin, Germany
    Competing interests
    The authors declare that no competing interests exist.
  6. Nick Yeung

    University of Oxford, Oxford, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.

Funding

NIH Office of the Director (R00 AG054732)

  • Matthew R Nassar

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: The study was performed following the guidelines of the ethics committee of the department of Psychology at Humboldt University. Participants gave informed consent to the experiment and were remunerated with course credits or 8 € per hour.

Reviewing Editor

  1. Tadeusz Wladyslaw Kononowicz, Cognitive Neuroimaging Unit, CEA DRF/Joliot, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, France

Publication history

  1. Received: September 4, 2020
  2. Accepted: April 30, 2021
  3. Accepted Manuscript published: April 30, 2021 (version 1)

Copyright

© 2021, Frömer et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 767
    Page views
  • 149
    Downloads
  • 0
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Download citations (links to download the citations from this article in formats compatible with various reference manager tools)

Open citations (links to open the citations from this article in various online reference manager services)

Further reading

    1. Neuroscience
    Yu Takagi et al.
    Research Article

    Choices rely on a transformation of sensory inputs into motor responses. Using invasive single neuron recordings, the evolution of a choice process has been tracked by projecting population neural responses into state spaces. Here we develop an approach that allows us to recover similar trajectories on a millisecond timescale in non-invasive human recordings. We selectively suppress activity related to three task-axes, relevant and irrelevant sensory inputs and response direction in magnetoencephalography data acquired during context-dependent choices. Recordings from premotor cortex show a progression from processing sensory input to processing the response. In contrast to previous macaque recordings, information related to choice-irrelevant features is represented more weakly than choice-relevant sensory information. To test whether this mechanistic difference between species is caused by extensive overtraining common in non-human primate studies, we trained humans on >20,000 trials of the task. Choice-irrelevant features were still weaker than relevant features in premotor cortex after overtraining.

    1. Cell Biology
    2. Neuroscience
    Vladimir Zhemkov et al.
    Research Article

    Sigma 1 receptor (S1R) is a 223-amino-acid-long transmembrane endoplasmic reticulum (ER) protein. S1R modulates activity of multiple effector proteins and is a well-established drug target. However, signaling functions of S1R in cells are poorly understood. Here, we test the hypothesis that biological activity of S1R in cells can be explained by its ability to interact with cholesterol and to form cholesterol-enriched microdomains in the ER membrane. By performing experiments in reduced reconstitution systems, we demonstrate direct effects of cholesterol on S1R clustering. We identify a novel cholesterol-binding motif in the transmembrane region of human S1R. Mutations of this motif impair association of recombinant S1R with cholesterol beads, affect S1R clustering in vitro and disrupt S1R subcellular localization. We demonstrate that S1R-induced membrane microdomains have increased local membrane thickness and that increased local cholesterol concentration and/or membrane thickness in these microdomains can modulate signaling of inositol-requiring enzyme 1α in the ER. Further, S1R agonists cause disruption of S1R clusters, suggesting that biological activity of S1R agonists is linked to remodeling of ER membrane microdomains. Our results provide novel insights into S1R-mediated signaling mechanisms in cells.