Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala

  1. Lauren Y Atlas  Is a corresponding author
  2. Bradley B Doll
  3. Jian Li
  4. Nathaniel D Daw
  5. Elizabeth A Phelps
  1. National Institutes of Health, United States
  2. New York University, United States
  3. Peking University, China
  4. Princeton University, United States

Abstract

Socially-conveyed rules and instructions strongly shape expectations and emotions. Yet most neuroscientific studies of learning consider reinforcement history alone, irrespective of knowledge acquired through other means. We examined fear conditioning and reversal in humans to test whether instructed knowledge modulates the neural mechanisms of feedback-driven learning. One group was informed about contingencies and reversals. A second group learned only from reinforcement. We combined quantitative models with functional magnetic resonance imaging and found that instructions induced dissociations in the neural systems of aversive learning. Responses in striatum and orbitofrontal cortex updated with instructions and correlated with prefrontal responses to instructions. Amygdala responses were influenced by reinforcement similarly in both groups and did not update with instructions. Results extend work on instructed reward learning and reveal novel dissociations that have not been observed with punishments or rewards. Findings support theories of specialized threat-detection and may have implications for fear maintenance in anxiety.

Article and author information

Author details

  1. Lauren Y Atlas

    National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, United States
    For correspondence
    lauren.atlas@nih.gov
    Competing interests
    The authors declare that no competing interests exist.
  2. Bradley B Doll

    Center for Neural Sciences, New York University, New York, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Jian Li

    Department of Psychology, Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
    Competing interests
    The authors declare that no competing interests exist.
  4. Nathaniel D Daw

    Department of Psychology, Princeton Neuroscience Institute, Princeton University, Princeton, United States
    Competing interests
    The authors declare that no competing interests exist.
  5. Elizabeth A Phelps

    Center for Neural Sciences, New York University, New York, United States
    Competing interests
    The authors declare that no competing interests exist.

Ethics

Human subjects: Informed consent was obtained from all subjects. Research was approved by New York University's Institutional Review Board.

Copyright

This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.

Metrics

  • 3,455
    views
  • 786
    downloads
  • 75
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Lauren Y Atlas
  2. Bradley B Doll
  3. Jian Li
  4. Nathaniel D Daw
  5. Elizabeth A Phelps
(2016)
Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala
eLife 5:e15192.
https://doi.org/10.7554/eLife.15192

Share this article

https://doi.org/10.7554/eLife.15192

Further reading

    1. Neuroscience
    David C Williams, Amanda Chu ... Michael A McDannald
    Research Advance

    Recognizing and responding to threat cues is essential to survival. Freezing is a predominant threat behavior in rats. We have recently shown that a threat cue can organize diverse behaviors beyond freezing, including locomotion (Chu et al., 2024). However, that experimental design was complex, required many sessions, and had rats receive many foot shock presentations. Moreover, the findings were descriptive. Here, we gave female and male Long Evans rats cue light illumination paired or unpaired with foot shock (8 total) in a conditioned suppression setting, using a range of shock intensities (0.15, 0.25, 0.35, or 0.50 mA). We found that conditioned suppression was only observed at higher foot shock intensities (0.35 mA and 0.50 mA). We constructed comprehensive temporal ethograms by scoring 22,272 frames across 12 behavior categories in 200-ms intervals around cue light illumination. The 0.50 mA and 0.35 mA shock-paired visual cues suppressed reward seeking, rearing, and scaling, as well as light-directed rearing and light-directed scaling. The shock-paired visual cue further elicited locomotion and freezing. Linear discriminant analyses showed that ethogram data could accurately classify rats into paired and unpaired groups. Using complete ethogram data produced superior classification compared to behavior subsets, including an Immobility subset featuring freezing. The results demonstrate diverse threat behaviors – in a short and simple procedure – containing sufficient information to distinguish the visual fear conditioning status of individual rats.

    1. Neuroscience
    Paul I Jaffe, Gustavo X Santiago-Reyes ... Russell A Poldrack
    Research Article

    Evidence accumulation models (EAMs) are the dominant framework for modeling response time (RT) data from speeded decision-making tasks. While providing a good quantitative description of RT data in terms of abstract perceptual representations, EAMs do not explain how the visual system extracts these representations in the first place. To address this limitation, we introduce the visual accumulator model (VAM), in which convolutional neural network models of visual processing and traditional EAMs are jointly fitted to trial-level RTs and raw (pixel-space) visual stimuli from individual subjects in a unified Bayesian framework. Models fitted to large-scale cognitive training data from a stylized flanker task captured individual differences in congruency effects, RTs, and accuracy. We find evidence that the selection of task-relevant information occurs through the orthogonalization of relevant and irrelevant representations, demonstrating how our framework can be used to relate visual representations to behavioral outputs. Together, our work provides a probabilistic framework for both constraining neural network models of vision with behavioral data and studying how the visual system extracts representations that guide decisions.