Dopamine neuron ensembles signal the content of sensory prediction errors

  1. Thomas Stalnaker  Is a corresponding author
  2. James D Howard
  3. Yuji K Takahashi
  4. Samuel J Gershman
  5. Thorsten Kahnt
  6. Geoffrey Schoenbaum  Is a corresponding author
  1. National Institute on Drug Abuse, National Institutes of Health, United States
  2. Northwestern University, United States
  3. Harvard University, United States

Abstract

Dopamine neurons respond to errors in predicting value-neutral sensory information. These data, combined with causal evidence that dopamine transients support sensory-based associative learning, suggest that the dopamine system signals a multidimensional prediction error. Yet such complexity is not evident in individual neuron or average neural activity. How then do downstream areas know what to learn in response to these signals? One possibility is that information about content is contained in the pattern of firing across many dopamine neurons. Consistent with this, here we show that the pattern of firing across a small group of dopamine neurons recorded in rats signals the identity of a mis-predicted sensory event. Further, this same information is reflected in the BOLD response elicited by sensory prediction errors in human midbrain. These data provide evidence that ensembles of dopamine neurons provide highly specific teaching signals, opening new possibilities for how this system might contribute to learning.

Data availability

The raw data that went into the analyses shown in Figures 1,2 and 3 are archived athttps://github.com/tastalnaker/dopamine_ensemble_analysis.git

Article and author information

Author details

  1. Thomas Stalnaker

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    For correspondence
    thomas.stalnaker@nih.gov
    Competing interests
    No competing interests declared.
  2. James D Howard

    Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9309-3773
  3. Yuji K Takahashi

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    Competing interests
    No competing interests declared.
  4. Samuel J Gershman

    Department of Psychology, Harvard University, Cambridge, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-6546-3298
  5. Thorsten Kahnt

    Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, United States
    Competing interests
    Thorsten Kahnt, Reviewing editor, eLife.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-3575-2670
  6. Geoffrey Schoenbaum

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    For correspondence
    geoffrey.schoenbaum@nih.gov
    Competing interests
    Geoffrey Schoenbaum, Reviewing editor, eLife.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8180-0701

Funding

National Institute on Drug Abuse (ZIA-DA000587)

  • Geoffrey Schoenbaum

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: This study was performed in strict accordance with the recommendations in the Guide for the Care and Use of Laboratory Animals of the National Institutes of Health. All of the animals were handled according to approved institutional animal care and use committee protocols of the NIH. The protocol (#18-CNRB-108) was approved by the NIDA-IRP ACUC. All surgery was performed under isoflurane anesthesia, and every effort was made to minimize suffering.

Human subjects: Subjects gave informed consent to participate in the experiment. The protocol (#STU00098371) and consent forms were approved by Northwestern University's Institutional Review Board.

Copyright

This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.

Metrics

  • 4,114
    views
  • 604
    downloads
  • 50
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Thomas Stalnaker
  2. James D Howard
  3. Yuji K Takahashi
  4. Samuel J Gershman
  5. Thorsten Kahnt
  6. Geoffrey Schoenbaum
(2019)
Dopamine neuron ensembles signal the content of sensory prediction errors
eLife 8:e49315.
https://doi.org/10.7554/eLife.49315

Share this article

https://doi.org/10.7554/eLife.49315

Further reading

    1. Neuroscience
    Diellor Basha, Amirmohammad Azarmehri ... Igor Timofeev
    Research Article

    Memory consolidation during sleep depends on the interregional coupling of slow waves, spindles, and sharp wave-ripples (SWRs), across the cortex, thalamus, and hippocampus. The reuniens nucleus of the thalamus, linking the medial prefrontal cortex (mPFC) and the hippocampus, may facilitate interregional coupling during sleep. To test this hypothesis, we used intracellular, extracellular unit and local field potential recordings in anesthetized and head restrained non-anesthetized cats as well as computational modelling. Electrical stimulation of the reuniens evoked both antidromic and orthodromic intracellular mPFC responses, consistent with bidirectional functional connectivity between mPFC, reuniens and hippocampus in anesthetized state. The major finding obtained from behaving animals is that at least during NREM sleep hippocampo-reuniens-mPFC form a functional loop. SWRs facilitate the triggering of thalamic spindles, which later reach neocortex. In return, transition to mPFC UP states increase the probability of hippocampal SWRs and later modulate spindle amplitude. During REM sleep hippocampal theta activity provides periodic locking of reuniens neuronal firing and strong crosscorrelation at LFP level, but the values of reuniens-mPFC crosscorrelation was relatively low and theta power at mPFC was low. The neural mass model of this network demonstrates that the strength of bidirectional hippocampo-thalamic connections determines the coupling of oscillations, suggesting a mechanistic link between synaptic weights and the propensity for interregional synchrony. Our results demonstrate the presence of functional connectivity in hippocampo-thalamo-cortical network, but the efficacy of this connectivity is modulated by behavioral state.

    1. Neuroscience
    Maxine K Loh, Samantha J Hurh ... Mitchell F Roitman
    Research Article

    Mesolimbic dopamine encoding of non-contingent rewards and reward-predictive cues has been well established. Considerable debate remains over how mesolimbic dopamine responds to aversion and in the context of aversive conditioning. Inconsistencies may arise from the use of aversive stimuli that are transduced along different neural paths relative to reward or the conflation of responses to avoidance and aversion. Here, we made intraoral infusions of sucrose and measured how dopamine and behavioral responses varied to the changing valence of sucrose. Pairing intraoral sucrose with malaise via injection of lithium chloride (LiCl) caused the development of a conditioned taste aversion (CTA), which rendered the typically rewarding taste of sucrose aversive upon subsequent re-exposure. Following CTA formation, intraoral sucrose suppressed the activity of ventral tegmental area dopamine neurons (VTADA) and nucleus accumbens (NAc) dopamine release. This pattern of dopamine signaling after CTA is similar to intraoral infusions of innately aversive quinine and contrasts with responses to sucrose when it was novel or not paired with LiCl. Dopamine responses were negatively correlated with behavioral reactivity to intraoral sucrose and predicted home cage sucrose preference. Further, dopamine responses scaled with the strength of the CTA, which was increased by repeated LiCl pairings and weakened through extinction. Thus, the findings demonstrate differential dopamine encoding of the same taste stimulus according to its valence, which is aligned to distinct behavioral responses.