Dopamine neuron ensembles signal the content of sensory prediction errors

  1. Thomas Stalnaker  Is a corresponding author
  2. James D Howard
  3. Yuji K Takahashi
  4. Samuel J Gershman
  5. Thorsten Kahnt
  6. Geoffrey Schoenbaum  Is a corresponding author
  1. National Institute on Drug Abuse, National Institutes of Health, United States
  2. Northwestern University, United States
  3. Harvard University, United States

Abstract

Dopamine neurons respond to errors in predicting value-neutral sensory information. These data, combined with causal evidence that dopamine transients support sensory-based associative learning, suggest that the dopamine system signals a multidimensional prediction error. Yet such complexity is not evident in individual neuron or average neural activity. How then do downstream areas know what to learn in response to these signals? One possibility is that information about content is contained in the pattern of firing across many dopamine neurons. Consistent with this, here we show that the pattern of firing across a small group of dopamine neurons recorded in rats signals the identity of a mis-predicted sensory event. Further, this same information is reflected in the BOLD response elicited by sensory prediction errors in human midbrain. These data provide evidence that ensembles of dopamine neurons provide highly specific teaching signals, opening new possibilities for how this system might contribute to learning.

Data availability

The raw data that went into the analyses shown in Figures 1,2 and 3 are archived athttps://github.com/tastalnaker/dopamine_ensemble_analysis.git

Article and author information

Author details

  1. Thomas Stalnaker

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    For correspondence
    thomas.stalnaker@nih.gov
    Competing interests
    No competing interests declared.
  2. James D Howard

    Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9309-3773
  3. Yuji K Takahashi

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    Competing interests
    No competing interests declared.
  4. Samuel J Gershman

    Department of Psychology, Harvard University, Cambridge, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-6546-3298
  5. Thorsten Kahnt

    Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, United States
    Competing interests
    Thorsten Kahnt, Reviewing editor, eLife.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-3575-2670
  6. Geoffrey Schoenbaum

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    For correspondence
    geoffrey.schoenbaum@nih.gov
    Competing interests
    Geoffrey Schoenbaum, Reviewing editor, eLife.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8180-0701

Funding

National Institute on Drug Abuse (ZIA-DA000587)

  • Geoffrey Schoenbaum

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: This study was performed in strict accordance with the recommendations in the Guide for the Care and Use of Laboratory Animals of the National Institutes of Health. All of the animals were handled according to approved institutional animal care and use committee protocols of the NIH. The protocol (#18-CNRB-108) was approved by the NIDA-IRP ACUC. All surgery was performed under isoflurane anesthesia, and every effort was made to minimize suffering.

Human subjects: Subjects gave informed consent to participate in the experiment. The protocol (#STU00098371) and consent forms were approved by Northwestern University's Institutional Review Board.

Copyright

This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.

Metrics

  • 3,992
    views
  • 583
    downloads
  • 40
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Thomas Stalnaker
  2. James D Howard
  3. Yuji K Takahashi
  4. Samuel J Gershman
  5. Thorsten Kahnt
  6. Geoffrey Schoenbaum
(2019)
Dopamine neuron ensembles signal the content of sensory prediction errors
eLife 8:e49315.
https://doi.org/10.7554/eLife.49315

Share this article

https://doi.org/10.7554/eLife.49315

Further reading

    1. Computational and Systems Biology
    2. Neuroscience
    Matthieu K Chardon, Y Curtis Wang ... Charles J Heckman
    Research Article

    In this study, we develop new reverse engineering (RE) techniques to identify the organization of the synaptic inputs generating firing patterns of populations of neurons. We tested these techniques in silico to allow rigorous evaluation of their effectiveness, using remarkably extensive parameter searches enabled by massively-parallel computation on supercomputers. We chose spinal motoneurons as our target neural system, since motoneurons process all motor commands and have well-established input-output properties. One set of simulated motoneurons was driven by 300,000+ simulated combinations of excitatory, inhibitory, and neuromodulatory inputs. Our goal was to determine if these firing patterns had sufficient information to allow RE identification of the input combinations. Like other neural systems, the motoneuron input-output system is likely non-unique. This non-uniqueness could potentially limit this RE approach, as many input combinations can produce similar outputs. However, our simulations revealed that firing patterns contained sufficient information to sharply restrict the solution space. Thus, our RE approach successfully generated estimates of the actual simulated patterns of excitation, inhibition, and neuromodulation, with variances accounted for ranging from 75–90%. It was striking that nonlinearities induced in firing patterns by the neuromodulation inputs did not impede RE, but instead generated distinctive features in firing patterns that aided RE. These simulations demonstrate the potential of this form of RE analysis. It is likely that the ever-increasing capacity of supercomputers will allow increasingly accurate RE of neuron inputs from their firing patterns from many neural systems.

    1. Neuroscience
    Quynh Anh Thi Nguyen, Andrea Rocha ... Sachiko Haga-Yamanaka
    Research Article

    Animals have the innate ability to select optimal defensive behaviors with appropriate intensity within specific contexts. The vomeronasal organ (VNO) serves as a primary sensory channel for detecting predator cues by relaying signals to the medial hypothalamic nuclei, particularly the ventromedial hypothalamus (VMH), which directly controls defensive behavioral outputs. Here, we demonstrate that cat saliva contains predator cues that signal the imminence of predator threat and modulate the intensity of freezing behavior through the VNO in mice. Cat saliva activates VNO neurons expressing the V2R-A4 subfamily of sensory receptors, and the number of VNO neurons activated in response to saliva correlates with both the freshness of saliva and the intensity of freezing behavior. Moreover, the number of VMH neurons activated by fresh, but not old, saliva positively correlates with the intensity of freezing behavior. Detailed analyses of the spatial distribution of activated neurons, as well as their overlap within the same individual mice, revealed that fresh and old saliva predominantly activate distinct neuronal populations within the VMH. Collectively, this study suggests that there is an accessory olfactory circuit in mice that is specifically tuned to time-sensitive components of cat saliva, which optimizes their defensive behavior to maximize their chance of survival according to the imminence of threat.