Dopamine neuron ensembles signal the content of sensory prediction errors

  1. Thomas Stalnaker  Is a corresponding author
  2. James D Howard
  3. Yuji K Takahashi
  4. Samuel J Gershman
  5. Thorsten Kahnt
  6. Geoffrey Schoenbaum  Is a corresponding author
  1. National Institute on Drug Abuse, National Institutes of Health, United States
  2. Northwestern University, United States
  3. Harvard University, United States

Abstract

Dopamine neurons respond to errors in predicting value-neutral sensory information. These data, combined with causal evidence that dopamine transients support sensory-based associative learning, suggest that the dopamine system signals a multidimensional prediction error. Yet such complexity is not evident in individual neuron or average neural activity. How then do downstream areas know what to learn in response to these signals? One possibility is that information about content is contained in the pattern of firing across many dopamine neurons. Consistent with this, here we show that the pattern of firing across a small group of dopamine neurons recorded in rats signals the identity of a mis-predicted sensory event. Further, this same information is reflected in the BOLD response elicited by sensory prediction errors in human midbrain. These data provide evidence that ensembles of dopamine neurons provide highly specific teaching signals, opening new possibilities for how this system might contribute to learning.

Data availability

The raw data that went into the analyses shown in Figures 1,2 and 3 are archived athttps://github.com/tastalnaker/dopamine_ensemble_analysis.git

Article and author information

Author details

  1. Thomas Stalnaker

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    For correspondence
    thomas.stalnaker@nih.gov
    Competing interests
    No competing interests declared.
  2. James D Howard

    Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9309-3773
  3. Yuji K Takahashi

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    Competing interests
    No competing interests declared.
  4. Samuel J Gershman

    Department of Psychology, Harvard University, Cambridge, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-6546-3298
  5. Thorsten Kahnt

    Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, United States
    Competing interests
    Thorsten Kahnt, Reviewing editor, eLife.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-3575-2670
  6. Geoffrey Schoenbaum

    Intramural Research Program, National Institute on Drug Abuse, National Institutes of Health, Baltimore, United States
    For correspondence
    geoffrey.schoenbaum@nih.gov
    Competing interests
    Geoffrey Schoenbaum, Reviewing editor, eLife.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8180-0701

Funding

National Institute on Drug Abuse (ZIA-DA000587)

  • Geoffrey Schoenbaum

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: This study was performed in strict accordance with the recommendations in the Guide for the Care and Use of Laboratory Animals of the National Institutes of Health. All of the animals were handled according to approved institutional animal care and use committee protocols of the NIH. The protocol (#18-CNRB-108) was approved by the NIDA-IRP ACUC. All surgery was performed under isoflurane anesthesia, and every effort was made to minimize suffering.

Human subjects: Subjects gave informed consent to participate in the experiment. The protocol (#STU00098371) and consent forms were approved by Northwestern University's Institutional Review Board.

Copyright

This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.

Metrics

  • 4,085
    views
  • 603
    downloads
  • 50
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Thomas Stalnaker
  2. James D Howard
  3. Yuji K Takahashi
  4. Samuel J Gershman
  5. Thorsten Kahnt
  6. Geoffrey Schoenbaum
(2019)
Dopamine neuron ensembles signal the content of sensory prediction errors
eLife 8:e49315.
https://doi.org/10.7554/eLife.49315

Share this article

https://doi.org/10.7554/eLife.49315

Further reading

    1. Neuroscience
    Suelen Pereira, Ivan Tomsic ... Mychael V Lourenco
    Insight

    A dysfunctional signaling pathway in the hippocampus has been linked to chronic pain-related memory impairment in mice.

    1. Neuroscience
    Ilya A Rybak, Natalia A Shevtsova ... Alain Frigon
    Research Advance

    Locomotion is controlled by spinal circuits that interact with supraspinal drives and sensory feedback from the limbs. These sensorimotor interactions are disrupted following spinal cord injury. The thoracic lateral hemisection represents an experimental model of an incomplete spinal cord injury, where connections between the brain and spinal cord are abolished on one side of the cord. To investigate the effects of such an injury on the operation of the spinal locomotor network, we used our computational model of cat locomotion recently published in eLife (Rybak et al., 2024) to investigate and predict changes in cycle and phase durations following a thoracic lateral hemisection during treadmill locomotion in tied-belt (equal left-right speeds) and split-belt (unequal left-right speeds) conditions. In our simulations, the ‘hemisection’ was always applied to the right side. Based on our model, we hypothesized that following hemisection the contralesional (‘intact’, left) side of the spinal network is mostly controlled by supraspinal drives, whereas the ipsilesional (‘hemisected’, right) side is mostly controlled by somatosensory feedback. We then compared the simulated results with those obtained during experiments in adult cats before and after a mid-thoracic lateral hemisection on the right side in the same locomotor conditions. Our experimental results confirmed many effects of hemisection on cat locomotion predicted by our simulations. We show that having the ipsilesional hindlimb step on the slow belt, but not the fast belt, during split-belt locomotion substantially reduces the effects of lateral hemisection. The model provides explanations for changes in temporal characteristics of hindlimb locomotion following hemisection based on altered interactions between spinal circuits, supraspinal drives, and somatosensory feedback.