Abstract

Animals can learn to repeat behaviors to earn desired rewards, a process commonly known as reinforcement learning. While previous work has implicated the ascending dopaminergic projections to the basal ganglia in reinforcement learning, little is known about the role of the hippocampus. Here we report that a specific population of hippocampal neurons and their dopaminergic innervation contribute to operant self-stimulation. These neurons are located in the dentate gyrus, receive dopaminergic projections from the locus coeruleus, and express D1 dopamine receptors. Activation of D1+ dentate neurons is sufficient for self-stimulation: mice will press a lever to earn optogenetic activation of these neurons. A similar effect is also observed with selective activation of the locus coeruleus projections to the dentate gyrus, and blocked by D1 receptor antagonism. Calcium imaging of D1+ dentate neurons revealed significant activity at the time of action selection, but not during passive reward delivery. These results reveal the role of dopaminergic innervation of the dentate gyrus in supporting operant reinforcement.

Data availability

All data generated or analysed during this study are included in the manuscript and supporting files.

Article and author information

Author details

  1. Elijah A Petter

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  2. Isabella P Fallon

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Ryan N Hughes

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-4999-0215
  4. Glenn DR Watson

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  5. Warren H Meck

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  6. Francesco Paolo Ulloa Severino

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3725-9713
  7. Henry H Yin

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    For correspondence
    hy43@duke.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1546-6850

Funding

National Institute on Drug Abuse (DA040701)

  • Henry H Yin

National Institute of Neurological Disorders and Stroke (NS094754)

  • Henry H Yin

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: All experimental procedures were conducted in accordance with standard ethical guidelines and were approved by the Duke University Institutional Animal Care and Use Committee (protocol number: 162-22-09).

Copyright

© 2023, Petter et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,294
    views
  • 397
    downloads
  • 13
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Elijah A Petter
  2. Isabella P Fallon
  3. Ryan N Hughes
  4. Glenn DR Watson
  5. Warren H Meck
  6. Francesco Paolo Ulloa Severino
  7. Henry H Yin
(2023)
Elucidating a locus coeruleus-dentate gyrus dopamine pathway for operant reinforcement
eLife 12:e83600.
https://doi.org/10.7554/eLife.83600

Share this article

https://doi.org/10.7554/eLife.83600

Further reading

    1. Neuroscience
    Jack W Lindsey, Jeffrey Markowitz ... Ashok Litwin-Kumar
    Research Article

    Spiny projection neurons (SPNs) in dorsal striatum are often proposed as a locus of reinforcement learning in the basal ganglia. Here, we identify and resolve a fundamental inconsistency between striatal reinforcement learning models and known SPN synaptic plasticity rules. Direct-pathway (dSPN) and indirect-pathway (iSPN) neurons, which promote and suppress actions, respectively, exhibit synaptic plasticity that reinforces activity associated with elevated or suppressed dopamine release. We show that iSPN plasticity prevents successful learning, as it reinforces activity patterns associated with negative outcomes. However, this pathological behavior is reversed if functionally opponent dSPNs and iSPNs, which promote and suppress the current behavior, are simultaneously activated by efferent input following action selection. This prediction is supported by striatal recordings and contrasts with prior models of SPN representations. In our model, learning and action selection signals can be multiplexed without interference, enabling learning algorithms beyond those of standard temporal difference models.

    1. Neuroscience
    Guoling Tang, Yaning Han ... Pengfei Wei
    Tools and Resources

    Deep learning-based methods have advanced animal pose estimation, enhancing accuracy, and efficiency in quantifying animal behavior. However, these methods frequently experience tracking drift, where noise-induced jumps in body point estimates compromise reliability. Here, we present the anti-drift pose tracker (ADPT), a transformer-based tool that mitigates tracking drift in behavioral analysis. Extensive experiments across cross-species datasets—including proprietary mouse and monkey recordings and public Drosophila and macaque datasets—demonstrate that ADPT significantly reduces drift and surpasses existing models like DeepLabCut and SLEAP in accuracy. Moreover, ADPT achieved 93.16% identification accuracy for 10 unmarked mice and 90.36% accuracy for freely interacting unmarked mice, which can be further refined to 99.72%, enhancing both anti-drift performance and pose estimation accuracy in social interactions. With its end-to-end design, ADPT is computationally efficient and suitable for real-time analysis, offering a robust solution for reproducible animal behavior studies. The ADPT code is available at https://github.com/tangguoling/ADPT.