Abstract

Animals can learn to repeat behaviors to earn desired rewards, a process commonly known as reinforcement learning. While previous work has implicated the ascending dopaminergic projections to the basal ganglia in reinforcement learning, little is known about the role of the hippocampus. Here we report that a specific population of hippocampal neurons and their dopaminergic innervation contribute to operant self-stimulation. These neurons are located in the dentate gyrus, receive dopaminergic projections from the locus coeruleus, and express D1 dopamine receptors. Activation of D1+ dentate neurons is sufficient for self-stimulation: mice will press a lever to earn optogenetic activation of these neurons. A similar effect is also observed with selective activation of the locus coeruleus projections to the dentate gyrus, and blocked by D1 receptor antagonism. Calcium imaging of D1+ dentate neurons revealed significant activity at the time of action selection, but not during passive reward delivery. These results reveal the role of dopaminergic innervation of the dentate gyrus in supporting operant reinforcement.

Data availability

All data generated or analysed during this study are included in the manuscript and supporting files.

Article and author information

Author details

  1. Elijah A Petter

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  2. Isabella P Fallon

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Ryan N Hughes

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-4999-0215
  4. Glenn DR Watson

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  5. Warren H Meck

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
  6. Francesco Paolo Ulloa Severino

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3725-9713
  7. Henry H Yin

    Department of Psychology and Neuroscience, Duke University, Durham, United States
    For correspondence
    hy43@duke.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1546-6850

Funding

National Institute on Drug Abuse (DA040701)

  • Henry H Yin

National Institute of Neurological Disorders and Stroke (NS094754)

  • Henry H Yin

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Reviewing Editor

  1. Kate M Wassum, University of California, Los Angeles, United States

Ethics

Animal experimentation: All experimental procedures were conducted in accordance with standard ethical guidelines and were approved by the Duke University Institutional Animal Care and Use Committee (protocol number: 162-22-09).

Version history

  1. Received: September 20, 2022
  2. Preprint posted: October 17, 2022 (view preprint)
  3. Accepted: April 20, 2023
  4. Accepted Manuscript published: April 21, 2023 (version 1)
  5. Version of Record published: May 5, 2023 (version 2)

Copyright

© 2023, Petter et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,063
    views
  • 349
    downloads
  • 9
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Elijah A Petter
  2. Isabella P Fallon
  3. Ryan N Hughes
  4. Glenn DR Watson
  5. Warren H Meck
  6. Francesco Paolo Ulloa Severino
  7. Henry H Yin
(2023)
Elucidating a locus coeruleus-dentate gyrus dopamine pathway for operant reinforcement
eLife 12:e83600.
https://doi.org/10.7554/eLife.83600

Share this article

https://doi.org/10.7554/eLife.83600

Further reading

    1. Neuroscience
    Tianhao Chu, Zilong Ji ... Si Wu
    Research Article

    Hippocampal place cells in freely moving rodents display both theta phase precession and procession, which is thought to play important roles in cognition, but the neural mechanism for producing theta phase shift remains largely unknown. Here, we show that firing rate adaptation within a continuous attractor neural network causes the neural activity bump to oscillate around the external input, resembling theta sweeps of decoded position during locomotion. These forward and backward sweeps naturally account for theta phase precession and procession of individual neurons, respectively. By tuning the adaptation strength, our model explains the difference between ‘bimodal cells’ showing interleaved phase precession and procession, and ‘unimodal cells’ in which phase precession predominates. Our model also explains the constant cycling of theta sweeps along different arms in a T-maze environment, the speed modulation of place cells’ firing frequency, and the continued phase shift after transient silencing of the hippocampus. We hope that this study will aid an understanding of the neural mechanism supporting theta phase coding in the brain.

    1. Neuroscience
    Josue M Regalado, Ariadna Corredera Asensio ... Priyamvada Rajasethupathy
    Research Article

    Learning requires the ability to link actions to outcomes. How motivation facilitates learning is not well understood. We designed a behavioral task in which mice self-initiate trials to learn cue-reward contingencies and found that the anterior cingulate region of the prefrontal cortex (ACC) contains motivation-related signals to maximize rewards. In particular, we found that ACC neural activity was consistently tied to trial initiations where mice seek to leave unrewarded cues to reach reward-associated cues. Notably, this neural signal persisted over consecutive unrewarded cues until reward-associated cues were reached, and was required for learning. To determine how ACC inherits this motivational signal we performed projection-specific photometry recordings from several inputs to ACC during learning. In doing so, we identified a ramp in bulk neural activity in orbitofrontal cortex (OFC)-to-ACC projections as mice received unrewarded cues, which continued ramping across consecutive unrewarded cues, and finally peaked upon reaching a reward-associated cue, thus maintaining an extended motivational state. Cellular resolution imaging of OFC confirmed these neural correlates of motivation, and further delineated separate ensembles of neurons that sequentially tiled the ramp. Together, these results identify a mechanism by which OFC maps out task structure to convey an extended motivational state to ACC to facilitate goal-directed learning.