Abstract
Highlights
Optical VTA DA neuron stimulation is sufficient to elicit a Pavlovian-like dopamine transient in the NAc
Dopamine in the LH encodes both negative and positive reward prediction errors
Dopamine in the LH positively modulates orexin neuronal activity locally in a D2R dependent way
Dopamine and orexins (hypocretins) play important roles in regulating reward-seeking behaviors. It is known that hypothalamic orexinergic neurons project to dopamine neurons in the ventral tegmental area (VTA), where they can stimulate dopaminergic neuronal activity. Although there are reciprocal connections between dopaminergic and orexinergic systems, whether and how dopamine regulates the activity of orexin neurons is currently not known. Here we implemented an opto-Pavlovian task in which mice learn to associate a sensory cue with optogenetic dopamine neuron stimulation to investigate the relationship between dopamine release and orexin neuron activity in the LH. We found that dopamine release can be evoked in LH upon optogenetic stimulation of VTA dopamine neurons, and is also naturally evoked by cue presentation after opto-Pavlovian learning. Furthermore, orexin neuron activity could also be upregulated by local stimulation of dopaminergic terminals in the LH in a way that is partially dependent on dopamine D2 receptors (DRD2). Our results reveal previously unknown orexinergic coding of reward expectation and unveil an orexin-regulatory axis mediated by local dopamine inputs in the LH.
Introduction
Dopamine in the ventral and dorsal striatum shapes reward-related behaviors1–5; its dysregulation has been associated with several psychiatric disorders, including addiction6–8 and depression9–11. It is known that rewarding stimuli evoke dopamine transients both in the ventral12,13 and dorsal striatum14, and that the stimulation of dopaminergic neurons15,16 or teminals3 in the striatum is sufficient to trigger operant or Pavlovian conditioning17 as well as conditioned place preference. Instead, aversive stimuli or omission of expected reward delivery cause a decrease in dopamine in the ventral striatum, resulting in negative reinforcement learning18,19 via D2 receptors20,21.
Although the role of the dopaminergic projections to the striatum or mesolimbic dopamine pathway has been investigated extensively12,22 – their role in encoding reward prediction errors (RPE) in particular has been a point of focus12,23 – the role of dopamine in other brain regions is relatively understudied24–27. The lateral hypothalamus (LH) plays a pivotal role in reward-seeking behavior28–32 and feeding33–36, and several dopamine receptors are reported to be expressed in the LH37. The mechanism through which dopamine modulates neuronal activity in the LH, resulting in the modulation of behaviors, has not been established. To the best of our knowledge, there have been no measurements of dopamine transients in the LH during reward-associated behaviors.
The LH is a heterogeneous structure containing glutamatergic and GABAergic neurons, as well as several neuropeptidergic neurons, such as melanin-concentrating hormone positive and orexin-positive neurons38,39. Like dopamine, orexins (also known as hypocretins) are reported to play a pivotal role in reward-seeking behavior29,40,41. Orexinergic and dopaminergic systems are known to have reciprocal connections with each other, and some orexinergic neurons project to dopaminergic neurons in the ventral tegmental area (VTA), positively modulating their activity42,43. While there has been extensive investigation into how dopamine modulates orexinergic neuronal activity ex vivo (i.e. acute brain slices)44–47, it remains unclear whether and how dopamine transients modulate orexin neuronal activity in vivo.47 Advancements in optical tools, such as optogenetics for manipulating dopamine neurons and genetically encoded dopamine sensors for monitoring dopamine transients, have made it possible to precisely control and observe the dynamics of dopamine in neural systems.13,48–52 Here, we implemented an ‘opto-Pavlovian task‘17, in which mice learn to associate a sensory cue with optogenetic dopamine neuron stimulation. Using this task we measured dopamine transients in the nucleus accumbens (NAc), finding that dopamine activity patterns are consistent with previous reports of RPE-encoding dopaminergic neuron activity22. Using the same paradigm, we found that optical stimulation of dopaminergic neurons in the VTA evokes an increase of extra-synaptic dopamine in the LH, where the delivery of a cue preceding a reward also triggers dopamine transients in a way that is consistent with RPEs23. Furthermore, we investigated the regulation of LH orexinergic neurons by VTA dopaminergic neurons, and observed a dopamine transient in the LH and an increase in orexinergic neuronal activity during both predictive cue and the delivery of laser stimulation, indicating that the concentration of extra-synaptic dopamine in the LH and orexinergic neuronal activity are positively correlated. Finally, by stimulating dopaminergic terminals in the LH combined with pharmacological intervention, we found that dopamine in the LH positively modulates orexinergic neurons via the type 2 dopamine receptor (D2).
Overall, our study sheds light on the meso-hypothalamic dopaminergic pathway, and its impact on orexinergic neurons.
Results
RPE-like dopamine transient in the NAc in response to VTA dopamine neuron stimulation
Previous work established an optogenetics-powered Pavlovian conditioning task (hereon called opto-Pavlovian) wherein animals learn to associate the delivery of a cue with optogenetic activation of their midbrain dopamine neurons17. This previous study determines that dopaminergic neuron responses to optical stimulation-predictive cues become established over multiple learning sessions. However, in light of recent evidence demonstrating that dopamine release in the mesolimbic system and dopamine neuron activity can be uncoupled we sought out to determine whether dopamine release would also follow the same patterns of dopamine somatic activity during this task53,54. To selectively stimulate and monitor dopamine release from ventral tegmental area (VTA) dopaminergic neurons in the nucleus accumbens (NAc), we injected a cre-dependent ChrimsonR AAV in the VTA as well as dLight1.3b13, a genetically encoded dopamine sensor AAV, in the NAc of DAT-cre mice. The recording optic fiber was placed directly above the NAc injection site (Fig. 1A). Mice then underwent the ‘opto-Pavlovian task’17, where one cue (tone+light, 7s) was paired with the optogenetic stimulation of dopamine neurons in the VTA (Fig 1D), while the other cue was not (Fig. 1B). We observed a gradual increase of dopamine transients in response to the delivery of the laser-associated cue (Fig. 1C,E and F). In contrast, the change of response to the non-laser-paired cue was smaller (Fig. 1C,E and F), suggesting that mice discriminated between the two cues. After 10 sessions of the opto-Pavlovian task, mice were exposed to omission sessions (Fig 2A), in which one-third of the laser-paired cues failed to trigger laser stimulation and the other two-thirds were followed by laser stimulation of VTA dopamine neurons (Fig 2A, B and C). The omission of the laser stimulation triggered a dip of dLight signal (Fig 2D). We also observed a small dip of dLight signal during non-laser paired cue delivery (Figure 1 – Supplement 1).Overall, the dopamine transient observed during the opto-Pavlovian task was consistent with classical Pavlovian conditioning17,22, indicating that mice engage similar learning processes whether the reward consists of an edible entity or of optogenetic stimulation of VTA dopamine neurons.
Dopamine transients in the LH follow the same rules as in the NAc
Given the involvement of the lateral hypothalamus (LH) in reward-seeking behaviors28,55, we next asked whether a similar neuromodulatory coding of predictive cues could take place in the hypothalamus, outside of the mesolimbic dopamine system. To answer this question, we followed the same procedure as for the NAc, except injecting dLight1.3 and positioning the optic fiber for photometry recordings in the LH (Fig 3A). We observed Chrimson positive fibers in the LH originating from the VTA (Fig 3A) and found that the stimulation of VTA dopamine neurons reliably evoked dopamine transients in the LH (Fig 3B). The injected mice expressing dLight1.3b in the LH then underwent the opto-Pavlovian task (Fig 3C-G). On session 1 of the task, we observed dopamine transients neither around laser-paired cue nor around non-laser-paired cue presentation (Fig 3C and D). However, in the LH as in the NAc, there was a gradual increase of dopamine transients around the laser-paired cue delivery (Fig 3 E,F and G), consistent with RPE-like dopamine transients. Omission sessions after 10 sessions of the task (Fig 3H) showed a dip of dopamine signal during omission trials (Fig 3H). These results are indicative of the presence of a certain amount of tonic dopamine in the LH under unstimulated conditions and that negative RPEs can induce a decrease in the concentration of LH dopamine. Interestingly, the dopamine transients in the LH observed in these experiments mirrored the RPE-encoding dopamine responses we observed in the NAc.
Different kinetics of dopamine in the NAc and LH
After conducting dLight recordings in the NAc and LH during the opto-pavlovian task, we observed distinct kinetics of dopamine in these two brain regions. First we compared the dopamine transient during stimulation trials of omission sessions, where mice already learned the association between the cue and the laser stimulation (Figure 3 - Supplement 1A). In the NAc, the dLight signal continued to increase until the laser was turned off, while in the LH, the dLight signal plateaued shortly after the initiation of the laser stimulation (Figure 3 - Supplement 1A). To precisely assess the kinetics of the dLight signals, we calculated their derivatives (Figure 3 - Supplement 1B). In the NAc, the derivative crossed zero shortly after the termination of the laser stimulation, while in the LH, the zero-crossing point was observed during the laser stimulation (Figure 3 - Supplement 1B and C), indicating a different timing of direction change in the dLight signal. We applied the same analysis to the omission trials (Figure 3 - Supplement 1D, E, and F). Following the initiation of the laser-paired cue, two zero-crossing points of the derivative of the dLight signal were identified. The first one corresponded to the maximum of the dLight signal, and the second one corresponded to the minimum of the dLight signal. In the LH, both zero-crossing points were smaller than in the NAc, suggesting that LH dopamine exhibits faster kinetics.
Orexin neuron dynamics during the opto-Pavlovian task
We next addressed the hypothesis positing that dopamine in the LH can modulate orexinergic neuronal activity. We injected DAT-cre mice with an orexin promoter-driven GCaMP6s56–59, which has been reported to target orexin neurons with >96% specificity59, in the LH and used fiber photometry to monitor the calcium transients of LH orexinergic neurons while optically controlling dopamine release via ChrimsonR expressed in the VTA (Fig 4A and B). After the mice fully recovered from the surgery, they underwent the opto-Pavlovian task. On session 1, calcium transients in orexin neurons were not modulated by the presentation of laser-paired or non-laser-paired cues (Fig 4C), although laser stimulation triggered the increase of calcium signal (Figure 4 - Supplement 1). As we observed with dLight recordings in the NAc and LH, the orexin-specific GCaMP signal increased across sessions around the presentation of the laser-paired cue (Fig 4D and E), therefore following a similar time course to the evolution of dopamine release in the LH. After mice learned the association, we tested the omission of laser stimulation (Fig 4F). Unlike dopamine signals, we did not observed a dip in orexin activity during omission trials (Fig 4F). Orexin neuron activity is known to be associated with animal locomotion60,61. To exclude the possibility that the increase in calcium signaling during laser-paired cue trials is an indirect effect of stimulation-induced locomotion60,61, we performed photometry recordings and optogenetic stimulation of VTA dopaminergic terminals in the LH both in freely-moving or in isoflurane-anesthetized conditions (Fig 5A). In both conditions we observed an increased orexinergic neuron activity after the onset of laser stimulation (Fig 5B and C), suggesting that the observed upregulation in orexinergic neuronal activity is independent from animal locomotion. Finally, to identify which dopamine receptor is responsible for this increase in orexinergic calcium, we systemically (I.P.) injected a D1 (SCH 23390) or D2 (raclopride) receptor antagonist, and optically stimulated dopaminergic terminals in the LH (Fig 5E and Figure 5 - Supplement 1). Raclopride largely reduced the observed orexin neuronal activity increases while SCH 23390 did not, indicating that the signal is at least in part mediated by the D2 receptor (Fig 5F). Our experiments suggest that LH orexin neurons participate in the LH response to VTA dopamine, and that D2 receptors play an important role locally in the LH in regulating orexin neuron activity evoked by dopamine release.
Discussion
The mesolimbic dopamine system has been proposed to encode reward prediction errors (RPEs)12,22,23, which signal a discrepancy between expected and experienced rewards. Recently, it has been demonstrated that the optical stimulation of midbrain dopamine neurons is sufficient to create Pavlovian conditioning17. While it is known that cells within the LH express several different dopamine receptor subtypes37, and microinjection of D1 and D2 receptor agonists have been shown to decrease food intake in rodents62, before our study, dopamine transients in the LH during reward associated tasks had not been reported. Here, we used an opto-Pavlovian task that echoed, with NAc dopamine measurements, already reported findings on the midbrain dopamine neurons’ RPE-encoding role17. Then, we determined that VTA dopaminergic neurons release dopamine in the LH and found that dopamine transients in the LH in response to the same opto-Pavlovian task were qualitatively similar to those observed in the mesolimbic dopamine system.
Recent findings suggest that dopaminergic transients in the dorsal bed nucleus of the stria terminalis (dBNST) encode RPE26, indicating qualitative similarities in dopamine activity within this brain region compared to what we observed in the LH and NAc. Conversely, dopamine responses in other brain regions, such as the medial prefrontal cortex (mPFC)25,63 and amygdala50,64, predominantly react to aversive stimuli. The dopamine transients in the LH during aversive stimuli, with their robust orexinergic responses to aversiveness65, warrant careful characterization.
Indeed, during the opto-Pavlovian task, in which we stimulated VTA dopamine neurons and measured dopamine, we observed dopamine transients around a Pavlovian laser-paired cue presentation. We also observed a dip of dLight signal during omission trials, suggesting that a detectable concentration of dopamine is at extra-synaptic space in the LH at basal condition and that at the moment of omission, the concentration of extra-synaptic dopamine decreases. These data indicate that dopamine transients in the LH, as in the NAc, could be encoding reward prediction error.
While smaller than the response to the laser-paired cue, we observed modulation of the dLight signal in the NAc during the presentation of the non-laser paired cue. In Session 1, the cue presentation immediately triggered a dip, whereas in Session 10, it evoked a slight increase in the signal, followed by a dip. Our hypothesis suggests that two components contribute to the dip in the signal. The first is the aversiveness of the cue; the relatively loud sound (90dB) used for the cue could be mildly aversive to the experimental animals. Previous studies have shown that aversive stimuli induce a dip in dopamine levels in the NAc, although this effect varies across subregions3,63. The second component is related to reward prediction error. While the non-laser paired cue never elicited the laser stimulation, it shares similarities with the laser-paired cue in terms of a loud tone and the same color of the visual cue (albeit spatially different). We posit that it is possible that the reward-related neuronal circuit was slightly activated by the non-laser paired cue. Indeed, a small increase in the signal was observed on day 10 but not on day 1. If our hypothesis holds true, as this signal is induced by two components, further analysis unfortunately becomes challenging.
While dopaminergic transients in the NAc and LH share qualitative similarities, the kinetics of dopamine differs between these two brain regions. Under optical stimulation, the dLight signal in the NAc exhibited a continuous increase, never reaching a plateau until the laser was turned off. In contrast, in the LH, the dLight signal reached a plateau shortly after the initiation of the laser stimulation. The distinction in dopamine kinetics was also evident during omission trials, where the dopamine kinetics in the LH were faster than those in the NAc. The molecular mechanisms underlying this difference in kinetics and its impact on behavior remain to be elucidated. Due to this kinetic difference, we employed distinct time windows to capture the dip in the dLight signal during omission trials.
Previous work indicates that orexin neurons project to VTA dopamine neurons40,42,43, facilitating dopamine release in the NAc and promoting reward-seeking behavior. However, while it has been demonstrated that systemic injection of dopamine receptor agonists activates orexin neurons41, their reciprocal connection with dopaminergic neurons had not yet been investigated in vivo47. Here, we studied the relationship between orexinergic and dopaminergic activity in the LH and found that LH dopamine transients and orexinergic neuronal activities are positively correlated. Seeing as dopamine-related orexinergic activity was reduced by systemic injections of raclopride, we postulate that dopamine in the LH activates orexin neurons via D2R. D2R couples to Gi proteins66, so it is unlikely that dopamine directly activates orexin neurons. Our testable hypothesis is that dopamine modulates orexin neuron activation via a disinhibitory mechanism; for example, GABA interneurons could be inhibited by the activation of D2R, consequently disinhibiting orexin neurons67,68. It has been established that D1 receptor expressing medium spiny neurons (D1-MSNs) in the NAc densely project to the LH, especially to GABAergic neurons33,69, raising a possibility that dopamine in the LH modulates the presynaptic terminals of D1-MSNs. However, administration of D1R antagonist (SCH 23390) did not block the calcium transient in orexin neurons evoked by the dopaminergic terminal stimulation in the LH, implying that the contribution of D1-MSNs to orexin neuronal activity is minimal in our experimental design. While systemic injections of raclopride effectively reduced dopaminergic terminal stimulation-evoked orexinergic activity, the long-lasting calcium signal remained unaltered (Fig. 5E). This discrepancy could arise from an insufficient blockade of dopamine receptors. For D1R blockade, we administered 1 mg/kg of SCH-23390 5 minutes before recordings. This dose is adequate to induce behavioral phenotypes70 and block D1R-based dopamine sensors 13, although higher doses have been used in some studies.50 To block D2R, we injected 1 mg/kg of raclopride, a dose known to induce hypo-locomotion71, indicating effective modification of the neuronal circuit. However, these data do not guarantee complete receptor blockade, and it is possible that optical stimulation resulted in high extra-synaptic dopamine concentration, leading to partial receptor binding. Alternatively, this component might be mediated by other neurotransmitters, such as glutamate72–74 or GABA75, which are known to be co-released from dopaminergic terminals.
Several ex vivo experiments suggest that dopamine, particularly at high concentrations (50 μM or higher), reduces the firing rate of orexin neurons, albeit with a potency significantly lower than that of norepinephrine44,45 through both direct and indirect mechanisms46,47. This apparent discrepancy with our results could be attributed to a different time course of dopamine transients. In slice experiments, the concentration of dopamine is determined by the experimenter and often maintained at high levels for minutes. In contrast, in our experimental setup, dopamine evoked by laser stimulation is reuptaken as soon as the laser is turned off. This variation in the time course of dopamine transients could contribute to the observed differences in responses to dopamine. Another plausible explanation for this discrepancy is the difference in dopamine concentration. Modulations of synaptic transmission to orexinergic neurons by dopamine are reported to be concentration-dependent46. The relationship between the response of genetically encoded dopamine sensors and extracellular dopamine concentrations is non-linear13, which makes estimating dopamine concentrations in vivo based on the sensor’s brightness not technically possible. Therefore, it is challenging to determine the exact dopamine concentration achieved by laser stimulation, and it is possible that this concentration differs from the one that triggers the reduction in the firing rate of orexin neurons.
Although presentation of laser-paired cue and laser stimulation of VTA dopamine neurons evoked dopamine transient in the LH and an increase of calcium signals of orexin neurons, we did not observe a dip of calcium signal of orexin neurons during omission trials. This lack of a dip could be due to 1) slow sensor kinetics76 – since the pre-omission cue triggers LH dopamine release, and increases the calcium transient in orexin neurons, if the kinetics of GCaMP6s expressed in orexin neurons were too slow, we would not be able to observe an omission-related orexin activity dip – 2) dopamine signaling properties. Dopamine receptors couple to G proteins77, which act relatively slowly, potentially preventing us from seeing an omission-related signaling dip. Both theories are compatible with our observation that orexinergic activity increases over time during the presentation of our laser-paired cue, as our observed increases are not sporadic but developed over time. Recent studies indicate that orexin neurons respond to cues associated with reward delivery. However, unlike dopaminergic responses, which linearly correlate with the probability of reward delivery, the orexin response plateaus at around 50% probability of reward delivery56. This observation indicates that orexin neurons encode multiplexed cognitive information rather than merely signaling reward prediction error. Our data indicate a direct conveyance of dopaminergic information, specifically reward prediction error, to orexinergic neurons. However, the mechanism by which orexinergic neurons process and convey this information to downstream pathways remains an open question.
The silencing of orexinergic neurons induces conditioned place preference78, suggesting that the silencing of orexin neurons is positively reinforcing. Considering that the stimulation of VTA dopamine neurons15,16 and dopaminergic terminals in the LH79 is generally considered to be positively reinforcing, the activation of orexin neurons by dopaminergic activity might be competing with dopamine’s own positive reinforcing effect. At the moment of omission, we observed a dopamine dip both in the NAc and LH, while orexin neurons were still activated. These data suggest that there is a dissociation between dopamine concentration and orexin neuronal activity at the moment of omission. This raises the intriguing possibility that this dissociation - the activation of orexin neurons during a quiet state of dopamine neurons – could be highly aversive to the mice, therefore could be playing a role in negative reinforcement 20,22,39.
It has been demonstrated that the orexin system plays a critical role in motivated learning80. Blocking orexin receptors impairs Pavlovian conditioning81, operant behavior82, and synaptic plasticity induced by cocaine administration40. Additionally, dopamine in the LH is essential for model-based learning, and the stimulation of dopaminergic terminals in the LH is sufficient to trigger reinforcement learning79. These collective findings strongly suggest that the activation of orexin neurons, evoked by dopamine transients, is crucial for reinforcement learning. Our data indicate that dopamine in both the NAc and LH encodes reward prediction error (RPE). One open question is the existence of such a redundant mechanism. We hypothesize that dopamine in the LH boosts dopamine release via a positive feedback loop between the orexin and dopamine systems. It has already been established that some orexin neurons project to dopaminergic neurons in the VTA, positively modulating firing42. On the other hand, our data indicate that dopamine in the LH stimulates orexinergic neurons. These collective findings suggest that when either the orexin or dopamine system is activated, the other system is also activated consequently, followed by further activation of those systems. Although the current findings align with this idea, the hypothesis should be carefully challenged and scrutinized.
In summary, by implementing an opto-Pavlovian task combined with fiber photometry recordings, we found evidence that the meso-hypothalamic dopamine system exhibits features qualitatively similar to those observed in the mesolimbic dopamine system – where dopamine is thought to encode RPEs. Furthermore, our findings show that dopamine in the LH positively modulates the neuronal activities of orexin neurons via D2 receptors. These findings give us new insights into the reciprocal connections between the orexin and dopamine systems and shed light on the previously overlooked direction of dopamine to orexin signaling, which might be key for understanding negative reinforcement and its dysregulation.
Methods
Animals
All animal procedures were performed in accordance to the Animal Welfare Ordinance (TSchV 455.1) of the Swiss Federal Food Safety and Veterinary Office and were approved by the Zurich Cantonal Veterinary Office. Adult DAT-IRES-cre (B6.SJL-Slc6a3tm1.1(cre)Bkmn/J; Jackson Labs) mice of both sexes were used in this study. Mice were kept in a temperature- and humidity-controlled environment with ad libitum access to chow and water on 12-h/12-h light/dark cycle.
Animal surgeries and viral injections
Surgeries were conducted on adult anesthetized mice (males and females, age > 6 weeks). AAV5-hSyn-FLEX-ChrimsonR-tdTomato (UNC Vector Core, 7.8 × 10E12 vg/ml) was injected in the VTA (−3.3 mm AP, 0.9 mm ML, −4.28 mm DV, with 10 degrees angle. volume: 600 nL). Above the injection site, a single optic fiber cannula (diameter: 200 μm) was chronically implanted (−3.3 mm AP, 0.9 mm ML, −4.18 mm DV). In the NAc (1.5 mm AP, 0.7 mm ML, −4.5 mm DV), AAV9-hSyn1-dLight1.3b-WPRE-bGHp (Viral Vector Facility,7.9 × 10E12 vg/ml) was injected and an optic fiber (diameter: 400 μm) was implanted (1.5 mm AP, 0.7 mm ML, −4.4 mm DV) for photometry recordings. In some mice, dLight virus or AAV1.pORX.GCaMP6s.hGH56 was injected in the LH (−1.4 mm AP, 1.1 mm ML, −5.0 mm DV), followed by an optic fiber implantation (−1.4 mm AP, 1.1 mm ML, −4.8 mm DV).
Opto-Pavlovian task
Dat-cre mice infected with AAV5-hSyn-FLEX-ChrimsonR-tdTomato in the VTA were placed in an operant chamber inside a sound-attenuating box with low illumination (30 Lux). Chamber functions synchronized with laser light deliveries were controlled by custom-written Matlab scripts via a National Instrument board (NI USB 6001). The optic fiber implanted above the VTA was connected to a red laser (638 nm, Doric Lenses; CLDM_638/120) via an FC/PC fiber cable (M72L02; Thorlabs) and a simple rotary joint (RJ1; Thorlabs). Power at the exit of the patch cord was set to 15 ± 1 mW. Two visual cues were in the operant chamber and a speaker was placed inside the sound-attenuating box. The laser-predictive cue was composed of the illumination of one visual stimulus (7 seconds continuous) and a tone (5kHz, 7 seconds continuous, 90dB), while the non-laser-paired cue was composed of a second visual stimulus (7 seconds continuous) and a different tone (12kHz, 7 seconds continuous, 90dB). Each cue was presented for 7 seconds. Two seconds after the onset of the laser-predictive cue, the red laser was applied for 5 seconds (20Hz, 10ms pulse duration). The presentation of the non-laser cue was followed by no stimuli. In random interval 60 seconds (45-75 seconds), one cue was presented in a pseudorandom sequence (avoiding the presentation of the same trials more than three times in a row). Mice were exposed to 30 laser cues and 30 Non-laser-paired cues in each session. Mice were trained 5 days per week. After 10 sessions of opto-Pavlovian training, mice underwent 2 sessions of omission. In the omission sessions, two thirds of laser-paired cue presentation was followed by the delivery of the laser stimulation (laser trial), and one third of laser-paired cue presentation didn’t lead to laser stimulation (omission trial). The laser-paired cue was kept the same for laser and non-laser trials. Each omission session was composed of 20 laser trials, 10 omission trials, and 30 non-laser trials.
Photometry recordings
Fiber photometry recordings were performed in all the sessions. Dat-cre mice injected with AAV9-hSyn1-dLight1.3b-WPRE-bGHp in the NAc or LH, or AAV1.pORX.GCaMP6s.hGH in the LH were used. All the mice were infected with AAV5-hSyn-FLEX-ChrimsonR-tdTomato in the VTA. iFMC6_IE(400-410)_E1(460-490)_F1(500-540)_E2(555-570)_F2(580-680)_S photometry system (Doric Lenses) was controlled by the Doric Neuroscience Studio software in all the photometry experiments except for Fig. 5’s anesthesia experiment. In Fig 5’s experiment, a 2-color + optogenetic stimulation rig (Tucker-Davis Technologies, TDT) was used. Mice were exposed to 5% isoflurane for anaesthesia induction, and were kept anesthetized at 2 % isoflurane through the rest of the experiment. The recordings started 10min after the induction of anesthesia. A low-autofluorescence patch cord (400 μm, 0.57 N.A., Doric Lenses) was connected to the optic fiber implanted above the NAc or LH. The NAc or LH was illuminated with blue (465 nm, Doric) and violet (405 nm, Doric) filtered excitation LED lights, which were sinusoidally modulated at 208 Hz and 572 Hz (405nm and 465nm, respectively) via lock-in amplification, then demodulated on-line and low-passed filtered at 12 Hz in the Doric system. In the TDT system, signals were sinusoidally modulated, using the TDT Synapse® software and a RX8 Multi I/O Processor at 210 Hz and 330 Hz (405nm and 465nm, respectively) via a lock-in amplification detector, then demodulated on-line and low-passed filtered at 6 Hz. Analysis was performed offline in MATLAB. To calculate ΔF/F0, a linear fit was applied to the 405 nm control signal to align it to the 470 nm signal. This fitted 405 nm signal was used as F0 in standard ΔF/F0 normalization {F(t) − F0(t)}/F0(t). For antagonist experiments in Figure 5, SCH-23390 (1mg/kg in saline) or raclopride (1mg/kg in saline) was injected (I.P.) 5 minutes before recordings.
Immunohistochemistry
Perfused brains were fixed with 4% Paraformaldehyde (Sigma-Aldrich) overnight (room temperature) and stored in PBS at 4°C for a maximum of one month. Brains were sliced with a Vibratome (Leica VT1200S; feed=60µm, freq=0.5, ampl=1.5), and brain slices near the fiber tracts were subsequently selected for staining. These slices were permeabilized with 0.3% Triton X-100 for 10 min (room temperature). Next, they were incubated with blocking buffer for 1 h (5% bovine serum albumin, BSA; 0.3% Triton x-100) before staining with the respective primary antibodies (NAc and LH with αGFP chicken 1:1000, Aves Labs ref GFP-1010; αmCherry rabbit, 1:1000, abcam ab167453; and αOrexin goat, 1:500, Santa Cruz Biotech, C-19; VTA with αmCherry rabbit, 1:1000, abcam, ab167453; and αTH chicken, 1:500, TYH0020) overnight. After three washes with 0.15% Triton, samples were incubated with the respective secondary antibodies and DAPI (for GFP donkey-αchicken, 1:1000, AlexaFluor 488, 703-545-155; for mCherry donkey-αrabbit 1:67, Cy3, Jackson, 711-165-152; for orexin donkey-αgoat, 1:500, Cy5; for TH donkey-αchicken, 1:67, AlexaFluor647, 703-605-155; for DAPI 1:2000, Thermofisher, 62248) for 1h. Finally, samples were washed three times with PBS and mounted on microscope slides with a mounting medium (VectaShield® HardSet™ with DAPI, H-1500-10). Image acquisition was performed with a ZEISS LSM 800 with Airyscan confocal microscope equipped with a Colibri 7 light source (Zeiss Apochromat).
Statistical Analysis
Statistical analysis was performed in Graphpad Prism9. For all tests, the threshold of statistical significance was placed at 0.05. For experiments involving one subject, one sample t-test was used. For experiments involving two independent subjects or the same subjects at two different time points, two tailed Student’s unpaired or paired t-test was used, respectively. For experiments involving more than two groups, one-way or two-way ANOVA was performed and followed by Tukey’s multiple comparison test. All data are shown as mean ± SEM.
Acknowledgements
We acknowledge funding from the Swiss National Science Foundation (grant agreement: 310030_196455 to TP), the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation program (grant agreement: 891959 to TP) and the University of Zürich. We would like to thank Jean-Charles Paterna and the Viral Vector Facility of the Neuroscience Center Zürich (ZNZ) for the kind help with virus production.
Competing financial interests
The authors have nothing to disclose.
References
- 1.Spontaneous behaviour is structured by reinforcement without explicit rewardNature 614:108–117https://doi.org/10.1038/s41586-022-05611-2
- 2.Mesoaccumbal Dopamine Heterogeneity: What Do Dopamine Firing and Release Have to Do with It?Annu. Rev. Neurosci 45:109–129https://doi.org/10.1146/annurev-neuro-110920-011929
- 3.Nucleus Accumbens Subnuclei Regulate Motivated Behavior via Direct Inhibition and Disinhibition of VTA Dopamine SubpopulationsNeuron 97:434–449https://doi.org/10.1016/j.neuron.2017.12.022
- 4.Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural CircuitryNeuron 88:247–263https://doi.org/10.1016/j.neuron.2015.08.037
- 5.Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral ConditioningScience 324:1080–1084https://doi.org/10.1126/science.1168878
- 6.Consolidating the Circuit Model for AddictionAnnu. Rev. Neurosci 44:173–195https://doi.org/10.1146/annurev-neuro-092920-123905
- 7.The transition to compulsion in addictionNature Reviews Neuroscience 21:247–263https://doi.org/10.1038/s41583-020-0289-z
- 8.Cell-type specific synaptic plasticity in dorsal striatum is associated with punishment-resistance compulsive-like cocaine self-administration in miceNeuropsychopharmacology https://doi.org/10.1038/s41386-022-01429-8
- 9.The Mesolimbic Dopamine Reward Circuit in DepressionBiological Psychiatry 59:1151–1159https://doi.org/10.1016/j.biopsych.2005.09.018
- 10.Molecular Adaptations Underlying Susceptibility and Resistance to Social Defeat in Brain Reward RegionsCell 131:391–404https://doi.org/10.1016/j.cell.2007.09.018
- 11.mDia and ROCK Mediate Actin-Dependent Presynaptic Remodeling Regulating Synaptic Efficacy and AnxietyCell Reports 17:2405–2417https://doi.org/10.1016/j.celrep.2016.10.088
- 12.A Unified Framework for Dopamine Signals across TimescalesCell 183:1600–1616https://doi.org/10.1016/j.cell.2020.11.013
- 13.Ultrafast neuronal imaging of dopamine dynamics with designed genetically encoded sensorsScience 360https://doi.org/10.1126/science.aat4422
- 14.Prolonged dopamine signalling in striatum signals proximity and value of distant rewardsNature 500:575–579https://doi.org/10.1038/nature12475
- 15.Corticostriatal Activity Driving Compulsive Reward SeekingBiological Psychiatry 90:808–818https://doi.org/10.1016/j.biopsych.2021.08.018
- 16.Stochastic synaptic plasticity underlying compulsion in a model of addictionNature 564:366–371https://doi.org/10.1038/s41586-018-0789-4
- 17.Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational propertiesNature Neuroscience 21:1072–1083https://doi.org/10.1038/s41593-018-0191-4
- 18.GABA Neurons of the VTA Drive Conditioned Place AversionNeuron 73:1173–1183https://doi.org/10.1016/j.neuron.2012.02.015
- 19.Activation of VTA GABA Neurons Disrupts Reward ConsumptionNeuron 73:1184–1194https://doi.org/10.1016/j.neuron.2012.02.016
- 20.Dopamine D2 receptors in discrimination learning and spine enlargementNature 579:555–560https://doi.org/10.1038/s41586-020-2115-1
- 21.‘Ups, downs, and sideways’ of dopamine in drug addictionTrends in Neurosciences 44:593–594https://doi.org/10.1016/j.tins.2021.06.009
- 22.Neuron-type-specific signals for reward and punishment in the ventral tegmental areaNature 482:85–88https://doi.org/10.1038/nature10754
- 23.A Neural Substrate of Prediction and RewardScience 275:1593–1599https://doi.org/10.1126/science.275.5306.1593
- 24.Rapid eye movement sleep is initiated by basolateral amygdala dopamine signaling in miceScience 375:994–1000https://doi.org/10.1126/science.abl6618
- 25.Dopamine enhances signal-to-noise ratio in cortical-brainstem encoding of aversive stimuliNature 563:397–401https://doi.org/10.1038/s41586-018-0682-1
- 26.Dopamine in the dorsal bed nucleus of stria terminalis signals Pavlovian sign-tracking and reward violationseLife 12https://doi.org/10.7554/eLife.81980
- 27.Differential Role of D1 and D2 Receptors in the Perifornical Lateral Hypothalamus in Controlling Ethanol Drinking and Food Intake: Possible Interaction with Local Orexin NeuronsAlcoholism: Clinical and Experimental Research 38:777–786https://doi.org/10.1111/acer.12313
- 28.Distinct Accumbens Shell Output Pathways Promote versus Prevent Relapse to Alcohol SeekingNeuron 98:512–520https://doi.org/10.1016/j.neuron.2018.03.033
- 29.A role for lateral hypothalamic orexin neurons in reward seekingNature 437:556–559https://doi.org/10.1038/nature04071
- 30.Paraventricular Thalamus Projection Neurons Integrate Cortical and Hypothalamic Signals for Cue-Reward ProcessingNeuron 103:423–431https://doi.org/10.1016/j.neuron.2019.05.018
- 31.Lateral Hypothalamic GABAergic Neurons Encode Reward Predictions that Are Relayed to the Ventral Tegmental Area to Regulate LearningCurrent Biology 27:2089–2100https://doi.org/10.1016/j.cub.2017.06.024
- 32.Increased Number and Activity of a Lateral Subpopulation of Hypothalamic Orexin/Hypocretin Neurons Underlies the Expression of an Addicted State in RatsBiological Psychiatry 85:925–935https://doi.org/10.1016/j.biopsych.2018.07.022
- 33.Accumbal D1R Neurons Projecting to Lateral Hypothalamus Authorize FeedingNeuron 88:553–564https://doi.org/10.1016/j.neuron.2015.09.038
- 34.Visualizing Hypothalamic Network Dynamics for Appetitive and Consummatory BehaviorsCell 160:516–527https://doi.org/10.1016/j.cell.2014.12.026
- 35.The Inhibitory Circuit Architecture of the Lateral Hypothalamus Orchestrates FeedingScience 341:1517–1521https://doi.org/10.1126/science.1241812
- 36.Control of food approach and eating by a GABAergic projection from lateral hypothalamus to dorsal ponsProceedings of the National Academy of Sciences 117:8611–8615https://doi.org/10.1073/pnas.1909340117
- 37.Expression of Dopamine Receptors in the Lateral Hypothalamic Nucleus and Their Potential Regulation of Gastric Motility in Rats With Lesions of Bilateral Substantia NigraFrontiers in Neuroscience 13
- 38.Single-cell transcriptomic analysis of the lateral hypothalamic area reveals molecularly distinct populations of inhibitory and excitatory neuronsNature Neuroscience 22:642–656https://doi.org/10.1038/s41593-019-0349-8
- 39.Awake dynamics and brain-wide direct inputs of hypothalamic MCH and orexin networksNature Communications 7https://doi.org/10.1038/ncomms11395
- 40.Orexin A in the VTA Is Critical for the Induction of Synaptic Plasticity and Behavioral Sensitization to CocaineNeuron 49:589–601https://doi.org/10.1016/j.neuron.2006.01.016
- 41.Dopaminergic regulation of orexin neuronsEuropean Journal of Neuroscience 21:2993–3001https://doi.org/10.1111/j.1460-9568.2005.04121.x
- 42.Optogenetic stimulation of lateral hypothalamic orexin/dynorphin inputs in the ventral tegmental area potentiates mesolimbic dopamine neurotransmission and promotes reward-seeking behavioursNeuropsychopharmacology 47:728–740https://doi.org/10.1038/s41386-021-01196-y
- 43.Projection-Target-Defined Effects of Orexin and Dynorphin on VTA Dopamine NeuronsCell Reports 18:1346–1355https://doi.org/10.1016/j.celrep.2017.01.030
- 44.Orexin Neurons Are Directly and Indirectly Regulated by Catecholamines in a Complex MannerJournal of Neurophysiology 96:284–298https://doi.org/10.1152/jn.01361.2005
- 45.Direct and Indirect Inhibition by Catecholamines of Hypocretin/Orexin NeuronsJ. Neurosci 25https://doi.org/10.1523/JNEUROSCI.4015-04.2005
- 46.Concentration-dependent activation of dopamine receptors differentially modulates GABA release onto orexin neuronsEuropean Journal of Neuroscience 42:1976–1983https://doi.org/10.1111/ejn.12967
- 47.Dopamine modulates excitatory transmission to orexin neurons in a receptor subtype-specific manner. American Journal of Physiology-RegulatoryIntegrative and Comparative Physiology 316:R68–R75https://doi.org/10.1152/ajpregu.00150.2018
- 48.A Genetically Encoded Fluorescent Sensor for Rapid and Specific In Vivo Detection of NorepinephrineNeuron 102:745–761https://doi.org/10.1016/j.neuron.2019.02.037
- 49.Next-generation GRAB sensors for monitoring dopaminergic activity in vivoNature Methods 17:1156–1166https://doi.org/10.1038/s41592-020-00981-9
- 50.Improved green and red GRAB sensors for monitoring dopaminergic activity in vivoNature Methods https://doi.org/10.1038/s41592-023-02100-w
- 51.Pushing the frontiers: tools for monitoring neurotransmitters and neuromodulatorsNature Reviews Neuroscience 23:257–274https://doi.org/10.1038/s41583-022-00577-6
- 52.An expanded palette of dopamine sensors for multiplex imaging in vivoNature Methods 17:1147–1155https://doi.org/10.1038/s41592-020-0936-3
- 53.Dissociable dopamine dynamics for learning and motivationNature 570:65–70https://doi.org/10.1038/s41586-019-1235-y
- 54.An action potential initiation mechanism in distal axons for the control of dopamine releaseScience 375:1378–1385https://doi.org/10.1126/science.abn0532
- 55.Decoding Neural Circuits that Control Compulsive Sucrose SeekingCell 160:528–541https://doi.org/10.1016/j.cell.2015.01.003
- 56.Coding of reward uncertainty and probability by orexin neuronsbioRxiv https://doi.org/10.1101/2022.04.13.488195
- 57.Ingested non-essential amino acids recruit brain orexin cells to suppress eating in miceCurrent Biology 32:1812–1821https://doi.org/10.1016/j.cub.2022.02.067
- 58.Hypothalamic deep brain stimulation as a strategy to manage anxiety disordersProceedings of the National Academy of Sciences 119https://doi.org/10.1073/pnas.2113518119
- 59.Inhibitory Interplay between Orexin Neurons and EatingCurrent Biology 26:2486–2491https://doi.org/10.1016/j.cub.2016.07.013
- 60.Role of spontaneous and sensory orexin network dynamics in rapid locomotion initiationProgress in Neurobiology 187https://doi.org/10.1016/j.pneurobio.2020.101771
- 61.Anticipatory countering of motor challenges by premovement activation of orexin neuronsPNAS Nexus 1https://doi.org/10.1093/pnasnexus/pgac240
- 62.Dopaminergic mechanisms in the lateral hypothalamus regulate feeding behavior in association with neuropeptidesBiochemical and Biophysical Research Communications 519:547–552https://doi.org/10.1016/j.bbrc.2019.09.037
- 63.Aversion hot spots in the dopamine systemCurrent Opinion in Neurobiology 64:46–52https://doi.org/10.1016/j.conb.2020.02.002
- 64.State-specific gating of salient cues by midbrain dopaminergic input to basal amygdalaNature Neuroscience 22:1820–1833https://doi.org/10.1038/s41593-019-0506-0
- 65.Aversive emotion rapidly activates orexin neurons and increases heart rate in freely moving miceMolecular Brain 14https://doi.org/10.1186/s13041-021-00818-2
- 66.The role of D2-autoreceptors in regulating dopamine neuron activity and transmissionNeuroscience 282:13–22https://doi.org/10.1016/j.neuroscience.2014.01.025
- 67.Regulation of Lateral Hypothalamic Orexin Activity by Local GABAergic NeuronsJ. Neurosci 38https://doi.org/10.1523/JNEUROSCI.1925-17.2017
- 68.Local network regulation of orexin neurons in the lateral hypothalamus. American Journal of Physiology-RegulatoryIntegrative and Comparative Physiology 301:R572–R580https://doi.org/10.1152/ajpregu.00674.2010
- 69.Depression of Accumbal to Lateral Hypothalamic Synapses Gates OvereatingNeuron 107:158–172https://doi.org/10.1016/j.neuron.2020.03.029
- 70.Characterization of dopamine transporter and locomotor effects of cocaine, GBR 12909, epidepride, and SCH 23390 in C57BL and DBA micePharmacology Biochemistry and Behavior 48:327–335https://doi.org/10.1016/0091-3057(94)90534-7
- 71.Predicting how equipotent doses of chlorpromazine, haloperidol, sulpiride, raclopride and clozapine reduce locomotor activity in miceEuropean Neuropsychopharmacology 10:159–164https://doi.org/10.1016/S0924-977X(00)00070-5
- 72.Dopamine neuron dependent behaviors mediated by glutamate cotransmissioneLife 6https://doi.org/10.7554/eLife.27566
- 73.VTA Glutamate Neuron Activity Drives Positive Reinforcement Absent Dopamine Co-releaseNeuron 107:864–873https://doi.org/10.1016/j.neuron.2020.06.011
- 74.Dopamine neurons in culture express VGLUT2 explaining their capacity to release glutamate at synapses in addition to dopamineJournal of Neurochemistry 88:1398–1405https://doi.org/10.1046/j.1471-4159.2003.02277.x
- 75.Inhibitory co-transmission from midbrain dopamine neurons relies on presynaptic GABA uptakeCell Reports 39https://doi.org/10.1016/j.celrep.2022.110716
- 76.Fast and sensitive GCaMP calcium indicators for imaging neural populationsNature 615:884–891https://doi.org/10.1038/s41586-023-05828-9
- 77.Dopamine Signaling in reward-related behaviorsFrontiers in Neural Circuits 7
- 78.Orexin neurons and inhibitory Agrp→orexin circuits guide spatial exploration in miceThe Journal of Physiology 598:4371–4383https://doi.org/10.1113/JP280158
- 79.A novel hypothalamic-midbrain circuit for model-based learningbioRxiv https://doi.org/10.1101/2023.03.02.530856
- 80.The role of orexin in motivated behavioursNature Reviews Neuroscience 15:719–731https://doi.org/10.1038/nrn3837
- 81.Orexin/hypocretin receptor 1 signaling mediates Pavlovian cue-food conditioning and extinctionPhysiology & Behavior 162:27–36https://doi.org/10.1016/j.physbeh.2016.02.042
- 82.Orexin Signaling Via the Orexin 1 Receptor Mediates Operant Responding for Food ReinforcementBiological Psychiatry 67:753–760https://doi.org/10.1016/j.biopsych.2009.12.035
Article and author information
Author information
Version history
- Preprint posted:
- Sent for peer review:
- Reviewed Preprint version 1:
- Reviewed Preprint version 2:
- Version of Record published:
Copyright
© 2023, Harada et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
- views
- 1,273
- downloads
- 104
- citations
- 0
Views, downloads and citations are aggregated across all versions of this paper published by eLife.