Associative Learning: How nitric oxide helps update memories
To find food and avoid danger in changing environments, animals need to be able to learn to associate specific sensory stimuli, such as odors, with reward or punishment. Such memories must also adapt to reflect new circumstances. How is such memory flexibility achieved?
An excellent model system for studying these questions is the fruit fly Drosophila melanogaster, which can learn to associate certain odors with reward or punishment. Odor-associated memories are formed in a part of the fly brain called the mushroom body, which contains about 2000 neurons called Kenyon cells, which are connected to other neurons called mushroom body output neurons (MBONs; Amin and Lin, 2019). A small percentage of Kenyon cells (~5–10%) is activated by a given odor, which triggers a behavioral response (via the MBONs), such as approaching the odor or avoiding it.
The connections between the Kenyon cells and the MBONs can be altered by subpopulations of dopaminergic neurons that carry reward or punishment information (Hige et al., 2015). When a fly smells an odor at the same time as it experiences reward or punishment, certain dopaminergic neurons are activated at the same time as an odor-specific set of Kenyon cells. This simultaneous activation alters Kenyon cell-to-MBON connections, leading to an altered odor-induced behavior (positive or negative memory).
Now, in eLife, Gerald Rubin and colleagues at Janelia Research Campus, Columbia University, and the University of Virginia – including Yoshinori Aso as first author – report that some dopaminergic neurons release nitric oxide as well as dopamine, and that this nitric oxide acts in the ‘opposite direction’ to the dopamine, and also on a slower timescale (Aso et al., 2019). These opposing signals ensure that odor-associated memories are forgotten after time passes, allowing for memory flexibility.
Different types of dopaminergic neurons innervate different ‘compartments’ in the mushroom body (Figure 1A). Previous work showed that activating a dopaminergic neuron that responds to punishment (reward) while the fly smells an odor can induce a negative (positive) artificial memory, so the fly later avoids (approaches) that particular odor (Aso and Rubin, 2016; Aso et al., 2012; Aso et al., 2010). This memory can form and decay quickly or slowly depending on what dopaminergic neuron induced it.
One would expect that if a fly cannot produce dopamine (because an enzyme needed to make it is knocked out), these memories would not form. However, Aso et al. encountered something surprising when they performed experiments on flies that lacked dopamine: activating a dopaminergic neuron called PPL1-γ1pedc (which normally induces negative memories) induced a positive memory, while activating PAM-γ5/PAM-β’2a (which normally induce positive memories) induced a negative memory. These 'inverted memory' results are consistent with previous results that dopamine-less flies form positive memories when they are trained to associate an odor to a negative experience like an electric shock (Riemensperger et al., 2011). Aso et al. went further by pinning down this inverted memory to specific neurons. Thus, dopaminergic neurons can induce memory formation without dopamine, suggesting that they might use another neurotransmitter as a co-transmitter.
But what co-transmitter? Using RNA-seq, Aso et al. looked at gene expression in different dopaminergic neuron subtypes to see what the subtypes inducing inverted memories express that others do not. This analysis pointed to nitric oxide synthase, the enzyme that produces nitric oxide (NO). This gas has several roles in the body, including acting as a neurotransmitter in mammalian long term memory (Harooni et al., 2009). Moreover, the major downstream signaling molecule for NO, soluble guanylate cyclase, is expressed in Kenyon cells, suggesting that NO might diffuse across cell membranes from dopaminergic neurons to Kenyon cells (Figure 1B).
Aso et al. showed that both NO production in dopaminergic neurons and soluble guanylate cyclase signaling in Kenyon cells are required for inverted memory. When either is disrupted, activating the dopaminergic neurons described above in dopamine-less flies no longer produces inverted memories. However, when dopamine levels were restored in flies lacking both NO and dopamine, normal memory formation took place, indicating NO is not required for normal memory (as opposed to inverted memory).
Why would these dopaminergic neurons simultaneously induce two opposite memories? The inverted memory induced by NO forms more slowly than the normal memory induced by dopamine, suggesting that the inverted memory could cancel out the normal memory after some time passes (Figure 1C). Consistent with this hypothesis, normal memories in NO-deficient flies last much longer than in wild-type flies, suggesting that the inverted memory is actually a kind of active forgetting. Indeed, NO-deficient flies struggle to update memories based on new information.
Aso et al. used computational modeling to understand how the dopamine-induced normal memory and the NO-induced inverted memory interact with each other. The results suggest that dopamine and NO could modulate three classical parameters of synaptic strength (quantal size, release probability, and number of release sites), which give the mean postsynaptic response when multiplied together. It will be interesting to test which, if any, of these parameters are altered during learning.
The mushroom body is architecturally similar to the vertebrate cerebellum (Farris, 2011), and this study highlights further molecular parallels. In the cerebellum, NO can induce a change in the connection between granule cells (akin to Kenyon cells) and Purkinje cells (akin to MBONs) in the opposite direction to the change that happens during normal learning (Lev-Ram et al., 2002). Whether due to conservation from an ancestral brain structure or convergent evolution to a useful architecture, these parallels underscore the usefulness of the mushroom body as a model system to understand memory dynamics. It will be interesting in the future to explore how opposing co-transmitters modulate memory timescales in other systems, and whether such systems are involved in human learning disabilities or dementia.
References
-
Neuronal mechanisms underlying innate and learned olfactory processing in DrosophilaCurrent Opinion in Insect Science 36:9–17.https://doi.org/10.1016/j.cois.2019.06.003
-
Are mushroom bodies cerebellum-like structures?Arthropod Structure & Development 40:368–379.https://doi.org/10.1016/j.asd.2011.02.004
Article and author information
Author details
Publication history
Copyright
© 2020, Green and Lin
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,772
- views
-
- 165
- downloads
-
- 1
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
The relation between neural activity and behaviorally relevant variables is at the heart of neuroscience research. When strong, this relation is termed a neural representation. There is increasing evidence, however, for partial dissociations between activity in an area and relevant external variables. While many explanations have been proposed, a theoretical framework for the relationship between external and internal variables is lacking. Here, we utilize recurrent neural networks (RNNs) to explore the question of when and how neural dynamics and the network’s output are related from a geometrical point of view. We find that training RNNs can lead to two dynamical regimes: dynamics can either be aligned with the directions that generate output variables, or oblique to them. We show that the choice of readout weight magnitude before training can serve as a control knob between the regimes, similar to recent findings in feedforward networks. These regimes are functionally distinct. Oblique networks are more heterogeneous and suppress noise in their output directions. They are furthermore more robust to perturbations along the output directions. Crucially, the oblique regime is specific to recurrent (but not feedforward) networks, arising from dynamical stability considerations. Finally, we show that tendencies toward the aligned or the oblique regime can be dissociated in neural recordings. Altogether, our results open a new perspective for interpreting neural activity by relating network dynamics and their output.
-
- Neuroscience
The circadian clock, an internal time-keeping system orchestrates 24 hr rhythms in physiology and behavior by regulating rhythmic transcription in cells. Astrocytes, the most abundant glial cells, play crucial roles in CNS functions, but the impact of the circadian clock on astrocyte functions remains largely unexplored. In this study, we identified 412 circadian rhythmic transcripts in cultured mouse cortical astrocytes through RNA sequencing. Gene Ontology analysis indicated that genes involved in Ca2+ homeostasis are under circadian control. Notably, Herpud1 (Herp) exhibited robust circadian rhythmicity at both mRNA and protein levels, a rhythm disrupted in astrocytes lacking the circadian transcription factor, BMAL1. HERP regulated endoplasmic reticulum (ER) Ca2+ release by modulating the degradation of inositol 1,4,5-trisphosphate receptors (ITPRs). ATP-stimulated ER Ca2+ release varied with the circadian phase, being more pronounced at subjective night phase, likely due to the rhythmic expression of ITPR2. Correspondingly, ATP-stimulated cytosolic Ca2+ increases were heightened at the subjective night phase. This rhythmic ER Ca2+ response led to circadian phase-dependent variations in the phosphorylation of Connexin 43 (Ser368) and gap junctional communication. Given the role of gap junction channel (GJC) in propagating Ca2+ signals, we suggest that this circadian regulation of ER Ca2+ responses could affect astrocytic modulation of synaptic activity according to the time of day. Overall, our study enhances the understanding of how the circadian clock influences astrocyte function in the CNS, shedding light on their potential role in daily variations of brain activity and health.