Energy efficient synaptic plasticity
Abstract
Many aspects of the brain's design can be understood as the result of evolutionary drive towards metabolic efficiency. In addition to the energetic costs of neural computation and transmission, experimental evidence indicates that synaptic plasticity is metabolically demanding as well. As synaptic plasticity is crucial for learning, we examine how these metabolic costs enter in learning. We find that when synaptic plasticity rules are naively implemented, training neural networks requires extremely large amounts of energy when storing many patterns. We propose that this is avoided by precisely balancing labile forms of synaptic plasticity with more stable forms. This algorithm, termed synaptic caching, boosts energy efficiency manifold and can be used with any plasticity rule, including back-propagation. Our results yield a novel interpretation of the multiple forms of neural synaptic plasticity observed experimentally, including synaptic tagging and capture phenomena. Furthermore our results are relevant for energy efficient neuromorphic designs.
Data availability
Simulation scripts can be found at https://github.com/vanrossumlab/li_vanrossum_19.
-
Data from: The MNIST database of handwritten digitsThe MNIST database of handwritten digits.
Article and author information
Author details
Funding
Leverhulme Trust (RPG-2017-404)
- Mark CW van Rossum
Engineering and Physical Sciences Research Council (EP/R030952/1)
- Mark CW van Rossum
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Copyright
© 2020, Li & van Rossum
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 3,282
- views
-
- 475
- downloads
-
- 32
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Dense core vesicles (DCVs) transport and release various neuropeptides and neurotrophins that control diverse brain functions, but the DCV secretory pathway remains poorly understood. Here, we tested a prediction emerging from invertebrate studies about the crucial role of the intracellular trafficking GTPase Rab10, by assessing DCV exocytosis at single-cell resolution upon acute Rab10 depletion in mature mouse hippocampal neurons, to circumvent potential confounding effects of Rab10’s established role in neurite outgrowth. We observed a significant inhibition of DCV exocytosis in Rab10-depleted neurons, whereas synaptic vesicle exocytosis was unaffected. However, rather than a direct involvement in DCV trafficking, this effect was attributed to two ER-dependent processes, ER-regulated intracellular Ca2+ dynamics, and protein synthesis. Gene Ontology analysis of differentially expressed proteins upon Rab10 depletion identified substantial alterations in synaptic and ER/ribosomal proteins, including the Ca2+ pump SERCA2. In addition, ER morphology and dynamics were altered, ER Ca2+ levels were depleted, and Ca2+ homeostasis was impaired in Rab10-depleted neurons. However, Ca2+ entry using a Ca2+ ionophore still triggered less DCV exocytosis. Instead, leucine supplementation, which enhances protein synthesis, largely rescued DCV exocytosis deficiency. We conclude that Rab10 is required for neuropeptide release by maintaining Ca2+ dynamics and regulating protein synthesis. Furthermore, DCV exocytosis appeared more dependent on (acute) protein synthesis than synaptic vesicle exocytosis.
-
- Neuroscience
The infralimbic cortex (IL) is essential for flexible behavioral responses to threatening environmental events. Reactive behaviors such as freezing or flight are adaptive in some contexts, but in others a strategic avoidance behavior may be more advantageous. IL has been implicated in avoidance, but the contribution of distinct IL neural subtypes with differing molecular identities and wiring patterns is poorly understood. Here, we study IL parvalbumin (PV) interneurons in mice as they engage in active avoidance behavior, a behavior in which mice must suppress freezing in order to move to safety. We find that activity in inhibitory PV neurons increases during movement to avoid the shock in this behavioral paradigm, and that PV activity during movement emerges after mice have experienced a single shock, prior to learning avoidance. PV neural activity does not change during movement toward cued rewards or during general locomotion in the open field, behavioral paradigms where freezing does not need to be suppressed to enable movement. Optogenetic suppression of PV neurons increases the duration of freezing and delays the onset of avoidance behavior, but does not affect movement toward rewards or general locomotion. These data provide evidence that IL PV neurons support strategic avoidance behavior by suppressing freezing.