Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
Abstract
Recent experiments have shown that animals and humans have a remarkable ability to adapt their learning rate according to the volatility of the environment. Yet the neural mechanism responsible for such adaptive learning has remained unclear. To fill this gap, we investigated a biophysically inspired, metaplastic synaptic model within the context of a well-studied decision-making network, in which synapses can change their rate of plasticity in addition to their efficacy according to a reward-based learning rule. We found that our model, which assumes that synaptic plasticity is guided by a novel surprise detection system, captures a wide range of key experimental findings and performs as well as a Bayes optimal model, with remarkably little parameter tuning. Our results further demonstrate the computational power of synaptic plasticity, and provide insights into the circuit-level computation which underlies adaptive decision-making.
Article and author information
Author details
Funding
Schwartz foundation
- Kiyohito Iigaya
Gatsby Charitable Foundation
- Kiyohito Iigaya
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Copyright
© 2016, Iigaya
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,600
- views
-
- 522
- downloads
-
- 43
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Neurovascular coupling, linking neuronal activity to cerebral blood flow, is essential for brain function and underpins functional brain imaging. Whereas mechanisms involved in vasodilation are well-documented, those controlling vasoconstriction remain overlooked. This study unravels the mechanisms by which pyramidal cells elicit arteriole vasoconstriction. Using patch-clamp recording, vascular and Ca2+ imaging in mouse cortical slices, we show that strong optogenetic activation of layer II/III pyramidal cells induces vasoconstriction, correlating with firing frequency and somatic Ca2+ increase. Ex vivo and in vivo pharmacological investigations indicate that this vasoconstriction predominantly recruits prostaglandin E2 through the cyclooxygenase-2 pathway, and activation of EP1 and EP3 receptors. We also present evidence that specific interneurons releasing neuropeptide Y, and astrocytes, through 20-hydroxyeicosatetraenoic acid, contribute to this process. By revealing the mechanisms by which pyramidal cells lead to vasoconstriction, our findings shed light on the complex regulation of neurovascular coupling.
-
- Neuroscience
Aβ is believed to play a significant role in synaptic degeneration observed in Alzheimer’s disease and is primarily investigated as a secreted peptide. However, the contribution of intracellular Aβ or other cleavage products of its precursor protein (APP) to synaptic loss remains uncertain. In this study, we conducted a systematic examination of their cell-autonomous impact using a sparse expression system in rat hippocampal slice culture. Here, these proteins/peptides were overexpressed in a single neuron, surrounded by thousands of untransfected neurons. Surprisingly, we found that APP induced dendritic spine loss only when co-expressed with BACE1. This effect was mediated by β-CTF, a β-cleavage product of APP, through an endosome-related pathway independent of Aβ. Neuronal expression of β-CTF in mouse brains resulted in defective synaptic transmission and cognitive impairments, even in the absence of amyloid plaques. These findings unveil a β-CTF-initiated mechanism driving synaptic toxicity irrespective of amyloid plaque formation and suggest a potential intervention by inhibiting the endosomal GTPase Rab5.