Recurrent network model for learning goal-directed sequences through reverse replay
Abstract
Reverse replay of hippocampal place cells occurs frequently at rewarded locations, suggesting its contribution to goal-directed path learning. Symmetric spike-timing dependent plasticity (STDP) in CA3 likely potentiates recurrent synapses for both forward (start to goal) and reverse (goal to start) replays during sequential activation of place cells. However, how reverse replay selectively strengthens forward synaptic pathway is unclear. Here, we show computationally that firing sequences bias synaptic transmissions to the opposite direction of propagation under symmetric STDP in the co-presence of short-term synaptic depression or afterdepolarization. We demonstrate that significant biases are created in biologically realistic simulation settings, and this bias enables reverse replay to enhance goal-directed spatial memory on a W-maze. Further, we show that essentially the same mechanism works in a two-dimensional open field. Our model for the first time provides the mechanistic account for the way reverse replay contributes to hippocampal sequence learning for reward-seeking spatial navigation.
Data availability
Our study is based on computer simulations, and we are sharing codes in Github.
Article and author information
Author details
Funding
Ministry of Education, Culture, Sports, Science, and Technology (15H04265)
- Tomoki Fukai
Core Research for Evolutional Science and Technology (JPMJCR13W1)
- Tomoki Fukai
Ministry of Education, Culture, Sports, Science, and Technology (16H01289)
- Tomoki Fukai
Ministry of Education, Culture, Sports, Science, and Technology (17H06036)
- Tomoki Fukai
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Copyright
© 2018, Haga & Fukai
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,869
- views
-
- 473
- downloads
-
- 41
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
The increasing use of tissue clearing techniques underscores the urgent need for cost-effective and simplified deep imaging methods. While traditional inverted confocal microscopes excel in high-resolution imaging of tissue sections and cultured cells, they face limitations in deep imaging of cleared tissues due to refractive index mismatches between the immersion media of objectives and sample container. To overcome these challenges, the RIM-Deep was developed to significantly improve deep imaging capabilities without compromising the normal function of the confocal microscope. This system facilitates deep immunofluorescence imaging of the prefrontal cortex in cleared macaque tissue, extending imaging depth from 2 mm to 5 mm. Applied to an intact and cleared Thy1-EGFP mouse brain, the system allowed for clear axonal visualization at high imaging depth. Moreover, this advancement enables large-scale, deep 3D imaging of intact tissues. In principle, this concept can be extended to any imaging modality, including existing inverted wide-field, confocal, and two-photon microscopy. This would significantly upgrade traditional laboratory configurations and facilitate the study of connectomes in the brain and other tissues.
-
- Neuroscience
What determines where to move the eyes? We recently showed that pupil size, a well-established marker of effort, also reflects the effort associated with making a saccade (‘saccade costs’). Here, we demonstrate saccade costs to critically drive saccade selection: when choosing between any two saccade directions, the least costly direction was consistently preferred. Strikingly, this principle even held during search in natural scenes in two additional experiments. When increasing cognitive demand experimentally through an auditory counting task, participants made fewer saccades and especially cut costly directions. This suggests that the eye-movement system and other cognitive operations consume similar resources that are flexibly allocated among each other as cognitive demand changes. Together, we argue that eye-movement behavior is tuned to adaptively minimize saccade-inherent effort.