Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks
Abstract
Neural activity during cognitive tasks exhibits complex dynamics that flexibly encode task-relevant variables. Chaotic recurrent networks, which spontaneously generate rich dynamics, have been proposed as a model of cortical computation during cognitive tasks. However, existing methods for training these networks are either biologically implausible, and/or require a continuous, real-time error signal to guide learning. Here we show that a biologically plausible learning rule can train such recurrent networks, guided solely by delayed, phasic rewards at the end of each trial. Networks endowed with this learning rule can successfully learn nontrivial tasks requiring flexible (context-dependent) associations, memory maintenance, nonlinear mixed selectivities, and coordination among multiple outputs. The resulting networks replicate complex dynamics previously observed in animal cortex, such as dynamic encoding of task features and selective integration of sensory inputs. We conclude that recurrent neural networks offer a plausible model of cortical dynamics during both learning and performance of flexible behavior.
Article and author information
Author details
Funding
G Harold and Leila Y. Mathers Foundation
- Thomas Miconi
The William and Jane Walsh Charitable Remainder Unitrust
- Thomas Miconi
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Copyright
© 2017, Miconi
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 7,919
- views
-
- 1,399
- downloads
-
- 108
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Computational and Systems Biology
- Medicine
Excessive consumption of sucrose, in the form of sugar-sweetened beverages, has been implicated in the pathogenesis of metabolic dysfunction‐associated fatty liver disease (MAFLD) and other related metabolic syndromes. The c-Jun N-terminal kinase (JNK) pathway plays a crucial role in response to dietary stressors, and it was demonstrated that the inhibition of the JNK pathway could potentially be used in the treatment of MAFLD. However, the intricate mechanisms underlying these interventions remain incompletely understood given their multifaceted effects across multiple tissues. In this study, we challenged rats with sucrose-sweetened water and investigated the potential effects of JNK inhibition by employing network analysis based on the transcriptome profiling obtained from hepatic and extrahepatic tissues, including visceral white adipose tissue, skeletal muscle, and brain. Our data demonstrate that JNK inhibition by JNK-IN-5A effectively reduces the circulating triglyceride accumulation and inflammation in rats subjected to sucrose consumption. Coexpression analysis and genome-scale metabolic modeling reveal that sucrose overconsumption primarily induces transcriptional dysfunction related to fatty acid and oxidative metabolism in the liver and adipose tissues, which are largely rectified after JNK inhibition at a clinically relevant dose. Skeletal muscle exhibited minimal transcriptional changes to sucrose overconsumption but underwent substantial metabolic adaptation following the JNK inhibition. Overall, our data provides novel insights into the molecular basis by which JNK inhibition exerts its metabolic effect in the metabolically active tissues. Furthermore, our findings underpin the critical role of extrahepatic metabolism in the development of diet-induced steatosis, offering valuable guidance for future studies focused on JNK-targeting for effective treatment of MAFLD.
-
- Computational and Systems Biology
Manifold-learning is particularly useful to resolve the complex cellular state space from single-cell RNA sequences. While current manifold-learning methods provide insights into cell fate by inferring graph-based trajectory at cell level, challenges remain to retrieve interpretable biology underlying the diverse cellular states. Here, we described MGPfactXMBD, a model-based manifold-learning framework and capable to factorize complex development trajectories into independent bifurcation processes of gene sets, and thus enables trajectory inference based on relevant features. MGPfactXMBD offers a more nuanced understanding of the biological processes underlying cellular trajectories with potential determinants. When bench-tested across 239 datasets, MGPfactXMBD showed advantages in major quantity-control metrics, such as branch division accuracy and trajectory topology, outperforming most established methods. In real datasets, MGPfactXMBD recovered the critical pathways and cell types in microglia development with experimentally valid regulons and markers. Furthermore, MGPfactXMBD discovered evolutionary trajectories of tumor-associated CD8+ T cells and yielded new subtypes of CD8+ T cells with gene expression signatures significantly predictive of the responses to immune checkpoint inhibitor in independent cohorts. In summary, MGPfactXMBD offers a manifold-learning framework in scRNA-seq data which enables feature selection for specific biological processes and contributing to advance our understanding of biological determination of cell fate.