Learning recurrent dynamics in spiking networks

Abstract
Data availability
Article and author information
Metrics

Abstract

Spiking activity of neurons engaged in learning and performing a task show complex spatiotemporal dynamics. While the output of recurrent network models can learn to perform various tasks, the possible range of recurrent dynamics that emerge after learning remains unknown. Here we show that modifying the recurrent connectivity with a recursive least squares algorithm provides sufficient flexibility for synaptic and spiking rate dynamics of spiking networks to produce a wide range of spatiotemporal activity. We apply the training method to learn arbitrary firing patterns, stabilize irregular spiking activity in a network of excitatory and inhibitory neurons respecting Dale's law, and reproduce the heterogeneous spiking rate patterns of cortical neurons engaged in motor planning and movement. We identify sufficient conditions for successful learning, characterize two types of learning errors, and assess the network capacity. Our findings show that synaptically-coupled recurrent spiking networks possess a vast computational capability that can support the diverse activity patterns in the brain.

Data availability

Example computer code that trains recurrent spiking networks is available at http://github.com/chrismkkim/SpikeLearning

Article and author information

Author details

Christopher M Kim

National Institute of Diabetes and Kidney and Digestive Diseases, National Institutes of Health, Bethesda, United States

For correspondence
chrismkkim@gmail.com

Competing interests
The authors declare that no competing interests exist.

"This ORCID iD identifies the author of this article:" 0000-0002-1322-6207
Carson C Chow

National Institute of Diabetes and Kidney and Digestive Diseases, National Institutes of Health, Bethesda, United States

For correspondence
carsonc@niddk.nih.gov

Competing interests
The authors declare that no competing interests exist.

"This ORCID iD identifies the author of this article:" 0000-0003-1463-9553

Funding

National Institute of Diabetes and Digestive and Kidney Diseases (Intramural Research Program)

Christopher M Kim
Carson C Chow

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Copyright

This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.