Local online learning in recurrent networks with random feedback

  1. James M Murray  Is a corresponding author
  1. Columbia University, United States

Abstract

Recurrent neural networks (RNNs) enable the production and processing of time-dependent signals such as those involved in movement and working memory. Classic gradient-based algorithms for training RNNs have been available for decades, but are inconsistent with biological features of the brain, such as causality and locality. We derive an approximation to gradient-based learning that comports with these constraints by requiring synaptic weight updates to depend only on local information about pre- and postsynaptic activities, in addition to a random feedback projection of the RNN output error. In addition to providing mathematical arguments for the effectiveness of the new learning rule, we show through simulations that it can be used to train an RNN to perform a variety of tasks. Finally, to overcome the difficulty of training over very large numbers of timesteps, we propose an augmented circuit architecture that allows the RNN to concatenate short-duration patterns into longer sequences.

Data availability

Code implementing the RFLO learning algorithm for the example shown in Figure 2 has been included as a source code file accompanying this manuscript.

Article and author information

Author details

  1. James M Murray

    Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, United States
    For correspondence
    jm4347@columbia.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3706-4895

Funding

National Institutes of Health (DP5 OD019897)

  • James M Murray

National Science Foundation (DBI-1707398)

  • James M Murray

Gatsby Charitable Foundation

  • James M Murray

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Copyright

© 2019, Murray

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 5,870
    views
  • 933
    downloads
  • 50
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. James M Murray
(2019)
Local online learning in recurrent networks with random feedback
eLife 8:e43299.
https://doi.org/10.7554/eLife.43299

Share this article

https://doi.org/10.7554/eLife.43299

Further reading

    1. Neuroscience
    Vincent Huson, Wade G Regehr
    Research Article

    Unipolar brush cells (UBCs) are excitatory interneurons in the cerebellar cortex that receive mossy fiber (MF) inputs and excite granule cells. The UBC population responds to brief burst activation of MFs with a continuum of temporal transformations, but it is not known how UBCs transform the diverse range of MF input patterns that occur in vivo. Here, we use cell-attached recordings from UBCs in acute cerebellar slices to examine responses to MF firing patterns that are based on in vivo recordings. We find that MFs evoke a continuum of responses in the UBC population, mediated by three different types of glutamate receptors that each convey a specialized component. AMPARs transmit timing information for single stimuli at up to 5 spikes/s, and for very brief bursts. A combination of mGluR2/3s (inhibitory) and mGluR1s (excitatory) mediates a continuum of delayed, and broadened responses to longer bursts, and to sustained high frequency activation. Variability in the mGluR2/3 component controls the time course of the onset of firing, and variability in the mGluR1 component controls the duration of prolonged firing. We conclude that the combination of glutamate receptor types allows each UBC to simultaneously convey different aspects of MF firing. These findings establish that UBCs are highly flexible circuit elements that provide diverse temporal transformations that are well suited to contribute to specialized processing in different regions of the cerebellar cortex.

    1. Neuroscience
    Choongheon Lee, Mohammad Shokrian ... Jong-Hoon Nam
    Research Article

    We hypothesized that active outer hair cells drive cochlear fluid circulation. The hypothesis was tested by delivering the neurotoxin, kainic acid, to the intact round window of young gerbil cochleae while monitoring auditory responses in the cochlear nucleus. Sounds presented at a modest level significantly expedited kainic acid delivery. When outer-hair-cell motility was suppressed by salicylate, the facilitation effect was compromised. A low-frequency tone was more effective than broadband noise, especially for drug delivery to apical locations. Computational model simulations provided the physical basis for our observation, which incorporated solute diffusion, fluid advection, fluid–structure interaction, and outer-hair-cell motility. Active outer hair cells deformed the organ of Corti like a peristaltic tube to generate apically streaming flows along the tunnel of Corti and basally streaming flows along the scala tympani. Our measurements and simulations coherently suggest that active outer hair cells in the tail region of cochlear traveling waves drive cochlear fluid circulation.