Neural population dynamics of computing with synaptic modulations

  1. Kyle Aitken  Is a corresponding author
  2. Stefan Mihalas
  1. Allen Institute, United States

Abstract

In addition to long-timescale rewiring, synapses in the brain are subject to significant modulation that occurs at faster timescales. These modulations vary widely in underlying biological mechanisms as well as the timescales over which they occur, yet they all endow the brain with additional means of processing information. Despite this, models of the brain like recurrent neural networks (RNNs) often have their weights frozen after training, relying on an internal state stored in neuronal activity to hold temporal information over task-relevant timescales. Although networks with dynamical synapses have been explored previously, often said modulations are added to networks that also have recurrent connections and thus the computational capabilities and dynamical behavior contributed by the synapses remain unclear. In this work, we study the computational potential and resulting dynamics of a network that relies solely on synapse dynamics to process temporal information, the multi-plasticity network (MPN). Unlike traditional RNNs, the weights in the MPN are modulated during inference. The generality of the MPN allows for our results to apply to synaptic modulation mechanisms ranging from short-term synaptic plasticity (STSP) to slower modulations such as spike-time dependent plasticity (STDP). We thoroughly examine the neural population dynamics of the MPN trained on integration-based tasks and compare it to known RNN dynamics, finding the two to have fundamentally different attractor structure. We find said differences in dynamics allow the MPN to outperform its RNN counterparts on several neuroscience-relevant tests. Training the MPN across a battery of neuroscience tasks, we find its computational capabilities in such settings is comparable to networks that compute with recurrent connections. Altogether, we believe this works demonstrates the computational possibilities of computing with synaptic modulations and highlights important motifs of these computations so that they can be identified in brain-like systems.

Data availability

The current manuscript is a computational study, so no data have been generated for this manuscript. Modeling code is available on GitHub at: https://github.com/kaitken17/mpn (the link provided in the Methods section of the paper).

Article and author information

Author details

  1. Kyle Aitken

    MindScope Program, Allen Institute, Seattle, United States
    For correspondence
    kyle.aitken@alleninstitute.org
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-0207-5885
  2. Stefan Mihalas

    MindScope Program, Allen Institute, Seattle, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-2629-7100

Funding

National Institutes of Health (F1DA055669)

  • Stefan Mihalas

National Institutes of Health (R01EB02981)

  • Stefan Mihalas

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Copyright

© 2023, Aitken & Mihalas

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,942
    views
  • 322
    downloads
  • 6
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Kyle Aitken
  2. Stefan Mihalas
(2023)
Neural population dynamics of computing with synaptic modulations
eLife 12:e83035.
https://doi.org/10.7554/eLife.83035

Share this article

https://doi.org/10.7554/eLife.83035

Further reading

    1. Neuroscience
    Jakob Rupert, Dragomir Milovanovic
    Insight

    By influencing calcium homeostasis, local protein synthesis and the endoplasmic reticulum, a small protein called Rab10 emerges as a crucial cytoplasmic regulator of neuropeptide secretion.

    1. Neuroscience
    Yi-Yun Ho, Qiuwei Yang ... Melissa R Warden
    Research Article

    The infralimbic cortex (IL) is essential for flexible behavioral responses to threatening environmental events. Reactive behaviors such as freezing or flight are adaptive in some contexts, but in others a strategic avoidance behavior may be more advantageous. IL has been implicated in avoidance, but the contribution of distinct IL neural subtypes with differing molecular identities and wiring patterns is poorly understood. Here, we study IL parvalbumin (PV) interneurons in mice as they engage in active avoidance behavior, a behavior in which mice must suppress freezing in order to move to safety. We find that activity in inhibitory PV neurons increases during movement to avoid the shock in this behavioral paradigm, and that PV activity during movement emerges after mice have experienced a single shock, prior to learning avoidance. PV neural activity does not change during movement toward cued rewards or during general locomotion in the open field, behavioral paradigms where freezing does not need to be suppressed to enable movement. Optogenetic suppression of PV neurons increases the duration of freezing and delays the onset of avoidance behavior, but does not affect movement toward rewards or general locomotion. These data provide evidence that IL PV neurons support strategic avoidance behavior by suppressing freezing.