Gated recurrence enables simple and accurate sequence prediction in stochastic, changing, and structured environments

  1. Cédric Foucault
  2. Florent Meyniel  Is a corresponding author
  1. INSERM, CEA, Université Paris-Saclay, France
  2. CEA, Sorbonne Université, France

Abstract

From decision making to perception to language, predicting what is coming next is crucial. It is also challenging in stochastic, changing, and structured environments; yet the brain makes accurate predictions in many situations. What computational architecture could enable this feat? Bayesian inference makes optimal predictions but is prohibitively difficult to compute. Here, we show that a specific recurrent neural network architecture enables simple and accurate solutions in several environments. This architecture relies on three mechanisms: gating, lateral connections, and recurrent weight training. Like the optimal solution and the human brain, such networks develop internal representations of their changing environment (including estimates of the environment's latent variables and the precision of these estimates), leverage multiple levels of latent structure, and adapt their effective learning rate to changes without changing their connection weights. Being ubiquitous in the brain, gated recurrence could therefore serve as a generic building block to predict in real-life environments.

Data availability

This paper presents no experimental data. All synthetic data are available in the code repository at https://github.com/cedricfoucault/networks_for_sequence_prediction and archived on Zenodo with DOI: 10.5281/zenodo.5707498.

The following data sets were generated
    1. Foucault C
    (2021) Networks for sequence prediction
    Publicly available at Zenodo (https://zenodo.org/).

Article and author information

Author details

  1. Cédric Foucault

    INSERM, CEA, Université Paris-Saclay, Gif sur Yvette, France
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-7247-6927
  2. Florent Meyniel

    NeuroSpin, CEA, Sorbonne Université, Gif sur Yvette, France
    For correspondence
    florent.meyniel@cea.fr
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-6992-678X

Funding

Ecole normale superieure Paris-Saclay (PhD fellowship Contrat doctoral spécifique normalien"")

  • Cédric Foucault

Agence Nationale de la Recherche (18-CE37-0010-01 CONFI LEARN"")

  • Florent Meyniel

H2020 European Research Council (ERC StG 947105 NEURAL PROB"")

  • Florent Meyniel

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Reviewing Editor

  1. Srdjan Ostojic, Ecole Normale Superieure Paris, France

Version history

  1. Preprint posted: May 3, 2021 (view preprint)
  2. Received: June 30, 2021
  3. Accepted: December 1, 2021
  4. Accepted Manuscript published: December 2, 2021 (version 1)
  5. Version of Record published: January 6, 2022 (version 2)
  6. Version of Record updated: January 21, 2022 (version 3)
  7. Version of Record updated: February 3, 2022 (version 4)

Copyright

© 2021, Foucault & Meyniel

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,205
    views
  • 183
    downloads
  • 5
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Cédric Foucault
  2. Florent Meyniel
(2021)
Gated recurrence enables simple and accurate sequence prediction in stochastic, changing, and structured environments
eLife 10:e71801.
https://doi.org/10.7554/eLife.71801

Share this article

https://doi.org/10.7554/eLife.71801

Further reading

    1. Neuroscience
    Nicholas GW Kennedy, Jessica C Lee ... Nathan M Holmes
    Research Article

    How is new information organized in memory? According to latent state theories, this is determined by the level of surprise, or prediction error, generated by the new information: a small prediction error leads to the updating of existing memory, large prediction error leads to encoding of a new memory. We tested this idea using a protocol in which rats were first conditioned to fear a stimulus paired with shock. The stimulus was then gradually extinguished by progressively reducing the shock intensity until the stimulus was presented alone. Consistent with latent state theories, this gradual extinction protocol (small prediction errors) was better than standard extinction (large prediction errors) in producing long-term suppression of fear responses, and the benefit of gradual extinction was due to updating of the conditioning memory with information about extinction. Thus, prediction error determines how new information is organized in memory, and latent state theories adequately describe the ways in which this occurs.

    1. Biochemistry and Chemical Biology
    2. Neuroscience
    Katarzyna Marta Zoltowska, Utpal Das ... Lucía Chávez-Gutiérrez
    Research Article

    Amyloid β (Aβ) peptides accumulating in the brain are proposed to trigger Alzheimer’s disease (AD). However, molecular cascades underlying their toxicity are poorly defined. Here, we explored a novel hypothesis for Aβ42 toxicity that arises from its proven affinity for γ-secretases. We hypothesized that the reported increases in Aβ42, particularly in the endolysosomal compartment, promote the establishment of a product feedback inhibitory mechanism on γ-secretases, and thereby impair downstream signaling events. We conducted kinetic analyses of γ-secretase activity in cell-free systems in the presence of Aβ, as well as cell-based and ex vivo assays in neuronal cell lines, neurons, and brain synaptosomes to assess the impact of Aβ on γ-secretases. We show that human Aβ42 peptides, but neither murine Aβ42 nor human Aβ17–42 (p3), inhibit γ-secretases and trigger accumulation of unprocessed substrates in neurons, including C-terminal fragments (CTFs) of APP, p75, and pan-cadherin. Moreover, Aβ42 treatment dysregulated cellular homeostasis, as shown by the induction of p75-dependent neuronal death in two distinct cellular systems. Our findings raise the possibility that pathological elevations in Aβ42 contribute to cellular toxicity via the γ-secretase inhibition, and provide a novel conceptual framework to address Aβ toxicity in the context of γ-secretase-dependent homeostatic signaling.