Fundamental bound on the persistence and capacity of short-term memory stored as graded persistent activity

  1. Onur Ozan Koyluoglu  Is a corresponding author
  2. Yoni Pertzov
  3. Sanjay Manohar
  4. Masud Husain
  5. Ila R Fiete
  1. University of California, United States
  2. Hebrew University of Jerusalem, Israel
  3. University of Oxford, United Kingdom
  4. The University of Texas at Austin, United States

Abstract

It is widely believed that persistent neural activity underlies short-term memory. Yet, as we show, temporal degradation in such networks behaves differently from human short-term memory performance. We build a more general framework where the memory is viewed as a problem of passing information through noisy channels that represent analog persistent activity networks. Rather than directly storing information, such memory networks might hold information encoded to achieve robustness against noise. We derive a fundamental lower-bound on memory recall precision, which declines with storage duration and number of stored items. We show that human performance, though inconsistent with models involving direct (uncoded) storage in persistent activity networks, can be well-fit by the theoretical bound. This finding is consistent with the view that if the brain stores information in patterns of persistent activity, it might use codes that minimize the effects of noise, motivating the search for such codes in the brain.

Article and author information

Author details

  1. Onur Ozan Koyluoglu

    Department of Electrical and Computer Science, University of California, Berkeley, United States
    For correspondence
    ozan.koyluoglu@berkeley.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8512-4755
  2. Yoni Pertzov

    Department of Psychology, Hebrew University of Jerusalem, Jerusalem, Israel
    Competing interests
    The authors declare that no competing interests exist.
  3. Sanjay Manohar

    Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-0735-4349
  4. Masud Husain

    Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  5. Ila R Fiete

    Center for Learning and Memory, The University of Texas at Austin, Austin, United States
    Competing interests
    The authors declare that no competing interests exist.

Funding

National Science Foundation (IIS-1464349)

  • Onur Ozan Koyluoglu

Israeli Science Foundation (1747/14)

  • Yoni Pertzov

National Institute for Health Research (Oxford Biomedical Centre)

  • Masud Husain

Wellcome Trust

  • Masud Husain

National Science Foundation (IIS-1148973)

  • Ila R Fiete

Simons Foundation

  • Ila R Fiete

Howard Hughes Medical Institute (Faculty Scholar Award)

  • Ila R Fiete

MRC Clinician Scientist Fellowship (MR/P00878X)

  • Sanjay Manohar

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: The study reported here conform to the Declaration of Helsinki and all procedures were approved by the ethics committee of the National Hospital for Neurology and Neurosurgery (NHNN) prior to the study commencing. Research Ethics Committee number (ERC) 04/Q0406/60. Personal information about individuals was password protected and saved in compliance to the Data Protection Act 1998 (DPA).

Copyright

© 2017, Koyluoglu et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,537
    views
  • 393
    downloads
  • 30
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Onur Ozan Koyluoglu
  2. Yoni Pertzov
  3. Sanjay Manohar
  4. Masud Husain
  5. Ila R Fiete
(2017)
Fundamental bound on the persistence and capacity of short-term memory stored as graded persistent activity
eLife 6:e22225.
https://doi.org/10.7554/eLife.22225

Share this article

https://doi.org/10.7554/eLife.22225

Further reading

    1. Computational and Systems Biology
    Liqi Kang, Banghao Wu ... Liang Hong
    Research Article

    Artificial intelligence (AI) models have been used to study the compositional regularities of proteins in nature, enabling it to assist in protein design to improve the efficiency of protein engineering and reduce manufacturing cost. However, in industrial settings, proteins are often required to work in extreme environments where they are relatively scarce or even non-existent in nature. Since such proteins are almost absent in the training datasets, it is uncertain whether AI model possesses the capability of evolving the protein to adapt extreme conditions. Antibodies are crucial components of affinity chromatography, and they are hoped to remain active at the extreme environments where most proteins cannot tolerate. In this study, we applied an advanced large language model (LLM), the Pro-PRIME model, to improve the alkali resistance of a representative antibody, a VHH antibody capable of binding to growth hormone. Through two rounds of design, we ensured that the selected mutant has enhanced functionality, including higher thermal stability, extreme pH resistance, and stronger affinity, thereby validating the generalized capability of the LLM in meeting specific demands. To the best of our knowledge, this is the first LLM-designed protein product, which is successfully applied in mass production.

    1. Computational and Systems Biology
    2. Genetics and Genomics
    Jia-Ying Su, Yun-Lin Wang ... Chien-Ling Lin
    Research Article

    Untranslated regions (UTRs) contain crucial regulatory elements for RNA stability, translation and localization, so their integrity is indispensable for gene expression. Approximately 3.7% of genetic variants associated with diseases occur in UTRs, yet a comprehensive understanding of UTR variant functions remains limited due to inefficient experimental and computational assessment methods. To systematically evaluate the effects of UTR variants on RNA stability, we established a massively parallel reporter assay on 6555 UTR variants reported in human disease databases. We examined the RNA degradation patterns mediated by the UTR library in two cell lines, and then applied LASSO regression to model the influential regulators of RNA stability. We found that UA dinucleotides and UA-rich motifs are the most prominent destabilizing element. Gain of UA dinucleotide outlined mutant UTRs with reduced stability. Studies on endogenous transcripts indicate that high UA-dinucleotide ratios in UTRs promote RNA degradation. Conversely, elevated GC content and protein binding on UA dinucleotides protect high-UA RNA from degradation. Further analysis reveals polarized roles of UA-dinucleotide-binding proteins in RNA protection and degradation. Furthermore, the UA-dinucleotide ratio of both UTRs is a common characteristic of genes in innate immune response pathways, implying a coordinated stability regulation through UTRs at the transcriptomic level. We also demonstrate that stability-altering UTRs are associated with changes in biobank-based health indices, underscoring the importance of precise UTR regulation for wellness. Our study highlights the importance of RNA stability regulation through UTR primary sequences, paving the way for further exploration of their implications in gene networks and precision medicine.