1. Neuroscience
  2. Physics of Living Systems

Unsupervised Bayesian Ising Approximation for decoding neural activity and other biological dictionaries

  1. Damián G Hernández  Is a corresponding author
  2. Samuel J Sober  Is a corresponding author
  3. Ilya Nemenman  Is a corresponding author
  1. Centro Atómico Bariloche and Instituto Balseiro, Argentina
  2. Emory University, United States
https://doi.org/10.7554/eLife.68192
Share this article
Cite this article
  1. Damián G Hernández
  2. Samuel J Sober
  3. Ilya Nemenman
(2022)
Unsupervised Bayesian Ising Approximation for decoding neural activity and other biological dictionaries
eLife 11:e68192.
https://doi.org/10.7554/eLife.68192
  2. Download BibTeX
  3. Download .RIS

Abstract

The problem of deciphering how low-level patterns (action potentials in the brain, amino acids in a protein, etc.) drive high-level biological features (sensorimotor behavior, enzymatic function) represents the central challenge of quantitative biology. The lack of general methods for doing so from the size of datasets that can be collected experimentally severely limits our understanding of the biological world. For example, in neuroscience, some sensory and motor codes have been shown to consist of precisely timed multi-spike patterns. However, the combinatorial complexity of such pattern codes have precluded development of methods for their comprehensive analysis. Thus, just as it is hard to predict a protein’s function based on its sequence, we still do not understand how to accurately predict an organism's behavior based on neural activity. Here we introduce the unsupervised Bayesian Ising Approximation (uBIA) for solving this class of problems. We demonstrate its utility in an application to neural data, detecting precisely timed spike patterns that code for specific motor behaviors in a songbird vocal system. In data recorded during singing from neurons in a vocal control region, our method detects such codewords with an arbitrary number of spikes, does so from small data sets, and accounts for dependencies in occurrences of codewords. Detecting such comprehensive motor control dictionaries can improve our understanding of skilled motor control and the neural bases of sensorimotor learning in animals. To further illustrate the utility of uBIA, used it to identify the distinct sets of activity patterns that encode vocal motor exploration versus typical song production. Crucially, our method can be used not only for analysis of neural systems, but also for understanding the structure of correlations in other biological and nonbiological datasets.

Data availability

The software implementation of uBIA is available from https://github.com/dghernandez/decomotor. The data used in this work is availablefrom https://figshare.com/articles/Songbird_premotor_dictionaries/10315844.

The following previously published data sets were used

Article and author information

Author details

  1. Damián G Hernández

    Department of Medical Physics, Centro Atómico Bariloche and Instituto Balseiro, Bariloche, Argentina
    For correspondence
    damian.g.h.l@gmail.com
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-8995-7495

  2. Samuel J Sober

    Department of Biology, Emory University, Atlanta, United States
    For correspondence
    samuel.j.sober@emory.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-1140-7469

  3. Ilya Nemenman

    Department of Physics, Emory University, Atlanta, United States
    For correspondence
    ilya.nemenman@emory.edu
    Competing interests
    The authors declare that no competing interests exist.

Funding

National Institutes of Health (R01-EB022872)

  • Damián G Hernández
  • Samuel J Sober
  • Ilya Nemenman

Simons Foundation (Simons Investigator in MPS)

  • Ilya Nemenman

National Institutes of Health (R01-NS084844)

  • Samuel J Sober
  • Ilya Nemenman

National Institutes of Health (R01-NS099375)

  • Damián G Hernández
  • Samuel J Sober
  • Ilya Nemenman

National Science Foundation (BCS-1822677 (CRCNS Program))

  • Samuel J Sober
  • Ilya Nemenman

KITP ((NSF) PHY-1748958)

  • Ilya Nemenman

KITP ((NIH) R25GM067110)

  • Ilya Nemenman

KITP ((Gordon and Betty Moore) 2919.01)

  • Ilya Nemenman

Aspen Center for Physics ((NSF) PHY-1607611)

  • Samuel J Sober
  • Ilya Nemenman

Simons Foundation (The Simons-Emory International Consortium on Motor Control)

  • Samuel J Sober
  • Ilya Nemenman

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Copyright

© 2022, Hernández et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,121
    views
  • 225
    downloads
  • 8
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Damián G Hernández
  2. Samuel J Sober
  3. Ilya Nemenman
(2022)
Unsupervised Bayesian Ising Approximation for decoding neural activity and other biological dictionaries
eLife 11:e68192.
https://doi.org/10.7554/eLife.68192

Share this article

https://doi.org/10.7554/eLife.68192

Categories and tags

Further reading

    1. Neuroscience

    Evaluating hippocampal replay without a ground truth

    Masahiro Takigawa, Marta Huelin Gorriz ... Daniel Bendor
    Research Article

    During rest and sleep, memory traces replay in the brain. The dialogue between brain regions during replay is thought to stabilize labile memory traces for long-term storage. However, because replay is an internally-driven, spontaneous phenomenon, it does not have a ground truth - an external reference that can validate whether a memory has truly been replayed. Instead, replay detection is based on the similarity between the sequential neural activity comprising the replay event and the corresponding template of neural activity generated during active locomotion. If the statistical likelihood of observing such a match by chance is sufficiently low, the candidate replay event is inferred to be replaying that specific memory. However, without the ability to evaluate whether replay detection methods are successfully detecting true events and correctly rejecting non-events, the evaluation and comparison of different replay methods is challenging. To circumvent this problem, we present a new framework for evaluating replay, tested using hippocampal neural recordings from rats exploring two novel linear tracks. Using this two-track paradigm, our framework selects replay events based on their temporal fidelity (sequence-based detection), and evaluates the detection performance using each event's track discriminability, where sequenceless decoding across both tracks is used to quantify whether the track replaying is also the most likely track being reactivated.

    1. Neuroscience

    Brain Activity: Unifying networks of a rhythm

    Mohsen Alavash
    Insight

    Combining electrophysiological, anatomical and functional brain maps reveals networks of beta neural activity that align with dopamine uptake.

    1. Neuroscience

    A deep learning approach for automated scoring of the Rey–Osterrieth complex figure

    Nicolas Langer, Maurice Weber ... Ce Zhang
    Tools and Resources

    Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey–Osterrieth complex figure (ROCF) is the state-of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF drawing and quantifies deviations from the original figure. This manual procedure is time-consuming, slow and scores vary depending on the clinician’s experience, motivation, and tiredness. Here, we leverage novel deep learning architectures to automatize the rating of memory deficits. For this, we collected more than 20k hand-drawn ROCF drawings from patients with various neurological and psychiatric disorders as well as healthy participants. Unbiased ground truth ROCF scores were obtained from crowdsourced human intelligence. This dataset was used to train and evaluate a multihead convolutional neural network. The model performs highly unbiased as it yielded predictions very close to the ground truth and the error was similarly distributed around zero. The neural network outperforms both online raters and clinicians. The scoring system can reliably identify and accurately score individual figure elements in previously unseen ROCF drawings, which facilitates explainability of the AI-scoring system. To ensure generalizability and clinical utility, the model performance was successfully replicated in a large independent prospective validation study that was pre-registered prior to data collection. Our AI-powered scoring system provides healthcare institutions worldwide with a digital tool to assess objectively, reliably, and time-efficiently the performance in the ROCF test from hand-drawn images.