1. Neuroscience

The impact of task context on predicting finger movements in a brain-machine interface

  1. Matthew J Mender
  2. Samuel R Nason-Tomaszewski
  3. Hisham Temmar
  4. Joseph T Costello
  5. Dylan M Wallace
  6. Matthew S Willsey
  7. Nishant Ganesh Kumar
  8. Theodore A Kung
  9. Parag Patil  Is a corresponding author
  10. Cynthia A Chestek  Is a corresponding author
  1. University of Michigan-Ann Arbor, United States
https://doi.org/10.7554/eLife.82598
Share this article
Cite this article
  1. Matthew J Mender
  2. Samuel R Nason-Tomaszewski
  3. Hisham Temmar
  4. Joseph T Costello
  5. Dylan M Wallace
  6. Matthew S Willsey
  7. Nishant Ganesh Kumar
  8. Theodore A Kung
  9. Parag Patil
  10. Cynthia A Chestek
(2023)
The impact of task context on predicting finger movements in a brain-machine interface
eLife 12:e82598.
https://doi.org/10.7554/eLife.82598
  2. Download BibTeX
  3. Download .RIS

Abstract

A key factor in the clinical translation of brain-machine interfaces (BMIs) for restoring hand motor function will be their robustness to changes in a task. With functional electrical stimulation (FES) for example, the patient's own hand will be used to produce a wide range of forces in otherwise similar movements. To investigate the impact of task changes on BMI performance, we trained two rhesus macaques to control a virtual hand with their physical hand while we added springs to each finger group (index or middle-ring-small) or altered their wrist posture. Using simultaneously recorded intracortical neural activity, finger positions, and electromyography, we found that decoders trained in one context did not generalize well to other contexts, leading to significant increases in prediction error, especially for muscle activations. However, with respect to online BMI control of the virtual hand, changing either the decoder training task context or the hand's physical context during online control had little effect on online performance. We explain this dichotomy by showing that the structure of neural population activity remained similar in new contexts, which could allow for fast adjustment online. Additionally, we found that neural activity shifted trajectories proportional to the required muscle activation in new contexts. This shift in neural activity possibly explains biases to off-context kinematic predictions and suggests a feature that could help predict different magnitude muscle activations while producing similar kinematics.

Data availability

Neural, behavioral, EMG, and online BMI performance data has been deposited in the Dryad repository (https://doi.org/10.5061/dryad.p2ngf1vtn).

The following data sets were generated

Article and author information

Author details

  1. Matthew J Mender

    Department of Biomedical Engineering, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1562-3289

  2. Samuel R Nason-Tomaszewski

    Department of Biomedical Engineering, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.

  3. Hisham Temmar

    Department of Biomedical Engineering, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-4464-4911

  4. Joseph T Costello

    Department of Electrical Engineering and Computer Science, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.

  5. Dylan M Wallace

    Department of Robotics, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.

  6. Matthew S Willsey

    Department of Biomedical Engineering, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.

  7. Nishant Ganesh Kumar

    Department of Surgery, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.

  8. Theodore A Kung

    Department of Surgery, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    The authors declare that no competing interests exist.

  9. Parag Patil

    Department of Biomedical Engineering, University of Michigan-Ann Arbor, Ann Arbor, United States
    For correspondence
    pgpatil@med.umich.edu
    Competing interests
    The authors declare that no competing interests exist.

  10. Cynthia A Chestek

    Department of Biomedical Engineering, University of Michigan-Ann Arbor, Ann Arbor, United States
    For correspondence
    cchestek@umich.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9671-7051

Funding

National Science Foundation (Grant Number 1926576)

  • Matthew J Mender
  • Hisham Temmar
  • Parag Patil
  • Cynthia A Chestek

National Institute of General Medical Sciences (Grant Number R01GM111293)

  • Parag Patil
  • Cynthia A Chestek

National Science Foundation (Graduate Research Fellowship Program)

  • Joseph T Costello

Eunice Kennedy Shriver National Institute of Child Health and Human Development (Grant Number F31HD098804)

  • Samuel R Nason-Tomaszewski

National Institute of Neurological Disorders and Stroke (Grant Number T32NS007222)

  • Matthew S Willsey

National Institute of Neurological Disorders and Stroke (Grant Number R01NS105132)

  • Nishant Ganesh Kumar
  • Theodore A Kung

The D. Dan and Betty Kahn Foundation (Grant AWD011321)

  • Dylan M Wallace

University of Michigan Robotics Institute (Graduate student fellowship)

  • Dylan M Wallace

A. Alfred Taubman Medical Research Institute

  • Parag Patil

Craig H. Neilsen Foundation (Project 315108)

  • Cynthia A Chestek

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: All protocols were in accord with the National Institutes of Health guidelines and approved by the University of Michigan Institutional Animal Care and Use Committee (protocol numbers PRO00010076 and PRO00008138).

Copyright

© 2023, Mender et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 617
    views
  • 109
    downloads
  • 1
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Matthew J Mender
  2. Samuel R Nason-Tomaszewski
  3. Hisham Temmar
  4. Joseph T Costello
  5. Dylan M Wallace
  6. Matthew S Willsey
  7. Nishant Ganesh Kumar
  8. Theodore A Kung
  9. Parag Patil
  10. Cynthia A Chestek
(2023)
The impact of task context on predicting finger movements in a brain-machine interface
eLife 12:e82598.
https://doi.org/10.7554/eLife.82598

Share this article

https://doi.org/10.7554/eLife.82598

Categories and tags

Research organism

Further reading

    1. Neuroscience

    Tripartite organization of brain state dynamics underlying spoken narrative comprehension

    Lanfang Liu, Jiahao Jiang ... Guosheng Ding
    Research Article

    Speech comprehension involves the dynamic interplay of multiple cognitive processes, from basic sound perception, to linguistic encoding, and finally to complex semantic-conceptual interpretations. How the brain handles the diverse streams of information processing remains poorly understood. Applying Hidden Markov Modeling to fMRI data obtained during spoken narrative comprehension, we reveal that the whole brain networks predominantly oscillate within a tripartite latent state space. These states are, respectively, characterized by high activities in the sensory-motor (State #1), bilateral temporal (State #2), and default mode networks (DMN; State #3) regions, with State #2 acting as a transitional hub. The three states are selectively modulated by the acoustic, word-level semantic, and clause-level semantic properties of the narrative. Moreover, the alignment with both the best performer and the group-mean in brain state expression can predict participants’ narrative comprehension scores measured from the post-scan recall. These results are reproducible with different brain network atlas and generalizable to two datasets consisting of young and older adults. Our study suggests that the brain underlies narrative comprehension by switching through a tripartite state space, with each state probably dedicated to a specific component of language faculty, and effective narrative comprehension relies on engaging those states in a timely manner.

    1. Developmental Biology
    2. Neuroscience

    Aberrant FGF signaling promotes granule neuron precursor expansion in SHH subgroup infantile medulloblastoma

    Odessa R Yabut, Jessica Arela ... Samuel J Pleasure
    Research Article

    Mutations in Sonic Hedgehog (SHH) signaling pathway genes, for example, Suppressor of Fused (SUFU), drive granule neuron precursors (GNP) to form medulloblastomas (MBSHH). However, how different molecular lesions in the Shh pathway drive transformation is frequently unclear, and SUFU mutations in the cerebellum seem distinct. In this study, we show that fibroblast growth factor 5 (FGF5) signaling is integral for many infantile MBSHH cases and that FGF5 expression is uniquely upregulated in infantile MBSHH tumors. Similarly, mice lacking SUFU (Sufu-cKO) ectopically express Fgf5 specifically along the secondary fissure where GNPs harbor preneoplastic lesions and show that FGFR signaling is also ectopically activated in this region. Treatment with an FGFR antagonist rescues the severe GNP hyperplasia and restores cerebellar architecture. Thus, direct inhibition of FGF signaling may be a promising and novel therapeutic candidate for infantile MBSHH.

    1. Neuroscience

    Mixed representations of choice direction and outcome by GABA/glutamate cotransmitting neurons in the entopeduncular nucleus

    Julianna Locantore, Yijun Liu ... Michael Wallace
    Research Article

    The basal ganglia (BG) are an evolutionarily conserved and phylogenetically old set of sub-cortical nuclei that guide action selection, evaluation, and reinforcement. The entopeduncular nucleus (EP) is a major BG output nucleus that contains a population of GABA/glutamate cotransmitting neurons (EPSst+) that specifically target the lateral habenula (LHb) and whose function in behavior remains mysterious. Here, we use a probabilistic switching task that requires an animal to maintain flexible relationships between action selection and evaluation to examine when and how GABA/glutamate cotransmitting neurons contribute to behavior. We find that EPSst+ neurons are strongly engaged during this task and show bidirectional changes in activity during the choice and outcome periods of a trial. We then tested the effects of either permanently blocking cotransmission or modifying the GABA/glutamate ratio on behavior in well-trained animals. Neither manipulation produced detectable changes in behavior despite significant changes in synaptic transmission in the LHb, demonstrating that the outputs of these neurons are not required for ongoing action-outcome updating in a probabilistic switching task.