Sequential Movement: Reaching into the future

When carrying out a sequence of movements, humans can plan several steps in advance to make the movement smooth.
  1. Raeed H Chowdhury  Is a corresponding author
  1. Department of Bioengineering, University of Pittsburgh, United States

Recently a friend introduced me to Beat Saber, a virtual reality game that involves using virtual swords to rhythmically slash through colored blocks that come streaming towards the player. After twenty minutes of flailing my arms around with minimal success, I gave up. My friend then passed the headset to his eight-month-pregnant wife who, after being helped off the couch, switched the difficulty to ‘expert’ and within seconds blew past my score with unbelievable grace and efficiency. Watching her, one thing became clear: while I had been focusing on how to slash the blocks nearest to me, she had already started to think about and prepare for the blocks in the distance as she slashed through those closest to her.

This ability to prepare future movements allows us to perform everyday tasks, like writing and washing dishes. However, many questions remain about how this continuous planning works in the brain. For instance, how many movements can the brain prepare in advance, and how malleable are these planned movements to change? Now, in eLife, J Andrew Pruszynski and colleagues – including Mehrdad Kashefi as first author – report new findings that help to answer these questions (Kashefi et al., 2024).

The team (who are based at Western University and San Diego State University) asked human participants to perform a task like Beat Saber (Figure 1A), where each individual had to reach towards a series of targets that appeared one after the other on a screen. However, unlike other sequential reaching tasks (Glaser et al., 2018; Zimnik and Churchland, 2021), this task also sometimes showed future targets beyond the upcoming one, allowing participants to plan multiple movements in advance, if they were able to.

Planning a sequence of movements.

(A) A schematic representation of the virtual reality game Beat Saber, during which the player must use a sword (left) to slash a stream of blocks (right) that are coming towards them – similar to the task Kashefi et al. used in their study. Based on results from Kashefi et al., knowing about future blocks influences planned movements (dashed line) and helps players to slash the boxes as they arrive. (B) A natural follow-up study would be to repeat the experiment in monkeys and use electrodes (triangles) to measure the spiking neural activity of their motor cortex (represented as a stream of vertical lines from each electrode) as they plan ahead.

Image credit: Raeed H Chowdhury; monkey illustration is by Carolina Massumoto.

Kashefi et al. found that participants could indeed plan at least two movements ahead. As they were given information on future targets, their movements became faster and more coordinated, with each movement smoothly transitioning into the next. It seemed that plans for movements in the distant future were not simply added to a queue, but instead modified movements in the near future to improve their efficiency.

Kashefi et al. confirmed this with a clever manipulation that involved making one of the targets jump, thus forcing the participants to re-plan their movements on the fly. When a target suddenly jumped to a new position on the screen, subjects were slower to respond to the jump if they already had information about the next future target. Overall, the results suggest that plans for future movements interact with and modify each other.

This interdependence between movement plans might suggest that short sequences of movements are planned together as a single trajectory, or ‘motor chunk’ (Ramkumar et al., 2016). In this scenario, once one chunk is completed, the subject moves onto the next, effectively planning one chunk – rather than one movement – at a time. However, Kashefi et al. show that this is not the case in their experiment. Participants transitioned smoothly and continuously between movements, without any discernible breaks that would indicate motor chunks. Furthermore, when a target jumped to a new position, participants were able to flexibly change individual movement plans to compensate, rather than having to re-plan a whole chunk.

In the brain, movement planning is accompanied by specific patterns of neural activity in the motor cortex, a brain region critical for skilled motions like playing a musical instrument (Strick et al., 2021). These patterns of neural activity help the brain prepare for an upcoming movement and are distinct from the activity patterns that control the actual movement (Ames et al., 2019; Churchland et al., 2010; Elsayed et al., 2016; Schimel et al., 2024).

One highly relevant study explored these preparatory neural patterns in monkeys reaching for two consecutive targets (Zimnik and Churchland, 2021). Like the study performed by Kashefi et al., the researchers found that monkeys did not prepare movements in chunks. Instead, the preparatory neural patterns that arose during the first movement prepared the monkeys to reach for the second target. However, while the study in monkeys suggested that sequential movements are prepared independently, Kashefi et al. went further by using trials with many movements and adding more targets to the planning horizon. In doing so, they showed that the preparation of future movements is in fact interrelated.

This difference between the two studies opens up a number of questions. For instance, what does neural activity look like during multi-movement planning tasks like the one conducted by Kashefi et al. (Figure 1B)? Also, what happens in the brain when plans for future targets interact, or when planned movements must change as targets unexpectedly jump to new positions?

While researchers have a reasonably good understanding of how individuals prepare single movements, much less is known about preparing movement sequences. The task and behavioral analysis undertaken by Kashefi et al. provides an excellent foundation upon which to build this knowledge. Until then, I will just have to continue practicing to get better at Beat Saber.

References

Article and author information

Author details

  1. Raeed H Chowdhury

    Raeed H Chowdhury is in the Department of Bioengineering, University of Pittsburgh, Pittsburgh, United States

    For correspondence
    raeed.chowdhury@pitt.edu
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-5934-919X

Publication history

  1. Version of Record published:

Copyright

© 2024, Chowdhury

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 583
    views
  • 37
    downloads
  • 0
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Raeed H Chowdhury
(2024)
Sequential Movement: Reaching into the future
eLife 13:e101739.
https://doi.org/10.7554/eLife.101739
  1. Further reading

Further reading

    1. Cell Biology
    2. Neuroscience
    Jun Sun, Francisca Rojo-Cortes ... Alicia Hidalgo
    Research Article

    Experience shapes the brain as neural circuits can be modified by neural stimulation or the lack of it. The molecular mechanisms underlying structural circuit plasticity and how plasticity modifies behaviour are poorly understood. Subjective experience requires dopamine, a neuromodulator that assigns a value to stimuli, and it also controls behaviour, including locomotion, learning, and memory. In Drosophila, Toll receptors are ideally placed to translate experience into structural brain change. Toll-6 is expressed in dopaminergic neurons (DANs), raising the intriguing possibility that Toll-6 could regulate structural plasticity in dopaminergic circuits. Drosophila neurotrophin-2 (DNT-2) is the ligand for Toll-6 and Kek-6, but whether it is required for circuit structural plasticity was unknown. Here, we show that DNT-2-expressing neurons connect with DANs, and they modulate each other. Loss of function for DNT-2 or its receptors Toll-6 and kinase-less Trk-like kek-6 caused DAN and synapse loss, impaired dendrite growth and connectivity, decreased synaptic sites, and caused locomotion deficits. In contrast, over-expressed DNT-2 increased DAN cell number, dendrite complexity, and promoted synaptogenesis. Neuronal activity modified DNT-2, increased synaptogenesis in DNT-2-positive neurons and DANs, and over-expression of DNT-2 did too. Altering the levels of DNT-2 or Toll-6 also modified dopamine-dependent behaviours, including locomotion and long-term memory. To conclude, a feedback loop involving dopamine and DNT-2 highlighted the circuits engaged, and DNT-2 with Toll-6 and Kek-6 induced structural plasticity in this circuit modifying brain function and behaviour.

    1. Neuroscience
    Walter Senn, Dominik Dold ... Mihai A Petrovici
    Research Article

    One of the most fundamental laws of physics is the principle of least action. Motivated by its predictive power, we introduce a neuronal least-action principle for cortical processing of sensory streams to produce appropriate behavioral outputs in real time. The principle postulates that the voltage dynamics of cortical pyramidal neurons prospectively minimizes the local somato-dendritic mismatch error within individual neurons. For output neurons, the principle implies minimizing an instantaneous behavioral error. For deep network neurons, it implies the prospective firing to overcome integration delays and correct for possible output errors right in time. The neuron-specific errors are extracted in the apical dendrites of pyramidal neurons through a cortical microcircuit that tries to explain away the feedback from the periphery, and correct the trajectory on the fly. Any motor output is in a moving equilibrium with the sensory input and the motor feedback during the ongoing sensory-motor transform. Online synaptic plasticity reduces the somatodendritic mismatch error within each cortical neuron and performs gradient descent on the output cost at any moment in time. The neuronal least-action principle offers an axiomatic framework to derive local neuronal and synaptic laws for global real-time computation and learning in the brain.