Postural control of arm and fingers through integration of movement commands

  1. Scott T Albert  Is a corresponding author
  2. Alkis M Hadjiosif
  3. Jihoon Jang
  4. Andrew J Zimnik
  5. Demetris S Soteropoulos
  6. Stuart N Baker
  7. Mark M Churchland
  8. John W Krakauer
  9. Reza Shadmehr  Is a corresponding author
  1. Department of Biomedical Engineering, Johns Hopkins School of Medicine, United States
  2. Department of Neurology, Johns Hopkins School of Medicine, United States
  3. Department of Neuroscience, Columbia University, United States
  4. Institute of Neuroscience, Newcastle University, United Kingdom
8 figures and 2 additional files

Figures

Figure 1 with 1 supplement
Integral of muscle activity during the reach correlates with subsequent activity during the hold period.

(A) In current models (left), a feedback controller generates commands that move the arm, and then upon reach end, a postural controller holds the limb still. For this model, hold commands depend only on the target position. In the model considered here (right), the move commands are integrated in real-time by a postural controller. Thus, the hold commands depend on the preceding reach commands, not solely the target position. (B) Monkeys reached out to one of eight targets, waited, and then reached back to the home position. EMG from ant. deltoid is shown for three targets, and decomposed into m(t) and h(t) using Equation (5), with k = 1. (C) Normalized activity of anterior deltoid in Monkey B starting from the center location. Colors correspond to targets in part B. (D) Change in ant. deltoid EMG from the initial hold period for reach out and reach back components of the task. The bars for hold 1 and hold 2 indicate periods where hold activity was calculated. (E and F) Change in hold period activity for reach out (green) and reach back (red) components of the task as a function of the integral of the preceding reach period in two representative muscles for each monkey, and all muscles. (G) The integration gain (slope of the line in E) across various conditions: outward vs. return, fast vs. slow, horizontal target positions vs. other targets. (H) Comparison of two hypotheses: hold period activity relates linearly to integral of previous reach period, or hold period activity relates linearly to the maximum activity of the muscle in the previous reach period. Each point is a single muscle. Error bars are SEM. Statistics: **p<0.01 and n.s. p>0.05.

Figure 1—source data 1

The EXCEL source data file contains holding EMG activity and the integral of moving EMG activity for all muscles and moving directions shown in Figure 1E–H.

The ‘readme’ tab describes all quantities reported in the ‘data’ tab.

https://cdn.elifesciences.org/articles/52507/elife-52507-fig1-data1-v2.xlsx
Figure 1—figure supplement 1
Muscles that do not integrate also do not contribute to posture.

(A) Two monkeys performed a reaching task in the vertical plane. The monkeys reached out to one of eight targets, waited, and then reached back to the home position. Trajectories for the outward reach are shown. (B) Normalized activity of brachialis in Monkey B. Colors correspond to targets in A. We selected this representative muscle to demonstrate that some muscles show little to no holding activity at most, if not all, targets. These muscles all tend to show early moving activity, well before peak speed, and then cease activity around halfway through the movement. The hand speed is shown in black. (C) We selected muscles that have little to no holding activity, that is those whose activity during the hold period has a magnitude less than 10% of the peak moving activity. There are 6 out of 20 muscles who had such a property for most, if not all holding locations. We quantified the change in holding activity (from before to after the movement) and the integral of moving activity. We asked how well the integral of moving activity predicted the change in holding activity (the variance accounted for, or R2) in muscles with little holding activity (non-integrators) and others that were more active during holding still (integrators). Error bars are SEM. Statistics: *p<0.05.

The integral of muscle activity during finger flexion correlates with subsequent activity during the hold period.

(A and B) Monkeys were trained to move their index finger from an initial position to a target against a load. The traces show representative movements. Positive displacements correspond to flexion. (C) Activity of flexor digitorum profundus (FDP) in monkey R. Left panel shows FDP activity for the trials shown in (B). The bars for hold 1 and hold 2 indicate periods was hold activity was calculated. Right panel shows FDP activity during the hold periods. Activity increased with flexion of the finger, but was variable from one trial to the next. (D) Evaluation of the hypothesis that variability in muscle activity at the hold 2 position could be explained by variability in the preceding hold 1 activity. Left panel is for the FDP muscle during a single session in monkey R. Center and right panels present data across all muscles recorded in each monkey. Each ellipse is the 95% confidence interval for a single muscle. R2 value refers to a linear fit across all trials and muscles. (E) Same as for (D), except here we test the hypothesis that variability in hold period activity is related to the integral of the preceding moving activity.

Figure 2—source data 1

The EXCEL source data file contains holding EMG activity and the integral of moving EMG activity for all muscles shown in Figure 2.

The data provide trial-by-trial measures of each quantity. In addition, the position of the finger during hold 1 and hold 2 are provided for all trials in each session. The ‘readme’ tab describes all quantities reported in the ‘data’ tab.

https://cdn.elifesciences.org/articles/52507/elife-52507-fig2-data1-v2.xlsx
Figure 3 with 1 supplement
The integral of reaching forces correlates with forces produced during the subsequent hold period.

(A) Human participants held the handle of a robotic arm and made point-to-point reaching movements (top). On most trials, participants reached freely to the target. After the reach ended, a target-hold well held the hand in place (null field trial). On some trials, hand trajectory was constrained to a straight line (channel trial, trajectories shown at left). (B) Example lateral force traces on channel trials during the null field period (in a single subject). The bars hold 1 and hold 2 indicate the periods in which holding force levels were quantified. At top-right, we show the correlation between the integral of reach period forces and the change in holding force for this representative subject. At bottom-right, we compare the gain of integration (slope of the line at top-right) between conditions with and without weight support for the arm. (C) We calculated the correlation coefficient between the time-integral of reach forces and holding forces across all channel trials in the null field, within each individual (n = 220). The vertical blue line denotes the mean of the distribution. (D) For each subject, we selected their two fastest and two slowest movements in the null field, resulting in two distributions, with each subject represented equally in each distribution. We then performed linear regression on each distribution separately. Error bars for the integration gain are 95% CI at right. At middle, we show the distribution of reach duration. (E) After the null field period, we gradually introduced a velocity-dependent force field (top). We measured moving and holding forces as subjects adapted and de-adapted to counterclockwise (CCW) and clockwise (CW) force fields (bottom). (F) Each trace represents the force on one channel trial, averaged across participants during the CCW force field adaptation period. The vertical gray bars denote the start and end of the reaching movement. The color of each traces indicates the force field magnitude at each point in the experiment. The hold 1 and hold 2 bars indicate periods over which holding forces were quantified. (G) On each trial, we calculated the time-integral of forces during reaching (green) and compared these to the change in holding force (red). Values are mean ± SEM across all participants. Statistics: n.s. p>0.05.

Figure 3—source data 1

The EXCEL source data file contains holding forces and the integral of moving forces as shown in Figure 3.

The data are divided into two tabs, ‘data-panels-B-D’ and ‘data-panels-E-G’. For the former, data are provided for all channel trials appearing in the baseline null field period for all healthy participants (n = 220). Here, we also indicate the movement duration and whether or not the arm was supported against gravity. For the latter, data are provided for force field adaptation trials for the participants shown in the corresponding figure panels (n = 32). The adaptation paradigm for these trials is shown in Figure 3E (bottom). The ‘readme’ tab describes all quantities reported in the two tabs containing participant data.

https://cdn.elifesciences.org/articles/52507/elife-52507-fig3-data1-v2.xlsx
Figure 3—figure supplement 1
Holding forces are sustained across long time intervals.

Participants (n = 7) were exposed to a CCW velocity-dependent curl force that increased in magnitude across many trials. Here, we show the lateral force (top) and hand velocity (bottom) after exposure to maximal field strength. The vertical line denotes the end of the movement, hence, the start of the holding period. On the trials shown, participants held the hand at the target and waited for a long inter-trial-interval to start the next reaching movement. During this period of time, participants engaged in a working memory task.

Holding forces are an integration of moving forces, not a continuation.

We designed a set of experiments to test the possibility that hold period forces are a continuation, not an integral, of moving forces. (A) Participants (n = 11) reached in a force field that was active only during the second half of the reach. In Phase 1 (left), we gradually increased the magnitude of the force field. In Phase 2 (right), we maintained this force field for several hundred trials. We measured the change in holding force (right, red) and the integral of moving force (left, green) throughout adaptation. (B) A new set of participants (n = 14) repeated Phase 1 (left), but during Phase 2 (right) an opposite force field was gradually applied to the first half of the movement. As the integral of move period force approached zero in Phase 2, so did holding force. (C) The mean force profile over trials sampled from Phases 1 and 2 for the experiment in part B. Values are mean ± SEM across all participants.

Figure 4—source data 1

The EXCEL source data file contains holding forces and the integral of moving forces as shown in Figure 4.

The data are divided into two tabs, ‘data-panel-A’ and ‘data-panel-B’. The former contains the data for Figure 4A and the latter contains the data for Figure 4B. Data are provided for all channel trials during Phase 1 and Phase 2 of adaptation as shown in Figure 4. The ‘readme’ tab describes all quantities reported in the two tabs containing participant data.

https://cdn.elifesciences.org/articles/52507/elife-52507-fig4-data1-v2.xlsx
The null point of the postural field is set by the integral of reaching forces.

(A) To measure the arm’s postural field, we slowly displaced the hand during the holding period, while participants were distracted with a working memory task. (B) We measured the forces applied to the handle (left). We re-measured these forces after participants were exposed to a velocity-dependent curl field (at right). Forces were measured by displacing the hand outwards along 12 different lines. Interior estimates for the force were made using two-dimensional linear interpolation. The magnitude and direction of these interpolated forces are indicated by the black arrows. Color reiterates the restoring force magnitude. The holding position at reach end is located at the intersection of the two dashed white lines. (C) We measured lateral forces applied to the channel walls during reaching movements (null field period, black, and curl field period, red). (D) We used a two-dimensional spring model to quantify postural field properties: null point, orientation, and stiffness (null field and curl field in black and red). (E) To test if holding forces were related to the null point of the postural field, participants (n = 19) were exposed to a curl field that gradually increased over trials. During holding, we recorded hand forces (right inset) as the arm was displaced in the direction of holding forces. Arrows show the location of the null point (zero-crossing) on selected trials. (F) We calculated the holding force before displacement of the hand, and the corresponding postural null point on each trial. Values are trial means and 95% CIs for distributions bootstrapped across participants. Linear regression was performed on the bootstrapped estimates (black line). Error bars denote mean ± SEM in panels (C and D). Statistics: ***p<10−3 and n.s. p>0.05.

Figure 5—source data 1

The EXCEL source data file contains parameters for our postural field model, as shown in Figure 5D.

We fit a linear spring model (Equations 10 and 11) to the postural fields measured before (Figure 5B left) and after adaptation (Figure 5B right). Here we provide parameters pertaining the null point of the two-dimensional spring and the stiffness of the postural field for individual participants. The ‘readme’ tab describes all quantities reported in the ‘data-panel-D’ tab.

https://cdn.elifesciences.org/articles/52507/elife-52507-fig5-data1-v2.xlsx
Adaptation of the integration gain.

(A) To maintain endpoint stability after adaptation of the reach controller, the postural controller must also adapt. (B) We hypothesized that integrator adaptation would be driven by errors in hand trajectory that occur near the end of the reach. To detect these errors, we looked for deviations in the reach trajectory after the reach exceeded 80% of its displacement. We spatially aligned reaches by subtracting off the terminal hand position and then temporally aligned the reach trajectories to the point in time at which the hand had the largest endpoint error. These errors are marked as ‘endpoint correction’. Here, we show the average reach trajectory during adaptation to a gradual force field for two subjects, one who exhibited integration (S5), and one who did not (S11). (C) The average forces produced at the end of adaptation for the same two subjects. Note that the subject with large errors near reach endpoint no longer generated holding forces at the end of adaptation. (D) We measured the gain of integration at the end of the adaptation period, for subjects that adapted to gradual force fields. We also measured the magnitude and sign of the late reach errors. Larger errors led to a reduction in gain. Each data point is one subject. (E) To confirm that the integration gain changed over the course of adaptation, and not immediately upon introduction of the force field, we compared the gain during the null period, with gains measured during early and late parts of adaptation using a repeated measures ANOVA. Values are mean ± SEM across participants. Statistics: ***p<10−3 and n.s. p>0.05.

Figure 6—source data 1

The EXCEL source data file contains data for panels D and E of Figure 6.

In the ‘data-panel-D-force-field’ tab, we report the endpoint error (labeled ‘endpoint correction’ in Figure 6B) measured on all trials in the force field period for each participant. In the ‘data-panel-D-channel’ tab, we report the holding forces and the integral of moving forces measured on channel trials at the end of the adaptation period for each participant. In the ‘data-panel-D-gain-and-error’, we provide single measures of endpoint error and integration gain for each participant, obtained from post-processing of the data provided in the prior two tabs. In ‘data-panel-E’, we provide the integration gain measured for each subject during the null period, early during force field adaptation, and late in force field adaptation. The ‘readme’ tab describes all quantities reported in the other four tabs containing participant data.

https://cdn.elifesciences.org/articles/52507/elife-52507-fig6-data1-v2.xlsx
Cortical reaching commands are integrated in a subcortical area.

(A) Stroke survivors (n = 14) participated in a set of clinical exams to measure functional impairment. Shown are isolated images for an extension-based task, for the non-paretic (top) and paretic (bottom) arms of an example participant (S015). The instruction is to place a rectangular block on the elevated surface. Images show the moment of maximal extension for the paretic (right) and nonparetic (left) arms. (B) To improve the range of motion of the arm, patients and healthy controls performed reaching movements holding the robotic handle, with the arm supported by an air sled. Shown are example trajectories during an initial null field period for the representative patient (black is nonparetic, red is paretic) in A, and a control participant (blue). (C) Example force traces during null field block in channel trials. The solid line denotes forces during moving. The dashed line denotes forces during holding still. (D and E) We measured the integral of moving forces (D) and holding forces (E) on each channel trial. We measured the trial-by-trial variability (standard deviation) of these quantities across all movements in the null field. (F, H, I, and J) We compared trial-by-trial fluctuations in moving and holding forces during the null field period (F, left panel). Next, we gradually adapted subjects to a velocity-dependent force field and compared within-trial integral of moving forces with subsequent holding force (F, right panel). Data are shown for a representative stroke patient and healthy control. We calculated the correlation coefficient between reaching and holding forces during the initial null field period (H) and force field period (I). We measured the slope of the integration function (i.e., the integration gain) across all trials within individual subjects (J). (G) Our conjecture that the cortex generates reaching commands which are then integrated in a subcortical area spared by cortical stroke. Values are mean ± SEM across participants. Points represent individual trials in F. Points represent individual subjects in D, E, H, and I. Statistics: *p<0.05, and n.s. p>0.05.

Figure 7—source data 1

The EXCEL source data file contains holding forces and the integral of moving forces as shown in Figure 7.

The data are divided into two tabs, ‘data-null-field-trials’ and ‘data-force-field-trials’. For the former, data are provided for all channel trials appearing in the baseline null field period for the paretic and non-paretic arms of stroke patients, as well as their age-matched controls. For the latter, the same data are provided but for the force field adaptation period. The ‘readme’ tab describes all quantities reported in the two tabs containing participant data.

https://cdn.elifesciences.org/articles/52507/elife-52507-fig7-data1-v2.xlsx
Author response image 1

Additional files

Supplementary file 1

Measures of impairment in stroke patients.

Patients completed the Fugl-Meyer Assessment (FMA) and the Action Research Arm Test (ARAT), as well as strength testing in the shoulder and elbow. Strength measurements were repeated twice and the maximal force was recorded on each effort and then averaged across repetitions. Two separate raters scored the FMA and ARAT assessments, and scores were averaged across raters. Missing entries in table indicate that the patient was unable to perform the desired action. Patients were selected based on MRI or CT scans, and/or available radiologic reports. Scans and/or reports were corroborated to determine the level at which the white matter of the corticospinal tract (CST) was lesioned. Here, we provide the level of the brain at which the white matter was lesioned.

https://cdn.elifesciences.org/articles/52507/elife-52507-supp1-v2.docx
Transparent reporting form
https://cdn.elifesciences.org/articles/52507/elife-52507-transrepform-v2.docx

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Scott T Albert
  2. Alkis M Hadjiosif
  3. Jihoon Jang
  4. Andrew J Zimnik
  5. Demetris S Soteropoulos
  6. Stuart N Baker
  7. Mark M Churchland
  8. John W Krakauer
  9. Reza Shadmehr
(2020)
Postural control of arm and fingers through integration of movement commands
eLife 9:e52507.
https://doi.org/10.7554/eLife.52507