Abstract
The remarkable ability of the motor system to adapt to novel environments has traditionally been investigated using kinematically non-redundant tasks, such as planar reaching movements. This limitation prevents the study of how the motor system achieves adaptation by altering the movement patterns of our redundant body. To address this issue, we developed a redundant motor task in which participants reached for targets with the tip of a virtual stick held with both hands. Despite the redundancy of the task, participants consistently employed a stereotypical strategy of flexibly changing the tilt angle of the stick depending on the direction of tip movement. Thus, this baseline relationship between tip-movement direction and stick-tilt angle constrained both the physical and visual movement patterns of the redundant system. Our task allowed us to systematically investigate how the motor system implicitly changed both the tip-movement direction and the stick-tilt angle in response to imposed visual perturbations. Both types of perturbations, whether directly affecting the task (tip-movement direction) or not (stick-tilt angle around the tip), drove adaptation, and the patterns of implicit adaptation were guided by the baseline relationship. Consequently, tip-movement adaptation was associated with changes in stick-tilt angle, and intriguingly, even seemingly ignorable stick-tilt perturbations significantly influenced tip-movement adaptation, leading to tip-movement direction errors. These findings provide a new understanding that the baseline relationship plays a crucial role not only in how the motor system controls movement of the redundant system, but also in how it implicitly adapts to modify movement patterns.
Introduction
If a movement error occurs while reaching a target, the motor system automatically and implicitly updates the motor command for the next movement to reduce the error. This remarkable motor learning ability contributes not only to maintaining accurate movements in the presence of noise but also to flexibly adapting the movement to new environments. In the standard planar arm-reaching task, which has been widely used to study the mechanisms of motor learning, participants manipulate a visual cursor with their hands primarily by moving their shoulder and elbow joints (Flash & Hogan, 1985; Gordon et al., 1994) (Fig. 1a). The arm-reaching task has contributed to uncovering many important properties of motor adaptation when a novel environment is introduced (Shadmehr & Mussa-Ivaldi, 1994; Thoroughman & Shadmehr, 1999; Mazzoni & Krakauer, 2006; Taylor & Ivry, 2011; Takiyama et al., 2015; Hayashi et al., 2016).
Notably, there is no redundancy between hand position and joint angles in such a planar arm-reaching task. The joint angles are primarily determined by the target to be reached (Fig. 1b). Because of this non-redundancy, when the motor system adapts the reaching movement to the visual rotation imposed on the cursor (Fig. 1c, left), the adapted pattern of joint angles is also determined (Fig. 1c, right). Naturally, the adapted pattern of joint angles should be identical to the pattern when reaching in the adapted direction (Fig. 1d). However, our body systems for performing practical motor tasks generally have more degrees of freedom than necessary to accomplish the tasks (Bernstein, 1996; Singh et al., 2016). For example, in the golf swing, there are countless patterns of whole-body configurations to achieve identical clubhead positions at ball contact.
The problem arising from such a redundant structure can be illustrated by considering the reaching movement of a hypothetical limb with three joints (Fig. 1e). In this case, there are a large number of possible joint angle patterns for the same hand position (Fig. 1f). However, given that the motor system solves task redundancy by minimizing motor cost (Collins, 1995; O’Sullivan et al., 2009) or movement error (White & Diedrichsen, 2010; Zhang et al., 2018), we should observe a stereotypical pattern of joint angles according to the targets (Fig. 1g). The problem is how the motor system changes the direction of cursor movement to implicitly adapt to the visual rotation imposed on the cursor (Fig. 1h). Are the joint angles after adaptation identical to those observed when aiming in the same adapted direction before adaptation? (Fig. 1i, left). Alternatively, does the motor system adopt a new joint movement pattern? (Fig. 1i, right).
It has not been thoroughly investigated how the motor system coordinates to change the redundant body system to implicitly adapt to the perturbation to the cursor representing the position of the end-effector.
Redundancy poses another type of problem for implicit movement adaptation. If the joint angles are perturbed while the hand position remains unchanged (Fig. 1j), how does the motor system respond to the perturbation? The motor system may simply ignore the perturbation because it does not affect the cursor position (Fig. 1k, left). Alternatively, the motor system may attempt to correct the joint movements (Fig. 1k, right). Conventionally, this type of problem has been investigated in the context of how the motor system responds to the movement variability that affects or does not affect task performance (i.e., task-relevant or task-irrelevant variability). Previous studies have consistently shown that the motor system actively corrects for task-relevant variability while allowing task-irrelevant variability (Mosier et al., 2005; Latash, 2012; van Beers et al., 2013; Sternad, 2018; Scholtz & Schoner, 1999; Scholtz et al., 2000). Optimal feedback control theory suggests that the strategies based on such a “minimal intervention principle” are optimal in terms of achieving task goals (e.g., movement accuracy) (Todorov & Jordan, 2002; Todorov, 2004; Scott, 2004; Diedrichsen, 2007; Valero-Cuevas et al., 2009; Ronsse et al., 2010; Sternad et al., 2011; Selgrade & Chang, 2015). These studies demonstrated that the motor system does not intervene movement change or variability as long as the task goal is achieved. Thus, the motor system should ignore the perturbations to joint angles that do not affect the task goal (Fig 1k, left). However, these studies did not directly test whether the redundant body movement pattern is also unchanged when the end-effector movement remains unchanged.
Conversely, it has also been reported that the motor system adapts to change the movement in response to the task-irrelevant perturbation (Wolpert et al., 1995; Flanagan & Rao, 1995; Morehead et al., 2017; Diedrichsen et al., 2010; Schaefer et al., 2012; Franklin et al., 2016; Kim et al., 2019). For example, when the cursor trajectory was curved only in the middle of the reaching movement, the hand movement was adaptively modified even though the perturbation did not cause a reaching error at the target (Wolpert et al., 1995; Flanagan & Rao, 1995). It should be noted that these previous studies created the task-irrelevant condition by applying the perturbation to the end-effector. In contrast, the present study focuses on how the motor system responds to the perturbation of the redundant body the end-effector remains unaffected (Figs. 1i and 1k). In light of this, in this study, we use the terms “end-effector relevant perturbation” (e.g., Fig. 1h) and “end-effector irrelevant perturbation” (e.g., Fig. 1j) when appropriate, instead of the more commonly used terms “task-relevant perturbation” and “task-irrelevant perturbation”. The current study aims to develop a novel task that creates end-effector relevant and end-effector irrelevant perturbations.
To investigate the problem of how the motor system adapts the redundant body system to these perturbations, this study introduces a novel bimanual stick manipulation task specifically designed to address this issue (Fig. 2a). Participants manipulated a virtual stick held with both hands to reach visual targets by the tip of the stick. Redundancy in the task is achieved by acknowledging that the same tip position can be achieved with different stick angles (Fig. 2b). Importantly, this task allowed us to visually perturb the tip position (i.e., end-effector relevant perturbation) and the stick angle (i.e., end-effector irrelevant perturbation) either separately or simultaneously. Using this approach, we can directly investigate how the motor system makes use of the redundant body system when adapting to these two types of perturbations.
Results
Movement strategy to manipulate the stick
A total of 72 healthy participants took part in the study (Experiments 1–3). They were asked to manipulate a virtual stick with both hands (length = 40 cm; distance between hands = 15 cm) to move the right tip of the stick towards the targets (Fig. 2a). This task is redundant because the same target can be reached in countless movement patterns. The participants could move both hands in parallel without tilting the stick (Fig. 2b, top). Alternatively, they could perform the task by tilting the stick (Fig. 2b, bottom). During the first part of the task (baseline phase: 360 trials) in all the experiments (Experiments 1–3), the participants moved the tip from a starting point to a target (movement distance = 10 cm) that appeared in one of nine directions (0°: horizontal direction, ±10°, ±20°, ±30°, and ±40°) (Fig. 2c).
The trajectories of the tip and both hands appeared to be almost straight, but both hands were not moved in parallel, except when aiming at the 0° target (Fig. 2d, top). The velocity profiles of the hands and tip were bell-shaped (Fig. 2d, bottom), similar to a normal unimanual reaching movement (Flash & Hogan, 1985; Gordon et al., 1994). The time-course changes in the stick-tilt angle relative to the initial horizontal tilt angle showed that the participants moved the tip while slightly tilting the stick, except when aiming at the 0° target (Fig. 2e). This tendency was observed from the beginning of the experiment (t-test compared with 0°, |t(71)| > 6.4, Bonferroni corrected P < 0.001; Fig. 2f).
Movement strategies to manipulate the stick for individuals are illustrated on the plane expressed by two variables: tip-movement direction relative to a horizontal direction (TMD) and the stick-tilt angle relative to the initial horizontal state (STA) (Fig. 3a). Although each participant could have performed the task differently (Fig. 2b), all participants showed stereotypical movement patterns: The stick-tilt angle was significantly modulated by the tip-movement direction (t-test compared with 0°, |t(71)| > 5.5, Bonferroni corrected P < 0.01; Fig. 3a, inset). This monotonically increasing curve, which will be referred to as the “baseline TMD–STA relationship”, reflects a constraint between the direction of tip movement and the angle of stick tilt. The relationship showed that clockwise (CW) tip movement direction was accompanied by CW stick-tilt, and counterclockwise (CCW) tip-movement direction was accompanied by CCW stick-tilt. This constraint of movement patterns was likely created by minimizing the movement distance of the hands. If both hands are moved in parallel, the total distance between the initial and final positions of the hands should be 20 cm (10 cm for each) regardless of the targets; however, the experimentally observed distance was reduced by tilting the stick (Fig. 3b). The average distance was a near- minimal value (versus parallel translation: Cohen’s d = 1.914, versus theoretical minimum: Cohen’s d = 0.334; Fig. 3c).
Experiment 1: Motor adaptation pattern to the end-effector relevant perturbation
During the second part of the experiment (adaptation phase: 240 trials), the target appeared only in the 0° direction, and three types of visual perturbations were introduced. Most importantly, this task enabled the introduction of end-effector relevant perturbation (Experiment 1), or end-effector irrelevant perturbation (Experiment 2), or a combination of both types of perturbations (Experiment 3). In Experiment 1A (N = 19), the tip-movement direction was visually rotated in the CCW direction around the starting position (tip perturbation), whereas the stick-tilt angle remained unchanged (Fig. 4a). Thus, this perturbation produced a positional dissociation between vision (i.e., the stick) and proprioception (i.e., the hands). The amount of tip directional rotation was gradually increased by 1° per a trial up to 30° so that the participants did not notice the presence of perturbation.
Figure 4b illustrates how this visual perturbation changes the states of stick movement in visual and physical spaces represented by mapping between the tip- movement direction and stick-tilt angle. The movement in the visual space was the one visible to the participants, whereas the movement in the physical space was the actual hand movement, which was invisible to them. On a plane representing visual movement patterns (Fig. 4b, left), the visual perturbation to the tip can be expressed as a shift of the state along the x-axis. The error of the tip-movement direction in the visual space needs to be compensated by changing the movement of both hands. On a plane representing physical movement patterns (Fig. 4b, right), this requirement can be expressed as a shift of the task goal in the direction opposite to the visual perturbation.
Owing to the redundant nature of this task, participants could adapt to change the visual tip movement using different strategies. For example, they could change the tip movement without changing the stick-tilt while keeping the strategy of moving both hands in parallel (Fig. 4c, top). Alternatively, they might adapt by changing the stick tilt as if they were aiming at a -30° target (Fig. 4c, bottom). These strategies can be expressed as a state shift towards the new task goal line along the x-axis or along the baseline TMD–STA relationship in the physical plane (Fig. 4d).
The experimental results demonstrated that the participants adapted to the tip perturbation by tilting the stick (Fig. S1). On the visual plane (Fig. 5a), after the adaptation, the tip-movement direction remained at the baseline level (paired t-test, t(18) = -1.320, P = 0.203), while the stick was tilted significantly more in the CW direction than when aiming at the 0° target in the baseline phase (paired t-test, t(18) = 10.003, P < 0.01). Thus, the tip perturbation was compensated by adaptation, but the adaptation produced an abnormal visual stick-tilt. This result is likely to support the idea of the minimal intervention principle because participants ignored this visual stick- tilt which did not directly influence the task.
On the physical plane, adaptation appeared to progress along the baseline TMD–STA relationship throughout the adaptation phase (Figs. 5b and 5c). The implicitly adapted tip-movement direction and stick-tilt angle were similar to those when voluntarily aiming at the -30° target in the baseline phase. Although the difference was small but significant for the tip-movement direction (paired t-test, t(18) = -10.053, P < 0.01), there was no significant difference in the stick-tilt angle (paired t-test, t(18) = - 1.081, P = 0.294). Thus, the motor system implicitly achieved adaptation to the tip perturbation as if it had voluntarily aimed at the -30° target (i.e., pattern ii in Figs. 4c and 4d) (Fig. 5d). This adaptation characteristic was also supported by the observation that the participants who tilted their stick more when aiming at the -30° target in the baseline phase exhibited a greater stick- tilt in the adapted movement patterns (R = 0.601, P = 0.007; Fig. 5e). In Experiment 1B (N = 13), we imposed the 30° tip perturbation abruptly to allow participants to use explicit strategy, and obtained nearly identical results (Figs. S2 and S3).
As described above, the adapted tip-movement direction on the physical plane was significantly different from the tip-movement direction when aiming at the -30° target in the baseline phase (Fig. 5b). In contrast, such significant difference was not observed for Experiment 1B (Fig. S3). Why was such a difference only in Experiment 1A? We speculated that this difference was caused by the implicit adaptation to correct the abnormal visual stick-tilt angle. As shown in Fig. 5a, after the adaptation, the stick was visually tilted in the CW direction. If the physical movement pattern is constrained by the baseline TMD–STA relationship, the CCW correction of the stick-tilt angle should be accompanied by the CCW change in tip-movement, which would interfere with the adaptation to the tip perturbation.
Experiment 2: Motor adaptation pattern to end-effector irrelevant perturbation
Thus, it is still possible that the motor system does not necessarily ignore, but corrects for, the stick-tilt error that does not directly influence the tip position. Experiment 2 (N = 20) was designed to directly test this possibility by imposing a stick-tilt perturbation around the right tip (i.e., end-effector irrelevant perturbation) (Fig. 6a). As the tip moved from the starting point, the stick started to tilt around the tip up to ±6° when the tip reached the target (the tilt amount was proportional to the tip’s distance from the starting point). The ±6° tilt perturbation was chosen according to the stick tilt at the movement offset when reaching the ±30° target for the baseline phase (see Fig. 3a). Ten participants participated in the CCW stick-tilt perturbation condition (E2CCW group: 6°), and the remaining ten participants took part in the CW stick-tilt perturbation condition (E2CW group: -6°). Because the amount was small, the participants did not notice the presence of perturbation throughout the experiment. Since this perturbation changed only the stick-tilt angle, it is expressed as a state shift along the y-axis on the visual plane (Fig. 6b). According to the minimal intervention principle, the motor system does not need to change anything because the stick-tilt perturbation does not affect the tip position (i.e., the task goal) (Figs. 6c and 6d, pattern i). However, if the motor system is actively compensating for the stick-tilt perturbation, it should change the stick-tilt angle (Figs. 6c and 6d, pattern ii).
Interestingly, the participants corrected the stick-tilt angle (Fig. S4). On the visual plane, the stick-tilt angles remained different from those in the baseline phase (Fig. 7a) (two-way (direction of stick-tilt perturbation (i.e., groups), trial phase (first 30 trials or last 30 trials)) repeated-measures ANOVA, a significant main effect of groups: F(1,18) = 54.457, P < 0.001; no effect of trial phase: F(1,18) = 2.554, P = 0.127; no interaction: F(1,18) = 1.613, P = 0.220). Thus, the adaptive changes did not fully compensate for the perturbation-induced stick-tilt errors. However, the data on the physical plane clearly demonstrated that participants implicitly changed the stick-tilt angle in the direction opposite to that of the perturbation from the early adaptation phase (Fig. 7b): Without the correction, the data of the E2CCW and E2CW groups should have largely overlapped. However, with respect to stick-tilt angle, two-way repeated-measures ANOVAs revealed the main effect of stick-tilt perturbation direction (F(1, 18) = 12.483, P < 0.01) but not the main effect of trial phase (F(1, 18) = 3.331, P = 0.085). The interaction between these factors was not significant (F(1, 18) = 1.362, P = 0.258).
Unexpectedly, this stick-tilt correction was accompanied by undesirable tip- movement directional errors (Fig. 7c). With respect to the tip-movement direction, two- way repeated-measures ANOVAs revealed the main effect of the direction of stick-tilt perturbation (F(1, 18) = 5.104, P = 0.037) but not the main effect of trial phase (F(1, 18) = 1.288, P = 0.271) (the interaction between these factors was not significant: F(1, 18) = 0.804, P = 0.382). Notably, these seemingly irrational adaptation patterns were consistent with the patterns predicted from the baseline physical TMD–STA relationship: CCW (CW) stick-tilt adaptation to the CW (CCW) stick-tilt perturbation slightly shifted the tip-movement direction in the CCW (CW) direction (Fig. 7d).
We also examined how the amount of adaptation depended on the amount of stick-tilt when voluntarily aiming at the ±30° target in the baseline phase. The 6° stick- tilt perturbation should be insignificant for participants who tilt the stick at a larger angle; thus, this perturbation tends to be ignored. Conversely, for participants who did not tilt the stick, a 6° stick-tilt perturbation should be significant and must be corrected. Figures 7e and 7f show how the amount of stick-tilt correction (Fig. 7e) and tip-movement directional change (Fig. 7f) depended on the amount of stick-tilt angle when aim at the ±30° target in the baseline phase. As predicted, we observed a negative correlation (stick-tilt correction: R = -0.572, P < 0.01; tip-movement directional change: R = -0.440, P = 0.052), although the tip-movement direction change was not significant.
Taken together, the results of Experiment 1 and Experiment 2 suggest that the implicit adaptation in the redundant stick-manipulating task is achieved by the following two mechanisms: First, the motor system attempts to correct for any perturbation in visual feedback, regardless of whether it is end-effector relevant or end-effector irrelevant. Second, the physical pattern of movement correction is constrained by the baseline TMD–STA relationship.
Experiment 3: Interaction between end-effector relevant and end-effector irrelevant perturbations
Experiment 3 (N = 20) was designed to further investigate the interaction between adaptations to end-effector relevant and end-effector irrelevant perturbations by applying both simultaneously (Fig. 8a). We hypothesized that adaptation to the tip perturbation would be influenced by the direction of the simultaneously applied stick- tilt perturbation. Specifically, the CCW tip perturbation was combined with the CCW stick-tilt perturbation (E3CCW group: N = 10) or with the CW stick-tilt perturbation (E3CW group: N = 10). These visual perturbation patterns can be expressed as state shifts in the visual plane (green and orange arrows for E3CCW and E3CW groups, respectively, in Fig. 8b). On the physical plane, the correction pattern required for the E3CCW group (Fig. 8c, top) is aligned with the baseline TMD–STA relationship (green arrow in Fig. 8d), from which we can predict that adaptation should proceed smoothly. In contrast, the correction pattern required for the E3CW group (Fig. 8c, bottom) is orthogonal to the baseline TMD–STA relationship (orange arrow in Fig. 8d), which may prevent smooth adaptation. We tested these predictions by simultaneously imposing the tip perturbation which was the same as the perturbation used in Experiment 1A and the stick-tilt perturbation which was the same as the perturbation used in Experiment 2. Again, the participants were unaware of the perturbations throughout the experiment.
Contrary to the predictions, the difference in stick-tilt perturbation directions did not affect the final adapted movement patterns (Fig. S5): As shown in the visual plane (Fig. 9a), the difference in stick-tilt angle remained unchanged (paired t-test, t(18) = 6.920, P < 0.001). Similarly, in the physical plane (Fig. 9b), there were no significant differences in movement pattern between the two groups (tip-movement direction: paired t-test, t(18) = -0.479, P = 0.638, stick-tilt angle: paired t-test, t(18) = -0.386, P = 0.704). However, a trial-by-trial variability of the movement pattern in the latter adaptation phase (trial# 121–240) showed a slight difference between groups (t-test, tip-movement direction: t(18) = -2.046, P = 0.056, stick-tilt angle, t(18) = -3.235, P = 0.005), suggesting that the adaptation processes were implicitly affected by combination of perturbations (Fig. 9a, inset). In partial agreement with our predictions, two groups showed different adaptation processes: trial-dependent trajectories to the final adapted pattern were clearly separated for both groups (Fig. 9c). Indeed, a repeated-measures multivariate analysis of variance (MANOVA) showed a significant effect of group (Pillai’s Trace F(8, 162) = 0.155, P < 0.001) and trial segment (Pillai’s Trace F(8, 162) = 0.719, P < 0.001); however, no significant interaction was observed (Pillai’s Trace F(8, 162) = 0.039, P = 0.982). As a result, the adaptation of the tip movement was more delayed in the E3CW group (trial segment 2: t-test, t(18) = -3.684, Bonferroni-corrected P < 0.05; Fig. 9d).
Discussion
Our bodies have more degrees of freedom than necessary to achieve a relatively low- dimensional task goal. Understanding how the motor system resolves this redundancy remains a challenging problem (Bernstein et al., 1996). In this study, we investigated the problems of motor control and adaptation specific to kinematically redundant systems. The first problem is how the motor system coordinates the redundant body movements to control the end-effector (Fig. 1f). The second problem is how the motor system coordinates to modify redundant body movements when implicitly adapting to the perturbation imposed on the end-effector (Fig. 1i). The third problem is how the motor system responds to the perturbation to the redundant dimension that does not directly affect the end-effector (Fig. 1k). These two types of perturbations have been conventionally referred to as “task-relevant” and “task-irrelevant” perturbations. However, it should be noted that previous studies investigating the effect of task- irrelevant perturbations have applied perturbations to the end-effector (e.g., cursor) without affecting task performance (Wolpert et al., 1995; Flanagan & Rao, 1995; Diedrichsen et al., 2010; Schaefer et al., 2012; Franklin et al., 2016; Kim et al., 2019). In contrast, the present study focused on investigating the effect of perturbations on the redundant body while leaving the end-effector unaffected (see Figure 1k). To clearly emphasize these differences, we specifically used the terms ’’end-effector relevant perturbation’’ and ’’end-effector irrelevant perturbation.’’
To investigate these issues, we designed a novel stick manipulation reaching task. This redundant motor task enables the investigation of adaptation patterns in the redundant system following the introduction of perturbations that are either end-effector relevant, end-effector irrelevant, or both. Because our experiments were conducted with a specific configuration (stick length, hand distance, target location etc), we must be cautious about the generalizability of the results to other configurations, but we obtained the following 4 main results. First, we showed that participants adopted a stereotyped strategy to reach the target with the stick tip, and that the movement pattern (stick tip movement and stick tilt angle) was constrained by a baseline TMD– STA relationship. Second, when only end-effector relevant perturbations were imposed on the tip, the motor system attempted to modify the physical movement patterns along the baseline TMD–STA relationship to achieve the task goal (Experiment 1). Third, even when perturbations were applied only to the end-effector irrelevant dimension (i.e., the stick-tilt angle), the motor system still adapted to the end-effector irrelevant perturbation and this adaptation was accompanied by an end-effector relevant error (Experiment 2). Finally, when both types of perturbations were imposed simultaneously, the adaptation processes were influenced depending on the combination of perturbations (Experiment 3).
Kinematic relationship between end-effector relevant and end-effector irrelevant dimensions
In our stick manipulation task, participants were asked to reach the tip of the stick to the targets. Participants can achieve the reaching task in different ways. For example, they can use a simple strategy by moving both hands in the same direction (Fig. 2b, top) or a more complicated strategy by tilting the stick (Fig. 2b, bottom). Nevertheless, they showed stereotypical patterns of moving the stick tip by tilting the stick from the beginning of the task (Fig. 2f): Reaching the CW (or CCW) targets was accompanied by the CW (or CCW) stick tilt (Fig. 3a). Such a stereotypical movement patterns have been reported for the movements of the joints in the redundant 3-dimensional reaching movements (Lacquaniti & Soechting, 1982; Proietti et al., 2017). Notably, compared with the case where both hands moved in parallel, the movement distances of both hands to perform the task were significantly reduced to a near-optimal level (Figs. 3b and 3c), which contributed to the reduction of work required (Collins, 1995; O’Sullivan et al., 2009). As a result of this optimization process, tip-movement and stick-tilt were associated with each other by the baseline TMD–STA relationship (Fig. 3a). Physically, this relationship constrains how the motor system should move the stick. Visually, it tells the motor system how the stick movement should be seen.
The strength of the task to investigate the motor adaptation in redundant system
Our task has several advantages. First, the task has created redundancy in a natural way. Manipulating a stick with both hands is relatively common in everyday life (using a broom, golf or bat swing etc.). This familiarity with the task was reflected in Fig. 2f which shows that all participants started tilting the stick to reach the tip toward the targets from the beginning of the experiment. This characteristic is ideal for investigating how this inherent movement pattern influences motor adaptation. Second, this task allows us to investigate how the perturbation to the tip-movement direction leads to a change in both the tip-movement direction itself and the stick-tilt angle. It has not been investigated how the motor system implicitly achieves adaptation to the end-effector perturbation (i.e., the end-effector relevant perturbation) by changing the movement patterns of the redundant body system. Third, this task can create a novel condition in which the perturbations are imposed on the redundant system while the tip position remains unchanged (i.e., the end-effector irrelevant perturbation). No previous studies have investigated how the motor system implicitly responds to such a perturbation by altering (or not altering) the movement of the redundant body system.
Adaptation to end-effector relevant perturbation
When the end-effector relevant perturbation was implicitly imposed to the tip- movement direction (visual rotation by 30° CCW), the participants adapted to change the tip-movement direction in the opposite CW direction (Experiment 1), as reported in many previous studies using an ordinary reaching movement (Cunningham, 1989; Krakauer et al., 2000). Importantly, our task helped to investigate how such motor adaptations in the end-effector relevant dimension (tip-movement direction) are accompanied by the movement pattern changes in the end-effector irrelevant dimension (stick-tilt angle). Participants implicitly corrected the tip-movement direction by changing the stick tilt as if they were voluntarily aiming at the -30° target. This adaptation can be visualized as a state shift along the baseline TMD–STA relationship in the physical plane (Fig. 5b). The baseline TMD–STA relationship originally contributes to dictate how the motor system voluntarily moves the stick. It is likely that the motor system also uses this relationship as a scaffold to implicitly guide how to correct the tip-movement direction. Hayashi et al. (2016) have demonstrated that the adaptation of the standard reaching movement to a visual perturbation was significantly influenced by the baseline relationship between the movement and target directions (i.e., a visuomotor map). After distorting the visuomotor map so that the movement direction was more (or less) sensitively modulated by the target direction, the movement adaptation was enhanced (or reduced). The present finding that the baseline movement pattern is used for the implicit adaptation is consistent with this previous finding.
Notably, this adaptation pattern changed the visual feedback of the stick tilt. When reaching the 0° target in the baseline condition, the stick-tilt angle was almost 0° (Fig. 3a). However, after adaptation, the amount of stick-tilt was equivalent to that when aiming at the -30° target (Fig. 5b). Thus, the visually observed stick-tilt after adaptation was different from that observed in the baseline condition (Fig. 5a). Nevertheless, the adapted physical movement pattern persisted to follow the baseline TMD–STA relationship, suggesting that the motor system mainly paid attention to end-effector relevant tip-movement and ignored end-effector irrelevant stick-tilt angle. This adaptation pattern seems to be consistent with the minimal intervention principle.
However, a slight difference in the adaptation patterns between Experiment 1A and Experiment 1B implies a violation of the minimal intervention principle. In Experiment 1A, in which a 30° visual rotation was implicitly introduced by gradually increasing its amplitude, the final adapted tip-movement direction was slightly but significantly different from that when voluntarily aiming at the adapted direction (i.e., - 30° target) (Fig. 5b). In contrast, such residual difference was not observed in Experiment 1B, where participants could use an explicit aiming strategy (Fig. S1b). Visuomotor adaptation is often incomplete even after sufficient training, and residual errors are observed (Krakauer et al., 2000; Ethier et al., 2008; Malone et al., 2011; Vaswani et al., 2015). Although the presence of residual errors has been attributed to the imbalance between learning and forgetting, a recent study demonstrated that only the implicit learning system is responsible for producing residual errors by modulating error sensitivity with the consistency of errors in previous trials (Albert et al., 2021). We speculate that an alternative mechanism is involved in the generation of a residual difference in Experiment 1A. If the motor system does not ignore the abnormal stick- tilt but attempts to correct it, and this correction pattern is physically constrained by the baseline TMD–STA relationship, the stick-tilt correction should accompany the de- adaptation of the tip-movement direction and lead to the generation of a residual error. As discussed below, the results of Experiment 2 and Experiment 3 support this idea.
Adaptation to end-effector irrelevant perturbation
Our task can create a novel end-effector irrelevant stick-tilt perturbation and allows us to study how the motor system responds to it. According to the minimal intervention principle, the motor system should ignore stick-tilt perturbations because they do not influence task goal achievement (i.e., so called “task-irrelevant” perturbation). However, inconsistent with this idea, Experiment 2 clearly demonstrated that the motor system responded to the stick-tilt perturbations (Figs. 7b and 7c). This result indicates that the motor system predicts the visual feedback of an end-effector irrelevant stick-tilt angle when performing the task and tries to eliminate the dissociation between the observed and predicted stick-tilt angle (i.e., sensory prediction error). This idea was corroborated by the fact that participants who demonstrated a shallower TMD–STA relationship during the baseline phase showed a greater amount of stick-tilt correction (Fig. 7e). The ±6° stick-tilt perturbation should cause the larger prediction error for these participants.
One might consider that previous studies have already shown that the motor system responds to the task-irrelevant perturbations (Wolpert et al., 1995; Flanagan & Rao, 1995; Diedrichsen et al., 2010; Schaefer et al., 2012; Franklin et al., 2016; Kim et al., 2019). However, the task-irrelevant conditions implemented in these previous studies are quite different from the end-effector irrelevant condition in our study. These studies created the task-irrelevant condition by combining the perturbation of visual cursors with the manipulation of movement trajectory (Wolpert et al., 1995; Flanagan & Rao, 1995; Morehead et al., 2017), target/cursor shape (Diedrichsen et al., 2010; Schaefer et al., 2012; Kim et al., 2019), or applying the simultaneous equal perturbations to the target and cursor (Franklin et al., 2016). Therefore, these perturbations are not “end-effector irrelevant”. Exceptionally, in several previous studies, an end-effector irrelevant perturbation was implemented in a bimanual postural task to investigate postural reflex activity (Dimitriou et al., 2012; Omrani et al., 2013). However, to our knowledge, such an end-effector irrelevant perturbation has never been used to investigate the motor adaptation pattern in a redundant system. Furthermore, as discussed in the next section, our task design revealed a novel aspect of motor adaptation to the end-effector irrelevant perturbation.
Adaptation to end-effector irrelevant perturbation influences end-effector relevant performance
Unexpectedly, Experiment 2 shows that adaptation to the end-effector irrelevant stick- tilt perturbation was accompanied by an increase in the end-effector relevant tip- movement direction error (Fig. 7c). This counterintuitive result can be explained by the constraint of the adaptation pattern along the baseline TMD–STA relationship (Fig. 3a). According to this constraint, CCW (or CW) stick-tilt adaptation should change the tip- movement direction in the CCW (or CW) direction (Fig. 7d). The influence of stick-tilt perturbation on tip-movement direction error tended to be more pronounced for participants with a smaller stick-tilt angle at baseline, i.e., those with a shallower baseline TMD–STA relationship (Fig. 7f), further supporting this idea. The results of Experiment 3 also support the existence of such an interaction between tip-movement and stick-tilt adaptation. When the tip-movement and stick-tilt perturbations were imposed simultaneously, the adaptation trajectories on the physical plane were significantly influenced by the perturbation combination patterns (Fig. 9c). If the motor system had simply attempted to correct the stick-tilt to reduce the sensory prediction error, this spillover effect on the tip-movement direction would not have been observed.
Given that the baseline TMD–STA relationship (Fig. 3a) reflects the motor cost minimization, it is likely that the motor system is attempting to reduce both the sensor prediction error and the motor cost. One remaining question is why the motor system needs to correct for end-effector irrelevant stick-tilt errors in the first place. We speculate that there may be two reasons. First, a possible simple explanation is that the motor system predicts all sensory consequences generated by the action and attempts to correct any differences between the predicted and actual sensory information, even when the task is successfully achieved (Mazzoni & Krakauer, 2006; Schaefer et al., 2012; Morehead et al., 2017; Kim et al., 2019). Similarly, it is possible that the correction for end-effector irrelevant stick errors reflects the motor system’s attempt to resolve the dissociation between stick (i.e., vision) and hands (i.e., proprioception) caused by the perturbation.
Second, given that tip-movement direction and stick-tilt angle are tightly coupled (i.e., the presence of baseline TMD–STA relationship), the presence of an end-effector irrelevant stick-tilt visual error implies the presence of an end-effector relevant tip-movement direction error. In other words, the motor system interprets end- effector irrelevant errors as evidence that end-effector relevant errors have been also produced. When sensory information contains noise and/or uncertainty, the reliability of sensory information estimation can be improved by utilizing additional sensory information (Ernst & Banks, 2002). From this viewpoint, utilizing stick-tilt information may be useful for improving the accuracy of the estimation of the tip-movement direction.
Figure 10 illustrates the possible mechanism by which the motor system alters the movement pattern of the redundant system when encountering visual errors. The motor system develops a stereotyped movement pattern through an optimization process that is expressed by a baseline TMD–STA relationship (gray lines in Figs. 10a and 10b). This relationship not only dictates how the motor system physically controls the redundant system, but also informs the resulting visual feedback. When visual perturbations are applied to the tip-movement direction or the stick-tilt angle (bold arrows in Fig. 10a), the motor system tries to eliminate the dissociation of the perturbed state from the original state (thin arrows in Fig. 10a). It even responds to the end- effector irrelevant perturbation (red and blue arrows in Fig. 10a), because the error in the end-effector irrelevant dimension implies the presence of an end-effector relevant error (black dashed arrows in Fig. 10a) under the condition that the stick-tilt angle is tightly coupled with the tip-movement direction (i.e., the baseline TMD–STA relationship). However, these correction patterns are not physically allowed. Since the tip-movement direction and the stick-tilt angle are physically constrained by the baseline TMD–STA relationship, these correction patterns are biased toward the relationship (bold arrows in Fig. 10b).
In summary, this study shows that the baseline TMD–STA relationship, originally developed to control the redundant system, also plays a crucial role for the motor system in how it should implicitly respond to the visual errors and how it should correct the physical movement. This idea provides a novel framework for understanding how the motor system leans to control the redundant system when encountering visual errors.
Materials and methods
Participants
A total of 72 healthy adults (25 females and 47 males, aged 22.1 ± 2.5 years old; mean ± SD) participated in the study. Participants were recruited using an online recruitment system (https://www.jikken-baito.com). All the participants were right- handed according to their laterality score (83.3 ± 13.7; mean ± SD) obtained using the Edinburgh Handedness Inventory (Oldfield, 1971). They provided written informed consent, and the experimental protocol was approved by the ethics committee of The University of Tokyo (#19-225).
Experimental apparatus
The participants performed reaching movements using a virtual stick displayed on a horizontal screen with both handles of a manipulandum (KINARM End-Point Lab; Kinarm, Kingston, Canada) (Scott, 1999) (Fig. 2a). This screen prevented the participants from directly seeing their arms and handles, and displayed a start position, a target (1.4 cm in diameter), and a virtual stick (length: 40 cm, width: 0.5 cm). A white circle (1 cm diameter) was displayed on the right tip of the stick. The participants held the left tip of the stick with their left hand (left handle) and the stick 15 cm away from the left hand with their right hand (right handle). The distance between the handles was fixed using a strong elastic force produced by the manipulandum (spring constant = 2000 N/m). The positions and velocities of the hands were analogue/digitally converted at 1.129 kHz and then recorded at 1 kHz for offline analysis.
Baseline phase
All the experiments (Experiments 1–3) comprised a baseline phase (360 trials) followed by an adaptation phase (240 trials). The baseline phase, which was common to all experiments, was performed to investigate the basic strategy of how the participants moved the stick to reach the targets with the right tip. Before each reaching movement, the participants were asked to move the stick to the home position with the help of a manipulandum (Fig. 2c). After maintaining the home position for 0.5−1 s, a gray target was pseudo-randomly chosen from nine possible targets (0°: horizontal direction, ±10°, ±20°, ±30°, ±40°) appearing 10 cm away from the initial right tip position of the stick. After waiting for another 0.5−1 s, the color of the target changed to pink, indicating that they should immediately start moving the tip to the target. The participants were instructed to maintain the peak velocities of the tip as constant as possible across the trials. When the tip reached the target, a feedback message, “fast” or “slow,” was presented on the monitor if the peak movement speed was higher or lower than the range of 300−450 mm/s, respectively. After maintaining the tip at the target for 0.5 s, the visual feedback of the stick disappeared. Then, the handles automatically returned to their home position, and the next trial began. During the subsequent 240 trials in the adaptation phase, the target appeared only in the 0° direction, and distinct visual perturbations were introduced in Experiments 1–3 as described below. The home positions, size of the visual feedback and the target, inter- trial interval, and criteria for the tip velocity feedback for the adaptation phase were the same as those in the baseline phase.
Experiment 1
Experiment 1A (N = 19) and Experiment 1B (N = 13) were performed to investigate how participants moved the stick when adapting to end-effector relevant perturbations (tip perturbations). In Experiment 1A, the tip-movement direction on the monitor was gradually rotated CCW direction around the starting position by 1° per trial up to 30° (Fig. 4a). The stick-tilt angle remained unchanged (i.e., the stick-tilt angle was identical to the angle of the line connecting both hands). In Experiment 1A, participants did not perceive the presence of rotation and the adaptation was considered to be dominated by the implicit process. On the other hand, in Experiment 1B, the 30° visual rotation was abruptly applied to the tip-movement direction, which allowed them to use an explicit strategy.
Experiment 2
Experiment 2 (N = 20) examined whether the motor system was indifferent to end-effector irrelevant perturbations (stick-tilt perturbations). The stick-tilt angle on the monitor was rotated around the right tip in the CW direction (E2CW group, N = 10) or in the CCW direction (E2CCW group, N = 10). Notably, these perturbations did not affect the tip-movement direction. During each reaching trial, the stick-tilt angle increased from 0° to 6° in proportion to the distance of the tip position from the starting point (0.6°/cm) (Fig. 6a). Participants did not notice any perturbations during the experiment.
Experiment 3
In Experiment 3 (N = 20), to examine how end-effector irrelevant stick-tilt perturbations influenced adaptation to end-effector relevant tip perturbations, both tip-movement and stick-tilt perturbations were simultaneously imposed (Fig. 8a). Ten participants participated in a task in which CCW tip and CCW stick-tilt rotations were imposed (E3CCW group). The remaining ten participants participated in a task in which CCW tip and CW stick-tilt rotations were imposed (E3CW group). The procedure for applying tip and stick-tilt perturbations was the same as in Experiment 1A and Experiment 2, respectively. The participants did not notice perturbations during the experiment.
Data analysis
Data analyses were performed using MATLAB R2023a (MathWorks, Natick, Massachusetts, USA). The behavioral data were low-pass filtered (10 Hz, fourth-order Butterworth filter). The tip-movement direction was calculated as the movement direction of the tip relative to the horizontal direction (Fig. 3a). The stick-tilt angle was defined as the tilting angle of the stick from the horizontal line (Fig. 3a). Positive values for both parameters were defined as the degree to the CCW direction. Unless otherwise noted, the tip-movement direction and the stick-tilt angle at the tip’s peak velocity were used to evaluate the feedforward motor commands.
Minimum distance of hand movement
The total movement distance of both hands in Figs. 3b and 3c was estimated by summing the Euclidean distances between the initial and final positions of the hands. The distance is represented as a function of the stick-tilt angle at the movement offset (θ).
The first term on the right side represents the distance of the left-hand movement, whereas the second term represents the distance of the right-hand movement. ϕ, d, L, and R represent a target direction (0°, ±10°, ±20°, ±30°, and ±40°), a target distance (10 cm), a distance between the left hand and the tip (40 cm), and a distance between the right hand and the tip (25 cm), respectively. The minimum distance of hand movement was derived by solving the following equation:
Statistical analysis
To statistically evaluate the behavioral data, we conducted t-tests, correlation analyses, two-way repeated-measures ANOVA, and MANOVA using MATLAB, the software package JASP (http://jasp-stats.org), and R studio.
Data Availability
Data collected in Experiments 1–3 and the code are uploaded in zenodo and are available at https://zenodo.org/record/8033232.
Acknowledgements
We thank members of the Nozaki laboratory for their helpful comments and suggestions, Jinnosuke Ueno, Junnosuke Sakuragi, and Ryosuke Miyazawa for performing preliminary experiments, Asako Munakata and Mayumi Yoda for coordinating experiments. This study was supported by a grant from the Japan Society for the Promotion of Science Research Fellowships for Young Scientists to T.K. (20J13734) and a KAKENHI to D.N. (17H00874, 21H04860) and to T.K. (23K10739).
Additional information
Competing Interest Statement
Authors declare that they have no competing interests.
Author Contributions
Conceptualization, Methodology, Investigation, Formal Analysis, Writing: TK, DN, Supervision: DN.
References
- 1.The Coordination of Arm Movements: An Experimentally Confirmed Mathematical ModelJournal of Neuroscience 5
- 2.Accuracy of planar reaching movements I. Independence of direction and extent variabilityExperimental Brain Research 99
- 3.Adaptive Representation of Dynamics During Learning of a Motor TaskJournal of Neuroscience 14
- 4.Electromyographic Correlates of Learning an Internal Model of Reaching MovementsJournal of Neuroscience 19
- 5.An Implicit Plan Overrides an Explicit Strategy during Visuomotor AdaptationJournal of Neuroscience 26
- 6.Flexible Cognitive Strategies during Motor LearningPLoS Computational Biology 7
- 7.Prospective errors determine motor learningNature Communications 6
- 8.Visuomotor Map Determines How Visually Guided Reaching Movements are Corrected Within and Across TrialseNeuro 3:e0032–16
- 9.Dexterity and Its DevelopmentPsychology Press
- 10.Exploration of joint redundancy but not task space variability facilitates supervised motor learningProceedings of the National Academy of Sciences of the United States of America 113
- 11.The Redundant Nature of Locomotor Optimization LawsJournal of Biomechanics 28
- 12.Dissociating Variability and Effort as Determinants of CoordinationPLoS Computational Biology 5
- 13.Responsibility assignment in redundant systemsCurrent Biology 20
- 14.Exploiting the geometry of the solution space to reduce sensitivity to neuromotor noisePLoS Computational Biology 14
- 15.Remapping Hand Movements in a Novel Geometrical EnvironmentJournal of Neurophysiology 94
- 16.The bliss (not the problem) of motor abundance (not redundancy)Experimental Brain Research 217
- 17.Random walk of motor planning in task- irrelevant dimensionsJournal of Neurophysiology 109
- 18.It’s not (only) the mean that matters: variability, noise and exploration in skill learningCurrent Opinion in Behavioral Sciences 20
- 19.The uncontrolled manifold concept: identifying control variables for a functional taskExperimental Brain Research 126
- 20.Uncontrolled manifold analysis of single trials during multi-finger force production by persons with and without Down syndromeExperimental Brain Research 153
- 21.Optimal feedback control as a theory of motor coordinationNature Neuroscience 5
- 22.Optimality principles in sensorimotor controlNature Neuroscience 7
- 23.Optimal feedback control and the neural basis of volitional motor controlNature Reviews Neuroscience 5
- 24.Optimal Task-Dependent Changes of Bimanual Feedback Control and AdaptationCurrent Biology 17
- 25.Structured Variability of Muscle Activations Supports the Minimal Intervention Principle of Motor ControlJournal of Neurophysiology 102
- 26.Optimal Control of a Hybrid Rhythmic-Discrete Task: The Bouncing Ball RevisitedJournal of Neurophysiology 103
- 27.Neuromotor Noise, Error Tolerance and Velocity-Dependent Costs in Skilled PerformancePLoS Computational Biology 7
- 28.Locomotor control of limb force switches from minimal intervention principle in early adaptation to noise reduction in late adaptationJournal of Neurophysiology 113
- 29.Are arm trajectories planned in kinematic or dynamic coordinates? An adaptation studyExperimental Brain Research 103
- 30.Trajectory Adaptation to a Nonlinear Visuomotor Transformation: Evidence of Motion Planning in Visually Perceived SpaceJournal of Neurophysiology 74
- 31.Characteristics of Implicit Sensorimotor Adaptation Revealed by Task-irrelevant Clamped FeedbackJournal of Cognitive Neuroscience 29
- 32.Use-Dependent and Error-Based Learning of Motor BehaviorsJournal of Neuroscience 30
- 33.Beside the point: motor adaptation without feedback-based error correction in task-irrelevant conditionsJournal of Neurophysiology 107
- 34.Temporal Evolution of Spatial Computations for Visuomotor ControlJournal of Neuroscience 36
- 35.The influence of task outcome on implicit motor learningeLife 8
- 36.Coordination of arm and wrist motion during a reaching taskJournal of Neuroscience 2
- 37.Modifying upper-limb inter-joint coordination in healthy subjects by training with a robotic exoskeletonJournal of NeuroEngineering and Rehabilitation 14
- 38.Aiming Error Under Transformed Spatial Mappings Suggests a Structure for Visual-Motor MapsJournal of Experimental Psychology 15
- 39.Learning of Visuomotor Transformations for Vectorial Planning of Reaching TrajectoriesJournal of Neuroscience 20
- 40.Spontaneous Recovery of Motor Memory During Saccade AdaptationJournal of Neurophysiology 99
- 41.Motor Adaptation Training for Faster RelearningJournal of Neuroscience 31
- 42.Persistent Residual Errors in Motor Adaptation Tasks: Reversion to Baseline and Exploratory EscapeJournal of Neuroscience 35
- 43.An implicit memory of errors limits human sensorimotor adaptationNature Human Behaviour 5
- 44.Task-dependent coordination of rapid bimanual motor responsesJournal of Neurophysiology 107
- 45.Rapid feedback corrections during a bimanual postural taskJournal of Neurophysiology 109
- 46.Humans integrate visual and haptic information in a statistically optimal fashionNature 415
- 47.The Assessment and Analysis of Handedness: The Edinburgh InventoryNeuropsychologia 9
- 48.Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reachingJournal of Neuroscience Methods 89
Article and author information
Author information
Version history
- Preprint posted:
- Sent for peer review:
- Reviewed Preprint version 1:
- Reviewed Preprint version 2:
- Version of Record published:
Copyright
© 2024, Toshiki Kobayashi & Daichi Nozaki
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
- views
- 683
- downloads
- 36
- citations
- 0
Views, downloads and citations are aggregated across all versions of this paper published by eLife.