The influence of task outcome on implicit motor learning

  1. Hyosub E Kim  Is a corresponding author
  2. Darius E Parvin
  3. Richard B Ivry
  1. University of California, Berkeley, United States
  2. University of Delaware, United States
7 figures, 4 tables and 2 additional files

Figures

Hitting the target attenuates the behavioral change from clamped feedback.

(a) During clamped visual feedback, the angular deviation of the cursor feedback is held constant throughout the perturbation block, and participants are fully informed of the manipulation. (b) The clamp angle was equal across all three conditions tested in Experiment 1, with only the target size varying between conditions. (c) Block design for experiment. (d) As in previous studies with clamped feedback, the manipulation elicits robust changes in hand angle. However, the effect was attenuated in the Hit Target condition, observed in the (e) rate of early adaptation, and, more dramatically, in (f) late learning. (g) The proportion of learning retained over the no feedback block following the clamp did not differ between groups. Dots represent individuals; shading and error bars denote SEM.

https://doi.org/10.7554/eLife.39882.002
Figure 1—source data 1

This file contains hand angle data for each trial and participant in Experiment 1, and was used to generate Figure 1d–g.

Reaction times (RTs) and movement times (MTs) are also included. Note that hand angles were flipped for participants who experienced a counter-clockwise clamp.

https://doi.org/10.7554/eLife.39882.003
The effects of hitting a target generalize to a different context and remain consistent at asymptote.

The attenuation of adaptation caused by hitting the target (a) generalizes to a different clamp angle and is stable over an extended clamp block (b). As in Experiment 1, there was (c) a marginal difference in early adaptation rate that became (d) a more dramatic difference in late learning. (e) Again, there was no difference in the proportion of retention, this time during a 0° clamp block. Dots represent individuals; shading and error bars denote SEM.

https://doi.org/10.7554/eLife.39882.004
Figure 2—source data 1

This file contains hand angle data for each trial and participant in Experiment 2, and was used to generate Figure 2b–e.

Reaction times (RTs) and movement times (MTs) are also included. Note that hand angles were flipped for participants who experienced a counter-clockwise clamp.

https://doi.org/10.7554/eLife.39882.005
Target size could affect adaptation due to increased perceptual uncertainty or greater variability in motor planning.

In the case of perceptual uncertainty, the feedback signal is weakened, thus leading to a weaker SPE signal. In the case of noisy motor planning, the forward model prediction would also be more variable and effectively weaken the SPE.

https://doi.org/10.7554/eLife.39882.006
Three models of how intrinsic reward or target error could affect learning.

(a) In the Movement Reinforcement model, reward signals cause reinforcement learning processes to bias future movements toward previously rewarded movements. The adaptation process is sensitive only to SPE and not reward. The overall movement reflects a composite of the two processes. (b) In the Adaptation Modulation model, reward directly attenuates adaptation to SPE. (c) In the Dual Error model, a second, independent implicit learning process, one driven by TE, combines with SPE-based adaptation to modify performance.

https://doi.org/10.7554/eLife.39882.007
Within-subject transfer design to evaluate models of the impact of task outcome on implicit motor learning.

(a) Using a transfer design, (b) the models diverge in their behavioral predictions for the Straddle-to-Hit group following transfer. The Movement Reinforcement model predicts a persistent asymptote following transfer, whereas the Adaptation Modulation and Dual Error models predict a decay in hand angle. During the acquisition phase, we again observed differences between the Hit and Straddle groups in the (c) early adaptation rate as well as (d) late learning. All participants in both groups demonstrated changes in reach angle consistent with the Adaptation Modulation and Dual Error models. (e) The learning functions were inconsistent with the Movement Reinforcement model. Note that the rise in hand angle for the Hit-to-Straddle group is consistent with all three models. Dots represent individuals; shading and error bars denote SEM.

https://doi.org/10.7554/eLife.39882.008
Figure 5—source data 1

This file contains hand angle data for each trial and participant in Experiment 3, and was used to generate Figure 5c–e and Figure 7.

Reaction times (RTs) and movement times (MTs) are also included. Note that hand angles were flipped for participants who experienced a counter-clockwise clamp.

https://doi.org/10.7554/eLife.39882.009
Figure 6 with 1 supplement
Model fits of the learning functions from Experiment 3.

The failure of the (a) Movement Reinforcement model to qualitatively capture the decay in hand angle following transfer in the Straddle-to-Hit condition argues against the idea that the effect of task outcome arises solely from a model-free learning process that operates independent of model-based adaptation. In contrast, both the (b) Adaptation Modulation and (c) Dual Error models accurately predict the changes in hand angle following transfer in both the Hit-to-Straddle and Straddle-to-Hit conditions.

https://doi.org/10.7554/eLife.39882.010
Figure 6—figure supplement 1
Correlations between bootstrapped parameter estimates.

Heat map of Pearson correlation coefficients between different parameters of the (a) Adaptation Modulation model and (b) Dual Error model. The strong negative correlations between retention and learning rate parameters (e.g. Amiss and Umiss) indicate a trade-off between these parameters. As such, caution is required concerning inferences about the impact of task outcome on the mechanisms of learning. Note that Amiss and Ahit refer to γA*A during miss or hit trials, respectively. Similarly, Umiss and Uhit refer to γu*U(e) during miss or hit trials.

https://doi.org/10.7554/eLife.39882.011
Effect of large target is not due to perceptual uncertainty.

(a) A control group was tested in a transfer design in which the large target was used in both phases, but a bisection line was present only during the acquisition phase. (b) The behavior of the control group (magenta) during the acquisition phase was not significantly different than that observed for the group that was tested with the (non-bisected) large target in the acquisition phase of Experiment 3 (re-plotted here in green), suggesting that perceptual uncertainty did not make a substantive contribution to the effects of hitting the target. Note that we do not display transfer data for the large target group since the target size changed for this group. (c) No change in asymptote was observed when going from the bisected target to the standard large target.

https://doi.org/10.7554/eLife.39882.013

Tables

Table 1
Model evaluations.
https://doi.org/10.7554/eLife.39882.012
Basic models# of free parametersR-squaredAIC
Movement Reinforcement40.824363
Adaptation Modulation40.861269
Dual Error40.895156
Hybrid Models
Movement Reinforcement + Adaptation Modulation60.945−100
Movement Reinforcement + Dual Error60.945−97
Appendix 1—table 1
Average Reaction Times (RTs) in ms.

Values represent mean ± SEM.

https://doi.org/10.7554/eLife.39882.017
Experiment 1BaselineEarly clampLate clampNo feedback
Hit325 ± 7327 ± 7347 ± 11344 ± 12
Straddle362 ± 12359 ± 14397 ± 32407 ± 33
Miss386 ± 22383 ± 19378 ± 15385 ± 15
Experiment 20° clamp
Hit378 ± 22376 ± 27354 ± 9351 ± 9
Straddle373 ± 12366 ± 13368 ± 15373 ± 16
Experiment 3
Hit-to-Straddle356 ± 19350 ± 15326 ± 9N/A
Straddle-to-Hit360 ± 8360 ± 7355 ± 7N/A
Bisected-to-Normal400 ± 28395 ± 27400 ± 25N/A
Appendix 1—table 2
Average Movement Times (MTs) in ms.

Values represent mean ± SEM.

https://doi.org/10.7554/eLife.39882.018
Experiment 1BaselineEarly clampLate clampNo feedback
Hit153 ± 11150 ± 10137 ± 8133 ± 9
Straddle162 ± 8149 ± 8139 ± 7131 ± 7
Miss137 ± 7134 ± 7124 ± 6118 ± 6
Experiment 20° clamp
Hit149 ± 8159 ± 20155 ± 11127 ± 7
Straddle157 ± 8161 ± 15170 ± 18130 ± 8
Experiment3
Hit-to-Straddle158 ± 7189 ± 12168 ± 12N/A
Straddle-to-Hit164 ± 11207 ± 28169 ± 13N/A
Bisected-to-Normal151 ± 11165 ± 14166 ± 15N/A
Appendix 1—table 3
Movement variability during baseline block.

Values represent mean ± SEM.

https://doi.org/10.7554/eLife.39882.019
Experiment 1Baseline SD
Hit4.19 ±. 26°
Straddle3.61 ±. 16°
Miss3.80 ±. 15°
Experiment 2
Hit3.09 ±. 18°
Straddle3.57 ±. 16°
Experiment 3
Hit-to-Straddle3.30 ±. 22°
Straddle-to-Hit3.85 ±. 37°
Bisected-to-Normal3.97 ±. 31°

Additional files

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Hyosub E Kim
  2. Darius E Parvin
  3. Richard B Ivry
(2019)
The influence of task outcome on implicit motor learning
eLife 8:e39882.
https://doi.org/10.7554/eLife.39882