Direction-dependent arm kinematics reveal optimal integration of gravity cues
Abstract
The brain has evolved an internal model of gravity to cope with life in the Earth's gravitational environment. How this internal model benefits the implementation of skilled movement has remained unsolved. One prevailing theory has assumed that this internal model is used to compensate for gravity's mechanical effects on the body, such as to maintain invariant motor trajectories. Alternatively, gravity force could be used purposely and efficiently for the planning and execution of voluntary movements, thereby resulting in direction-depending kinematics. Here we experimentally interrogate these two hypotheses by measuring arm kinematics while varying movement direction in normal and zero-G gravity conditions. By comparing experimental results with model predictions, we show that the brain uses the internal model to implement control policies that take advantage of gravity to minimize movement effort.
https://doi.org/10.7554/eLife.16394.001eLife digest
Many of the activities of humans and other animals require the limbs to be moved in a coordinated manner. For a movement to be successful, the brain must generate muscle contractions that take into account factors in the environment that might affect the movement. One such prominent environmental feature is gravity, and it is broadly believed that the brain develops and uses an internal representation of gravity to anticipate its effects on the limbs.
How an internal representation of gravity helps limb movements to be made successfully is not known. Theorists have proposed that the brain could use the internal model of gravity to predict how to compensate for its mechanical effects – or, on the contrary, take advantage of them.
Flying a plane in a “parabolic” arc creates a microgravity environment inside it that produces a feeling of weightlessness. Gaveau et al. asked volunteers to perform arm movements in normal earth gravity and in microgravity conditions. Under normal gravity, the volunteers made arm movements with speed profiles that differed according to movement direction. When they first performed these movements in microgravity, the speeds still differed according to direction. However, as the participants gained more experience of making the movements in microgravity, the speed at which upward and downward arm movements were made became more similar. Eventually movements were performed at the same speed in either direction.
Comparing these results to numerical simulations revealed a sophisticated behavior where movements are organized to take advantage of the effects of gravity to minimize the effort that the muscles need to make. Further research into the neural mechanisms behind this optimization process could benefit the development of various rehabilitative and assistive technologies, such as brain-machine interfaces and robotic devices to guide and support limbs.
https://doi.org/10.7554/eLife.16394.002Introduction
It is always fascinating to witness the ability of acrobats and dancers to accomplish complex and elegant movements, graciously interacting with gravito-inertial forces. Computational theory postulates that this captivating performance is due to the ability of the brain to learn and store internal representations of environmental dynamics (Wolpert and Ghahramani, 2000). On earth, gravity is the most ubiquitous and constant environmental feature. As such, a neural representation of gravity is created and stored through an internal model (Papaxanthis et al., 1998a; Angelaki et al., 1999; Merfeld et al., 1999; McIntyre et al., 2001; Angelaki et al., 2004; Indovina et al., 2005; Miller et al., 2008; Crevecoeur et al., 2009; Gaveau and Papaxanthis, 2011; Laurens et al., 2013a, 2013b).
The need for an internal model of gravity arises because Einstein’s equivalence principle prevents any single sensory receptor from encoding gravity without simultaneously also encoding inertial accelerations (Einstein, 1908). The neural representation of gravity is thought to solve this ambiguity by multisensory statistical inference (Angelaki et al., 1999; Merfeld et al., 1999; Angelaki et al., 2004; Laurens et al., 2013b). An internal model of gravity has been shown to benefit the anticipation of a free falling object motion (Zago and Lacquaniti, 2005; Zago et al., 2008; Lacquaniti et al., 2013), as well as the visual perception of allocentric vertical (Van Pelt et al., 2005; De Vrijer et al., 2008; Elmore et al., 2014). However, whether and how an internal model of gravity benefits the planning and execution of skilled movement remains unknown.
One influential viewpoint assumes a need for compensation; i.e., the internal model of gravity is used to predict and compensate for its mechanical effects on the body. This hypothesis has been motivated by experimental findings on arm movements in the presence of externally applied Coriolis, viscous force fields and interaction torques (Shadmehr and Mussa-Ivaldi, 1994; Gribble and Ostry, 1999; Pigeon et al., 2003). The main benefit of a compensation strategy would be the simplification of motor planning by allowing for invariant trajectories (Hollerbach and Flash, 1982; Atkeson and Hollerbach, 1985). Current research in fields as diverse as neurorehabilitation, movement perception, or motor control modularity, assumes such a compensation principle (Prange et al., 2009, 2012; Cook et al., 2013; Russo et al., 2014).
An alternative perspective is based on a need for effort optimization, i.e., the internal model of gravity could be used to predict and take advantage of its mechanical effects on the body. It has been proposed that adaptation to the Earth’s gravity field has allowed control policies to evolve that take advantage of environmental dynamics – use gravity as an assistive force to accelerate downward movements and as a resistive force to decelerate upward movements. This strategy, which has been formalized into a Minimum Smooth-Effort model, would result in movement kinematics that varies with direction (Berret et al., 2008a; Gaveau et al., 2014). Indeed, upward movements were shown to have shorter time to peak velocity and larger curvature than downward movements, but such comparisons were until now largely qualitative (Papaxanthis et al., 1998b; Gentili et al., 2007). Furthermore, upward/downward direction-dependent kinematics could also arise from the complex dynamics of the peripheral neuromuscular system. For example, the firing properties of extensor motoneurons (pulling the arm downwards when upright) are known to obey different rules from those of flexor motoneurons (pulling upwards when uptight; Cotel et al., 2009; Wilson et al., 2015). In addition, muscle force production generated by eccentric contraction (elongation, e.g. downward movements for flexors) is also known to obey differing rules from concentric contraction (e.g. upward movement for flexors; for a review see Enoka, 1996). Because of these asymmetrical neuromuscular peripheral properties, upward/downward kinematic asymmetries cannot necessarily be attributed to gravity effort optimality (i.e., minimization of muscular force to elevate and lower the arm). Thus, a solid test of the effort optimization hypothesis has been lacking.
Here, we explicitly distinguish between the compensation and effort optimization hypotheses with two critical experiments. First, we contrast predictions of optimal control models that either compensate or take advantage of gravity force effects. Then, we quantitatively compare these predictions with actual kinematic features of arm movements in multiple directions. Second, in order to discard a possible influence of peripheral neuromuscular mechanisms, we measure how differences in upward versus downward arm movement kinematics are influenced by the lack of gravity during the zero-G phase of parabolic flight. If directional asymmetries originate from asymmetric firing of flexor/extensor motoneurons, they should persist in the absence of gravity because motoneurons properties are not expected to change during the short zero-G phase of a parabolic flight (Ishihara et al., 1996, 2002; for a review see Nagatomo et al., 2014). On the other hand, if they originate from eccentric versus concentric force production differences, directional asymmetries should cease to exist instantly in 0g because movement dynamics no longer differ for upward and downward movements (Enoka, 1996). Alternatively, however, if directional asymmetries originate from neural planning processes that take advantage of the internal model of gravity, following a gradual recalibration of the gravity internal model, directional asymmetries should progressively decrease towards new optimal zero-G values (McIntyre et al., 2001; Izawa et al., 2008; Snaterse et al., 2011). In support of the effort optimization hypothesis, we show that directional asymmetries are gradually eliminated during repeated exposure to the zero-G phase of parabolic flight.
Results
We asked fifteen humans to perform arm movements around the shoulder joint in different directions (Figure 1A), whereby the work of gravity torque is systematically varied (Figure 1B), while other dynamic variables (interaction torques, Coriolis and centripetal forces) are constant (see Figure 1—figure supplement 1 for a geometrical illustration of the mechanical system and details on gravity torque computations). In single-degree of freedom movements, although the spatial shape of the endpoint trajectory is circular and constant across directions, the temporal shape of the endpoint trajectory (the form of the velocity profile) could change. As a measure of the shape of the velocity profile, we define a symmetry ratio (SR: acceleration time divided by the total movement time). SR corresponds to the relative timing of peak velocity (as in Figure 1C) and thus allows quantifying whether arm kinematics remains invariant (compensation hypothesis prediction) or changes (effort optimization hypothesis prediction) with movement direction. Here we use the optimal control framework (Bryson and Ho, 1975; Todorov, 2004) to simulate arm movement planning in different directions. Specifically, we change the cost function being minimized to understand how the neural model of gravity serves motor planning; i.e., we compare simulations of optimal control models that use the internal model of gravity to either compensate or take advantage of its mechanical effects on the body.
Minimizing a kinematic cost only, without taking joint torque into account, such as the Jerk model (Flash and Hogan, 1985), is a perfect example of the compensation strategy. This is because the brain must compensate all perturbing dynamics to produce a consistent and invariant kinematically-defined motor plan (Hollerbach and Flash, 1982; Atkeson and Hollerbach, 1985), thus predicting constant SR values for all movement directions (Jerk prediction in Figure 1D). In contrast, the Smooth-Effort model minimizes a hybrid cost that, in addition to the Jerk, takes the external dynamics into account to minimize the muscular force needed to move the arm (absolute work of muscular torque). Thus, by design, the Smooth-Effort model implements the effort optimization strategy, whereby the brain uses the gravity internal model to predict and take advantage of gravity torques in accelerating and decelerating downward and upward movements, respectively (Berret et al., 2008a, 2008b; Gaveau et al., 2011, 2014). The effort optimization hypothesis predicts a sigmoidal dependence of SR on movement direction (Smooth-Effort prediction in Figure 1D). Critically, increasing the weight of movement smoothness (Jerk) in the Smooth-Effort hybrid cost, leads to a progressive disappearance of the gravity-torque related tuning of arm kinematics (Figure 1—figure supplement 2). Accordingly, the compensation hypothesis predicts that movement kinematics remains unchanged for various gravity torque conditions (Jerk prediction in Figure 1E), whilst the effort optimization hypothesis predicts that movement kinematics strongly correlates (average R = 0.99 [min: 0.986, max: 0.994], p<1e-07) with the amount of gravity torque engaged in the motion (Smooth-Effort prediction in Figure 1E). Importantly, the SR dependence on movement direction (i.e., on gravity torque) is a unique feature of effort-related optimization as minimizing other cost functions that take joint torques into account, but are not directly related to effort, such as the Variance (Harris and Wolpert, 1998) or Torque Change (Uno et al., 1989), predict constant SR as a function of arm movement direction (Figure 1F; see also Figure 1—figure supplement 3 for additional simulations testing the effect of including muscle dynamics into the minimization of end-point Variance). In fact, minimization of an effort-related cost is a necessary and sufficient condition to predict directional asymmetries in the vertical plane (Berret et al., 2008a, 2008b).
Participants accomplished rapid arm movements with single-peaked velocity profiles. Average duration did not vary with movement direction (0.40s ± 0.01, SD; F16,224=0.67, p=0.82). Because arm movements were visually guided, systematic and variable errors were small and independent of movement direction (-2.5°< SE < 2°; VE < 2.5°; F16,224=1.13, p=0.32 and F16,224=1.02, p=0.44, respectively). As illustrated in Figure 2A, SR shows a sigmoidal modulation as a function of movement direction (F16,224=28.36, p<0.001). The robustness of this result is illustrated in Figure 2B, which shows sigmoidal fits for individual subjects (average RMSE = 9.77e-03 [min: 4.5e-03, max: 1.53e-02]). When SR was regressed against gravity torque, correlation coefficients were high, averaging R = 0.84 [min: 0.67, max: 0.92], p=2.5e-05 (Figure 2C). Furthermore, SR was independent of movement duration and movement amplitude (average correlation coefficient for duration R = 0.22 [min: 0.04, max: 0.57], p=0.41, see Figure 2—figure supplement 1A; for amplitude R = 0.29 [min: 0.02, max: 0.69], p=0.26, see Figure 2—figure supplement 1B). Thus, arm kinematics is selectively modulated according to the gravity torque requirements of the movement, as predicted by the Smooth-Effort model and quantified by high correlation coefficients between predicted and experimental SR values (average R = 0.82 [min: 0.61, max: 0.91], p=5.6e-05; compare Figure 1D and E to Figure 2A and C, respectively). These findings support the effort optimization hypothesis, whereby the brain implements control policies that exploit gravity effects to minimize muscular efforts.
Although undeniably supportive, interpretation of these results is complicated by direction-dependent properties of the peripheral neuromuscular system (Enoka, 1996; Cotel et al., 2009; Wilson et al., 2015). As a further test, exploitation of microgravity environments (e.g., during the zero-G phase of parabolic flight) offers a powerful tool to interrogate neural vs. peripheral origins of the directional asymmetries. This is because during the repeated transitions to zero-G, gravity torque is temporarily eliminated. According to the effort optimization hypothesis, kinematic asymmetries should gradually but systematically decrease to zero, because a progressive re-optimization neural process should take place gradually over multiple zero-G transitions (McIntyre et al., 2001; Izawa et al., 2008; Snaterse et al., 2011). In contrast, a peripheral origin of kinematic asymmetries leads to different predictions. Specifically, if directional asymmetries originate from flexor/extensor motoneuron properties, SR should not change during the zero-G phase of parabolic flight (Ishihara et al., 1996, 2002; Cotel et al., 2009; for a review see Nagatomo et al., 2014; Wilson et al., 2015). Else, if directional asymmetries originate from force production properties, SR asymmetries should be eliminated instantly, not gradually, in 0g (Enoka, 1996). A second experiment was designed to test these predictions.
Eleven participants performed fast and visually guided single-degree of freedom arm reaching movements in two directions (toward the head and toward the feet, Figure 3A), in zero-G conditions during 5 parabolas (P1-P5) of a flight where centrifugal manoeuvers allow cancellation of gravity effects in the plane’s frame of reference. Arm movements were planar with comparable systematic and variable errors for different gravity and direction conditions (shoulder abduction-adduction and internal/external rotation < 3.1°; -3°< SE < 3.3°; VE < 3.4°; gravity effect on SE, p=0.12 and VE, p=0.27; direction effect on SE, p=0.41 and VE, p=0.35). Velocity profiles were single-peaked in both one-G and zero-G conditions and average movement durations ranged between 0.40s and 0.54s (on average, 0.45±0.13s), without any statistical difference between gravity conditions (F5,50=1.274, p=0.29) and movement direction (F1,10=0.549, p=0.48).
Figure 3B shows the SR values predicted from the Smooth-Effort model for upward (red) and downward (blue) arm movements, both in one-G and zero-G environments. Optimization to the zero-G environment no longer predicts direction-dependent differences in velocity profiles, as was the case in one-G. In line with the effort optimization hypothesis, which predicts gradual adaptation to the zero-G environment, SR slowly converged towards the new direction-independent optimal value in zero-G (Figure 3C; gravity condition and movement direction interaction effect, F5,50=10.54, p<0.001). Importantly, directional asymmetries persisted early in zero-G (p=4.8e-05 for P1 and p=1.09e-03 for P2). This indicates that, during initial exposure to zero-G, the brain still uses the internal model of the one-G environment to plan arm movements.
However, directional asymmetries progressively disappeared in the following parabolas, suggesting a gradual re-optimization of motor commands through sensorimotor adaptation to the zero-G environment (post-hoc, p=0.34 for P3, p=0.92 for P4, and p=0.99 for P5). The corresponding average velocity profiles qualitatively illustrate the increase in acceleration/deceleration symmetry (Figure 3D). For the sake of clarity, these experimental findings are replotted as SR Down - SR Up in Figure 3E (black bars). To quantitatively validate the hypothesis of a gradual re-optimization of motor commands, we fitted this directional difference with the Smooth-Effort model (white bars in Figure 3E) by letting the internal model of gravity, g, being a free parameter (-2*G<g<2*G). The progressive decrease in g (internal model of gravity; green dots in Figure 3E) shows that the progressive change in arm kinematic asymmetries can be well explained as a recalibration of the gravity internal model used for optimal motor planning based on the effort optimization (minimization) model (McIntyre et al., 2001; Izawa et al., 2008; Snaterse et al., 2011).
Discussion
It is broadly believed that the brain develops and uses internal models of the sensor and effector dynamics, as well as physical laws of motion, to optimally interact with the external environment (Shadmehr and Mussa-Ivaldi, 1994; Conditt et al., 1997; Gribble and Ostry, 1999; Wolpert and Ghahramani, 2000; Pigeon et al., 2003; Todorov, 2004; Ahmed et al., 2008; Scott, 2012). Having evolved in the Earth’s gravitational environment, our brains have thus acquired an internal model of gravity (Angelaki et al., 1999, 2004; Indovina et al., 2005; Miller 2008). Here, we have conducted two critical experiments and showed that the brain takes advantage of this internal model to implement control policies that minimize movement effort under gravito-inertial constraints.
First, we have shown that humans use versatile temporal trajectories that are linearly tuned to the gravity torque requirements of the task. Simulations of a Smooth-Effort model, which minimizes a hybrid cost composed of the absolute work of muscular forces (mechanical energy expenditure) and jerk (inverse smoothness of the trajectory) can predict not only differences in upward/downward arm movements, but also the linear modulation of endpoint kinematics according to the gravity torque requirements of the movement. Because the smoothness term of the Smooth-Effort model corresponds to the Jerk, the Smooth-Effort model can be considered an expansion of the minimum Jerk requirement to include how task dynamics shapes movement kinematics. Yet, inclusion of an effort-related cost is a necessary and sufficient condition to predict directional asymmetries in the vertical plane (Berret et al., 2008a, 2008b). Furthermore, minimizing other torque-related cost functions failed to predict direction-dependent kinematics (Figure 1F). The present results therefore strongly support effort minimization in humans, further extending the growing idea that perceived effort plays an important role in the tailoring of human motor as well as non-motor behaviors (Bramble and Lieberman, 2004; Walton et al., 2006; Mazzoni et al., 2007; Carrier et al., 2011; Kurzban et al., 2013; Selinger et al., 2015; Farshchiansadegh et al., 2016; Shadmehr et al., 2016).
Second, we have also shown that the direction-dependent kinematics observed in normal gravity progressively vanishes during repeated exposure to a microgravity environment. Remarkably, Smooth-Effort model simulations nicely predict this adaptation to zero-G. Results of this second experiment are of major importance to disentangle peripheral and neural mechanisms for direction-dependent kinematics. This is because, if the observed direction-dependent kinematics were due to properties of the neuromuscular system, either an abrupt change or no change at all would be expected in the new gravity environment (Enoka, 1996; Ishihara et al., 1996, 2002; Cotel et al., 2009; Nagatomo et al., 2014; Wilson et al., 2015). The fact that neither happens reveals a central mechanism.
Furthermore, the fact that the observed progressive changes in kinematic asymmetries lead to new optimal values clearly supports the hypothesis of a progressive re-optimization procedure originating from planning processes (Izawa et al., 2008; Snaterse et al., 2011; Selinger et al., 2015). The present findings on arm movements extend and supplement the recent results of Selinger and collaborators on human walking (Selinger et al., 2015), suggesting that i) the brain can easily and progressively adapt motor patterns to reduce energy expenditure and ii) energy-related criteria (such as effort) are not only the result of, but actually tailor, motor patterns.
The present results and conclusions stand in contrast to a broad view that the brain uses internal models of perturbing forces for their compensation such that stereotypic trajectories can be maintained (Hollerbach and Flash, 1982; Atkeson and Hollerbach, 1985; Shadmehr and Mussa-Ivaldi, 1994). Although very influential, such a compensation hypothesis has been challenged by results of studies that quantified velocity profiles and revealed that the temporal organization of arm kinematics shows a small, yet consistent, dependence on movement direction, speed and load (Papaxanthis et al., 1998b; Gaveau et al., 2011, 2014). Furthermore, findings inconsistent with the compensation hypothesis have been largely ignored. For example, Virji-Babul et al. (1994) reported regression slopes of SR over movement amplitude that significantly differed between upward and downward movements (see Figure 2C in Virji-Babul et al., 1994). Also, the consistent observation of negative periods on the phasic activation of arm muscles, resulting from the subtraction of the hypothesized gravity-compensatory activity from the full muscle activation (Flanders et al., 1996), suggest that muscular activity does not compensate gravity torque (Gaveau et al., 2013).
Luckily, the application of the optimal control theory to the study of biological movement has given better insights into old phenomena. For example, recent studies, which framed motor adaptation as a process of re-optimization (Izawa et al., 2008; Crevecoeur et al., 2009; Gaveau et al., 2011; Cluff and Scott, 2015), have reported subtly altered trajectories – by contrast to the traditional compensation view that assumes invariant trajectories. Thus, newly constructed/calibrated internal models may serve trajectory optimization rather than external force compensation. The present results provide further support for this notion and demonstrate the propensity of the motor system for multiple control policies (i.e., trajectories) whose temporal organization shows small, but systematic, differences, such as to allow minimization of motor effort in our daily living ubiquitous gravity environment.
Although we have only used simple, mono-articular arm movements in the present experiments, our conclusions are generalizable. Specifically, directional asymmetries in the vertical plane (upwards versus downwards) have also been observed in multi-articular arm reaching, reaching to grasp, grasping, hand drawing, and whole-body sit-to-stand / stand-to-sit movements (Papaxanthis et al., 1998c, 2003, 2005; Yamamoto and Kushiro, 2014). Thus, we propose that the directional tuning of movement kinematics is a general feature of motor control that may reflect an evolutionary and/or developmental advantage for effort optimization in the Earth’s gravity field (Bramble and Lieberman, 2004; Carrier et al., 2011; Selinger et al., 2015).
Finally, it is important to speculate that the Smooth-Effort model pioneered here should not be considered solely an extension of the minimum jerk optimization model, which was proposed for planar horizontal movements that are unaffected by gravity (Flash and Hogan, 1985), to now include optimization of work against gravity for vertical movements. Even for movements in the horizontal plane, because the effort component of the cost function in the Smooth-Effort model is torque-dependent, the predictions of the Smooth-Effort model will change with the torque requirements of the movement. The minimum Jerk model predictions, however, will remain constant. Therefore, if interaction torques (for multi-degree of freedom arm movements) or additional external torques (produced by a robotic manipulandum for example) are experienced in the horizontal plane, the Smooth-Effort and Jerk model predictions would be different. Future experiments should test whether the need for optimization of work is limited to vertical movements pro or against gravity or, as we propose, represent a more general principle of motor control.
Materials and methods
Twenty-six right-handed healthy adults participated in these experiments (Experiment 1: 4♀ / 11♂, mean age = 24±3.2 years; Experiment 2: 2♀ / 9♂, mean age = 27±4.1 years). All gave their written informed consent. Right hand preference was evaluated by the Edinburg test (individual scores > 0.86; Oldfield, 1971). The regional ethics committee of Burgundy (C.E.R) approved the protocol of Experiment 1 and the ethics committee of INSERM (Institut National de la Santé et de la Recherche Médicale) approved the protocol of Experiment 2. All procedures were carried out in agreement with local requirements and international norms (Declaration of Helsinki, 1964).
Experiment 1
Request a detailed protocolParticipants comfortably sat on a chair with their trunk in the vertical position (Figure 1A). All trials started from a fixed initial position: shoulder elevation 90°, shoulder abduction 0°, elbow joint fully-extended, hand semi-pronated and aligned with the upper arm and the forearm. From that initial position, participants carried out rapid, visually guided, single degree of freedom arm movements (rotation around the shoulder, 45° amplitude) towards 17 targets (plastic markers, diameter 1 cm) placed in the right sagittal-frontal space. Note that results from previous experimental and theoretical studies have demonstrated that directional asymmetries in the vertical plane do not originate from the existence of inertial interaction torques at the elbow and wrist joints (Le Seac'h and McIntyre, 2007; Gaveau et al., 2014). Figure 1A depicts the projection of targets' position onto the frontal plane. The inter-target angles are described in Figure 1—figure supplement 1C (Plane angles). All targets were centered on the participants’ right shoulder at a distance equal to the length of their fully-extended arm. Reaching movements required a combination of shoulder abduction and shoulder flexion or extension. Participants performed 204 trials in a random order (12 trials for each movement direction, total trials in the experiment = 3060).
Experiment 2
Request a detailed protocolThis experiment took place in an aircraft during parabolic flight. Participants comfortably sat on the aircraft’s floor with their legs strapped and their trunk in the vertical position (Figure 3A). The general organization of the task was exactly as described in previous studies (Gaveau et al., 2011, 2014). Briefly, 3 targets were centered on the participants’ right shoulder (parasagittal plane) at a distance equal to the length of their fully extended arm. Participants were requested to perform fast visually guided upward and downward arm reaching movements (45° shoulder rotation). Participants first performed arm movements in normal gravity during the flight (before parabolic maneuvers started, 40 trials for each movement direction) and then in microgravity during 5 parabolas (≈75 trials, ≈15 trials per parabola). During the parabolic flight and based on pilots’ instructions about the gravity force level, the experimenter verbally instructed participants when to start a block of reaching movements and when to stop. This was important to ensure that movements started and finished within zero-G conditions; i.e., participants made no movement in one-G or two-G conditions during or between parabolic manoeuvers. At the beginning of a block of movements within a parabola, participants repetitively reached between the middle, the upward, and the downward targets as follows: middle-upward (stopped for roughly 1 s), upward-middle (pause 1 s), middle-downward (pause 1 s), downward-middle (pause 1 s) and so on for approximately 15 trials. As initial position did not influence adaptation results across parabolas, movements with different initial positions were pooled together within each direction. The experiments were carried out during 4 different flights. Each flight was composed of thirty parabolas, each parabola consisting of three successive phases: (i) hypergravity ~ 1.8 g, (ii) microgravity ~ 0 g, and (iii) hypergravity again ~ 1.8 g. Each of those three phases lasted ~30 s and the parabolas were separated by a time interval of ~ 2 min. The whole flight lasted ~ 2 hr. Here we present the results of an experiment performed during 5 parabolas for each participant. After this experiment, participants carried out a different experiment from which the results are not presented here.
Two participants were tested on each flight. Therefore, to reduce motor adaptation to zero-G before the experiment took place, participants who did not perform the experiment during the first five parabolas were restrained on the aircraft floor so as to prevent any motion. Similar results were observed for participants who did the experiment at the beginning or at the end of the flight (see Figure 3—figure supplement 1).
Data recording, analysis and modeling
Request a detailed protocolAll analyses were performed using custom programs in Matlab (Matworks, Natick, MA) and have been described in details in previous studies (Gaveau et al., 2011, 2014). Arm movements in both Experiments were recorded using an optoelectronic system of motion analysis (Smart, B.T.S., Italy) with 4 TV-cameras (120 Hz). Five reflective markers (diameter: 4 mm) were placed on the shoulder (acromion), elbow (lateral epicondyle), wrist (middle of the wrist), hand (first metacarpo-phalangeal joint), and the nail of the index. Kinematics was recorded in three dimensions (X, Y and Z) and low-pass filtered (10 Hz) using a digital fifth-order Butterworth filter. The start and end of each movement was defined as the time at which finger tangential velocity went above or fell below 5% of maximum velocity. An automatic inspection of all trials revealed that shoulder angular velocity profiles were single-peaked and presented no motion (<3°) from any other joint. Following this analysis, we calculated the subsequent kinematic parameters: (i) movement duration (MD), (ii) constant and variable angular final error and (iii) symmetry ratio (SR) of the finger velocity profile, defined as the ratio of acceleration time to total movement time (a ratio equal to 0.5 indicates temporally symmetric velocity profiles). In the present study, we used SR to quantify kinematic variations with movement direction. SR is a standard parameter that has been routinely used in numerous studies, therefore ensuring an easy comparison of the present result with past ones.
We calculated the gravity torque (GT) normal to the plane of motion with the following formula:
where is the mass of the arm (estimated for each subject from anthropometric tables, Winter, 1990), = 9.81 m.s-2, is the lever arm length (Winter, 1990), is the movement amplitude (0° to 45°) and is the plane of motion inclination with respect to horizontal. The geometrical illustration of the mechanical system along with details on how to derive Equation 1 are displayed in Figure 1—figure supplement 1.
In Experiment 1 we report the Work of Gravity Torque calculated as follows:
Positive values indicate that WGT has the same direction as arm motion, whilst negative values indicate that WGT direction is opposite to arm motion direction (see Figure 1—figure supplement 1).
In Experiment 1, we also performed iterative least square minimizations to fit a sigmoid function on simulated as well as experimentally recorded SR. This was performed using the “nlinfit” Matlab function (Mathworks) and Equation 3:
where are free parameters and is the angular scale. The goodness of fit was assessed by the Root-Mean-Square Error (RMSE), which is essentially equivalent to Standard Deviation and has the same units as the variable being fitted.
Simulations
Request a detailed protocolWe predicted SR using an optimal control framework based on the Minimum Smooth-Effort model (Gaveau et al., 2014). More sophisticated versions of the model focusing on multi-degree of freedom arm movements have been described in previous publications (Berret et al., 2008a, 2008b; Gaveau et al., 2011).
Equation 4 describes the equation of motion for a single degree of freedom limb movement, with amplitude angle , plane of motion inclination with respect to horizontal , moment of inertia (), viscous friction coefficient (as in Nakano et al., 1999) and gravitational torque . The net muscle torque acting at the shoulder is obtained as follows:
The Minimum Smooth-Effort model minimizes a combination of Effort and Smoothness. The mechanical effort related to a movement, i.e., the amount of muscular force spent to move the arm, can be computed as the absolute work of the muscle torque:
The rationale of this effort term is that the desired trajectory must take advantage of non-muscular torques – gravity torque in the present experiment – in order to minimize the amount of muscular torque required to move the arm up to the final posture.
It has been shown that considering effort expenditure alone usually fails to account for several features of human trajectories, such as motion smoothness (Berret et al., 2011a, 2011b). Consequently, we considered that a complementary objective of motor planning was to maximize motion smoothness. This was achieved by penalizing large angle jerks. Thus an additional term that enters into the minimization is:
The Smooth-Effort model then relies on the following composite cost function:
where is a weighting factor normalizing the relative magnitude of the jerk term in the total cost function. For all simulations, but Figure 1—figure supplement 2, we set . Figure 1—figure supplement 2 presents simulations where was systematically varied to test the relative roles of both the effort and smoothness parts of the cost function in predicting direction dependent kinematics (i.e., the linear correlation of SR with the Work of Gravity Torque; WGT, see Figure 1E). Note that minimizing some function will provide the same solution x as minimizing for any d>0. Hence, we normalized our cost function by setting b=d, thereby assuming a unit coefficient in front of one component of the cost.
For a given , the optimal control problem consists of finding a vector (here the time derivative of the muscle torque) driving the system from an initial to a final static posture , in time (adjusted for each subject based on experimental data), and yielding a minimum cost value . We solved the minimization numerically using a Gauss pseudospectral method and the software GPOPS (Benson et al., 2006; Garg et al., 2009; Rao et al., 2010). We verified that the control variable was smooth, the boundary values were not reached and the Pontryagin’s maximum principle necessary conditions (such as the constancy of the Hamiltonian) met. Predicted SR values were determined based on the simulated velocity profiles, as described above for experimental data.
We also derived the solution of the Minimum Smooth-Effort model for a constant gravitational torque and obtained very similar results to those presented in the main text. This means that asymmetries are not totally due to GT variations along the movement amplitude but to the presence of non-zero GT. The linearized case for similar models has been analyzed in depth in Berret et al. (2008a); where the solution of the Minimum Smooth-Effort model was derived explicitly and the origin of asymmetries in such a model was mathematically demonstrated – minimizing an effort-related cost is a necessary and sufficient condition for the production of a brief transient muscle inactivation near the peak of velocity which in turn induces the observed kinematic asymmetries with respect to movement direction.
In Figure 1 we also present the results of simulations performed with three influential alternative models: the Minimum Jerk, the Minimum Torque Change and the Minimum Variance (Flash and Hogan, 1985; Uno et al., 1989; Harris and Wolpert, 1998). Predicted SR values corresponding to the minimization of each subjective cost were obtained using the following equations and the same optimal control framework as described for the Minimum Smooth-Effort model.
The cost to minimize for the Jerk model was:
As we deal with a 1-dof arm, this model accounts for both the angular and Cartesian versions of the Minimum Jerk (which indeed provide equivalent predictions in the current case). Note that the smoothness term of the Smooth-Effort model corresponds to the minimum Jerk. The Smooth-Effort model thus represents an important and non-trivial extension of the minimum Jerk model, which also accounts for how task dynamics shapes movement kinematics. Because the effort part of our model is torque dependent, the prediction of the Smooth-Effort model will change with the torque requirement of the movement whilst the minimum Jerk prediction will not. Therefore, if interaction torques (for multi-degree of freedom arm movements) or additional external torques (produced by a robotic manipulandum for example) are experienced in the horizontal plane, the minimum Smooth-Effort and the minimum Jerk would predict very different solutions.
The cost to minimize for the Torque Change model (Uno et al., 1989) was:
Simulations of the Minimum Torque change model for horizontal single degree of freedom arm movements performed under various dynamics by Tanaka et al. (2004) reported that the Minimum Torque Change model predicts velocity profiles that are always symmetrical, in line with Figure 1F. The Minimum Torque Change model in the gravity field has also been investigated in depth in (Berret, 2009).
We also derived the solutions of the Minimum Variance model in the gravity field (Harris and Wolpert, 1998). We first linearized the arm’s dynamics (Equation 4) in order to compute the optimal solution according to the method presented in Harris and Wolpert (1998) and Tanaka et al. (2004). Here:
Equation 10 formalizes that a constant gravitational torque is pushing the moving segment downwards. Note that such linearized case for similar models has been extensively used by previous studies (Harris and Wolpert, 1998; Tanaka et al., 2004; Berret et al., 2008a).
We considered the discrete time version of the Minimum Variance optimal control problem. Denoting by the state vector and by the control variable, the linear state-space dynamics for the Minimum Variance model was expressed as follows:
where is the signal dependent (multiplicative) noise at time ( in all simulations) and with the time step size after discretization ( in our simulations).
We obtained the solution to the optimal control problem by iteratively computing the distribution of the state vector at time :
The positional variance of the endpoint at time t (denoted by ) is thus given by the element of the matrix (Equation 13). We can then define a quadratic programming problem by defining a cost related to the endpoint positional variance as follows:
where is an integer defining the post-movement stabilization time, is the a priori chosen movement time (counting only the transient phase). In our simulations, we considered . Because noise accumulates through time, is indeed a function of the control variable during the transient period of the motion. This minimization problem was solved using Matlab's fmincon function (sqp algorithm).
For the sake of completeness, we also derived the minimum variance solution when modeling some basic muscle dynamics, as performed by previous studies (Harris and Wolpert, 1998; Tanaka et al., 2004). In agreement with previous results from Tanaka et al. (2004); we obtained similar results to those presented in the main text (Figure 1F), as illustrated in Figure 1—figure supplement 3. In that case, the state vector becomes , the control variable becomes and the muscles are modeled as first order low-pass filters. The equations for the associated dynamics are as follows:
Equation 15 describes the equation of motion for a single degree of freedom limb movement, with amplitude angle, plane of motion inclination with respect to horizontal , moment of inertia (), viscous friction coefficient (Nakano et al., 1999) and gravitational torque . In Equation 16, the constant is a gain factor relating agonist and antagonist muscle activations to joint torques. Equations 17 and 18 describe the muscle dynamics as a first order low-pass filter. The control variable is the motoneurons inputs and with the constraint: . This implies the positivity of muscle activations and, therefore, muscle torque. The net torque is simply obtained by subtracting the agonist and antagonist torques.
Statistical analyses
Request a detailed protocolFor each participant, we calculated mean values for all recorded variables and checked for normal distribution (Shapiro-Wilk tests) and sphericity (Mauchly tests). In Experiment 1, statistical effects were accessed by within-subjects one-way repeated-measures ANOVA (factor: 17 angles). In Experiment 2, statistical comparisons were carried out by within-subjects two-way repeated-measures ANOVA. The factors were direction (2 levels) and gravity-conditions (six levels: 1g and 5 parabolas in 0g). For all statistical analyses, post-hoc differences were assessed with Scheffé's tests and significance was accepted at p<0.05.
References
-
Computation of inertial motion: neural strategies to resolve ambiguous otolith informationJournal of Neuroscience 19:316–327.
-
Kinematic features of unrestrained vertical arm movementsJournal of Neuroscience 5:2318–2330.
-
Direct trajectory optimization and costate estimation via an orthogonal collocation methodJournal of Guidance, Control, and Dynamics 29:1435–1440.https://doi.org/10.2514/1.20478
-
ThesisIntégration de la force gravitaire dans la planification motrice et le contrôle des mouvements du bras et du corpsUniversité de Bourgogne.
-
Evidence for composite cost functions in arm movement planning: an inverse optimal control approachPLoS Computational Biology 7:e1002183.https://doi.org/10.1371/journal.pcbi.1002183
-
Manifold reaching paradigm: how do we handle target redundancy?Journal of Neurophysiology 106:2086–2102.https://doi.org/10.1152/jn.01063.2010
-
How humans control arm movementsProceedings of the Steklov Institute of Mathematics 261:44–58.https://doi.org/10.1134/S0081543808020053
-
Apparent and actual trajectory control depend on the behavioral context in upper limb motor tasksJournal of Neuroscience 35:12465–12476.https://doi.org/10.1523/JNEUROSCI.0902-15.2015
-
The motor system does not learn the dynamics of the arm by rote memorization of past experienceJournal of Neurophysiology 78:554–560.
-
Optimal integration of gravity in trajectory planning of vertical pointing movementsJournal of Neurophysiology 102:786–796.https://doi.org/10.1152/jn.00113.2009
-
Uber das Relativita¨tsprinzip und die aus demselben gezogenen FolgerungenJber Radiokt 4:411–462.
-
ConferencePerception of planar surface orientation relative to earth verticalProgram No. 822.02. 2014 Neuroscience Meeting Planner.
-
Eccentric contractions require unique activation strategies by the nervous systemJournal of Applied Physiology 81:2339–2346.
-
Sensory agreement guides kinetic energy optimization of arm movements during object manipulationPLoS Computational Biology 12:e1004861.https://doi.org/10.1371/journal.pcbi.1004861
-
Basic features of phasic activation for reaching in vertical planesExperimental Brain Research 110:67–79.https://doi.org/10.1007/BF00241376
-
The coordination of arm movements: an experimentally confirmed mathematical modelJournal of Neuroscience 198:1688–1703.
-
ConferenceMotor planning in the gravitational field: how do monkeys reach?Program No. 650.03. 2013 Neuroscience Meeting Planner.
-
Compensation for interaction torques during single- and multijoint limb movementJournal of Neurophysiology 82:2310–2326.
-
Dynamic interactions between limb segments during planar arm movementBiological Cybernetics 44:67–77.https://doi.org/10.1007/BF00353957
-
Succinate dehydrogenase activity in rat dorsolateral ventral horn motoneurons at L6 after spaceflight and recoveryJournal of Gravitational Physiology 9:39–48.
-
Motor adaptation as a process of reoptimizationJournal of Neuroscience 28:2883–2891.https://doi.org/10.1523/JNEUROSCI.5359-07.2008
-
An opportunity cost model of subjective effort and task performanceBehavioral and Brain Sciences 36:661–679.https://doi.org/10.1017/S0140525X12003196
-
Visual gravitational motion and the vestibular system in humansFrontiers in Integrative Neuroscience 7:101.https://doi.org/10.3389/fnint.2013.00101
-
Computation of linear acceleration through an internal model in the macaque cerebellumNature Neuroscience 16:1701–1708.https://doi.org/10.1038/nn.3530
-
Multimodal reference frame for the planning of vertical arms movementsNeuroscience Letters 423:211–215.https://doi.org/10.1016/j.neulet.2007.07.034
-
Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivationJournal of Neuroscience 27:7105–7116.https://doi.org/10.1523/JNEUROSCI.0264-07.2007
-
Vestibular nuclei and cerebellum put visual gravitational motion in contextJournal of Neurophysiology 99:1969–1982.https://doi.org/10.1152/jn.00889.2007
-
Effects of exposure to microgravity on neuromuscular systems: a reviewInternal Journal of Microgravity Science Application 31:66–71.
-
Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change modelJournal of Neurophysiology 81:2140–2155.
-
The representation of gravitational force during drawing movements of the armExperimental Brain Research 120:233–242.https://doi.org/10.1007/s002210050397
-
Influence of gravity compensation on muscle activation patterns during different temporal phases of arm movements of stroke patientsNeurorehabilitation and Neural Repair 23:478–485.https://doi.org/10.1177/1545968308328720
-
Changes in muscle activation after reach training with gravity compensation in chronic stroke patientsInternational Journal of Rehabilitation Research 35:234–242.https://doi.org/10.1097/MRR.0b013e328353e3f1
-
Gpops: A matlab software for solving multiple-phase optimal control problems using the gauss pseudospectral methodACM Transactions on Mathematical Software 37:9.
-
Dimensionality of joint torques and muscle patterns for reachingFrontiers in Computational Neuroscience 8:24.https://doi.org/10.3389/fncom.2014.00024
-
The computational and neural basis of voluntary motor control and planningTrends in Cognitive Sciences 16:541–549.https://doi.org/10.1016/j.tics.2012.09.008
-
Humans can continuously optimize energetic cost during walkingCurrent Biology 25:2452–2456.https://doi.org/10.1016/j.cub.2015.08.016
-
A representation of effort in decision-making and motor controlCurrent Biology 26:1929–1934.https://doi.org/10.1016/j.cub.2016.05.065
-
Adaptive representation of dynamics during learning of a motor taskJournal of Neuroscience 14:3208–3224.
-
Distinct fast and slow processes contribute to the selection of preferred step frequency during human walkingJournal of Applied Physiology 110:1682–1690.https://doi.org/10.1152/japplphysiol.00536.2010
-
Optimality principles in sensorimotor controlNature Neuroscience 7:907–915.https://doi.org/10.1038/nn1309
-
Formation and control of optimal trajectory in human multijoint arm movement. Minimum torque-change modelBiological Cybernetics 61:89–101.
-
Visuospatial memory computations during whole-body rotations in rollJournal of Neurophysiology 94:1432–1442.https://doi.org/10.1152/jn.00018.2005
-
Effects of gravitational forces on single joint arm movements in humansExperimental Brain Research 99:338–346.https://doi.org/10.1007/BF00239600
-
Intrinsic excitability of human motoneurons in biceps brachii versus triceps brachiiJournal of Neurophysiology 113:3692–3699.https://doi.org/10.1152/jn.00960.2014
-
Computational principles of movement neuroscienceNature Neuroscience 3 Suppl:1212–1217.https://doi.org/10.1038/81497
-
Direction-dependent differences in temporal kinematics for vertical prehension movementsExperimental Brain Research 232:703–711.https://doi.org/10.1007/s00221-013-3783-y
-
Visual perception and interception of falling objects: a review of evidence for an internal model of gravityJournal of Neural Engineering 2:S198–208.https://doi.org/10.1088/1741-2560/2/3/S04
-
Internal models and prediction of visual gravitational motionVision Research 48:1532–1538.https://doi.org/10.1016/j.visres.2008.04.005
Article and author information
Author details
Funding
Institut National de la Santé et de la Recherche Médicale
- Jeremie Gaveau
- Charalambos Papaxanthis
Agence Nationale de la Recherche (projet MOTION, 14-CE30-007-01)
- Charalambos Papaxanthis
National Institute of Neurological Disorders and Stroke (R21-NS-075944-02)
- Jeremie Gaveau
- Dora E Angelaki
- Charalambos Papaxanthis
Centre National d’Etudes Spatiales
- Jeremie Gaveau
- Bastien Berret
- Charalambos Papaxanthis
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
This work was supported by the Institut National de la Santé et de la Recherche Médicale (INSERM), by the Agence National de Recherche (ANR, project MOTION ANR-14-CE30-0007-01), by the Centre National d'Etudes Spatiales (CNES) and by National Institute of Neurological Disorders and Stroke Grant R21-NS-075944-02. J Gaveau was supported by grants from the Ministère de l’Éducation Nationale, de l’Enseignement Supérieur et de la Recherche. We would like to thank Yves Ballay, Fabien Nicol and Cyril Sirandré for their help with data acquisition and technical support.
Ethics
Human subjects: Informed consent, and consent to publish, was obtained from all participants. The regional ethics committee of Burgundy (C.E.R) and the ethics committee of INSERM (Institut National de la Santé et de la Recherche Médicale) approved experimental protocols. All procedures were carried out in agreement with local requirements and international norms (Declaration of Helsinki, 1964).
Copyright
© 2016, Gaveau et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,837
- views
-
- 296
- downloads
-
- 67
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Computational and Systems Biology
- Microbiology and Infectious Disease
Timely and effective use of antimicrobial drugs can improve patient outcomes, as well as help safeguard against resistance development. Matrix-assisted laser desorption/ionization time-of-flight mass spectrometry (MALDI-TOF MS) is currently routinely used in clinical diagnostics for rapid species identification. Mining additional data from said spectra in the form of antimicrobial resistance (AMR) profiles is, therefore, highly promising. Such AMR profiles could serve as a drop-in solution for drastically improving treatment efficiency, effectiveness, and costs. This study endeavors to develop the first machine learning models capable of predicting AMR profiles for the whole repertoire of species and drugs encountered in clinical microbiology. The resulting models can be interpreted as drug recommender systems for infectious diseases. We find that our dual-branch method delivers considerably higher performance compared to previous approaches. In addition, experiments show that the models can be efficiently fine-tuned to data from other clinical laboratories. MALDI-TOF-based AMR recommender systems can, hence, greatly extend the value of MALDI-TOF MS for clinical diagnostics. All code supporting this study is distributed on PyPI and is packaged at https://github.com/gdewael/maldi-nn.
-
- Computational and Systems Biology
- Genetics and Genomics
Enhancers and promoters are classically considered to be bound by a small set of transcription factors (TFs) in a sequence-specific manner. This assumption has come under increasing skepticism as the datasets of ChIP-seq assays of TFs have expanded. In particular, high-occupancy target (HOT) loci attract hundreds of TFs with often no detectable correlation between ChIP-seq peaks and DNA-binding motif presence. Here, we used a set of 1003 TF ChIP-seq datasets (HepG2, K562, H1) to analyze the patterns of ChIP-seq peak co-occurrence in combination with functional genomics datasets. We identified 43,891 HOT loci forming at the promoter (53%) and enhancer (47%) regions. HOT promoters regulate housekeeping genes, whereas HOT enhancers are involved in tissue-specific process regulation. HOT loci form the foundation of human super-enhancers and evolve under strong negative selection, with some of these loci being located in ultraconserved regions. Sequence-based classification analysis of HOT loci suggested that their formation is driven by the sequence features, and the density of mapped ChIP-seq peaks across TF-bound loci correlates with sequence features and the expression level of flanking genes. Based on the affinities to bind to promoters and enhancers we detected five distinct clusters of TFs that form the core of the HOT loci. We report an abundance of HOT loci in the human genome and a commitment of 51% of all TF ChIP-seq binding events to HOT locus formation thus challenging the classical model of enhancer activity and propose a model of HOT locus formation based on the existence of large transcriptional condensates.