Mechanisms that allow cortical preparatory activity without inappropriate movement
Abstract
We reveal a novel mechanism that explains how preparatory activity can evolve in motor-related cortical areas without prematurely inducing movement. The smooth eye movement region of the frontal eye fields (FEFSEM) is a critical node in the neural circuit controlling smooth pursuit eye movement. Preparatory activity evolves in the monkey FEFSEM during fixation in parallel with an objective measure of visual-motor gain. We propose that the use of FEFSEM output as a gain signal rather than a movement command allows for preparation to progress in pursuit without causing movement. We also show that preparatory modulation of firing rate in FEFSEM predicts movement, providing evidence against the ‘movement-null’ space hypothesis as an explanation of how preparatory activity can progress without movement. Finally, there is a partial reorganization of FEFSEM population activity between preparation and movement that would allow for a directionally non-specific component of preparatory visual-motor gain enhancement in pursuit.
Introduction
Preparation is an important component of voluntary movement. Throughout the motor system, many neurons show modulation of firing rate that occurs during movement preparation and is linked to parameters of the ensuing movement (Dorris et al., 1997; Glimcher and Sparks, 1992; Hanes and Schall, 1996; Munoz and Wurtz, 1995; Tanaka and Fukushima, 1998; Tanji and Evarts, 1976; Weinrich and Wise, 1982; Wurtz and Goldberg, 1972; Churchland et al., 2006a; Churchland et al., 2006b; Darlington et al., 2018; Hanes and Schall, 1996; Mahaffy and Krauzlis, 2011; Messier and Kalaska, 2000). Importantly, many neurons that seem to be tied to movement still have preparatory activity, even though there is neither movement nor muscle activity during preparation. How can motor and premotor cells in the cerebral cortex and even the brainstem and spinal cord (Glimcher and Sparks, 1992; Munoz and Wurtz, 1995; Prut and Fetz, 1999) show preparatory activity without causing inappropriate movement?
We have addressed the general question of how preparatory activity fails to evoke movement in the smooth eye movement region of the frontal eye fields (FEFSEM), a critical node in the neural circuit for smooth pursuit eye movements. Neurons in FEFSEM are seemingly tied to pursuit. Inactivation or lesioning of FEFSEM produces dramatic defects in smooth pursuit (Keating, 1991; Shi et al., 1998). Micro-stimulation induces smooth eye movement (Gottlieb et al., 1993). Strong modulation of activity occurs just before the initiation of pursuit (MacAvoy et al., 1991). The modulation is tuned for the direction of visual motion and eye movement and is monotonically related to their speeds (Gottlieb et al., 1994; Tanaka and Lisberger, 2002a; Tanaka and Lisberger, 2002b). Therefore, the activity of FEFSEM cells seems to play an important role in the generation of smooth pursuit eye movement. Importantly, the same cells that discharge in relation to the initiation of pursuit also show an impressive ramp increase in firing rate during fixation, at a time when there is neither visual motion nor smooth eye movement (Mahaffy and Krauzlis, 2011; Tanaka and Fukushima, 1998). The preparatory activity grows over the hundreds of milliseconds preceding visual motion and the onset of pursuit, and its amplitude encodes expectation of upcoming target speed and combines with visual-motion input in a reliability-weighted manner to determine pursuit-related responses (Darlington et al., 2018).
Several mechanisms have been proposed in various motor systems to explain how preparatory activity can evolve without causing movement. In the arm movement system, the current paradigm suggests that populations of neurons act as a dynamical system in which preparatory activity sets the initial conditions for the progression of movement activity (Churchland et al., 2010; Churchland et al., 2012). Importantly, preparatory population activity in primary motor cortex (M1) and dorsal premotor cortex (PMd) progresses in a way that avoids dimensions related to movement (Kaufman et al., 2014). It remains confined to ‘movement-null’ dimensions until just before movement initiation, and only then begins to progress along ‘movement-potent’ dimensions. Indeed, the preparatory and movement-related population responses in M1 and PMd occupy orthogonal dimensions (Elsayed et al., 2016). Furthermore, the use of output-null neural dimensions plays a role in both M1’s initial processing of visuomotor feedback during movement as well as short-term force-field adaptation in PMd (Perich et al., 2018; Stavisky et al., 2017).
In the saccadic eye movement system, movement is prevented during preparation via the action of an all-or-none inhibitory gate created by the action of omnipause neurons in the brainstem (Cohen and Henn, 1972; Keller, 1974; Luschei and Fuchs, 1972). Ramps of preparatory activity in the saccadic region of the frontal eye fields fail to trigger eye movements until the collective descending activity from the frontal eye fields and superior colliculus cause the omnipause neurons to cease firing, releasing the circuits that generate movement (Dorris et al., 1997; Hanes and Schall, 1996). Furthermore, subthreshold activity in the superior colliculus possesses some motor potential when omnipause neurons are inhibited by the trigeminal blink reflex (Jagadisan and Gandhi, 2017). However, there is no evidence that the pursuit system uses the all-or-none gate that controls saccades (Missal and Keller, 2002; Schwartz and Lisberger, 1994).
Here we propose a third, different, mechanism for movement prevention during motor preparation. The outputs from the FEFSEM seem to control the gain of visual-motor transmission for pursuit (Nuding et al., 2009; Tanaka and Lisberger, 2001). Further, visual-motor gain is dialed up in preparation for an imminent smooth eye movement (Kodaka and Kawano, 2003; Tabata et al., 2006). In the present paper, we show striking parallels between the progression of preparatory activity in FEFSEM and the preparatory enhancement of visual-motor gain in the pursuit system. We argue that the output of FEFSEM dials up visual-motor gain in preparation for a behaviorally-relevant visual motion of a specific direction and speed, and that the use of FEFSEM output as a sensorimotor gain signal allows preparation to proceed without causing movement. We also show that preparatory activity in FEFSEM seems to contradict the major predictions of the dynamical system framework that has arisen from work in arm motor cortex (Churchland et al., 2010; Elsayed et al., 2016; Kaufman et al., 2014).
Results
We present three primary findings to support the conclusion that FEFSEM preparatory activity can evolve without causing smooth pursuit eye movement because its output does not drive smooth eye movement, but rather is used as a gain signal that controls access of visual motion to the oculomotor machinery. First, we demonstrate parallel progression of FEFSEM preparatory activity and an objective measure of visual-motor gain. Second, we show that preparatory activity in FEFSEM evolves in a manner that predicts movement when there is none, precluding for the smooth pursuit eye movement system the ‘movement-null’ space mechanism proposed for M1 and PMd preparatory activity in the arm movement system (Kaufman et al., 2014). Third, we show that there is some degree of reorganization of the FEFSEM population response, and we link the reorganization to a directionally nonspecific component of preparatory modulation of visual-motor gain. We suggest that gain control should be considered in all movement systems as one of several possible mechanisms to allow preparatory activity without movement.
FEFSEM preparatory activity evolves in parallel with a preparatory modulation of visual-motor gain
Neurons in FEFSEM are seemingly tied to the generation of smooth pursuit eye movement, yet display preparatory activity in the absence of any eye movement. We recorded single neurons in FEFSEM while monkeys smoothly tracked moving targets during blocks of trials that presented target motion in a single direction. The example recording in Figure 1A–C shows the response of a neuron with a strong ramp increase in firing rate during fixation of a stationary spot, well in advance of either (1) target motion that starts 800–1600 ms after fixation onset or (2) the initiation of eye movement. The same neuron shows a second increase in firing rate that starts after the onset of target motion, around the time of the initiation of smooth pursuit (arrow in Figure 1C). We observed a wide range of preparatory- and pursuit-related firing rate modulation across our FEFSEM population, and there was a positive relationship between preparatory- and pursuit-related firing rate modulation (Figure 1D, Monkey Re: Spearman’s correlation coefficient = 0.17, p=0.02, n = 187 data points from 80 neurons; Monkey Xt: Spearman’s correlation coefficient = 0.55, p=4.5×10−10, n = 110 data points from 66 neurons). As explained in the Materials and methods, we ran multiple blocks of trials on most neurons using different directions of target motion, and each block provided a data point. Thus, more data points than neurons.

Preparatory- and pursuit-related responses in our FEFSEM population.
(A, B) Continuous and dashed traces plot trial-averaged position (A) and speed (B) of the eye and target for one example experiment. (C) Trial-averaged firing rate as a function of time for one example neuron. The arrow points out the pursuit-related component of firing. (D) Solid and open symbols plot pursuit-related firing rate modulation as a function of preparatory-related firing rate modulation for the population of neurons recorded in monkeys Xt (Spearman’s correlation coefficient = 0.55, p = 4.5 x 10-10 , n = 110 data points from 66 neurons) and Re (Spearman’s correlation coefficient = 0.17, p = .02, n = 187 data points from 80 neurons). The black arrow indicates the example neuron from panel C. Pursuit firing rate modulation was calculated as the average firing rate 51-150 ms after motion onset minus the average firing rate during the last 100 ms of fixation. Preparatory firing rate modulation was calculated as the average firing rate during the last 100 ms of fixation minus the average firing rate during 151-250 ms after fixation onset. Panel D is adapted from Darlington et al. (2018), except that here the analysis is performed during different behavioral conditions from the same data set and slightly different epochs are used to calculate pursuit firing rate modulation.
-
Figure 1—source data 1
Source data for Figure 1.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig1-data1-v2.mat
We hypothesized that preparatory activity in FEFSEM fails to cause movement because it is used downstream as a visual-motor gain signal. Gain can be dialed up by preparatory activity, but absent a movement-driving visual motion signal there will be no movement. This hypothesis is based on previous publications showing that FEFSEM output during pursuit initiation is involved in controlling the gain of visual-motor transmission (Tanaka and Lisberger, 2001).
To test whether FEFSEM preparatory activity could be acting as a gain signal, we conducted experiments that measured only pursuit behavior, but were carefully contrived based on knowledge of the properties of preparatory activity in FEFSEM. We probed the state of visual-motor gain in pursuit by delivering a brief (50 ms) pulse of target motion at 5 deg/s during fixations leading up to single-direction pursuit trials. We delivered the pulse at different times during the build-up of preparatory activity and in different states of preparation. Because the test pulses of visual motion were always exactly the same and eye speed was zero at the time of the pulse, any effect of fixation time or preparatory state on the eye movement responses to the probe must reflect a change in the setting of visual-motor gain in the pursuit system.
It is important to note that the visual motion pulse experiments measured eye movement behavior only and were a direct follow-up from the analyses we performed on our neurophysiological data in FEFSEM. We matched all experimental conditions, including the timing of fixation and visual motion onset, in order to maximize the validity of comparisons between the behavioral and neurophysiology data sets. Further, the neurophysiological and behavioral experiments were conducted on the same pair of monkeys.
We found a series of parallels between the amplitude of preparatory activity and the setting of visual-motor gain, as probed by the size of the eye movement response to the pulse. Parallels include: (1) time course during fixation before target motion, (2) effect of variations in the expectation of target speed, and (3) direction specificity.
The behavioral assessment of visual-motor gain increases as a function of fixation time, paralleling the progression of preparatory activity in FEFSEM. Figure 2A illustrates data from one example session showing larger eye speed responses at later fixation times in response to identical, but differently-timed, pulses of visual motion. The same result appeared consistently in both monkeys we tested across multiple behavioral sessions (Figure 2B). Modulation of FEFSEM preparatory activity showed a very similar time course across fixation for the overwhelming majority of neurons that had positive preparatory firing rate modulation (Figure 2C, Figure 2—figure supplement 1). We can see the tight link between visual-motor gain and preparatory firing if we plot the behavioral results from Figure 2B against the preparatory firing from Figure 2C for each fixation time and each monkey (Figure 2D). The relationship is fairly linear with a positive correlation between neural responses and behavior across our population of neurons (slopes were computed for each neuron using linear regression: monkey Re mean = 0.073 degrees/spike, p=2.34×10−11, n = 135 data points from 66 neurons monkey Xt mean = 0.074 degrees/spike, p=2.76×10−11, n = 67 data points from 45 neurons).

Comparison of time course of visual-motor gain and preparatory activity during fixation at various times after fixation onset.
We probed visual-motor gain by measuring eye speed responses to brief target motions delivered at different times. (A) Different line styles plot trial-averaged eye speed traces aligned to the onset of a pulse of visual motion pulse delivered at different fixation times for one example behavioral experiment. (B) Filled (monkey Xt) and open (monkey Re) symbols plot eye speed averaged across experiments in response to visual motion pulses as a function of the fixation time when the pulse occurred. Error bars represent S.E.M (n = 15 behavioral experiments in Monkey Re and 12 behavioral experiments in Monkey Xt). Eye speeds were measured as the peak response in the interval from motion pulse onset to 200 ms after pulse onset. Light gray curves plot the data from individual experiments. (C) Filled (monkey Xt) and open (monkey Re) symbols plot average preparatory firing rate as a function of fixation time. Data were averaged across all neurons that increased their firing rate across fixation (n = 135 data points in 66 neurons for monkey Re and n = 67 data points in 45 neurons for monkey Xt). Firing rates were calculated as the average firing rate during the last 100 ms of fixation. (D) Filled and open symbols replot the eye speed data from panel B as a function of the firing rates from panel C for each fixation time for the two monkeys.
-
Figure 2—source data 1
Source data for Figure 2.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig2-data1-v2.mat
The behavioral assessment of visual-motor gain varies in parallel with preparatory activity when we change the expected target speed by changing the blend of target speeds in a block of trials. We showed previously that the amplitude of FEFSEM preparatory activity encodes an expectation of target speed based on experience in blocks of 50 trials with different blends of target speed (Figure 3A; Darlington et al., 2018). Preparatory firing rate modulation was larger in magnitude (Figure 3B) during the ‘fast-context’ (green traces, 80% of trials at 20 deg/s and 20% at 10 deg/s) compared to during the ‘slow-context’ (blue traces, with 80% of trials at 2 deg/s and 20% at 10 deg/s). Based on behavioral assessment using pulses of visual motion during fixation, visual-motor gain during the preparatory period also is enhanced in the fast context compared to the slow context. Eye velocity responses were larger during the fast-context versus the slow-context when we presented the same visual motion pulses during fixation at different times (green versus blue in Figure 3C, scatter plot in Figure 3D). In the fast-context versus slow-context, the mean eye velocity responses to the pulse were 3.02 ± 0.71 deg/s (SD) versus 2.27 ± 0.73 deg/s (SD), and the difference was statistically significant (p=8.30×10−6, paired, two-sided Wilcoxon signed rank test, n = 26 behavioral experiments in two monkeys, z = 4.46, Cohen’s d = 1.06).

Parallel effects of expected target speed on visual-motor gain and preparatory neural activity.
(A) Top and bottom panels plot the blend of target speeds during the fast- and slow-contexts used to control the expectation of target speed. (B) Green and blue traces show results for the fast- versus slow-context and plot the preparatory firing rate as a function of time during fixation, averaged separately across neurons that exhibit firing rate increases and decreases across fixation. Error-bands represent S.E.M (increase cells: n = 191 samples from 111 cells, decrease cells: n = 106 samples from 63 cells). Preparatory modulation was calculated for each sample as the average firing rate during the last 100 ms of fixation minus the average firing rate during 151–250 ms after fixation onset. Samples with positive and negative modulation were classified as increase and decrease cells. According to this classification, firing rate increased during fixation for 82 cells, decreased during fixation for 34 cells, and increased during fixation for some directions and decreased for other directions in 29 cells. (C) Green and blue traces show data obtained during the fast and slow contexts and plot the experiment-averaged eye speed responses aligned to the onset of the visual motion pulse. Error-bands represent S.E.M. (D) Open (monkey Re) and solid (monkey Xt) data symbols plot the trial-averaged peak eye speed response to visual motion pulses during the slow-context as a function of that during the fast context. Each symbol shows data for a single experiment (n = 15 behavioral experiments in Monkey Re and n = 11 behavioral experiments in Monkey Xt). Dashed line indicates unity.
-
Figure 3—source data 1
Source data for Figure 3.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig3-data1-v2.mat
The directional specificities of preparatory modulation of visual-motor gain and FEFSEM preparatory activity vary in parallel. To assess the directional specificity of preparatory visual-motor gain modulation, we delivered visual motion pulses during fixation again, but now in four different directions relative to the consistent direction of the pursuit target motion in a given single-direction block: 0 deg, ‘same-direction’;±90 deg, ‘orthogonal-direction’; 180 deg, ‘opposite-direction’. Across the full duration of fixation, eye speed responses were largest for same-direction pulses, intermediate for orthogonal-direction pulses, and smallest for opposite-direction pulses (Figure 4A). For all directions, eye speed responses increased as a function of time during fixation for same-, orthogonal-, and opposite-direction pulses. We quantified the effect of fixation time by computing the slope of response amplitudes across pulse times. For the same direction, orthogonal direction, and opposite direction pulses, the mean (+/- S.D.) slopes across 30 experiments in two monkeys were 1.05 ± 0.59 deg/s per s, 0.73 ± 0.40 deg/s per s, and 0.72 ± 0.45 deg/s per s. The effect of fixation time on response amplitude was significant across all directions using 2-sided Wilcoxon signed rank tests: same-direction (p=2.60×106, z = 4.70); orthogonal-direction (p=1.73×10−6, z = 4.78); and opposite-direction (p=4.78×10−6, z = 4.78). The differences from same-direction were statistically significant using the paired sample, 2-tailed Wilcoxon signed rank test for n = 30 experiments on two monkeys: same versus orthogonal-pulses (p=0.0093, z = 2.60, Cohen’s d = 0.63); same- versus opposite-direction pulses (p=0.029, n = 30, z = 2.19, Cohen’s d = 0.62). Thus, there is a greater preparatory enhancement of visual-motor gain in the expected direction of the upcoming pursuit trial. Further, the increase in response amplitude over fixation time for all directions of pulses indicates a degree of directionally non-specific preparatory enhancement of visual motor gain.

Parallels in directional specificity of eye speed responses to visual motion pulses and FEFSEM preparatory activity.
(A) Filled circles, open circles, and open triangles plot eye speed in response to visual motion pulses delivered during fixation in the same, orthogonal, and opposite direction as the expected pursuit direction. Data are averaged across experiments for both monkeys and error-bars plot S.E.M (n = 30 behavioral experiments across two monkeys). Fixation times were binned across 200 ms and plotted on the x-axis at the value in the middle of the bin. (B) Symbols plot average preparatory modulation of firing rate versus the direction of the experiment relative to the preferred direction of the cell. Error-bars represent the S.E.M. (Same: n = 119 samples across 97 neurons, Orthogonal: n = 111 samples across 79 neurons, Opposite n = 67 samples across 62 neurons). (C) Bar graph plots the percentage of variance explained by each of the 10 components obtained by demixed principal component analaysis (dPCA). Filled and open bars designate direction-dependent versus direction-independent variance contributions to each component. (D), (E), (F) Black and red curves plot the projection of FEFSEM preparatory activity during single-direction blocks of trials that were toward or away from the preferred direction of each cell onto the first (D), second (E), and third (F) components obtained used dPCA.
-
Figure 4—source data 1
Source data for Figure 4.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig4-data1-v2.mat
FEFSEM preparatory activity also is related to the expectation of target direction created by adjusting the preponderance of target directions in a block of trials. We divided our FEFSEM population into three groups according to the relative difference between the preferred direction of each cell and the direction of the experiment: same direction, 0 ± 45 deg; orthogonal, +90 ± 45 deg and −90 ± 45 deg; and opposite, 180 ± 45 deg. Consistent with a larger behavioral preparatory enhancement of visual-motor gain in the expected direction, FEFSEM neurons display the largest modulation of firing rate during fixations leading to target motion towards their preferred direction (Figure 4B). Preparatory firing rate modulation was smallest for upcoming target motions that were opposite to the preferred direction and intermediate for upcoming target motions that were orthogonal to the preferred direction.
We find even more compelling neural correlates of the behavior shown in Figure 4A using a semi-supervised variant of principal component analysis: demixed principal component analysis (dPCA) (Kobak et al., 2016). The primary difference is that dPCA retains knowledge of experimental conditions when finding components, allowing for identification of different patterns of population activity that are independent of, or dependent on, experimental condition. We performed dPCA on the preparatory responses of a subset of our FEFSEM population (n = 63 neurons) from which we were able to collect data during experiments toward and away from the preferred directions of each neuron. Thus, the sole condition in our dPCA is the direction of the ensuing target motion and eye movement. Our aim was to identify ‘direction-dependent’ and ‘direction-independent’ components to test the idea that FEFSEM contributes to the directionally specific and non-specific components of preparatory visual-motor gain enhancement shown in Figure 4A.
FEFSEM population activity can fully account for the directional features of preparatory visual-motor gain enhancement. The first three components obtained via dPCA account for ~90% of the variance of our FEFSEM population preparatory response (Figure 4C). Each of the three primary components predict features of the behavioral data shown in Figure 4A. Component one is direction-independent. The projections of FEFSEM preparatory population activity onto component one both increase across fixation for impending target motion toward and away from the preferred direction (Figure 4D). The projections onto component one are consistent with the directionally nonspecific enhancement of visual-motor gain observed for the orthogonal and opposite-direction visual motion pulses. Component two is direction-dependent. There are two primary differences between the projections of FEFSEM population activity onto component two during preparation for target motion toward and away from the preferred direction (Figure 4E). (i) The projections are offset from each other with the projections for toward and away motion sitting above and below each other, respectively. The offset between the projections is consistent with the behavioral finding of an offset between the eye speed responses to brief target motions in the same versus opposite direction from expected target motion: there is a substantial difference in eye speed responses to the same and opposite visual motion pulses even at the earliest fixation times we tested. (ii) The projection for motion toward the preferred direction increases and that for motion away from preferred projection decreases during the latter half of the fixation period. Component three also is direction dependent. The projection of FEFSEM population activity onto component three also shows a ramp increase for impending target motion toward the preferred direction and a ramp decrease for impending target motion away from the preferred direction. The increase and decrease of the projections onto components 2 and 3 are consistent with the larger enhancement of visual-motor gain across fixation time for the same versus opposite direction visual motion pulses. In conclusion, the neural basis for the behavioral preparatory enhancement of visual-motor gain can be fully reconstructed from the first 3 dPCA components of the FEFSEM preparatory population response.
Modulation of FEFSEM preparatory activity occurs along movement-potent dimensions
Studies of arm movement have shown that population preparatory activity in M1 and PMd evolves in a manner that does not predict movement (Kaufman et al., 2014). Movement is prevented during preparation because the population activity resides in ‘movement-null’ neural dimensions. We now test this idea on our population of FEFSEM neurons. A priori, such a mechanism could generalize to the smooth pursuit eye movement system, especially since humans and monkeys can initiate smooth pursuit in the absence of visual motion under certain conditions (Freyberg and Ilg, 2008; de Hemptinne et al., 2006; Kowler et al., 2019). Even if the output of FEFSEM truly is used as a gain signal, noise immunity might be enhanced if population activity resided in an output null state until there is a believable visual motion signal to drive pursuit initiation. Two mechanisms for preventing unwanted movement might be better than one.
We established the movement-potent dimensions for our sample of FEFSEM neurons from blocks of trials where the monkey pursued a patch of dots that moved in each of 8 randomly chosen directions (Figure 5A). The population average of FEFSEM firing across our full sample of neurons was strongly tuned to the direction of target motion and pursuit (Figure 5B), with a large increase in firing rate in the ‘preferred direction’ of the cell, a smaller increase when motion was at +/- 45 degrees from the preferred direction, no modulation for visual motion orthogonal to the preferred direction, and decreases in firing rate for +/- 135 degrees and 180 degrees from the preferred direction. We represented the movement-potent dimension for our population by computing the optimal linear model that related the pursuit-related firing of our sample of FEFSEM neurons to the eye movements evoked during the initiation of pursuit in eight directions. The linear model optimized two weights for each neuron: one related the neuron’s firing rate to horizontal eye velocity and the second related the neuron’s firing rate to vertical eye velocity. Our fitting procedure assigned a continuous distribution of weight magnitudes to the members of our population (Figure 5C), showing that the model used the entire FEFSEM population and did not simply pick out a few particularly informative cells. The model worked well on data from pursuit trials that were not used to compute the weights: target motion at three different speeds (2, 10, and 20 deg/s) and two different contrasts (12% and 100%) from a separate block of trials that presented visual motion in a single, repeated direction. It produced fairly accurate predictions for horizontal eye velocity (Figure 5D, slope = 1.09, r2 = 0.85) and accurately predicted zero vertical eye velocities (data not shown). Because a model based on the responses to 8 directions of motion was able to predict well the responses in a different block of trials with a single direction of motion, we conclude that it is valid to use a single model across different blocks of behavior.

The optimal linear model for converting the population activity in FEFSEM into eye velocity.
(A) Different line styles plot trial-averaged horizontal versus vertical eye velocity for smooth pursuit eye movement to 15 deg/s target motion in eight different directions (4 cardinal and four oblique directions). (B) Traces with the same line styles as in A plot the population trial-averaged firing rate after rotating directions to align the preferred direction of each cell at 0 deg (n = 146 FEFSEM neurons collected in two monkeys). (C) Histogram plots the distribution of calculated linear model weight magnitudes across our population of FEFSEM units. (D) Cross validation of the optimal linear model. The curves plot the horizontal eye velocity predicted during the single-direction block of trials by the model versus actual trial-averaged horizontal eye velocity. Different colored traces differentiate among 6 combinations of target contrast and speed.
-
Figure 5—source data 1
Source data for Figure 5.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig5-data1-v2.mat
FEFSEM preparatory activity does not avoid movement-potent neural dimensions. The optimal linear model predicts movement when there is none, during fixation and preparatory activity. When we passed the trial-averaged population preparatory firing rate modulation from a single-direction block of pursuit trials through the model, we obtained a non-zero prediction for change in eye velocity across fixation (Figure 6A and B). Importantly, the output of the linear model predicts eye movement in a direction that is appropriate for the upcoming target motion according to how neurons across experimental sessions were combined into a pseudo-population (see below): a large positive horizontal component and relatively smaller vertical component.

Result of using optimal linear model to transform preparatory activity in FEFSEM into a prediction of eye velocity during preparation for movement.
(A) Solid and dashed traces plot the linear model’s predictions for horizontal and vertical eye velocity during fixation. (B) Solid and dotted traces plot the linear model’s prediction for eye speed during fixation and the actual eye speed during fixation. (C, D) Histograms plot the distributions of predicted eye movement direction and speed during fixation from 1000 bootstrapped iterations of preparatory modulation of activity for single trials. The dashed lines in c demarcate the middle 95% of the distribution.
-
Figure 6—source data 1
Source data for Figure 6.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig6-data1-v2.mat
We obtained similar results when we asked whether we could verify the failings of the movement-null hypothesis for FEFSEM in neural responses from single trials. We generated 1000 single-trial pseudo-population responses by randomly sampling preparatory firing rate modulations from each cell for fixation-duration matched trials across our population. We passed each pseudo-population response into the optimal linear model to predict the change in horizontal and vertical eye speed across fixation, and computed eye direction and speed during fixation on each ‘trial’. Consistent with the findings of Figure 6A and B, the single trial analysis predicts non-zero eye velocity with a significant projection in the direction of the subsequent pursuit trial (Figure 6C and D). The mean predicted direction was −1.3 deg with a 95% bootstrap interval of −65.8 to +71.8 deg; the mean predicted eye speed was 2.9 deg/s. Thus, for the motor system we study, the data do not fulfill one important prediction of the null-space hypothesis: the optimal linear model for pursuit initiation predicts significant non-zero eye velocities driven by preparatory activity.
We made a number of modifications in adapting the analyses performed in Kaufman et al. (2014) to our data. These modifications were made due to a key difference in our behavioral paradigm: the upcoming direction of arm movement was explicitly cued in Kaufman et al. (2014); the direction of the upcoming visual motion was not explicitly cued in our task. Therefore, only the single-direction block allows for accurate preparation, as the monkey is able to anticipate the upcoming visual motion. However, the eight-direction block provides a more rigorous mapping of FEFSEM pursuit-related firing rate to eye velocity. Thus, we chose to find the optimal mapping of FEFSEM firing rate to eye movement in the 8-direction block and test preparatory activity in the single-direction block.
Our strategy was then to create as large of a population response as we could, without excluding data points or neurons. We also did not wish to bias our data collection for the single-direction experiment towards any part of the direction tuning curve of our recorded neurons, for example by only running the single-direction experiment in the preferred direction of our neurons. To this end, we ran multiple single-direction blocks of trials for each neuron that we recorded using target directions that were different from each other and at various points on each neuron’s tuning curve. We then rotated each neuron’s direction tuning curves while fitting the linear model to the 8-direction block in a manner that made it seem like all of the single-direction experiments were run in the same direction (0 degrees, rightward). We included multiple single-direction blocks from the same neurons as if they were independent under the relatively safe assumption that there is a different neuron with a tuning curve that is naturally aligned in the manner that we rotated our data.
We performed several control analyses to confirm that none of our analytical choices produced our results. First, the findings of Figure 6 are not a product of oversampling the preferred directions of our FEFSEM cells during the single-direction experiments (Figure 6—figure supplement 1). Second, we obtained the same results when we used only a single block of trials from each neuron so that our conclusions are strengthened statistically but do not depend on the use of multiple data points from each neuron as independent units (Figure 6—figure supplement 2). Third, a supplementary analysis that is more congruent with the analysis performed in Kaufman et al. (2014), and that uses a model based on the single-direction block, arrives at the same conclusions (Figure 6—figure supplement 3).
Partial reorganization of population activity from preparatory- to pursuit-related dimensions
If preparatory and pursuit-related activity resided in orthogonal dimensions, then we would say that the population activity in FEFSEM reorganized completely in the transition from preparation to action. If they resided in parallel dimensions, then we would say that they did not reorganize at all. We now show that the truth lies between these two extremes by using principal component analysis to compare the neural dimensions related to preparation and movement. The existence of a partial reorganization explains why we find that preparatory activity predicts movement and still allows the operation of our system to align to some degree with the operation of the arm movement system, where there is a full reorganization.
After reducing the dimensionality of our preparatory- and pursuit-related population responses during the single-direction trial blocks, we analyze the first preparatory and pursuit PCs (PCPrep1 and PCPurs1), each of which captures more than 70% of the variance (Figure 7A), the same amount captured by the dimensionality reduction in Elsayed et al. (2016). We validated PCPurs1 by showing that the projection of pursuit-related activity onto the PCPurs1 captures differences in both the speed of target motion and the contrast of the target: in parallel with the neural responses, the projections scaled with target speed and are larger in magnitude and shorter in latency for high- compared to low-contrast targets (Figure 7B). As expected, given the results in the previous section using the optimal linear model, the projection of preparatory activity onto PCPurs1 shows a ramp increase across fixation (Figure 7D). The main difference between the preparatory and pursuit projections is that the preparatory projection ramps up more slowly to a smaller magnitude compared to the pursuit projections.

Direct assessment of preparatory- versus pursuit-related neural dimensions through comparison of principal components for preparatory- and pursuit-related population activity in FEFSEM.
(A) Solid and open symbols plot the percentage of the total pursuit-related and preparatory response variances explained by each principal component. Beyond principal component 3, the open symbols obscure the filled symbols. (B) Different colored traces plot projection of pursuit-related population firing rates in response to low-contrast and high-contrast target motion of 20, 10, and 2 deg/s onto the first pursuit principal component. (C) Histogram plots the distribution of the angle between the first pursuit-related and preparatory principal components across 1000 bootstrapped iterations. (D) Projection of population preparatory firing rates during fixation onto the first principal component of pursuit-related responses.
-
Figure 7—source data 1
Source data for Figure 7.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig7-data1-v2.mat
We demonstrate a partial reorganization of population activity between preparation and pursuit-related activity by computing the angle between PCPrep1 and PCPurs1. We used a bootstrap approach that sampled trial-averaged neurons from our population, independently found PCPrep1 and PCPurs1 for the sampled population, and calculated the angle between them. We used a sampling procedure that created 1000 simulated population responses, each with 160 units having a uniform representation of preferred directions (see Materials and methods and Supplementary Figure 1 for more details). We find that the mean angle between PCPrep1 and PCPurs1 is 65.2 degrees and is significantly different from both 0 and 90 (Figure 7C, p<0.001, two-sided bootstrap statistics, 95% bootstrap interval = 61.4–69.2 deg, n = 1000 iterations). Therefore, preparatory- and pursuit-related neural dimensions are neither aligned nor completely orthogonal in our population of FEFSEM neurons. As with the linear model, our findings were not influenced by our choice to treat multiple data points from each neuron as independent units in our pseudo-population (Figure 7—figure supplement 1).
To understand what features of the neural responses caused the reorganization of the population response, we examined how the PCA component loadings, defined as the weights relating each neuron’s response to the principal component, changed between PCPrep1 and PCPurs1. The distribution of the ratios between the PCA component loadings of PCPrep1 and PCPurs1, generated from the bootstrap in Figure 3B, is significantly bimodal (Figure 8A, Hartigan’s Dip Test, Dip statistic = 0.0794, p=0.001). One peak is at a positive ratio and a smaller peak is at a negative ratio. A positive ratio indicates that a given unit behaves in a similar manner during preparation and movement, whereas a negative ratio indicates a change in behavior between preparation and pursuit. We conclude that there are two subpopulations in FEFSEM, and that the one with negative PCPrep1/PCPurs1 ratios may be responsible for the partial reorganization of population activity between preparation and movement.

Two subpopulations of FEFSEM neurons with different relationships between preparatory and pursuit-related activity.
(A) The distribution of PCPrep1/PCPurs1 ratios averaged across 1000 bootstrapped iterations. The dashed line indicates a ratio of 0, the point where we split our FEFSEM population into two subpopulations. (B) Black and red symbols summarize the distributions of preferred directions relative to the direction of the single-direction experiment for units in Subpopulations 1 and 2 in the bootstrap analysis. Error bars represent the middle 95% distribution obtained from our bootstrap analysis (n = 1000 iterations). (C) Black and red symbols plot preparatory- versus pursuit-related firing rate modulations for Subpopulations 1 and 2 in our full FEFSEM data set (n = 207 data points from 130 neurons for Subpopulation 1 and n = 90 data points from 65 neurons for Subpopulation 2). Panel C plots the same data from Figure 1D, except here it has been separated into Subpopulations 1 and 2 (D) Black and red symbols plot data for subpopulations 1 and 2 and show the normalized preparatory modulation of firing rate versus the direction of the experiment relative to the preferred direction of the cell. Error-bars represent the middle 95% of the bootstrapped distribution (n = 1000 iterations). (E), (F) Black, magenta, and blue traces plot normalized modulation of preparatory firing rate as a function of time from fixation onset when experiments were run in the same, orthogonal, and opposite direction as the preferred direction of the neuron. Data were averaged separately across neurons in Subpopulations 1 (E) and 2 (F). For each direction, the middle trace is the average and the flanking traces border the middle 95% of the bootstrapped distribution, n = 1000 iterations). (G) Black and red histograms plot the distribution of the angle between the first pursuit-related and preparatory principal components for Subpopulations 1 and 2 across 1000 bootstrapped iterations.
-
Figure 8—source data 1
Source data for Figure 8.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig8-data1-v2.mat
To test our hypothesis about the role of neurons with negative PCPrep1/PCPurs1 ratios, we separated our population into units with positive (Subpopulation 1) and negative (Subpopulation 2) ratios and compared a number of properties of the two subpopulations. (1) Preferred directions (Figure 8B): Subpopulation 1 consistently made up a larger proportion of units in our bootstrap analysis and contains a higher proportion of units with a preferred direction towards the direction of the single-direction experiment. Conversely, Subpopulation 2 contains a higher proportion of units with preferred directions away from the direction of the experiment. (2) Preparatory versus pursuit modulation: When we redid principal component analysis on the full (non-bootstrapped) data, neurons in Subpopulation 1 had statistically larger amplitudes of both preparatory- and pursuit-related modulation (compare red and black data points in Figure 8C; preparatory activity: p=0.019, Cohen’s d = 0.34, pursuit activity: p=2.7×10−12, Cohen’s d = 0.95, 2-sided Wilcoxon rank sum tests). There is a significant positive correlation between preparatory and pursuit modulation in Subpopulation 1 (Figure 8C, Spearman’s correlation coefficient = 0.59, p=7.8×10−21, n = 207 samples from 130 neurons) and a significant negative correlation in Subpopulation 2 (Figure 8C, Spearman’s correlation coefficient = −0.63, p=3.8×10−11, n = 90 samples from 65 neurons). (3) Principal component alignment: For Subpopulation 1 alone, the first principal components of pursuit and preparatory activity are separated by an angle of only 26.2 degrees. For Subpopulation 2 alone, the angle between PCPrep1 and PCPurs1 is 151.2 degrees (Figure 8G). These facts suggest that Subpopulation 2 is responsible for the partial reorganization of population activity between preparation and movement, and that the large difference in response amplitudes between the two populations is at least partly responsible for a lack of full reorganization between preparatory- and movement-related dimensions.
The existence of two subpopulations of FEFSEM neurons allows for a directionally-nonspecific component of preparatory visual-motor gain enhancement. In Subpopulation 1, preparatory modulation of firing rate has conventional direction tuning. It is large and positive when the upcoming target motion will be in the preferred direction of the cell, smaller when it will be orthogonal to the preferred direction, and negative when it will be opposite to the preferred direction of the cell (Figure 8D,E). In Subpopulation 2, preparatory modulation of firing rate has weaker and non-conventional direction tuning. Modulation is positive when the upcoming target motion is orthogonal or opposite to the preferred direction and absent when target motion will be toward the preferred direction (Figure 8D,F). Together, the two subpopulations can explain two features of Figure 4A. The preparatory activity in Subpopulation 1 explains why preparatory enhancement of visual-motor gain is largest in the direction of the upcoming target motion. The smaller preparatory activity in Subpopulation 2 might explain the directionally-nonspecific, and smaller, component of preparatory visual-motor gain enhancement in orthogonal and opposite directions relative to the upcoming target motion.
To further examine differences between the two subpopulations, we repeated the optimal linear model analysis from Figures 5 and 6 separately on each subpopulation. Linear models generated from the two subpopulations perform roughly the same in predicting eye velocity during the single direction block (Figure 9A,D). Subpopulation 1 predicts eye movement during preparation in the same direction as the upcoming visual motion and eye movement (Figure 9B,C). Subpopulation 2 predicts no significant eye movement during preparation (Figure 9E,F). However, it is worth pointing out that the spread around zero for horizontal and vertical eye velocities is quite large. These features are consistent with Subpopulation 2 dialing up visual-motor gain in a directionally-nonspecific manner and they suggest that the nonspecific component of visual-motor gain is fairly uniform across directions.

Result of using optimal linear model to transform preparatory activity in the two subpopulations into a prediction of eye velocity during preparation for movement.
(A, D) The curves plot the horizontal eye velocity predicted during the single-direction block of trials by the model for Subpopulation 1 (A) and Subpopulation 2 (D) versus actual trial-averaged horizontal eye velocity. (B, C, E, F) Solid traces plot the mean of the bootstrapped linear model’s predictions for horizontal (B, E) and vertical (C, F) eye velocity during fixation for Subpopulation 1 (B, C) and Subpopulation 2 (E, F).: Different colored traces in A and D differentiate among 6 combinations of target contrast and speed. Dotted lines in B, C, E, and F plot the middle 95% of the 1000 bootstrapped iterations.
-
Figure 9—source data 1
Source data for Figure 9.
- https://cdn.elifesciences.org/articles/50962/elife-50962-fig9-data1-v2.mat
In our system, we not only characterize the population activity during preparation and movement, but also understand why it reorganizes in the way that it does and how that reorganization improves the performance of pursuit eye movements. A full analysis of FEFSEM neural responses during pursuit eye movements shows that (1) there is a partial reorganization of the population between preparation and movement, (2) the reorganization is not complete enough to place the population activity in a movement-null dimension during preparation, (3) output control of the gain of visual-motor transmission rather than of movement kinematics allows the reorganization to be incomplete without causing movement, and (4) the existence of two subpopulations of neurons explains the partial reorganization of population activity and allows the behavior to be preferentially prepared for target motion in an expected direction with a lower level of readiness for all directions of motion.
Discussion
Preparatory activity without movement
Preparatory activity is ubiquitous in motor systems. In advance of all but the most short-latency and reflexive movements, preparatory activity appears at least in the primary motor cortex (Tanji and Evarts, 1976), the premotor cortex (Weinrich and Wise, 1982), the frontal eye fields for both saccades and pursuit (Bruce and Goldberg, 1985; Mahaffy and Krauzlis, 2011; Tanaka and Fukushima, 1998), the parietal cortex (Mazzoni et al., 1996; Shadlen and Newsome, 2001), the cerebellum (Gao et al., 2018), the superior colliculus (Dorris et al., 1997; Glimcher and Sparks, 1992; Munoz and Wurtz, 1995; Wurtz and Goldberg, 1972), and even in last-order interneurons in the spinal cord (Prut and Fetz, 1999). It seems clear that preparatory activity plays a crucial role in setting the state of the nervous system leading up to movements. Many of the neurons that show preparatory changes in firing rate seem to play key roles in selecting, initiating, and/or guiding movement. Yet, preparatory activity evolves without actually causing movement. Why?
Different mechanistic explanations, all supported by data, have been proposed for different motor systems. The earliest solution, proposed for saccadic eye movements, is a ‘gate’ or ‘switch’ (Keller, 1974). The neural circuit that implements the switch is in the brainstem (Cohen and Henn, 1972; Evinger et al., 1982; Luschei and Fuchs, 1972). It has known internal connectivity, documented by electrophysiology and anatomical tracing with horseradish peroxidase (Hikosaka et al., 1978; Langer and Kaneko, 1990). The connectivity leads to switching behavior in computational models and the output pathways from the brain’s switching circuit are appropriate to prevent saccades during preparation until it is time for the movement (Fuchs et al., 1985; Robinson, 1973).
A more recent solution, proposed for arm movements, suggests that the population of neurons in the motor cortex operates as a dynamical system (Churchland et al., 2010; Churchland et al., 2012). During the preparation of a movement, the population activity evolves within a set of dimensions that are ‘movement-null’ in the sense that population output is orthogonal to a later set of states that exists in ‘movement-potent’ dimensions (Elsayed et al., 2016; Kaufman et al., 2014). Analysis of population activity in the motor and pre-motor cortex supports the dynamical system explanation.
A third mechanism, based on our and others’ research in smooth pursuit eye movements, involves the use of motor cortical output signals not to drive movement, but instead to modulate the strength of sensory-motor transmission. In the pursuit system, several lines of evidence, most notably the effects of microstimulation, imply that the output from the FEFSEM modulates the gain of visual-motor transmission (Nuding et al., 2009; Tanaka and Lisberger, 2001).
We imagine that all these mechanisms could be used in different blends by different motor systems. So, the challenge is to identify the mechanisms that prevent preparatory activity from causing movement in as many different movements as possible, explore the blend of mechanisms deployed by each motor system, and find the neural substrates of the different mechanisms.
The use of FEFSEM output as a gain signal allows preparation to progress without causing movement
In the present paper, we present evidence that the smooth pursuit eye movement system emphasizes gain-modulation as a mechanism to allow preparation to progress without causing movement. Even though preparatory activity in FEFSEM is movement-potent in the sense that it shares dimensions with pursuit-related activity of the same population, preparatory activity fails to cause smooth eye movement because its role is to modulate the strength of movement-potent visual motion signals that are not present during preparation. Without the visual motion signal that it acts upon, gain can be dialed up without causing movement. The smooth eye movement output of the system will remain zero.
In contrast, our population analysis fails to support the dynamical systems explanation of orthogonal preparatory- and movement-related neural dimensions. The preparatory- and pursuit-related neural dimensions are neither completely orthogonal nor completely overlapping. Thus, there is a reorganization of the population activity in FEFSEM between preparation and pursuit, but the reorganization is not complete enough to push preparatory activity into a movement-null dimension. In our system, we are able to understand in terms of the responses of its constituent neurons why the population reorganizes partially rather than fully, and we have a functional explanation for why the system might operate in this regime. We identified two subpopulations of cells in our data and one of them (‘Subpopulation 2’) seems to be responsible for the partial reorganization of neural dimensions between preparation and pursuit (Figure 4D). Because the reorganization is not sufficient to prevent movement during preparation, we propose that Subpopulation 1 creates a highly-directional enhancement of visual-motor gain while Subpopulation 2 is responsible for a directionally non-specific component of preparatory visual-motor gain enhancement, in effect providing a rigid and fairly uniform prior for the direction of target motion. A potential benefit of the regime created by the two Subpopulations is that the system will be fully ready for an expected direction of target motion and never be caught entirely flat-footed if target motion occurs in a completely unexpected direction.
Previous work suggests that gating mechanisms play minor roles for pursuit. The discharge of the neurons involved in the switch for saccades is incompatible with the idea that pursuit might use the same switch circuit (Missal and Keller, 2002). The firing of omnipause neurons pauses completely during the execution of saccades of any direction and amplitude but exhibits directionally-tuned decrements of firing rate that are graded according to eye speed during smooth pursuit eye movement. While one could argue that the use of an absolute versus a dynamic gate to prevent activity from causing movement is a matter of semantics, we are suggesting something fundamentally different in this paper: movement is not prevented during modulation of FEFSEM activity by the action of an inhibitory gate, rather FEFSEM output is controlling the gate. Indeed, it is possible that FEFSEM output interacts with omnipause neurons. Omnipause neurons are anatomically connected to at least the saccadic frontal eye fields and their responses during pursuit align closely with properties of visual-motor gain (Langer and Kaneko, 1990; Missal and Keller, 2002; Schwartz and Lisberger, 1994).
Our findings are not due to the trivial conclusion of a lack of importance of FEFSEM in the generation of pursuit eye movement. Lesioning and inactivating FEFSEM results in large decrements of pursuit speed and an increase in the number of catch-up saccades (Keating, 1991; Shi et al., 1998). The output of FEFSEM (and possibly partner areas such as the Supplementary Eye Fields Missal and Heinen, 2001) is necessary to allow visual motion signals to drive the oculomotor machinery (Tanaka and Lisberger, 2001). Furthermore, there are trial-by-trial correlations between FEFSEM activity during pursuit and eye velocity (Schoppik et al., 2008). The fact that microstimulation of FEFSEM causes smooth eye movement seems to contradict our conclusion that the output from FEFSEM is modulatory. We suspect that the artificial situation created by micro-stimulation will drive activity in brainstem oculomotor neurons simply because FEFSEM is anatomically connected to the motor system. Beyond general anatomical connectivity, micro-stimulation-generated smooth eye movements may say little about how FEFSEM output is actually used downstream.
Comparative advantages of different mechanisms for preventing movement during preparation
We suggest that the brain uses multiple mechanisms to prevent preparatory activity from causing unwanted and premature movement, and that the primary mechanism used by any particular movement system will depend on the organization of that particular system. Further, a system could use multiple mechanisms at the same time, perhaps emphasizing one or another.
The short latency and sensory-driven features of pursuit may mitigate in favor of a system where preparatory activity is used to modulate sensory-motor transmission. In pursuit, movement initiation is driven directly, with relatively short latencies, by sensory inputs from extrastriate visual area MT (Komatsu and Wurtz, 1989; Newsome et al., 1988). Outputs from MT and FEFSEM converge downstream in the pursuit circuit to control the activity of motoneurons (Lisberger, 2010; Mustari et al., 2009). Importantly, preparatory modulation of visual-motor gain is a genuine preparatory signal. FEFSEM preparatory responses encode the expected speed and direction of the upcoming target motion and FEFSEM seems to set the state of the pursuit system during preparation in a way that sculpts the subsequent visual motion signals (Darlington et al., 2018).
In the arm movement system and the motor cortex, it may be difficult to prevent activity in the motor cortex from affecting the firing of motoneurons, and so it is ideal to nullify the preparatory activity by contriving for it to reside in a movement-null dimension. Here, the link from sensory input to motor output is less direct than for pursuit and the output from the primary motor cortex and the premotor cortex affect the firing of motoneurons directly, over monosynaptic and disynaptic pathways (Dum and Strick, 1991; Griffin et al., 2015; Kuypers and Brinkman, 1970). That said, it is possible that gain control mechanisms also operate in arm movements, both to implement the essential function of adjusting to different contexts, and to allow preparatory activity without movement. Just as we think that FEFSEM is responsible for the preparatory aspects of pursuit and area MT is responsible for the movement drive, recent work in the mouse motor system revealed subpopulations of motor cortex neurons with distinct roles in preparation and movement (Economo et al., 2018). Furthermore, last-order interneurons in the spinal cord show arm-movement-related preparatory activity that could reflect motor cortical modulation of the gain of spinal reflex circuits (Prut and Fetz, 1999).
In saccadic eye movements, the need for high degrees of accuracy and precision in a totally open-loop movement probably requires the preparatory activity that exists at least in the frontal eye fields, the superior colliculus, and the parietal cortex, but also requires an absolute brake on movement until all the brain’s ducks are in a row (Glimcher and Sparks, 1992; Hanes and Schall, 1996; Mazzoni et al., 1996). Here, the switching circuit in the brainstem prevents any movement until the activity that guides the direction and amplitude of the impending saccade is fully prepared to make a movement that is at the same time really quick and accurate (Robinson, 1973). For example, a monkey executes a 20 deg saccade in 40 ms with accuracy of better than 5% (Fuchs, 1967). By contrast, pursuit eye movements are much slower and less accurate, and arm movements rely partly on feedback to achieve maximum accuracy.
Preparatory activity is ubiquitous, but the different features of different motor systems may require different mechanisms to prevent movement during preparation. A switching circuit could exist for movements other than saccades, perhaps in a softer, more compliant form. Gain control, may be an ideal way to establish context sensitivity and adjust the responsiveness to descending signals in systems with short latencies and graded responses. The dynamical system regime may be specialized for neural systems where the neurons involved in preparation make synaptic connections directly onto final motor pathways.
Materials and methods
Experimental model and subject details
Request a detailed protocolAs described in Darlington et al. (2018), two male rhesus monkeys aged 8–10 years and weighing between 12 and 14 kg were used in the neurophysiology experiments (Darlington et al., 2018). The same two monkeys were used for the new behavioral experiments presented here. The monkeys underwent surgeries to implant head-restraining hardware onto the skull and a scleral search coil to track eye movements. Following recovery, monkeys were trained to fixate and smoothly track moving visual targets. During experiments, analog signals produced by the scleral search system recorded vertical and horizontal eye position. Eye velocity-related signals were obtained by passing the position-related signals through an analog circuit that differentiated signals from DC to 25 Hz and rejected signals at higher frequencies (−20 dB/decade). Eye position and velocity signals were sampled at 1 kHz and stored for offline data analysis. After training, monkeys underwent another surgery in which a craniotomy was performed in an area centered over the smooth eye movement region of the frontal eye fields (FEFSEM). A sealable, titanium chamber was fixed to the skull over the craniotomy. All procedures received prior approval by Duke’s Institutional Animal Care and Use Committee and complied with the National Institutes of Health’s Guide for the Care and Use of Laboratory Animals.
Method details
Neurophysiological experiments
Request a detailed protocolWe present new analyses of neural data that were collected using methods detailed in Darlington et al. (2018). Briefly, we made extracellular single unit recordings in awake, behaving monkeys. Three Thomas Recording tetrodes were introduced into FEFSEM for isolation of single units. Visual stimuli were displayed on a 24-inch gamma-corrected CRT monitor with a refresh rate of 80 Hz placed 40 centimeters from the monkeys’ eyes, creating a field of view that spanned 62 (horizontal) by 42 (vertical) degrees.
Each experiment was divided into discrete trials. All trials began with the monkey fixating a central black spot for 800–1600 ms, after which the fixation target was replaced with a pursuit target. The pursuit target was either a patch of 72 dots within a 4-degree aperture or a Gabor function see Darlington et al. (2018). The pursuit target initially underwent 100 ms of coherent local pattern motion at a defined speed and direction within a stationary, invisible aperture. The target and aperture subsequently moved en bloc with the same parameters as the previous local motion. The initial use of local motion followed by global motion helps avoid early catch-up saccades and has similar advantages as the Rashbass ‘step-ramp’ used in pursuit paradigms for spot-targets (Rashbass, 1961). Monkeys were rewarded with juice for successfully tracking the center of the target within a 4 × 4 degree window.
During neurophysiological recording, we ran two different behavioral experiments. In the ‘8-direction’ experiment, targets moved at 15 deg/s in a direction randomly chosen from the four cardinal and four oblique directions. In the ‘single direction’ experiment, targets moved in only one direction (chosen from the four cardinal and oblique directions). Thus, target direction was perfectly predictable. The ‘single-direction’ task was split up into blocks of trials that provided visual motion of different blends of speed. In the fast-context, 80% of the trials moved at 20 deg/s and 20% of the trials moved at 10 deg/s. In the slow-context, 80% of the trials moved at 2 deg/s and 20% of the trials moved at 10 deg/s. In a control-context, 100% of the trials moved at 10 deg/s. In both of the experiments, pursuit targets of high- (100%) and low-contrast (6 or 12%) were interleaved randomly.
Behavioral assessment of gain of visual-motor transmission
Request a detailed protocolWe performed two separate sets of behavioral experiments, without neurophysiological recordings, as a modified version of the single-direction experiment described above. We presented the same blends of targets, directions, and speeds but the pursuit target was present through the entire trial, including during fixation before the onset of target motion. On approximately half of the trials, the pursuit target delivered a brief pulse that comprised a 5 deg/s step of target speed for 50 ms. Pulses occurred at a random time during fixation, 550–1350 ms after fixation onset. In the speed context experiment, pulses provided motion in the same direction as the impending target motion. In an experiment that tested direction selectivity, pulses provided motion in one of four directions, the same direction, opposite direction, or one of the two directions orthogonal to the direction of target motion in the single-direction experiment. The purpose of the pulse in target velocity was to probe the state of visual-motor gain in the pursuit system. We confirmed that the brief pulse of target velocity evokes responses with all the same features discovered before with sinusoidal perturbations (data not shown), and we chose to use the pulse to better assess directional specificity of gain modulation during fixation (Schwartz and Lisberger, 1994).
Comparison with arm movement paradigm
Request a detailed protocolOur behavioral paradigm for defining movement potent dimensions was very similar to the behavioral paradigm used in Kaufman et al. (2014). The random 8-direction pursuit task is the eye movement analogue to the center out reaching task. One notable difference is that we used a single-direction task to probe the preparatory activity whereas Kaufman et al. used the preparatory epoch during the center out task. We did not use explicit cues during the 8-direction block to allow for preparation to occur. Instead we used the single-direction block to allow for expectation-driven preparation. Several benefits to our approach include the use of single-direction eye movement epoch data for cross validation (Figure 5D) and prevention of confounding variables like visual cues. There were no differences in the methods by which we collected neurophysiological data. Most neurons were recorded during different experimental sessions. This is consistent with half of the data presented in Kaufman et al. (2014) and all of the data presented in Elsayed et al. (2016).
Quantification
Demixed principal component analysis
Request a detailed protocolThe method of demixed principal component analysis (dPCA) is described in detail by Koback et al. (2016). Briefly, dPCA is a semi-supervised dimensionality reduction technique that in addition to capturing the majority of the variance present in the data (e.g. PCA) pulls out, or 'demixes', features of the data that are task-dependent (i.e. stimulus, decision, etc.). It does so by first decomposing a neural matrix, , with n rows that is mean-centered on zero into a sum of averages taken over various task parameters, ϕ.
The core of dPCA is to then find a low dimensional encoding/decoding model (FD) for each that minimizes the loss function:
FD produces an n x n matrix A, which could normally be solved via classical regression, yielding the ordinary least squares solution. However, A is not full rank and is instead solved as a reduced-rank regression problem via singular value decomposition.
We used the MatLab code publicly provided from the Machen’s lab to perform the dPCA presented in Figure 4 (https://github.com/machenslab/dPCA). Our goal in using dPCA was to discover features of the FEFSEM population response during preparation that are related to the expectation of upcoming direction of visual motion and eye movement. As direction is not predictable during the eight-direction block, we relied on data from the single-direction task to probe reliable preparatory responses. In this way, expectation of direction is implicit and built from experience as monkeys tracked targets in the same direction typically for about 700–800 consecutive trials. The direction of the single-direction task varied across experiments and was chosen at various points relative to the preferred direction of the neurons under study. In order to get a sense for the neural representation of expected upcoming target direction and to pool as much of our data together, we subsampled our population of FEFSEM neurons, limiting ourselves to neurons where we ran multiple single-direction experiments with target motion both toward and away from their preferred directions. Toward the preferred direction was considered to be any single-direction experiment run within 90 degrees of the preferred direction and away from the preferred direction was considered to be any experiment run greater than 90 degrees away from the preferred direction. Preferred directions were calculated from pursuit responses of each neuron to trials in a direction tuning block of trials (see Statistics section). Thus, the sole condition used in our dPCA is the expected (and impending) direction of target motion relative to the preferred direction.
Of the 146 neurons that we recorded, we were able to collect single-direction experiments run both toward and away from the preferred direction in 63 of our neurons. We used 1400 ms of firing rate during fixation for each of the two conditions (towards and away from preferred direction). Therefore, the in our analysis was a 63 x 2800 matrix.
Linear model relating FEFSEM to eye velocity
Request a detailed protocolWe analyzed neurophysiological data and eye velocity from the random 8-direction block of trials to generate a linear model relating the modulation of firing rate of our population of FEFSEM neurons to changes in eye velocity:
Here, E is a 2 × 2000 matrix of eye velocity (horizontal, vertical velocity x eight directions, 250 ms of data per direction) averaged across all experiments. N8D is a 297 × 2000 matrix of firing rate modulation during the random 8-direction experiment (297 single-direction neural recordings from 146 neurons x eight directions, 250 ms of data per direction). W is the 2 × 297 wt matrix that relates the firing rate of each neuron to modulation of horizontal and vertical eye velocity.
We took several steps to combine neural data collected during different experiments. The single-direction experiments were run in different directions for different cells in an attempt to sample the full tuning curve of our population. Because we were interested in how modulation of our population of cells predicts changes of eye velocity relative to the single direction, we rotated the tuning curves of each cell so that they were aligned according to the direction of the single-direction experiment. For example, if the single-direction experiment was run at 90 degrees, then 90 degrees during the random 8-direction experiment was considered 0 degrees, 180 degrees was considered to be 90 degrees, 270 degrees was considered to be 180 degrees, and 0 degrees was considered to be 270 degrees. We rotated eye velocity in the same way and averaged across experiments to get the 2 × 2000 E matrix. For each neuron, firing rate responses to motion in each of the eight directions were averaged across trials, smoothed with a Gaussian filter (σ = 20 ms, similar results were obtained using σ = 10 ms), subtracted to have a mean of zero across all conditions, and normalized to the range across all conditions. To accommodate known lags between firing rate and movement, behavioral data was shifted forward in time by 25 ms. We repeated the analysis with shifting by 50 and 0 ms, but 25 ms yielded the best cross validation shown in Figure 5D. Nevertheless, repeating the analysis with the other temporal shifts yielded similar conclusions (data not shown). The weight matrix, W, was solved using regularized (ridge) regression.
Firing rates during fixation from the single-direction paradigm were processed in a similar manner. For each neuron, we averaged firing rate across trials, aligned to fixation onset. Each trial contributed data up to the time of the onset of target motion in that trial. We discarded the first 150 ms of averaged data to avoid any effects from the beginning of the trial and/or the saccade back to the center of the screen from the previous trial. We also discarded the last 50 ms of averaged data since there were too few trials with long enough fixation durations to generate a meaningful average. Again, firing rates were subtracted to have a value of zero at the start of the trial and normalized using the same ranges that were used for the normalization of the random 8-direction firing rates. The firing rates during fixation then were passed through the linear model generated from solving W of Equation (1) to obtain PE, the eye velocity predicted from preparatory modulation of firing rate:
Here, N1D is a 297 × 1400 matrix of firing rates (297 data points from 146 neurons x 1400 ms of fixation data; firing rates were trial-averaged, Gaussian-smoothed, σ = 20 ms, similar results with σ = 10 ms) and PE is a 2 × 1400 matrix of predicted eye velocity (horizontal, vertical velocity x 1400 ms of fixation). Predicted speeds (PS) were computed using standard trigonometry based on the horizontal and vertical components of the predicted eye velocity.
For the single trial analysis performed in Figure 6C and D, we used the same W matrix obtained from Equation (1). However, we computed preparatory firing rate modulation on single trials for each neuron as the average firing rate during the last 100 ms of fixation minus the average firing rate 150–250 ms after fixation-onset. Trials were matched by fixation time across cells and then randomly sampled (one trial per cell). These single trial data were normalized to the same range used to normalize N8D and N1D and passed through the linear model. For each of 1000 repetitions of the analysis, we computed the predicted eye direction as the arctangent of the predicted vertical and horizontal components of eye velocity and predicted eye speed as the square root of the sum of the squares of the predicted horizontal and vertical components.
Principal component analysis
Request a detailed protocolWe performed dimensionality reduction independently on preparatory- and pursuit-related firing rates using Principal Component Analysis (PCA) on their respective data matrices (Nprep and Npurs). Nprep is a 297 neuron x 1400 ms of preparatory-related firing rate matrix and Npurs is a 297 neuron x 750 ms of pursuit-related firing rate matrix (125 ms x 2 contrasts x two target speeds). All firing rates were trial-averaged and Gaussian smoothed (σ = 20 ms, similar results were obtained with σ = 10 ms). As is standard for PCA, we preprocessed each data matrix by normalizing rows (firing rates for each neuron) to have unity range and then centering firing rates on their means by subtracting off the row means. Each PC represents an orthogonal vector in N = 297 (or N = 160 for the bootstrap analyses) dimensional neural space. We chose to focus all of the subsequent analysis on the first identified PC for preparation and movement (PCPrep1 and PCPurs1), because they each captured at least 70% of the variance of the full responses (Elsayed et al., 2016). The angle between PCPrep1 and PCPurs1 was calculated as:
We also determined how the PCA component loadings for each unit changed between PCPrep1 and PCPurs1 by calculating the ratio PCPrep1/PCPurs1.
Pulse analysis
Request a detailed protocolTrials with saccades, detected with a combination of acceleration and velocity thresholds, in the window from pulse onset to 200 ms after visual motion onset were discarded before averaging the eye speed responses to pulses in matched conditions. The magnitude of the eye speed response was estimated as the maximum eye speed achieved across the 200 ms following pulse onset.
Statistics
We did not use formal tests to predetermine sample size, but our sample sizes are comparable to those reported in previous studies. Data were collected from two rhesus monkeys and consist of 321 data points collected from 164 neurons across 95 experimental sessions. We used only cells for which at least four trials/direction were collected during a direction-tuning block. This brought the sample size to 297 data points from 146 neurons: 80 neurons (187 data points) from monkey RE and 66 neurons (110 data points) from monkey XT. For the behavioral pulse experiments, 26 experiments were run in two monkeys for the speed context analysis (Figure 3) and 30 experiments were run in two monkeys for the effect of pulse direction experiments (Figure 4). Of the 30 pulse direction experiments, 27 had an early pulse onset time point of 400 ms for the same direction (Figure 2). Hypothesis testing was accomplished using a mix of two-sided bootstrap statistics, two-sided Wilcoxon signed rank tests, and two-sided Wilcoxon rank sum tests. Parametric hypothesis testing led to the same conclusions. The bootstrap procedure used in Figures 7 and 8 and Supplementary Figure 1 randomly sampled 20 units from each of the eight groups with different preferred directions relative to the direction of the experiment. We randomly sampled without replacement to avoid rank issues when performing the linear fitting and PCA. We chose 20 units because the smallest number of units in one of the 8 groups of preferred directions is 24. Preferred direction was calculated for each neuron as the weighted circular mean of the responses during the 8-direction block. This gives the mean parameter of a von Mises distribution fit to the direction tuning data. Our bootstrap approach was chosen to generate populations with a uniform distribution of preferred directions as a way of controlling for any biases of preferred direction in our data collection. The bootstrap was repeated for 1000 iterations.
Data availability
Source data have been provided for each figure.
References
-
Primate frontal eye fields. I. single neurons discharging before saccadesJournal of Neurophysiology 53:603–635.https://doi.org/10.1152/jn.1985.53.3.603
-
Preparatory activity in premotor and motor cortex reflects the speed of the upcoming reachJournal of Neurophysiology 96:3130–3146.https://doi.org/10.1152/jn.00307.2006
-
Neural implementation of bayesian inference in a sensorimotor behaviorNature Neuroscience 21:1442–1451.https://doi.org/10.1038/s41593-018-0233-y
-
Neuronal activity in monkey superior colliculus related to the initiation of saccadic eye movementsThe Journal of Neuroscience 17:8566–8579.https://doi.org/10.1523/JNEUROSCI.17-21-08566.1997
-
The origin of corticospinal projections from the premotor Areas in the frontal lobeThe Journal of Neuroscience 11:667–689.https://doi.org/10.1523/JNEUROSCI.11-03-00667.1991
-
Activity of omnipause neurons in alert cats during saccadic eye movements and visual stimuliJournal of Neurophysiology 47:827–844.https://doi.org/10.1152/jn.1982.47.5.827
-
Anticipatory smooth-pursuit eye movements in man and monkeyExperimental Brain Research 186:203–214.https://doi.org/10.1007/s00221-007-1225-4
-
Saccadic and smooth pursuit eye movements in the monkeyThe Journal of Physiology 191:609–631.https://doi.org/10.1113/jphysiol.1967.sp008271
-
Brainstem control of saccadic eye movementsAnnual Review of Neuroscience 8:307–337.https://doi.org/10.1146/annurev.ne.08.030185.001515
-
Smooth eye movements elicited by microstimulation in the primate frontal eye fieldJournal of Neurophysiology 69:786–799.https://doi.org/10.1152/jn.1993.69.3.786
-
Direct inhibitory synaptic linkage of pontomedullary reticular burst neurons with abducens motoneurons in the catExperimental Brain Research 33:337–352.https://doi.org/10.1007/BF00235558
-
Cortical activity in the null space: permitting preparation without movementNature Neuroscience 17:440–448.https://doi.org/10.1038/nn.3643
-
Frontal eye field lesions impair predictive and visually-guided pursuit eye movementsExperimental Brain Research 86:311–323.https://doi.org/10.1007/BF00228954
-
Participation of medial pontine reticular formation in eye movement generation in monkeyJournal of Neurophysiology 37:316–332.https://doi.org/10.1152/jn.1974.37.2.316
-
Preparatory modulation of the gain of visuo-motor transmission for smooth pursuit in monkeysExperimental Brain Research 149:391–394.https://doi.org/10.1007/s00221-003-1375-y
-
Modulation of pursuit eye movements by stimulation of cortical Areas MT and MSTJournal of Neurophysiology 62:31–47.https://doi.org/10.1152/jn.1989.62.1.31
-
Predictive smooth pursuit eye movementsAnnual Review of Vision Science 5:223–246.https://doi.org/10.1146/annurev-vision-091718-014901
-
Brainstem afferents to the oculomotor omnipause neurons in monkeyThe Journal of Comparative Neurology 295:413–427.https://doi.org/10.1002/cne.902950306
-
Activity of brain stem neurons during eye movements of alert monkeysJournal of Neurophysiology 35:445–461.https://doi.org/10.1152/jn.1972.35.4.445
-
Facilitation of smooth pursuit initiation by electrical stimulation in the supplementary eye fieldsJournal of Neurophysiology 86:2413–2425.https://doi.org/10.1152/jn.2001.86.5.2413
-
Common inhibitory mechanism for saccades and smooth-pursuit eye movementsJournal of Neurophysiology 88:1880–1892.https://doi.org/10.1152/jn.2002.88.4.1880
-
Saccade-related activity in monkey superior colliculus. I. characteristics of burst and buildup cellsJournal of Neurophysiology 73:2313–2333.https://doi.org/10.1152/jn.1995.73.6.2313
-
Signal processing and distribution in cortical-brainstem pathways for smooth pursuit eye movementsAnnals of the New York Academy of Sciences 1164:147–154.https://doi.org/10.1111/j.1749-6632.2009.03859.x
-
TMS evidence for smooth pursuit gain control by the frontal eye fieldsCerebral Cortex 19:1144–1150.https://doi.org/10.1093/cercor/bhn162
-
The relationship between saccadic and smooth tracking eye movementsThe Journal of Physiology 159:326–338.https://doi.org/10.1113/jphysiol.1961.sp006811
-
Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkeyJournal of Neurophysiology 86:1916–1936.https://doi.org/10.1152/jn.2001.86.4.1916
-
Deficits in smooth-pursuit eye movements after muscimol inactivation within the primate's frontal eye fieldJournal of Neurophysiology 80:458–464.https://doi.org/10.1152/jn.1998.80.1.458
-
Preparatory gain modulation of visuomotor transmission for smooth pursuit eye movements in monkeysJournal of Neurophysiology 96:3051–3063.https://doi.org/10.1152/jn.00412.2006
-
Role of arcuate frontal cortex of monkeys in smooth pursuit eye movements. II. relation to vector averaging pursuitJournal of Neurophysiology 87:2700–2714.https://doi.org/10.1152/jn.2002.87.6.2700
-
Anticipatory activity of motor cortex neurons in relation to direction of an intended movementJournal of Neurophysiology 39:1062–1068.https://doi.org/10.1152/jn.1976.39.5.1062
-
The premotor cortex of the monkeyThe Journal of Neuroscience 2:1329–1345.https://doi.org/10.1523/JNEUROSCI.02-09-01329.1982
-
Activity of superior colliculus in behaving monkey. 3. cells discharging before eye movementsJournal of Neurophysiology 35:575–586.https://doi.org/10.1152/jn.1972.35.4.575
Decision letter
-
Kunlin WeiReviewing Editor; Peking University, China
-
Joshua I GoldSenior Editor; University of Pennsylvania, United States
-
Jochen DitterichReviewer; UC Davis, United States
In the interests of transparency, eLife publishes the most substantive revision requests and the accompanying author responses.
Acceptance summary:
The study investigates how activity in a specific region of the frontal eye field changes when smooth pursuit eye movements switch from preparation to execution. They propose a novel framework based on visuomotor gain to account for the behavioural and neural data collected from monkeys, different from the movement potent framework that has been previously proposed for the skeletomotor system.
Decision letter after peer review:
Thank you for submitting your article entitled "Mechanisms that allow cortical preparatory activity without inappropriate movement" for peer review at eLife. Your article is being evaluated by three peer reviewers, and the evaluation is being overseen by a Reviewing Editor and Joshua Gold as the Senior Editor.
After consultation with each other and with the Reviewing Editor and Senior Editor, the reviewers have identified a list of essential revisions, involving extensive new analyses, which are listed below.
The present study aims to understand whether pseudo-population activity of FEFsem neurons is better explained by a visual-motor gain hypothesis or by the movement-potent/null space framework for the skeletomotor system. Using a brief pulse of visual motion during the preparatory period to produce transient eye motion during fixation, the authors found that the size of eye motion is modulated by factors such as the timing of pulse within the fixation period, direction of pulse motion, and expectation of target speed. This result was interpreted as matching the predictions of the visuomotor gain hypothesis. The authors further found that: 1) an optimal linear model, parameterized by weight estimates from one smooth pursuit task with 8 directions, was used on the same FEFsem neuron population during the preparatory period, and the model predictions appeared to match the actual eye velocity during fixation when there wasn't any; and 2) the principal components (PCs) of the population response measured during preparatory and movement initiation phases were separated by about 65 deg, as opposed to 90 deg as predicted by the movement-null space framework. These results were interpreted as evidence against the movement-null space framework.
All three reviewers (including the reviewing editor) find this paper interesting, well-written, and timely for the field. However, they converged on a common set of concerns about the data analysis.
1) The evidence against the movement-null space frame is indirect. For example, the approach is to find the preparatory subspace in one task and look at what happens in another task. Extensive additional analyses are needed to make the current work comparable to the studies (e.g., Kaufman et al.).
2) Some data analyses are confusing, such as artificially rotating the tuning of some neurons to build a neural space that sometimes includes the same neuron on different axes. These analyses should be either simplified or more clearly explained and justified.
3) The PCA analysis should be improved; e.g., using dPCA.
4) It would be meaningful and necessary to applied subspace analysis to the data from the experiment that provided the behavioral evidence (e.g., Figure 2).
Reviewer #1:
In this manuscript Darlington and Lisberger address the question how preparatory activity in the smooth pursuit eye movement system is prevented from actually driving eye movements. Different solutions have been proposed for different motor systems. The saccadic eye movement system has a gate (omnipause neurons) preventing preparatory activity from activating burst neurons. An analysis of primary motor and premotor activity in the arm movement system has shown that preparatory population activity avoids state space dimensions that result in driving motor output. For the smooth pursuit eye movement system, the authors propose that preparatory activity in the frontal eye field (FEF) controls the gain of a sensorimotor transformation process that is actually driven by visual motion information. An analysis of the FEF population activity indicated that the preparatory activity does not completely avoid the dimensions related to motor output, such that the preparatory activity would be expected to cause eye movements if the neural activity in FEF were responsible for driving smooth pursuit.
1) One of the key elements supporting the authors' claims is a comparison of the time course of preparatory activity in FEF with the time course of the behavioral effect of brief motion pulses. Ideally, these data would have been collected in a combined experiment. For this manuscript they were collected in separate experiments. This is not necessarily problematic as they were collected from the same monkeys. However, both time courses are likely affected by the animals' temporal expectations about upcoming eye movements. The timing of the experiments (distribution of time intervals between fixation onset and onset of the continuous motion cue driving pursuit, not the pulses) should therefore have been identical to be able to make the assumption that the animals' expectation was probably similar. The manuscript is not explicit about whether this was the case. Was it?
Other than that, I don't have any major issues. The data analysis is solid, and the manuscript is very clearly written.
Reviewer #2:
Darlington and Lisberger present a well-written and interesting study that explores how activity in a specific region of the frontal eye field (FEFsem) transitions between preparation and execution of smooth pursuit eye movements. The overall objective is to understand whether pseudo-population activity of FEFsem neurons is better explained by the visual-motor gain hypothesis, originally developed by Lisberger and colleagues, or by the movement-potent/null space framework championed recently by Shenoy and colleagues for the skeletomotor system. The authors provide three results that, in their opinion, support the visual-motor gain hypothesis and refute the movement-null space perspective. I will summarize the three findings and then evaluate the authors' interpretations.
1) Injecting a brief pulse of visual motion during the preparatory period produces transient eye motion during fixation. The size of eye motion depends on several factors (when during the fixation period, direction of pulse motion, and expectation of target speed). The authors view the results as consistent with and build logically on the visual-motor gain hypothesis as a mechanism for movement initiation, particularly smooth pursuit. In my view, their interpretation is reasonable.
2) As a test of the movement-potent space hypothesis, the authors estimate the contribution of each neuron/condition to the initiation of smooth pursuit during one task condition (8 directions randomly interleaved). They then use these weights on the preparatory activity of the same population during a different task (repeat trials of same direction) and find that the model predicts changes in eye velocity (during fixation) when there isn't any. This finding is interpreted as evidence against the movement-potent space framework.
In my view, the analysis is not rigorous enough to reach this conclusion. Is it safe to assume, as the authors seem to do, that the population response for movement initiation during the two tasks is the same? How well do the weights for the 8D task predict pursuit initiation for the 1D task? Also, how well do weights obtained from 1D task during pursuit predict eye velocity during preparation in the same 1D task? These factors must be addressed before appreciating the importance of the result emphasized in the manuscript. Also see dPCA comment below.
3) In a related analysis, the authors evaluated the principal components (PCs) of the population response measured during preparatory and movement initiation phases. They found that the 1st PC for each period accounts for ~70% of the variance and that the mean angle between these PCs is about 65 deg, which is not equal to the 90 deg required if preparatory period activity is in a movement-null space. In addition, they identified a subpopulation of neurons that accounts for the observed change in angle between the PCs.
Given that the angle of separation between the primary preparatory and movement PCs is not 90 deg, the authors de-emphasize the potential importance of the movement potent/null space framework and instead view favorably the visual-motor gain hypothesis. However, they do state, "two mechanisms for preventing movements might be better than one". My view on their data is that the population FEFsem definitely resides in different subspaces during preparatory and movement initiation periods. In other words, if we relax a strict interpretation of orthogonality of movement and null subspaces, then these data are very much in line with potent/null space framework. This very much contrasts the take-home message the authors deliver.
Moreover, it is not clear that PC analysis is the best/correct analysis to use for the current data. The authors should consider using demixed principal component analysis (dPCA; https://elifesciences.org/articles/10989; https://www.eneuro.org/content/3/4/ENEURO.0085-16.2016.long). An interesting outcome of previous studies using dPCA is that the primary PCA is generally condition independent and could reflect the large overlap in angle between the PCs. A separation is more appreciable with secondary and tertiary PCs. The authors should pursue this angle of inquiry.
Finally, there is a glaring omission in the analysis. The first part of the paper shows a robust behavioral result, in which a brief visual motion perturbation produces an eye movement during a period typically associated with movement preparation. What subspace is spanned by FEFsem population during the transient eye movement response? Does the activity remain aligned with preparatory PCs (evidence against functional importance of movement-null space) or does it shift to movement PCs (evidence to support the movement-potent hypothesis)? It seems to me that this analysis is crucial to understand population activity control of smooth pursuit by FEFsem.
In summary, a study of how population activity relates to movement preparation and generation is timely. Tests of whether new hypotheses developed in skeletomotor systems generalize to the oculomotor system is very much needed, and this study takes a step in the direction. However, the analysis isn't rigorous enough to reach a reliable conclusion.
Reviewer #3:
Darlington and Lisberger present a previously undescribed "mechanism" by which the smooth eye movement (SEM) region of FEF could prepare pursuit movements without causing them -by dialing up the visuomotor gain. Moreover, they provide evidence in the SEM system against the "null subspace" hypothesis of preparation of arm movements. I find many aspects of the manuscript interesting but I have some concerns about their analytical approach
Comments:
1) Although I think that the potential differences in control of reaching movements and pursuits are interesting, I have concerns about how the authors tested the "null subspace" hypothesis. Overall, I think that the authors should replicate the methods proposed by Kaufman et al., rather than introduce a number of modifications whose implications are hard to grasp -at least for me. In more detail:
1a) All subspace analyses putatively capture activity that reflects some aspect of the underlying circuitry as well as the task (e.g, related to inputs to the neural population or outputs). However, the authors find the null subspace in a lower-dimensional version of the task that they probe (1-targets vs. 8-targets) that is also -I think- cued differently. My suggestion is that they do the analysis using the full 8-target data and considering the preparatory and pursuit epochs as Kaufman et al. did.
1b) Studies like Kaufman's assume that the relevant "neural information" is captured by activity patterns shared across the neural population; these patterns are probed by analyzing a state space in which axis is the activity of one recorded neuron. The authors adopted an approach that puzzled me: having multiple axes that reflect the same neuron after rotating its activity. I'd again suggest them to adopt the simpler approach of defining one axes per neuron, discarding neurons that were recorded multiple times during different conditions (at least I have trouble foreseeing all potential implications of their manipulations)
1c) I am again a bit confused about the potential effect of the authors rotating the tuning curves of each neuron in the analysis. Although I agree that there may be FEF neurons with these properties, I would avoid it because it implies assuming that the absolute coordinates of the target doesn't matter, or at least show that it doesn't influence the main result.
1d) Did the authors include all the recorded neurons in this analysis or only neurons that were significantly tuned to the task? Although studies in the motor cortices suggest that the population dynamics sampled from sufficiently large neural populations are the same irrespective of the sampled neurons (Trautman et al., 2018), I worry this may bias their results.
1e) Because of these concerns, I believe that the authors should repeat Figure 8 after calculating the preparatory and pursuit PCs as in Kaufman et al., 2014.
1f) Minor: I assume that the authors only compare the first pursuit PC and the first preparatory PC because they each capture a large fraction of the total neural variance. For a full assessment, I'd suggest an analysis like the one in Figure 4 of Elsayed et al., 2016, or the principal angle analysis used in Gallego et al., 2018.
2) The central idea of "gain control" is interesting, but I think the authors should pursue it further. For example, can single trial eye speed be predicted from neural activity? (I'd do this analysis for the data in Figure 2 and 3). Also, how do the authors think this gain leads to a transition from preparation to movement, by exceeding a threshold? I think some analyses and discussion in this regard are missing.
3) In the Results section the authors make the proposal that there may be "non-specific preparatory enhancement of visuomotor gain". I think they could address this directly by using demixed principal component analysis (dPCA) (Kobak et al., 2016). dPCA effectively performs semi-supervised dimensionality reduction and can be used to isolate population activity patterns that only depend on time (these would be the component the authors refer to) and components that depend on the direction of the movement (see, e.g., Kaufman et al., 2016, Gallego et al., 2018 for examples in motor cortex). Examining both the dynamics of these components (e.g., when do putative time-related and target-related components start ramping up?) and the weights (e.g., are there subpopulations of neurons?) could be interesting. Note that there's freely available code by Kobak et al.
4) Figure 2 shows strong effects, but it would be nice to see the data distributions, or at least box plot versions of (b) and (c). As to (d), would the authors see the same trend if they plotted single trial values or a 2D histogram? This figure focuses in neurons that had "positive preparatory firing rate modulation". What was their percentage among all recorded neurons? And among all modulated neurons? And what happens with these neurons? Same for the increase and decrease cells in Figure 3.
References:
GF Elsayed, AH Lara, MT Kaufman, MM Churchland and JP Cunningham. Reorganization between preparatory and movement population responses in motor cortex. Nature Communications 2016
JA. Gallego, MG. Perich, SN. Naufel, C Ethier, SA Solla and LE Miller. Cortical population activity within a preserved neural manifold underlies multiple motor behaviors. Nature Communications 2018
MT Kaufman, JS Seely, D Sussillo, SI Ryu, KV Shenoy and MM Churchland. The Largest Response Component in the Motor Cortex Reflects Movement Timing but Not Movement Type. eNeuro 2016
D Kobak, W Brendel, C Constantinidis, CE Feierstein, A Kepecs, ZF Mainen, X-L Qi, R Romo, N Uchida, C Machens. Demixed principal component analysis of neural population data. eLife 2016
MG Perich, JA Gallego, LE Miller. A Neural Population Mechanism for Rapid Learning. Neuron 2018
EM Trautmann, SD Stavisky, S Lahiri, KC Ames, MT Kaufman, DJ O'Shea, S Vyas, X Sun, SI Ryu, S Ganguli, KV Shenoy. Accurate estimation of neural population dynamics without spike sorting. Neuron 2018
[Editors' note: further revisions were suggested prior to acceptance, as described below.]
Thank you for resubmitting your work entitled "Mechanisms that allow cortical preparatory activity without inappropriate movement" for further consideration by eLife. Your revised article has been evaluated by Joshua Gold (Senior Editor), a Reviewing Editor, and two of the original reviewers.
The manuscript has been improved substantially. The addition of new analyses as well as the justification for why other requested analyses are not needed were satisfactory. Overall, the revised version is well written and of strong impact. It pushes back a bit against the increasingly dogmatic view of movement-potent and movement-null subspaces.
We have one remaining major concern that should be addressed:
1) It would be interesting to a) recompute weights relating FEFsem activity to eye velocity separately for subpopulations 1 and 2, and (b) predict eye velocities for each. Is there a difference in the predictive power for the two subpopulations? And how well do the results align with the proposed role of each subset (including for different directions)? A new figure can probably be committed to the results.
https://doi.org/10.7554/eLife.50962.sa1Author response
Reviewer #1:
In this manuscript Darlington and Lisberger address the question how preparatory activity in the smooth pursuit eye movement system is prevented from actually driving eye movements. Different solutions have been proposed for different motor systems. The saccadic eye movement system has a gate (omnipause neurons) preventing preparatory activity from activating burst neurons. An analysis of primary motor and premotor activity in the arm movement system has shown that preparatory population activity avoids state space dimensions that result in driving motor output. For the smooth pursuit eye movement system, the authors propose that preparatory activity in the frontal eye field (FEF) controls the gain of a sensorimotor transformation process that is actually driven by visual motion information. An analysis of the FEF population activity indicated that the preparatory activity does not completely avoid the dimensions related to motor output, such that the preparatory activity would be expected to cause eye movements if the neural activity in FEF were responsible for driving smooth pursuit.
1) One of the key elements supporting the authors' claims is a comparison of the time course of preparatory activity in FEF with the time course of the behavioral effect of brief motion pulses. Ideally, these data would have been collected in a combined experiment. For this manuscript they were collected in separate experiments. This is not necessarily problematic as they were collected from the same monkeys. However, both time courses are likely affected by the animals' temporal expectations about upcoming eye movements. The timing of the experiments (distribution of time intervals between fixation onset and onset of the continuous motion cue driving pursuit, not the pulses) should therefore have been identical to be able to make the assumption that the animals' expectation was probably similar. The manuscript is not explicit about whether this was the case. Was it?
We agree that this is a very important issue. Despite the current ordering of figures, the behavioral experiments were actually a follow-up to the neural analyses we performed on our FEFSEM data. We matched all experimental conditions, including timing, in order to maximize the validity of our comparisons between the neurophysiology and behavioral data sets. We have added a short paragraph in the relevant place in the Results to be more explicit about this.
Other than that, I don't have any major issues. The data analysis is solid, and the manuscript is very clearly written.
We’d like to thank the reviewer for the positive feedback. We are glad that the reviewer enjoyed our manuscript.
Reviewer #2:
Darlington and Lisberger present a well-written and interesting study that explores how activity in a specific region of the frontal eye field (FEFsem) transitions between preparation and execution of smooth pursuit eye movements. The overall objective is to understand whether pseudo-population activity of FEFsem neurons is better explained by the visual-motor gain hypothesis, originally developed by Lisberger and colleagues, or by the movement-potent/null space framework championed recently by Shenoy and colleagues for the skeletomotor system. The authors provide three results that, in their opinion, support the visual-motor gain hypothesis and refute the movement-null space perspective. I will summarize the three findings and then evaluate the authors' interpretations.
1) Injecting a brief pulse of visual motion during the preparatory period produces transient eye motion during fixation. The size of eye motion depends on several factors (when during the fixation period, direction of pulse motion, and expectation of target speed). The authors view the results as consistent with and build logically on the visual-motor gain hypothesis as a mechanism for movement initiation, particularly smooth pursuit. In my view, their interpretation is reasonable.
2) As a test of the movement-potent space hypothesis, the authors estimate the contribution of each neuron/condition to the initiation of smooth pursuit during one task condition (8 directions randomly interleaved). They then use these weights on the preparatory activity of the same population during a different task (repeat trials of same direction) and find that the model predicts changes in eye velocity (during fixation) when there isn't any. This finding is interpreted as evidence against the movement-potent space framework.
In my view, the analysis is not rigorous enough to reach this conclusion. Is it safe to assume, as the authors seem to do, that the population response for movement initiation during the two tasks is the same? How well do the weights for the 8D task predict pursuit initiation for the 1D task? Also, how well do weights obtained from 1D task during pursuit predict eye velocity during preparation in the same 1D task? These factors must be addressed before appreciating the importance of the result emphasized in the manuscript. Also see dPCA comment below.
We’d like to thank the reviewer for the insightful questions and we agree that it is important that they be answered. In Figure 5D, which was part of the original paper, we show that the weights calculated in the 8D task do an excellent job of predicting actual horizontal eye velocity for the 1D task. These same weights accurately predict 0 vertical eye velocity (i.e. accurately predict direction) for the 1D task; because this is a ridiculous looking figure with all points plotting at (0,0), we state this result explicitly in the text. We have now also included a supplementary analysis shown in Figure 6—figure supplement 3 to confirm that we obtained all the same results when the fitting and predicting were both done on the 1D task.
3) In a related analysis, the authors evaluated the principal components (PCs) of the population response measured during preparatory and movement initiation phases. They found that the 1st PC for each period accounts for ~70% of the variance and that the mean angle between these PCs is about 65 deg, which is not equal to the 90 deg required if preparatory period activity is in a movement-null space. In addition, they identified a subpopulation of neurons that accounts for the observed change in angle between the PCs.
Given that the angle of separation between the primary preparatory and movement PCs is not 90 deg, the authors de-emphasize the potential importance of the movement potent/null space framework and instead view favorably the visual-motor gain hypothesis. However, they do state, "two mechanisms for preventing movements might be better than one". My view on their data is that the population FEFsem definitely resides in different subspaces during preparatory and movement initiation periods. In other words, if we relax a strict interpretation of orthogonality of movement and null subspaces, then these data are very much in line with potent/null space framework. This very much contrasts the take-home message the authors deliver.
We’d like to thank the reviewer for this feedback, which helped us to recognize a deficiency in our presentation in the original version of the paper. We have rewritten parts of the Results and Discussion to be transparent that while not orthogonal, there is clearly some reorganization between preparation and movement. We also added text to explain that the full set of data that we think argues against a simple and traditional “null-space” explanation for our findings. First, preparatory activity does evolve in a way that predicts movement, which is the strongest piece of evidence against the null/potent framework in the pursuit system. Second, we outline a broader (and in our view more compelling) function for this reorganization beyond simply preventing movement during preparation. Through an analysis that isolates the part of our population that is driving the partial reorganization, cells whose preferred direction was generally opposite the direction of the 1D experiment (that seemingly have a strong “prior” for that direction based on their preparatory responses), we connect this feature of the full population response to our behavioral finding of a directionally non-specific enhancement of visual motor gain (Figure 4A, orthogonal/opposite). We suggest that a more likely function of this reorganization is to allow the pursuit system to partially prepare for less likely directions of visual motion, so that it is never caught completely flat-footed in the event of unexpected target motion.
Moreover, it is not clear that PC analysis is the best/correct analysis to use for the current data. The authors should consider using demixed principal component analysis (dPCA; https://elifesciences.org/articles/10989; https://www.eneuro.org/content/3/4/ENEURO.0085-16.2016.long). An interesting outcome of previous studies using dPCA is that the primary PCA is generally condition independent and could reflect the large overlap in angle between the PCs. A separation is more appreciable with secondary and tertiary PCs. The authors should pursue this angle of inquiry.
We considered dPCA and read the paper cited by the reviewer, but decided in the end that our unbiased approach was actually more rigorous. We wanted to use an unbiased estimator of preparatory and pursuit dimensions to produce an unbiased result. Unless we have misunderstood the reviewer, we disagree that it would be a move rigorous approach to show that preparatory and pursuit secondary and tertiary PCs are different based on the results of semi-supervised dimensionality reduction, which defines preparation and pursuit as being different conditions.
Finally, there is a glaring omission in the analysis. The first part of the paper shows a robust behavioral result, in which a brief visual motion perturbation produces an eye movement during a period typically associated with movement preparation. What subspace is spanned by FEFsem population during the transient eye movement response? Does the activity remain aligned with preparatory PCs (evidence against functional importance of movement-null space) or does it shift to movement PCs (evidence to support the movement-potent hypothesis)? It seems to me that this analysis is crucial to understand population activity control of smooth pursuit by FEFsem.
Unfortunately, we do not have access to the data requested by the reviewer. The visual motion pulse experiments presented in Figures 2-4 were behavior-only experiments done as a direct follow-up to test our interpretation of the neural analyses of Figures 5-8.
First, we want to argue that this is not a glaring omission. The responses to a pulse of target motion at different times during fixation do not differ conceptually from the response to the onset of target motion at the end of the prescribed fixation period. Both initiate eye movement, both are driven by visual motion, and both represent neural correlates of the eye movement behavioral response. There is no reason to think that they would differ from the pursuit-related responses and the population activity during a probe should, by all accounts, align with the movement PCs (and only be partially reorganized from preparatory PCs). To collect these data would be a ton of work only to confirm a very solid prediction.
Second, we want to make an offer. A lab member who is not an author in this paper has collected neurophysiological data in FEFSEM during visual motion pulse experiments (n=51 neurons in one monkey). Even though there are some minor differences in the experimental design, we have analyzed those data and found a positive correlation (r=0.62) between preparatory modulation of firing rate and modulation of activity during the pulses (see Author response image 1). Thus, population modulation in response to the pulses is in the same direction as modulation during preparation. This is consistent with the relationship that we have shown between preparatory- and pursuit-related firing rates (Figure 1D) and weakly supports our expectation from doing this experiment correctly. We would be happy to include this as a supplementary figure and add the other lab member as an author on the paper if the reviewer deems that it materially adds to the story, even though we do not think it is a strong addition.
In summary, a study of how population activity relates to movement preparation and generation is timely. Tests of whether new hypotheses developed in skeletomotor systems generalize to the oculomotor system is very much needed, and this study takes a step in the direction. However, the analysis isn't rigorous enough to reach a reliable conclusion.
We appreciate the positive part of this comment. We have done the best we can to improve the rigor along the lines recommended by the reviewer, but we also respectfully disagree with one of the major comments concerning the use of dPCA. We agree that dPCA would be more “modern”, and have added dPCA in another portion of the manuscript. However, we think the analysis we have done in comparing preparatory and pursuit PCs is closer to unbiased and that this is a major virtue.
Reviewer #3:
Darlington and Lisberger present a previously undescribed "mechanism" by which the smooth eye movement (SEM) region of FEF could prepare pursuit movements without causing them -by dialing up the visuomotor gain. Moreover, they provide evidence in the SEM system against the "null subspace" hypothesis of preparation of arm movements. I find many aspects of the manuscript interesting but I have some concerns about their analytical approach.
Comments:
1) Although I think that the potential differences in control of reaching movements and pursuits are interesting, I have concerns about how the authors tested the "null subspace" hypothesis. Overall, I think that the authors should replicate the methods proposed by Kaufman et al., rather than introduce a number of modifications whose implications are hard to grasp -at least for me.
We’d like to thank the reviewer for this feedback and agree that we did not justify/clarify our use of these modifications. The primary reason we modified our analytical approach is because there are key experimental differences between the way that we collected our data and the way in which the Kaufman et al. data was collected. We have added text to clarify. Furthermore, we have taken two major steps to remedy this concern. First, we have included control analyses to show that our conclusions are not due to the modifications. Second, we have included as Figure 6—figure supplement 3 a supplementary analysis that is more congruent with what was done in the Kaufman et al. paper.
In more detail:
1a) All subspace analyses putatively capture activity that reflects some aspect of the underlying circuitry as well as the task (e.g, related to inputs to the neural population or outputs). However, the authors find the null subspace in a lower-dimensional version of the task that they probe (1-targets vs. 8-targets) that is also -I think- cued differently. My suggestion is that they do the analysis using the full 8-target data and considering the preparatory and pursuit epochs as Kaufman et al. did.
The only difference between the 1-direction and 8-direction tasks is the preponderance of target directions that occurs. There were no explicit cues in either task indicating the direction of the upcoming target motion. Therefore, accurate preparation is only possible during the 1-direction task where the monkey is able to anticipate the upcoming target motion. We decided to use the 8-direction task to perform the mapping of pursuit-related FEFSEM activity to eye movement because it provides a richer assessment of eye velocity. We have written more clearly about this issue, in a way that we hope resolves the reviewer’s concerns.
1b) Studies like Kaufman's assume that the relevant "neural information" is captured by activity patterns shared across the neural population; these patterns are probed by analyzing a state space in which axis is the activity of one recorded neuron. The authors adopted an approach that puzzled me: having multiple axes that reflect the same neuron after rotating its activity. I'd again suggest them to adopt the simpler approach of defining one axes per neuron, discarding neurons that were recorded multiple times during different conditions (at least I have trouble foreseeing all potential implications of their manipulations)
1c) I am again a bit confused about the potential effect of the authors rotating the tuning curves of each neuron in the analysis. Although I agree that there may be FEF neurons with these properties, I would avoid it because it implies assuming that the absolute coordinates of the target doesn't matter, or at least show that it doesn't influence the main result.
We can understand how readers might be confused by some of the choices we used in our data analysis and we apologize for not being clearer in our explanations and for not including some obvious controls. The goal was to create as much of a population response as we could, without excluding data points or neurons and without biasing our data collection for the 1D experiment towards any part of the direction tuning curve of our recorded neurons (i.e. only running the 1D experiment in the preferred direction of our neurons). Therefore, we ran multiple single direction experiments (where preparation could effectively occur) for most neurons in different directions relative to their preferred direction. We then chose to rotate the direction tuning curves in a manner that made it seem like all of the 1D experiments were run in the same direction (0 degrees, rightward). This allowed us to construct a full pseudo-population preparatory response for which the full range of differences between the expected direction of the upcoming visual motion and the preferred direction of the cell is represented.
We have corrected our prior errors. Now, we include a control analysis where each neuron contributes a single data point and we show that our conclusions are unchanged (Figure 6—figure supplement 2). Furthermore, Figure 6—figure supplement 3 show that we obtain the same results when the analysis used only data from the 1D task and involved no rotation of neural data.
1d) Did the authors include all the recorded neurons in this analysis or only neurons that were significantly tuned to the task? Although studies in the motor cortices suggest that the population dynamics sampled from sufficiently large neural populations are the same irrespective of the sampled neurons (Trautman et al., 2018), I worry this may bias their results.
We included all recorded neurons in this analysis. We are now clear about this in the text.
1e) Because of these concerns, I believe that the authors should repeat Figure 8 after calculating the preparatory and pursuit PCs as in Kaufman et al., 2014.
We have now included as Figure 6—figure supplement 3 a supplementary analysis that is more congruent with that used in Kaufman et al., 2014 in that it uses data from only one task, computes a weight matrix between pursuit PCs and eye movement, and tests the projections of preparatory PCs onto the row and null spaces of the weight matrix. The results and conclusions are unchanged.
1f) Minor: I assume that the authors only compare the first pursuit PC and the first preparatory PC because they each capture a large fraction of the total neural variance. For a full assessment, I'd suggest an analysis like the one in Figure 4 of Elsayed et al., 2016, or the principal angle analysis used in Gallego et al., 2018.
We chose only the first PCs because they each captured ~70% of the variance, the same value used to choose the number of PCs used in Elsayed et al., 2016. We now state this clearly in the text.
2) The central idea of "gain control" is interesting, but I think the authors should pursue it further. For example, can single trial eye speed be predicted from neural activity? (I'd do this analysis for the data in Figure 2 and 3). Also, how do the authors think this gain leads to a transition from preparation to movement, by exceeding a threshold? I think some analyses and discussion in this regard are missing.
We have added some text to the Discussion to pursue our ideas about “gain control” further. A previous publication from our laboratory showed that single trial eye speed can be predicted from neural activity during the initiation of pursuit (Schoppik et al., 2008). Because Figures 2 and 3 show the results of behavioral experiments without neural recordings, we cannot address this cogent question with the data at hand. We would, however, point out that single-trial neuron-behavior correlations are more of a statement about neuron-neuron correlations than about any particular functional role and, so, we view that question as tangential to the main point of the present paper. In terms of what triggers movement, we have just published a paper that shows the absence of a threshold for triggering movement based on the signals in the FEFSEM (Lee et al., 2019). Instead, we think that the gain signal from FEFSEM poises the system for action, but movement is triggered only by visual motion signals that are subject to the gain modulation.
3) In the Results section the authors make the proposal that there may be "non-specific preparatory enhancement of visuomotor gain". I think they could address this directly by using demixed principal component analysis (dPCA) (Kobak et al., 2016). dPCA effectively performs semi-supervised dimensionality reduction and can be used to isolate population activity patterns that only depend on time (these would be the component the authors refer to) and components that depend on the direction of the movement (see, e.g., Kaufman et al., 2016, Gallego et al., 2018 for examples in motor cortex). Examining both the dynamics of these components (e.g., when do putative time-related and target-related components start ramping up?) and the weights (e.g., are there subpopulations of neurons?) could be interesting. Note that there's freely available code by Kobak et al.
We’d like to thank the reviewer for this excellent suggestion. We used dPCA on a subset of our FEFSEM population in which we were able to collect single-direction data both toward and away from the preferred direction of each neuron. The results are shown in Figure 4 and reveal a very nice correlate with the behavioral findings of Figure 4A, making an even stronger link between FEFSEM preparatory activity and the preparatory modulation of visual-motor gain.
4) Figure 2 shows strong effects, but it would be nice to see the data distributions, or at least box plot versions of (b) and (c). As to (d), would the authors see the same trend if they plotted single trial values or a 2D histogram? This figure focuses in neurons that had "positive preparatory firing rate modulation". What was their percentage among all recorded neurons? And among all modulated neurons? And what happens with these neurons? Same for the increase and decrease cells in Figure 3.
The source data for Figure 2 (a and b) panels are included with the submission. We have added information to the paper clarifying the percentage of neurons categorized as having positive versus negative preparatory firing rate modulation. The behavioral data for the pulses was collected separately (though under identical conditions) from the neurophysiology data. Therefore, it is not possible to do this analysis with single trials. However, our prior papers (Darlington et al., 2018; Lee et al., 2019) show that there is a positive relationship between fixation time and preparatory firing rate, and unpublished data show a correlation between preparatory firing rate and ensuing pursuit speed on a trial-by-trial basis. We would be willing to include the latter data in Figure 2, but it seems somewhat tangential to the main points of this paper.
[Editors' note: further revisions were suggested prior to acceptance, as described below.]
We have one remaining major concern that should be addressed:
1) It would be interesting to a) recompute weights relating FEFsem activity to eye velocity separately for subpopulations 1 and 2, and (b) predict eye velocities for each. Is there a difference in the predictive power for the two subpopulations? And how well do the results align with the proposed role of each subset (including for different directions)? A new figure can probably be committed to the results.
We performed the linear model analysis from Figures 5 and 6 separately on the two subpopulations. This analysis has been added to the manuscript as Figure 9. It reveals that both subpopulations perform roughly the same in terms of predicting the eye velocity during pursuit in the single-direction block. Furthermore, it shows that preparatory activity in subpopulation 1 evolves in a way that predicts movement in the direction of the upcoming visual motion and eye movement. However, preparatory activity from subpopulation 2 predicts no movement on average.
https://doi.org/10.7554/eLife.50962.sa2Article and author information
Author details
Funding
National Institutes of Health (R01-EY027373)
- Stephen G Lisberger
National Institutes of Health (F30-EY027684)
- Timothy R Darlington
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Stefanie Tokiyama, Bonnie Bowell, Scott Ruffner, and Steven Happel for technical assistance, and the other members of our laboratory for helpful comments on the manuscript. We thank J Patrick Mayo for providing the figure panel found in our response to the reviews. Research supported by R01-EY027373 (SGL) and F30-EY027684 (TRD).
Ethics
Animal experimentation: All procedures received prior approval by Duke's Institutional Animal Care and Use Committee (protocol A085-18-04) and were in compliance with the National Institutes of Health's Guide for the Care and Use of Laboratory Animals.
Senior Editor
- Joshua I Gold, University of Pennsylvania, United States
Reviewing Editor
- Kunlin Wei, Peking University, China
Reviewer
- Jochen Ditterich, UC Davis, United States
Publication history
- Received: August 8, 2019
- Accepted: February 20, 2020
- Accepted Manuscript published: February 21, 2020 (version 1)
- Version of Record published: March 6, 2020 (version 2)
Copyright
© 2020, Darlington and Lisberger
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,916
- Page views
-
- 225
- Downloads
-
- 6
- Citations
Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
In value-based decision making, options are selected according to subjective values assigned by the individual to available goods and actions. Despite the importance of this faculty of the mind, the neural mechanisms of value assignments, and how choices are directed by them, remain obscure. To investigate this problem, we used a classic measure of utility maximization, the Generalized Axiom of Revealed Preference, to quantify internal consistency of food preferences in Caenorhabditis elegans, a nematode worm with a nervous system of only 302 neurons. Using a novel combination of microfluidics and electrophysiology, we found that C. elegans food choices fulfill the necessary and sufficient conditions for utility maximization, indicating that nematodes behave as if they maintain, and attempt to maximize, an underlying representation of subjective value. Food choices are well-fit by a utility function widely used to model human consumers. Moreover, as in many other animals, subjective values in C. elegans are learned, a process we find requires intact dopamine signaling. Differential responses of identified chemosensory neurons to foods with distinct growth potentials are amplified by prior consumption of these foods, suggesting that these neurons may be part of a value-assignment system. The demonstration of utility maximization in an organism with a very small nervous system sets a new lower bound on the computational requirements for utility maximization and offers the prospect of an essentially complete explanation of value-based decision making at single neuron resolution in this organism.
-
- Neuroscience
While there is a wealth of knowledge about core object recognition—our ability to recognize clear, high-contrast object images—how the brain accomplishes object recognition tasks under increased uncertainty remains poorly understood. We investigated the spatiotemporal neural dynamics underlying object recognition under increased uncertainty by combining MEG and 7 Tesla (7T) fMRI in humans during a threshold-level object recognition task. We observed an early, parallel rise of recognition-related signals across ventral visual and frontoparietal regions that preceded the emergence of category-related information. Recognition-related signals in ventral visual regions were best explained by a two-state representational format whereby brain activity bifurcated for recognized and unrecognized images. By contrast, recognition-related signals in frontoparietal regions exhibited a reduced representational space for recognized images, yet with sharper category information. These results provide a spatiotemporally resolved view of neural activity supporting object recognition under uncertainty, revealing a pattern distinct from that underlying core object recognition.