Saccadic suppression as a perceptual consequence of efficient sensorimotor estimation
Abstract
Humans perform saccadic eye movements two to three times per second. When doing so, the nervous system strongly suppresses sensory feedback for extended periods of time in comparison to movement time. Why does the brain discard so much visual information? Here we suggest that perceptual suppression may arise from efficient sensorimotor computations, assuming that perception and control are fundamentally linked. More precisely, we show theoretically that a Bayesian estimator should reduce the weight of sensory information around the time of saccades, as a result of signal dependent noise and of sensorimotor delays. Such reduction parallels the behavioral suppression occurring prior to and during saccades, and the reduction in neural responses to visual stimuli observed across the visual hierarchy. We suggest that saccadic suppression originates from efficient sensorimotor processing, indicating that the brain shares neural resources for perception and control.
https://doi.org/10.7554/eLife.25073.001eLife digest
Although we have the impression that our eyes move smoothly from place to place, we in fact perform rapid eye movements called saccades several times per second. Experiments have shown that our ability to perceive contrast and flashes decreases before and during each saccade. This phenomenon is known as saccadic suppression.
A prevailing hypothesis to explain saccadic suppression suggests that by making vision temporarily less sharp for the rapid eye movement, the nervous system discards visual information about movement and helps us to perceive the world as stable. However, this does not explain the timing of saccadic suppression. Indeed, for saccades of about 50 milliseconds, the brain begins to reduce the sharpness of vision roughly 100 milliseconds before each eye movement begins. Why does the brain discard so much visual input?
To answer this question, Crevecoeur and Kording generated a computer model that took into account three properties that previous experiments have detected in animal nervous systems. First, transferring information between the retina and the neurons that control the movement of the eyes involves delays. Second, when neurons generate commands to move the eyes, they also show random fluctuations in activity that increase with the intensity of the commands. And third, visual information can still influence eye movement during a saccade. As a result of incorporating these three properties, the model predicted optimal timings for saccadic suppression that correspond to those that occur in real life.
Visual perception and the control of eye movements have often been considered as separate functions of the brain. However, the model generated by Crevecoeur and Kording suggests that perception and the control of eye movement may in fact involve common brain regions. Further research is now needed to investigate predictions made by the model, which should provide new insights into how the brain supports vision.
https://doi.org/10.7554/eLife.25073.002Introduction
People skillfully combine acquired knowledge, and sensory feedback, a combination that is typically modeled using Bayesian statistics (Körding, 2007; Angelaki et al., 2009). This framework effectively captures behavior in numerous tasks broadly corresponding to perceptual decision-making (Ernst and Banks, 2002; van Beers et al., 1999; Fetsch et al., 2011; Drugowitsch et al., 2014; Acuna et al., 2015), or online movement control (Wolpert et al., 1995; Körding and Wolpert, 2004; Izawa and Shadmehr, 2008; Crevecoeur et al., 2016). Although perceptual decision-making and sensorimotor control are often considered different phenomena, they cannot really be dissociated in the real world – we need to use the same brain for movement and perception (Cisek, 2012; Wolpert and Landy, 2012). Perceptual decision-making and sensorimotor behaviors may thus be linked.
A salient case of crosstalk between perception and sensorimotor behavior is saccadic suppression: visual acuity is reduced around the time of a saccade. It is often assumed that this mechanism maintains stable perception of our surroundings (Wurtz, 2008). However, the behavioral and neural dynamics of saccadic suppression are difficult to explain if it were purely related to compensating for shifts in the retinal image induced by saccades and by the need to maintain perceptual stability.
Indeed, previous work has shown that saccadic suppression is controlled centrally, and typically lasts for >100 ms even for saccadic movements of ~50 ms (Ibbotson and Krekelberg, 2011). Furthermore, simulating the displacement of the retinal image without a saccade does not elicit similar suppression as during real saccades (Diamond et al., 2000; Thiele et al., 2002). As well, the reduction of visual acuity was reported to selectively impact the magnocellular pathway (Burr et al., 1994), although motion detection is still active (Castet and Masson, 2000). It is unclear why maintaining perceptual stability would require such a long, powerful, and selective suppression of sensory feedback, if it were purely related to perception, and independent of motor control. After all, there is a price to be paid to discard so much sensory information for some 100 ms. Thus, saccadic suppression is a complex phenomenon, for which a meaningful function has not been clearly identified.
Here we phrase this problem in the framework of Bayesian estimation during closed-loop control of saccades. In this framework, we show theoretically that the timing of saccadic suppression is expected if the brain uses the same posterior beliefs about the state of the eye for perception and control. Indeed, our model shows that uncertainty about the instantaneous state of the eye should increase with motor commands as a result of signal-dependent noise and of sensorimotor delays, making delayed sensory information less reliable around the time of movement. In an optimal estimation framework, this gives lower weights to sensory inputs when we move. Our study thus shows how sensorimotor control can give rise to sensory suppression in an efficient brain, provided that the nervous system uses a common substrate for perception and for control. We discuss how this theoretical result may arise from shared neural resources supporting perceptual and motor systems.
Results
An optimal control model of eye movements
If we want to explore the relationship between saccadic suppression and control we need to model the underlying system. First, the nature of the representation matters: although saccades are often simplistically viewed as ballistic (or open-loop) movements, these movements are monitored online through the corollary discharge (Van Gisbergen et al., 1981; West et al., 2009; Goossens and Van Opstal, 2000; Xu-Wilson et al., 2011; Sommer and Wurtz, 2008; Optican, 2009). Second, sensory feedback matters: we are not ‘blind’ during saccades. There is no peripheral interruption of sensory inflow, and information about specific spatiotemporal frequency or color is still good (Burr et al., 1994; Burr and Morrone, 1996). Moreover, target jumps during long saccades can influence movement (Gaveau et al., 2003). We should thus model saccades as driven by closed-loop control (Figure 1a).
To describe saccades in the context of closed loop control, we model a controller that takes the sensory feedback and the corollary discharge as input, and outputs motor commands. We employ a Linear-Quadratic-Gaussian (LQG) controller, which can deal with noise both in sensory feedback and control signals. We use a second order model for the oculomotor plant (see Materials and methods). This explicit model of saccadic control allows us to derive predictions of eye movement behaviors and gives us a control process that we can relate to saccadic suppression.
The important feature of this control design in the context of this paper is its state estimator. The control of saccadic eye movements relies on the corollary discharges as well as on sensory feedback, which jointly allow state estimation. This state estimator has two main components. The first is a forward model that dynamically updates the current estimate based on the corollary discharge (Figure 1a, bottom: Forward Model). The output is a prior estimate of the next state at the next step. The second component is the sensory extrapolation, which combines the delayed sensory feedback with the corollary discharge to estimate the current state (Figure 1a: Sensory Extrapolation, red). This sensory extrapolation is critical for the behavior of the model.
The presence of sensory extrapolation is supported by previous studies showing that error signals used to generate saccades depend on an estimate of the present state of the eye or of the target (Bennett et al., 2007; Ferrera and Barborica, 2010; Diaz et al., 2013; Blohm et al., 2005; de Brouwer et al., 2002), which clearly requires extrapolation of sensory feedback. Indeed, because the system only has access to the delayed feedback, this feedback must be extrapolated to compare it with the one step prediction, or prior. This operation does not appear explicitly in standard control models in which sensorimotor delays were considered (Izawa and Shadmehr, 2008; Crevecoeur et al., 2016; Todorov and Jordan, 2002; Crevecoeur and Scott, 2013), because these previous studies used system augmentation, and the sensory extrapolation in this case falls out of the block-structure of the model. However, this component is necessary, and ignoring it can lead to instability (Crevecoeur and Scott, 2013). In the present model, the sensory extrapolation is performed explicitly (Equation 5), which also allows us to incorporate the impact of the signal-dependent noise that accumulates over the delay interval during the extrapolation (see also Materials and methods). The model then corrects the one step prediction, weighting the difference between feedback and expected feedback optimally (Figure 1a, is the Kalman gain).
Saccades and smooth pursuit
The first behavior that our model must describe is a saccade. The model reproduces stereotyped, step-like trajectories (Figure 1b, top), like those found during real saccades. Moreover, the associated commands provide a typically wide agonist burst, followed by a short, sharp antagonistic inflection, which stabilizes the eye at the target (Figure 1b, bottom). This pattern of control, shaped by the fast time constants of the oculomotor plant, is compatible with the pattern of burst neurons that generate saccades (Van Gisbergen et al., 1981). Thus the model replicates both behavioral and physiological aspects of saccadic eye movements.
A second behavior that our model can capture is smooth pursuit. We do not imply that these two behaviors are supported by the same neural hardware, and the model does not make any prediction about their neural implementation. Instead, we simply assume that optimal state estimation underlies both saccades and pursuit, which is in agreement with the hypothesis that these movements are distinct outputs of shared sensorimotor computations (Orban de Xivry and Lefèvre, 2007; Krauzlis, 2004). The model reproduces typical responses to changes in target velocity, occurring with or without initial target jump (Figure 1c). When the target starts moving (velocity jump), position error accumulates over the delay interval, which in turn requires a rapid compensatory movement to catch up with the target (Figure 1b, light blue). Although the controller was not explicitly designed to model the interaction between saccades and pursuit, the catch-up saccade in Figure 1b naturally falls out of the simultaneous correction for errors both in position and velocity. In contrast, when the target jumps backwards at the onset of the velocity jump (Figure 1c, dark blue), the eye starts moving smoothly and there is no catch-up saccade (Rashbass, 1961). The model also reproduces corrections following perturbations applied during movement through internal monitoring of the corollary discharge, as well as online corrections for target jumps occurring during long saccades (simulations not shown). In all, the model generates typical trajectories and control commands associated with eye movements, and reproduces the dynamic estimation of the target resulting from the sensory extrapolation.
Saccadic suppression as a consequence of optimal estimation
Our muscles produce signal dependent noise; the stronger the muscles pull, the more noisy the state. The phasic activity associated with the agonist burst induces a peak in the variance of the control signal (Figure 2a, solid). Thus motor commands produce instantaneous noise, and because of the delay, there is no way for the nervous system to directly subtract or filter out this noise. As a consequence, the extrapolation error computed over an interval that includes even a fraction of the control burst has higher variance. In other words, moving the eye effectively induces visual uncertainty, which can only go back to baseline after the end of muscle activation.
The time-varying variance induced by control-dependent noise has a direct impact on the weight of retinal signals, through the Kalman gains (, Figure 2b). Recall that this matrix weights the difference between the current and expected estimates of both position and velocity, conditional upon the available visual information (see Materials and methods, , Equation 4 and Figure 1) to correct the one-step prediction. We thus focus on the weight of position feedback, as it appears closely related to saccadic suppression.
During saccades, the extrapolation variance increases as a result of signal dependent noise and of sensorimotor delays (, Equation 8). As the Kalman gain is inversely proportional to this variance, the transient increase associated with the agonist burst generates a reduction in , and thus lowers the weight of position feedback about the eye position in the state estimator. And indeed, sensory suppression is seen before and during the time of simulated saccades (Figure 2b). The period of suppression predicted by the model is long because the high variance period includes the movement time in addition to the delay (gray rectangle in Figure 2c). The model predicts that the onset of saccadic suppression should precede movement onset by a time interval equal to the delay, which was fixed to 100 ms in the model (see Materials and methods), although previous work suggested that it could be shorter (Gaveau et al., 2003). Considering that processing times in the retina approach ~50 ms (White et al., 2009), a conservative estimate for the onset of suppression according to the model ranges from 100 ms to 50 ms prior to movement onset. Our theoretical predictions thus indicate that feedback about retinal stimuli from this time window should be given less weight to optimally estimate the state of the eye.
We can also see related effects in the simulated pursuit task. The presence of a catch up saccade, even a small one (4deg in Figure 2), is sufficient to evoke a transient increase in extrapolation variance (Figure 2d–f). This results in a reduction in the weight of sensory feedback with similar timing as for larger saccades. In contrast, when the eye starts moving smoothly (Figure 2f), there is no catch-up saccade needed and the model predicts no visible change in the weight of sensory feedback. Because the model is linear, there is no transition between the simulated pursuit and saccade task, thus the apparent transition in the behavior results from the correction for the error in position that accumulates during the delay interval (Figures 1 and 2, light blue). The fact that suppression occurs for saccades specifically results from the high control signals required for these movements. In contrast, the pursuit task without a saccade uses smaller control signals that do not evoke any visible change in the weight of sensory feedback. The behavioral finding (Schütz et al., 2007) that saccades but not smooth pursuit elicit suppression of sensory feedback, and that the suppression scales with the amplitude of the catch-up saccade, directly results from this model.
Behaviorally, we can analyze data from perception experiments. According to our hypothesis, suppression should occur prior to movement onset, reach a maximum close to movement onset (Figure 3b), and scale with the movement amplitude with relatively invariant timing across amplitudes. Interestingly, this goes even down to the level of microsaccades, inducing partial suppression despite being very small in amplitude (Hafed and Krauzlis, 2010). These known properties of saccadic suppression are in line with the model prediction (Figure 3b, black): contrast sensitivity is reduced and visual stimuli such as flashes, gratings, or small displacements are less likely to be accurately perceived (Diamond et al., 2000; Burr et al., 1994; Watson and Krekelberg, 2011; Burr et al., 1999; Bridgeman et al., 1975; Beeler, 1967). This even happens when the stimuli are chosen so that the eye movement does not change the retinal image, which is compatible with the model (see the simulated contrast reduction of a white stripe, Figure 3a). Finally, although timing is preserved across amplitudes (Ibbotson and Krekelberg, 2011), the model predicts that the magnitude of suppression scales with the saccade amplitude as observed experimentally (Ridder and Tomlinson, 1997). This scaling is a direct consequence of signal-dependent noise.
A brief increase in the Kalman gain following the saccade can be observed in Figures 2 and 3. This increase is due to the fact that the absolute value of the motor command is transiently lesser than the activity required to maintain the eye at the eccentric target. Thus, during this short interval, the Kalman gain becomes greater than during the simulated fixation. This feature resembles post-saccadic enhancement, which characterizes the enhanced motor response to a velocity jump in the target following a saccade (Lisberger, 1998; Ibbotson et al., 2007). However, this transient increase in the model was not sufficient to generate a behavior similar to the one observed experimentally, despite the fact that larger differences in the Kalman gain can do so (simulations not shown). This observation and the fact that motion detection is active during saccades (Castet and Masson, 2000) suggest that the model needs further refinement to fully capture the processing of velocity signals during and after saccades.
The model also predicts changes in neural activity relative to the timing of saccadic suppression. One way to implement the Kalman gains is to simply drive neurons less strongly when there is more uncertainty. This should predict reduced firing rates around the time of saccades. Indeed, a large number of experimental studies have found such a neural suppression across the hierarchy of visual areas. (Ibbotson et al., 2008). The pathways begin with the lateral geniculate nucleus (LGN) (Reppas et al., 2002) and the superior colliculus (SC) (Hafed and Krauzlis, 2010), and continue in the cortical areas V1 (Kagan et al., 2008), MT, MST, MSTd (Ibbotson et al., 2008; Bremmer et al., 2009), and VIP (Bremmer et al., 2009) (Figure 3b, colored bars). Interestingly, the timing is very similar across brain regions, which emerges naturally from the fact that the loop through the outside world with its delays is the dominating timescale. Thus there is suppression of visual signals across the entire visual hierarchy consistent with a sensorimotor origin of saccadic suppression.
Discussion
We have presented a feedback control model that assumes signal-dependent noise and delays, and uses state estimation to optimally control eye movements. It is built on the insight that motor noise is unavoidable and produces sensorimotor uncertainty. It is also based on the key assumption that saccades are supported by closed-loop control including retinal signals. This assumption is further developed below. This model allowed us to propose the hypothesis that saccadic suppression originates from efficient sensorimotor integration. Behaviorally, it describes the dynamics of both smooth pursuit and saccades. Perceptually, it describes the suppression of sensation around the time of saccades. Neurally, it captures the reduction of neural responses to visual stimuli presented before or during saccades.
The important motivation behind this study was that cancelling the retinal shift induced by the saccade, as commonly assumed, does not explain the phenomenon of saccadic suppression. Indeed, suppression in this case should only occur when the eyes move, and should not be stronger than the moderate loss in performance associated with saccades simulated as a rapid displacement of the visual scene (Diamond et al., 2000). All discarded information beyond movement-related effects would otherwise represent a net loss (up to ~100 ms for some brain areas, Figure 3b). Thus it is clear that saccadic suppression is either very inefficient, or that maintaining a stable visual scene is just not its only purpose. We provide an alternative hypothesis that captures suppression qualitatively in the context of sensorimotor control. Rather than providing a definite answer to why suppression occurs, we highlight a plausible explanation and expect that it provide an insightful framework for interpreting data about visual processing.
Although the model is not straightforward to test experimentally, our assumption about a common origin for saccadic suppression and movement control makes testable predictions for prospective experimental work. For instance, as we suggest that perception is impaired by sensorimotor control, it is conceivable that control might be impaired by a perceptual task. That is, if it were possible to train participants to pay attention to visual stimuli displayed during saccades, thereby increasing the weight of sensory feedback, then the theory predicts that movement trajectories should become more variable as a result of suboptimal state estimation. There is already clear evidence that the locus of attention and the goal of saccadic movements are linked (Kowler et al., 1995) (and many references thereto). Here our specific prediction is that saccade trajectories should become more variable from trial to trial when participants are forced to use sensory information presented during the interval of saccadic suppression. As well, assuming that saccadic suppression is directly linked to the variance of sensory feedback through the Kalman filter, the model predicts that varying the reliability of sensory information may have an impact on the magnitude of saccadic suppression. Observe that these two predictions also assume that suppression can be flexibly modulated dependent on the behavioral context, which to our knowledge has not been documented.
In addition to capturing the major aspects of behavioral and neural suppression, our model explains the previous findings of Watson and colleagues (Watson and Krekelberg, 2011), who investigated the detection of noisy gratings in humans, and found that the best explanation for saccadic suppression was a stimulus-independent reduction in the response gain. This result is a key aspect of saccadic suppression: the retinal images do not become intrinsically noisier; instead it is the visual system that responds less to a given stimulus. Our model also accounts for this observation: by reducing the sensory weight in the Kalman gain, the controller becomes less sensitive to sensory information. This is due to the uncertainty induced by the motor commands, which is clearly independent of the retinal image. The contribution of our model is to show that such stimulus-independent reduction in response gain may be rooted in efficient computations about the state of the eye.
We propose this mechanism as a plausible origin of saccadic suppression, but cannot indicate how the visual system performs this operation at the level of neural circuits. We draw a qualitative link between Kalman filtering and the reduction in sensory weight or neural excitability, and thus this link remains speculative. However, the model does provide hints about what to look for. First, the increase in extrapolation variance clearly results from convolving the motor-dependent noise with the expected eye dynamics over the delay interval. Second, this increase is directly proportional to the integrated motor command. Thus, convolutional networks in the visual system receiving the corollary discharge as input may easily implement a reduction in the gain of neural responses that achieves statistically optimal sensory weighting. Any anatomical or functional similarity between these putative neural operations and neural data may thus provide insight into the circuitry underlying state estimation.
A compelling aspect of our model is its simplicity, as the distinct behaviors and the dynamic estimation simply fell out of the simplest instance of linear stochastic optimal control (LQG). Besides saccadic suppression, our model succeeded at the difficult task of controlling fast movements with comparatively long delays, without artificially interrupting the sensory inflow. While previous models of saccadic control tend to only consider open-loop controllers (Harris and Wolpert, 1998), or closed-loop control with internal feedback only (Optican, 2009; Jürgens et al., 1981; Chen-Harris et al., 2008), there is evidence that sensory information remains available and may influence online control. Indeed, motion detection during saccades is not suppressed (Castet and Masson, 2000), and peri-saccadic target jumps evoke adaptation (Panouillères et al., 2016). In addition, a large retinal slip prior to saccade initiation can elicit curved movements (Schreiber et al., 2006), indicating that retinal information prior to saccade onset can influence online control. Finally, Gaveau and colleagues reported partial corrections of eye trajectories following target jumps occurring during long saccades (Gaveau et al., 2003). The fact that these corrections accounted for a small proportion of the target jump can be explained in the model, as a lower weight of sensory feedback leads to only partial correction of the target jump (estimates take longer to converge to the true value). Thus, although evidence may not be definitive, these previous observations collectively suggest that sensory feedback must be considered in a model of neural control of saccades.
Based on this assumption, our model predicts that sensory feedback must be strongly reduced, but not completely suppressed, as observed experimentally (Castet and Masson, 2000). This is because the Kalman filter achieves an optimal projection in the probabilistic sense, by making the estimation error orthogonal to (or statistically uncorrelated with) the estimated state. Thus, the decrease in the Kalman gain during movement indicates that state information prior to the saccade still carries some information about the current state, and thus can be exploited to derive optimal estimates. The resulting control law (see Materials and methods, Equation 10) plays the role of a burst generator, and can be easily inserted as such in more complex models of gaze control.
We have formulated the hypothesis that saccadic suppression originates from sensorimotor processing, although suppression has been characterized behaviorally as a perceptual phenomenon. Thus our theoretical developments imply that perception and control share a common neural substrate in the visual system. There are already strong pieces of evidence for shared resources. Indeed, previous work emphasized that perception and action share estimates of target speed (Priebe and Lisberger, 2004). Recently, a strong link between saccadic suppression and visual-motor neurons has been established in superior colliculus of macaque monkeys (Chen and Hafed, 2017). Furthermore, the motion on its own must not be suppressed to maintain perceptual stability, instead it must be equal to the commanded movement monitored online, thus perception is also conditional upon the ability to integrate extra-retinal signals accurately, both during saccades and pursuit (Sommer and Wurtz, 2008; Blohm et al., 2005; Hafed and Krauzlis, 2010; Bedell and Lott, 1996).
If perceptual and sensorimotor processes were completely decoupled, posterior beliefs about sensory information could be separated from movement-related effects, and perception around the time of saccades could be as good as during simulated saccades (Figure 4, H1). Alternatively, a motor origin of saccadic suppression implies that the same posterior beliefs are shared for perception and control, which is suboptimal as it impacts perception of otherwise reliable sensory signals (Figure 4, H2). Thus the hypothesis of shared resources requires a functional explanation. Although perception on its own is suboptimal during saccades (we discard a lot of meaningful information), the shared resources model is clearly cheaper in terms of neural resources. It may thus be globally optimal to tolerate perceptual loss during saccades rather than commit to more neural resources for visual processing, considering perceptual and control systems together. Using the same posterior belief for perception and action also ensures self-consistency, in the sense that the same stimulus is not deemed more or less reliable dependent on how we use it. Self-consistency is known to characterize perceptual judgment tasks, where participants make continuous use of the hypothesis to which they previously committed (Stocker and Simoncelli, 2007). Our model suggests that similar principles may govern the use of posterior beliefs about the state of the eye for perception and control, indicating that these functions emerge from a shared neural substrate. We hope that future work will investigate whether this theory is generally applicable to other examples of active sensory suppression associated with voluntary actions such as force generation and reaching (Chapman et al., 1987; Blakemore et al., 1999; Seki et al., 2003).
Materials and methods
Biomechanical model
Request a detailed protocolWe consider a second-order, low-pass filter as a biomechanical model of the oculomotor plant. Based on previous modeling work (Robinson et al., 1986) we set the time constants to and . In the sequel, scalars are represented with lower-case characters, vectors with bold lower-case and matrices with capitals. Thus the state-space representation of the continuous-time differential equation representing the eye dynamics was:
where is the eye angle, is the eye velocity, is the command input and the dot operator is the time derivative. The explicit dependency on time was omitted for clarity. This representation takes the form
with representing the state of the system.
The plant model was then augmented with the target position and target velocity, and transformed into discrete time model to include sensorimotor noise. The discrete-time stochastic dynamics governing the change of state over time, and the equation describing the visual signals available in the brain () are as follows:
The matrices and form the discrete-time state space representation of the continuous-time system defined in Equation 1, which for a discretization step of corresponds to: , and . The constant is a scaling parameter; , and are Gaussian noise disturbances. The multiplicative noise () is a scalar with zero mean and unit variance, whereas the additive sources of noise are 4-dimensional random disturbances with zero mean and variance set to , which will be defined below. The measurement delay was in a agreement with measured and modeled latencies of rapid saccadic responses to visual stimuli (Munoz and Everling, 2004; Stanford et al., 2010). The subscript for the random noise disturbances was used to remind that these series do not have finite instantaneous variation; but they have finite variance over the discretization interval of .
The variable defined in Equation 4 represents the retinal information that is available to control the eye movement, which in the context of this paper is the state vector delayed by and corrupted by the sensory (. Thus this definition captures the hypothesis that the available sensory information is a noisy and delayed measurement of the state. Recall that the augmented state vector includes position and velocity, as well as the target position and velocity.
Closed-loop controller
Request a detailed protocolOptimal estimation and control of the stochastic system defined in Equations 3 and 4 can be derived in the framework of extended Linear-Quadratic-Gaussian control (LQG), including the effect of control and state-dependent noise (Todorov, 2005). However this approach is not necessarily well suited for handling sensorimotor delays because it requires system augmentation (Crevecoeur and Scott, 2013), and as a consequence the estimator achieves optimal (probabilistic) projection of the prior estimate onto the delayed state measurement (Anderson and Moore, 1979). Since we know that the visual system extrapolates sensory information to compute the present state of the eye or of a moving target (Bennett et al., 2007; Ferrera and Barborica, 2010; Diaz et al., 2013; Blohm et al., 2005), we were interested to derive an optimal estimator that explicitly extrapolates sensory signals, captured in , over the interval (see also Figure 2). The key aspect of this estimator design is that, by taking into account the control function , the variance of the extrapolated sensory signal is dynamically adjusted as a function of the control-dependent noise (3rd term of Equation 3).
More precisely, we assume that neural processing of sensory signals consists in computing an estimate of the present state of the eye given the delayed sensory signals as follows:
Using the notation , it is easy to observe that the extrapolation error () follows a Gaussian distribution defined as follows:
where was defined in agreement with the unit-variance Brownian noise disturbance considered for the stochastic differential equation.
With these definitions, we can derive an adaptive estimator based on standard Kalman filtering using the extrapolated state (Equation 8) instead of the available state measurement (Equation 4). The state estimate is computed in two steps as follows:
and the Kalman gain, , as well as the covariance of the estimated state are updated iteratively following standard procedures (Anderson and Moore, 1979). Observe from Equation 10 that a reduction in the Kalman gain has a direct impact on the use of visual feedback through the relationship between this feedback () and the sensory extrapolation (, Equation 5). In other words, visual information conveyed in the sensory feedback participates less to the estimation when the Kalman gain is low.
Observe that the separation principle does not hold because the variances of the one-step prediction and of both depend on . Thus our approach is valid under the assumption that the control must not be jointly optimized with the state estimator. Instead of optimizing iteratively the controller and the state estimator as in the extended LQG framework (Todorov, 2005; Phillis, 1985), we computed the controller independently based on the heuristic assumption that the separation principle applied, and then optimized the state estimator defined in Equations 9–10 by taking into account the effect of control-dependent noise explicitly (Equations 6–8). The controller was thus obtained by solving the LQG control problem while ignoring the multiplicative noise in Equation 3 as follows:
In Equation 11, represents the cost of motor commands, and the matrices are computed offline following standard procedures (Todorov, 2005; Astrom, 1970).
We developed this approach to include the extrapolation of sensory data while considering the control over the delay interval explicitly. Using feedback control based on a predicted state is known as finite spectrum assignment (FSA), which is germane to a Smith predictor in that it aims at removing the delay from the feedback loop (Zhong, 2010). Here, FSA was chosen to reconstruct the predicted state (instead of the system output as for the Smith predictor), allowing the use of position and velocity estimates in the control law (Equation 11).
Numerical simulations
Request a detailed protocolThe only free parameters are (the scaling of the signal dependent noise), the covariance matrices of and (respectively and ), and the cost-function used for control. We used the following values: the constant was set to , was and was times the identity matrix of appropriate dimension. These parameters were manually adjusted so that when adding the signal-dependent term to the variance of the extrapolation error (Equation 8), the Kalman gains converged to steady-state values and the variances of the extrapolated state and of the motor noise were comparable during fixation. It is clear that changing the noise parameters may influence the results qualitatively. However the key feature of the adaptive estimator is that the extrapolation variance increases monotonically with the square of the motor command, which is why the extrapolated measurement is dynamically reduced during movement. This aspect does not depend on the different noise parameters.
The cost parameters were adjusted to generate simulated saccades compatible with typical recordings of eye movements in humans, and these parameters do not impact the results qualitatively. For saccadic movements, we simulated two fixation periods at the initial () and final () targets during which the cost of position error was . The two fixation periods were separated by the movement time, which was a 50 ms window during which the eye was free to move without any penalty on the state vector. For the smooth movements in response to velocity jumps, we simulated a fixation to the target and changed the target state during a simulation run. The cost of motor commands in all cases was , with . Finally we used a discretization step of 5 ms.
One difficulty is that the extrapolation requires that all state variables, including the target, be observed independently (Equation 4). This is not fully compatible with the visual system, because there is no measurement of the target state independent of the state of the eye. This limitation could be overcome by considering another observer that reconstructs the state vector prior to extrapolating the sensory feedback. Here, instead of considering such additional observer, we injected similar amounts of signal-dependent noise in the sensory feedback about the state of the eye as about the state of the target. This procedure was chosen for simplicity and captures the intuitive idea that if the eye position is very noisy, then information about the target location logically shares the same uncertainty.
References
-
Multisensory integration: psychophysics, neurophysiology, and computationCurrent Opinion in Neurobiology 19:452–458.https://doi.org/10.1016/j.conb.2009.06.008
-
BookIntroduction to Stochastic Control Theory Vol. 70United States: Academic Press.https://doi.org/10.1016/s0076-5392(09)x6015-7
-
Target acceleration can be extracted and represented within the predictive drive to ocular pursuitJournal of Neurophysiology 98:1405–1414.https://doi.org/10.1152/jn.00132.2007
-
Spatio-temporal prediction modulates the perception of self-produced stimuliJournal of Cognitive Neuroscience 11:551–559.https://doi.org/10.1162/089892999563607
-
Processing of retinal and extraretinal signals for memory-guided saccades during smooth pursuitJournal of Neurophysiology 93:1510–1522.https://doi.org/10.1152/jn.00543.2004
-
Neural dynamics of saccadic suppressionJournal of Neuroscience 29:12374–12383.https://doi.org/10.1523/JNEUROSCI.2908-09.2009
-
Saccadic suppression precedes visual motion analysisCurrent Biology 9:1207–1209.https://doi.org/10.1016/S0960-9822(00)80028-7
-
Motion perception during saccadic eye movementsNature Neuroscience 3:177–183.https://doi.org/10.1038/72124
-
Sensory perception during movement in manExperimental Brain Research 68:516–524.https://doi.org/10.1007/BF00249795
-
Adaptive control of saccades via internal feedbackJournal of Neuroscience 28:2804–2813.https://doi.org/10.1523/JNEUROSCI.5300-07.2008
-
Making decisions through a distributed consensusCurrent Opinion in Neurobiology 22:927–936.https://doi.org/10.1016/j.conb.2012.05.007
-
Dynamic multisensory integration: somatosensory speed trumps visual accuracy during feedback controlThe Journal of Neuroscience 36:8598–8611.https://doi.org/10.1523/JNEUROSCI.0184-16.2016
-
What triggers catch-up saccades during visual tracking?Journal of Neurophysiology 87:1646–1650.https://doi.org/10.1152/jn.00432.2001
-
Extraretinal control of saccadic suppressionJournal of Neuroscience 20:3449–3455.
-
Internally generated error signals in monkey frontal eye field during an inferred motion taskJournal of Neuroscience 30:11612–11623.https://doi.org/10.1523/JNEUROSCI.2977-10.2010
-
Neural correlates of reliability-based cue weighting during multisensory integrationNature Neuroscience 15:146–154.https://doi.org/10.1038/nn.2983
-
Blink-perturbed saccades in monkey. I. behavioral analysisJournal of Neurophysiology 83:3411–3429.
-
BookDynamics of Visual Motion Processing: Neural Behavioral, and Computatiional ApproachesIlg UJ, Masson GS, editors. United States: Springer.
-
Visual perception and saccadic eye movementsCurrent Opinion in Neurobiology 21:553–558.https://doi.org/10.1016/j.conb.2011.05.012
-
On-line processing of uncertain information in visuomotor controlJournal of Neuroscience 28:11360–11368.https://doi.org/10.1523/JNEUROSCI.3063-08.2008
-
The role of attention in the programming of saccadesVision Research 35:1897–1916.https://doi.org/10.1016/0042-6989(94)00279-U
-
Recasting the smooth pursuit eye movement systemJournal of Neurophysiology 91:591–603.https://doi.org/10.1152/jn.00801.2003
-
Postsaccadic enhancement of initiation of smooth pursuit eye movements in monkeysJournal of Neurophysiology 79:1918–1930.
-
Look away: the anti-saccade task and the voluntary control of eye movementNature Reviews Neuroscience 5:218–228.https://doi.org/10.1038/nrn1345
-
Saccades and pursuit: two outcomes of a single sensorimotor processThe Journal of Physiology 584:11–23.https://doi.org/10.1113/jphysiol.2007.139881
-
Controller design of systems with multiplicative noiseIEEE Transactions on Automatic Control 30:1017–1019.https://doi.org/10.1109/TAC.1985.1103828
-
Estimating target speed from the population response in visual area MTJournal of Neuroscience 24:1907–1916.https://doi.org/10.1523/JNEUROSCI.4233-03.2004
-
The relationship between saccadic and smooth tracking eye movementsThe Journal of Physiology 159:326–338.https://doi.org/10.1113/jphysiol.1961.sp006811
-
A comparison of saccadic and blink suppression in normal observersVision Research 37:3171–3179.https://doi.org/10.1016/S0042-6989(97)00110-7
-
A model of the smooth pursuit eye movement systemBiological Cybernetics 55:43–57.https://doi.org/10.1007/BF00363977
-
Asynchrony between position and motion signals in the saccadic systemJournal of Neurophysiology 95:960–969.https://doi.org/10.1152/jn.00315.2005
-
Sensory input to primate spinal cord is presynaptically inhibited during voluntary movementNature Neuroscience 6:1309–1316.https://doi.org/10.1038/nn1154
-
Perceptual decision making in less than 30 millisecondsNature Neuroscience 13:379–385.https://doi.org/10.1038/nn.2485
-
A Bayesian model of conditioned perceptionAdvances in Neural Information Processing Systems 2007:1409–1416.
-
Neural mechanisms of saccadic suppressionScience 295:2460–2462.https://doi.org/10.1126/science.1068788
-
Optimal feedback control as a theory of motor coordinationNature Neuroscience 5:1226–1235.https://doi.org/10.1038/nn963
-
Integration of proprioceptive and visual position-information: an experimentally supported modelJournal of Neurophysiology 81:1355–1364.
-
A quantitative analysis of generation of saccadic eye movements by burst neuronsJournal of Neurophysiology 45:417–442.
-
An equivalent noise investigation of saccadic suppressionJournal of Neuroscience 31:6535–6541.https://doi.org/10.1523/JNEUROSCI.6255-10.2011
-
Color-related signals in the primate superior colliculusJournal of Neuroscience 29:12159–12166.https://doi.org/10.1523/JNEUROSCI.1986-09.2009
-
Motor control is decision-makingCurrent Opinion in Neurobiology 22:996–1003.https://doi.org/10.1016/j.conb.2012.05.003
-
Neuronal mechanisms of visual stabilityVision Research 48:2070–2089.https://doi.org/10.1016/j.visres.2008.03.021
-
TMS perturbs saccade trajectories and unmasks an internal feedback controller for saccadesJournal of Neuroscience 31:11537–11546.https://doi.org/10.1523/JNEUROSCI.1584-11.2011
Article and author information
Author details
Funding
Fonds De La Recherche Scientifique - FNRS (1.B.087.15F)
- Frederic Crevecoeur
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
The authors would like to thank G Blohm for comments on an earlier version of this manuscript. FC is supported by a grant from F.R.S.-FNRS (grant number: 1.B.087.15F Chargé de Recherches, Belgium) and by grants of the Interuniversity Attraction Poles of the Belgian Science Policy (IPA Network on Dynamical Systems, Control and Optimization, DYSCO).
Copyright
© 2017, Crevecoeur et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,206
- views
-
- 343
- downloads
-
- 34
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Computational and Systems Biology
- Neuroscience
The basolateral amygdala (BLA) is a key site where fear learning takes place through synaptic plasticity. Rodent research shows prominent low theta (~3–6 Hz), high theta (~6–12 Hz), and gamma (>30 Hz) rhythms in the BLA local field potential recordings. However, it is not understood what role these rhythms play in supporting the plasticity. Here, we create a biophysically detailed model of the BLA circuit to show that several classes of interneurons (PV, SOM, and VIP) in the BLA can be critically involved in producing the rhythms; these rhythms promote the formation of a dedicated fear circuit shaped through spike-timing-dependent plasticity. Each class of interneurons is necessary for the plasticity. We find that the low theta rhythm is a biomarker of successful fear conditioning. The model makes use of interneurons commonly found in the cortex and, hence, may apply to a wide variety of associative learning situations.
-
- Cancer Biology
- Computational and Systems Biology
Effects from aging in single cells are heterogenous, whereas at the organ- and tissue-levels aging phenotypes tend to appear as stereotypical changes. The mammary epithelium is a bilayer of two major phenotypically and functionally distinct cell lineages: luminal epithelial and myoepithelial cells. Mammary luminal epithelia exhibit substantial stereotypical changes with age that merit attention because these cells are the putative cells-of-origin for breast cancers. We hypothesize that effects from aging that impinge upon maintenance of lineage fidelity increase susceptibility to cancer initiation. We generated and analyzed transcriptomes from primary luminal epithelial and myoepithelial cells from younger <30 (y)ears old and older >55y women. In addition to age-dependent directional changes in gene expression, we observed increased transcriptional variance with age that contributed to genome-wide loss of lineage fidelity. Age-dependent variant responses were common to both lineages, whereas directional changes were almost exclusively detected in luminal epithelia and involved altered regulation of chromatin and genome organizers such as SATB1. Epithelial expression of gap junction protein GJB6 increased with age, and modulation of GJB6 expression in heterochronous co-cultures revealed that it provided a communication conduit from myoepithelial cells that drove directional change in luminal cells. Age-dependent luminal transcriptomes comprised a prominent signal that could be detected in bulk tissue during aging and transition into cancers. A machine learning classifier based on luminal-specific aging distinguished normal from cancer tissue and was highly predictive of breast cancer subtype. We speculate that luminal epithelia are the ultimate site of integration of the variant responses to aging in their surrounding tissue, and that their emergent phenotype both endows cells with the ability to become cancer-cells-of-origin and represents a biosensor that presages cancer susceptibility.