Figures and data

Construction of flight control models for singly presented visual patterns.
(A) Schematic of the experimental setup (left), a frame captured by the infrared camera (middle), and a simplified schematic of the setup (right). The annulus surrounding the fly schematic represents the visual display as viewed from above. (B) Wing responses of a sample fly to three rotating visual patterns: bar, spot, and grating. The bottom row (L-R WBA) represents the angular torque of the fly, calculated by subtracting the right wingbeat amplitude (RWBA) from the left wingbeat amplitude (LWBA). (C) L-R WBA traces of a sample fly in response to the three visual patterns. The thick black lines indicate the average across all trials (top) or all flies (bottom). Thin gray lines indicate individual trials (top) or fly averages (bottom). (D) Schematic of the position-velocity-based flight control model. (E) Average wing responses of a population of flies to the three visual patterns, rotating either in a clockwise (red) or counterclockwise (blue) direction. Top traces show the position of each pattern. Red and blue shadings at the bottom indicate the 95% confidence interval. (F) Position and velocity functions estimated from the wing responses in E. Light purple shadings indicate the 95% confidence interval.

The flight control models with a biomechanics block predicted the dynamics of the steering behavior to individual visual patterns.
(A) Schematics of three visuomotor response models with a biomechanics block. (B) Simplified version of the position and velocity responses for each pattern. (C) Simulation results for the three patterns (bar, spot, and grating) moving in a sigmoidal dynamics. The spot response was plotted with an 180° offset to facilitate comparison. Bar plots on the right show the latency of body angle with respect to the stimulus onset, measured at the 50% point of the pattern movement. (D) Simulation results for the three patterns moving in a sinusoidal dynamics. In the bar plots on the right, the amplitude was measured as the peak-to-peak amplitude, and the phase shift was calculated by measuring the peak time of the cross-correlation between the pattern and the fly heading. (E) Same as in (C), but for visual patterns remaining static at 0 degree position. The simulation was performed 10 times with a Gaussian noise component (gray lines). The mean response was plotted in thick colored lines. The probability density function of the body angle is shown on the right for each pattern.

Magnetically tethered flight experiments confirmed orientation changes predicted by the virtual fly model.
(A) Schematic of the magnetically tethered flight assay with an LED display (left). The image acquired from below was analyzed to estimate the body angle (right). The stimulus protocol (bottom) consisted of four phases: alignment, ready, go, and freeze. (B) Body orientation responses of a single fly for the bar, spot and grating patterns moving horizontally. (C) Same as in (B), but for a population of flies. The population averages were replotted at the bottom to facilitate the comparison of their dynamics. (D) Amplitude and latency of the body orientation responses. The box represents the interquartile range (IQR), with the median indicated by the horizontal black line. The whiskers extend to the minimum and maximum values within 1.5 times the IQR. Outliers are denoted by “+” marks beyond the whiskers.

Three integrative models of the visuomotor control and their predictions in a complex visual environment.
(A) Schematic of the visual environments used in the simulation. A moving bar is presented as a foreground object over a static grating background. (B) A diagram of the addition-only model. Object and background response circuits are joined at their output through addition. (C) A diagram of the graded EC model. An EC block translates the object-evoked motor command into the negative image of the predicted background input to counteract visual feedback. (D) A diagram of the all-or-none EC model. An EC switches off the background response circuit during the object-evoked turn. (E,F,G) Simulation results for the three models. The object position and the heading of the virtual fly model (top), and the associated torques as well as EC signals (bottom). EC signals (ε and η) and the fly velocity at the bottom plots of (F) and (G) are not to scale.

Bar- and background-evoked wing responses did not suppress each other when presented in time close to each other.
(A) The visual stimulus patterns. A dense starfield background moved either clockwise or counterclockwise by 45 degrees, while the bar always moved clockwise by 45 degrees. (B) A superposition pattern in which the background moves first, followed by the bar 100 ms later. tBG and tbar indicate the onset times of the stimuli. (C) Body angle measured in response to the superposition patterns. The onset time difference varied between −200 ms, 0 ms, and 200 ms. The background moved either clockwise or counterclockwise (n = 34 - 43 flies). (D) Wing response amplitude measured from the dataset used in (C). Error bars indicate the 95% confidence interval. (E) The background response component was estimated by computing the difference between body angle traces with the same onset latency but opposite background movement directions (n = 29 flies). (F) The background (BG) response component was estimated by averaging the body angle traces with the same onset latency but opposite background movement directions. (G,H) The amplitudes of the background and bar response components did not change significantly across different onset latencies (one-way ANOVA). (H) When the same experiments were conducted with different onset latencies and a shorter BG response, the response components for the bar and background remained unchanged across different onset latencies (n = 18 flies).

Loom- and background motion–evoked steering responses exhibit mutual suppression.
(A) Visual stimulus patterns. (B) Superposition patterns, where background rotation began 300 ms before loom pattern onset. (C) Body angle changes in response to the superposition patterns with varying onset latencies. (D) Amplitude of body angle changes in response to the superposition patterns (n = 21 - 24 flies). (E) The background response component was estimated by calculating the difference between body angle responses to superposition patterns with the same onset latency but opposite background rotation directions, then halving this difference (n = 21 flies). (F) Amplitude of the background response component, measured as the difference between the average body angle during the 200 ms period immediately before background movement onset and the average body angle during the 200 ms period starting 400 ms after background movement onset. (G) The loom response component was estimated by summing body angle responses with the same onset latency but opposite background movement directions, then halving this sum. (H) Amplitude of the loom response component, measured as the difference between the average body angle during the 200 ms period immediately before loom movement onset and the average body angle during the 200 ms period starting 400 ms after loom onset.

Dynamics of object-evoked flight turns were not affected by the background-dependent optic flow intensity.
(A) Temporal profile of the visual stimulus used to test the bar response when the background changes from the uniform to the dense-dot background. In each frame, the horizontal midline of the display is sampled and plotted over time (top). Sample pattern images at the moment of the bar movement onset (bottom middle). (B) Body angle changes to the rotation of the random dot backgrounds in two different densities (left). The amplitude is significantly larger for the dense background than the sparse one (right, Wilcoxon rank sum test). The background pattern was moved horizontally by 45 degrees in 200 ms. (C) Average body orientation traces in response to horizontally moving bars when the initial uniform, bright background is kept the same or changed to one of the two random-dot backgrounds. The thick colored lines in the top plots represent the population average, whereas the gray lines represent an average for individual flies. Box-and-whisker plots depict the amplitude (middle) and latency (bottom) of the body angle change. Error bars (bottom) indicate 95% confidence interval. (D) Same as in (C), but for different combinations of background patterns.