Computations underlying Drosophila photo-taxis, odor-taxis, and multi-sensory integration
Abstract
To better understand how organisms make decisions on the basis of temporally varying multi-sensory input, we identified computations made by Drosophila larvae responding to visual and optogenetically induced fictive olfactory stimuli. We modeled the larva's navigational decision to initiate turns as the output of a Linear-Nonlinear-Poisson cascade. We used reverse-correlation to fit parameters to this model; the parameterized model predicted larvae's responses to novel stimulus patterns. For multi-modal inputs, we found that larvae linearly combine olfactory and visual signals upstream of the decision to turn. We verified this prediction by measuring larvae's responses to coordinated changes in odor and light. We studied other navigational decisions and found that larvae integrated odor and light according to the same rule in all cases. These results suggest that photo-taxis and odor-taxis are mediated by a shared computational pathway.
https://doi.org/10.7554/eLife.06229.001eLife digest
Living organisms can sense cues from their surroundings and respond in appropriate ways. For example, animals will often move towards the smell of food or away from potential threats, such as predators. However, it is not fully understood how an animal's nervous system is set up to allow sensory information to control how the animal navigates its environment. It is also not clear how animals ‘decide’ what to do when they receive conflicting information from different senses.
Optogenetics is a technique that allows neuroscientists to control the activities of individual nerve cells simply by shining light on to them. Fruit fly larvae have a simple but well-studied nervous system, and they are nearly transparent, so scientists can use optogenetics to activate nerve cells in freely moving larvae.
Fruit fly larvae move in a series of forward ‘runs’ and direction-changing ‘turns’ and use sensory cues to decide when to turn, how large of a turn to make, and whether to turn left or right. Gepner, Mihovilovic Skanata et al. used optogenetics to stimulate different combinations of sensory nerve cells in larvae, while tracking the larvae's movements to discover exactly what information they used to make these decisions. An independent study by Hernandez-Nunez et al. also used a similar approach.
Fruit fly larvae are attracted towards scents from rotting fruit and are repelled by light—in particular, larvae are most sensitive to blue light but cannot detect red light. Therefore, Gepner, Mihovilovic Skanata et al. could expose the larvae to blue light to activate light-sensing nerve cells as normal, and use red light to activate odor-sensing nerve cells via optogenetics. These experiments showed that larvae changed direction more often when the level of blue light was increased or when the level of red light (which simulated the detection of odors from rotting fruits) was decreased.
Analysis of the data from these experiments revealed that larvae essentially assign negative values to the blue light and positive values to the ‘odor-mimicking’ red light. The larvae then use the sum of these two values to dictate their next move. This suggests that navigation in response to both light and odors is supported by the same pathways in a larva's nervous system.
The approach of using optogenetics in combination with quantitative analysis, as used in these two independent studies, is now opening the door to a more complete understanding of the connections between the activities of sensory nerve cells and perception and behavior.
https://doi.org/10.7554/eLife.06229.002Introduction
Many small organisms navigate their environments by decoding temporal variations in receptor activity to bias motor output decisions (Berg and Brown, 1972; Sawin et al., 1994; Pierce-Shimomura et al., 1999; Ryu and Samuel, 2002; Fishilevich et al., 2005; Louis et al., 2008; Luo et al., 2008, 2010; Albrecht and Bargmann, 2011; Gomez-Marin et al., 2011; Lockery, 2011; Gershow et al., 2012; Kane et al., 2013). The dynamics of these organisms' decision-making are intimately linked to the properties of the underlying chemical or neural substrates (Segall et al., 1986; Korobkova et al., 2004; Miller et al., 2005; Chronis et al., 2007; Clark et al., 2007; Emonet and Cluzel, 2008; Suzuki et al., 2008; Asahina et al., 2009; Shimizu et al., 2010; Bretscher et al., 2011; Busch et al., 2012; Kato et al., 2014; Luo et al., 2014). In their natural environments, animals are confronted with variable and frequently conflicting inputs arriving via multiple sensory pathways. How these simple organisms respond to multi-modal stimuli and how their neural circuits integrate and prioritize multi-sensory information remains unknown.
We sought to decode the computations underlying the Drosophila larva's response to visual and olfactory cues, when presented individually or in combination. The second instar larva uses a similar strategy for navigating environments with spatially varying odor concentrations, light levels, and temperatures. Larvae move forward in a series of relatively straight runs interspersed with reorienting turns, and increase the frequency and magnitude of their turns in response to unfavorable changes in the stimulus (Sawin et al., 1994; Busto et al., 1999; Scantlebury et al., 2007; Louis et al., 2008; Luo et al., 2010; Gomez-Marin et al., 2011; Gershow et al., 2012; Kane et al., 2013; Klein et al., 2014). During turns, larvae survey the local environment using side-to-side head sweeps to determine the direction of the next run (Sawin et al., 1994; Luo et al., 2010; Gomez-Marin et al., 2011; Gershow et al., 2012; Kane et al., 2013; Klein et al., 2014). That the larva uses the same strategy to respond to a variety of stimuli suggests navigation may be mediated by a single circuit that combines input from the various sensory organs. Alternately, this apparent commonality might result from the larva's limited repertoire of motor outputs with which to implement a navigational response. Perhaps, independent circuits mediate the ‘decision’ portion of each navigational algorithm and only converge at the motor output level (Frye and Dickinson, 2004).
We sought a computational model that could describe the transformation from sensory input to navigational decisions for uni- and multi-modal stimuli and that could differentiate between shared and parallel navigational circuits. The Linear-Nonlinear-Poisson (LNP) model (Chichilnisky, 2001; Dayan, 2001; Ringach and Shapley, 2004; Bialek and van Steveninck, 2005; Schwartz et al., 2006; Kim et al., 2011) is widely used to relate time-varying input to stochastic output. In this model, decisions (e.g., to initiate a turn, Figure 1A,B) are generated according to a Poisson process whose underlying rate at time t is:
where S(t) is the input signal, A is a linear filter, and f is a static nonlinear function (Figure 1B). Thus for uni-modal inputs, we aimed to develop models of the form:
where and are the outputs of the linear filters for odor and for light, respectively. For multi-modal input, we sought either a model in which turns are initiated independently by separate circuits
or one in which odor and light information are combined more generally
Results
Reverse-correlation with visual and fictive olfactory stimuli
We began by exploring larvae's responses to uni-modal stimuli. Drosophila larvae avoid light and carbon dioxide and are attracted to Ethyl Acetate (EtAc). The sensory input pathways are well-characterized for each of these stimuli. The larva's navigational response to light is mediated primarily by four photoreceptor neurons in each of two primitive eye-spots (Hassan et al., 2005; Sprecher and Desplan, 2008; Keene et al., 2011; Keene and Sprecher, 2012; Kane et al., 2013). A single pair of Gr21a expressing receptor neurons mediates the larva's CO2 response (Python and Stocker, 2002; Faucher, 2006; Jones et al., 2007; Kwon et al., 2007). Or42a and Or42b are the primary EtAc olfactory receptors (Kreher et al., 2005, 2008; Asahina et al., 2009), and larvae are capable of decoding odor gradients on the basis of only Or42a or Or42b receptor neurons (Louis et al., 2008; Asahina et al., 2009).
Larvae initiate turns in response to increasing light intensities (Sawin et al., 1994; Hassan et al., 2005; Scantlebury et al., 2007; Kane et al., 2013) and carbon dioxide concentrations (Gershow et al., 2012) and decreasing EtAc concentrations (Gomez-Marin et al., 2011; Gershow et al., 2012). To investigate the larva's decision to turn in response to visual cues, we presented 448 nm blue light to wild-type larvae. To probe olfactory computations, we expressed UAS-CsChrimson (Klapoetke et al., 2014), a red light activable cation channel, in Gr21a, Or42a, and Or42b receptor neuron pairs. We used 655 nm red light (outside the sensitive range of the larva's visual pigments [Salcedo et al., 1999]) to activate these neurons while presenting a constant dim blue light background (Klapoetke et al., 2014) to mask any visual response to the red light.
We presented groups of larvae with fluctuating levels of red or blue light and analyzed their resulting behaviors using machine vision software (Gershow et al., 2012) to identify each navigational decision (Figure 1C-1). We determined the parameters of the LNP model by measuring the reverse-correlation (Chichilnisky, 2001; Dayan, 2001; Westwick et al., 2003; Ringach and Shapley, 2004; Bialek and van Steveninck, 2005; Schwartz et al., 2006; Kim et al., 2011; Klein et al., 2014, Theobald et al., 2010) between the stimulus and evoked behaviors (Figure 1C, Video 1).
For light, odor, and carbon dioxide, the derivative of stimulus intensity is more salient to larvae than the stimulus value itself (Gomez-Marin et al., 2011; Gershow et al., 2012; Kane et al., 2013; Gomez-Marin and Louis, 2014). Typically in reverse-correlation experiments, rapidly changing uncorrelated stimulus intensities are provided (e.g. by choosing random binary values, random normally distributed values, or values from an M-sequence). Because of regression to the mean, these sequences have derivatives that are anticorrelated on time scales longer than the update period. Thus, if we provided uncorrelated stimulus intensities and larvae turned in response to an increase in light, we would expect an average decrease in light after turns. This would complicate analyses of decisions, like whether to accept or reject a head sweep, the larva makes following a turn. We therefore chose a stimulus optimized for analysis of the larva's response to derivatives, a Brownian random walk, whose derivatives (on all time scales) are independent identically distributed Gaussian variables.
Computations underlying the decision to turn in response to visual or olfactory stimuli
First, we computed the turn-triggered average (TTA) of the light intensity derivatives (Figure 2A). We found: wild-type larvae turn in response to an increase in blue light but were unresponsive to red light masked by dim blue light (even when fed all-trans-retinal); larvae expressing CsChrimson in EtAc sensing neurons (Or42a>CsChrimson, Or42b>CsChrimson) turned in response to a decrease in red light; and larvae expressing CsChrimson in the CO2 receptor (Gr21a>CsChrimson) turned in response to an increase in red light. These results match the larva's strategies for navigating static gradients of natural stimuli; turning in response to increases in light, decreases in EtAc, and increases in CO2. In all cases (excepting the wild-type red-light control), larvae considered changes over the previous ∼2.5 s when deciding to turn, and derivatives were maximally salient about 0.6–0.8 s before a turn was actually initiated.
For each set of reverse-correlation experiments, we used the TTA as the convolution kernel to calculate the linear filter outputs and computed the turn rate as a nonlinear function of the filter output (Figure 2B). To test the predictive power of the LNP model, we presented larvae with light intensity square waves. We compared the resulting turn rates to those predicted by our LNP model fits (Figure 2C). The cyan lines in Figure 2C show the exact predictions of the model, with no free parameters. We found that in all cases, except for Gr21a>CsChrimson, the step response has a longer duration than predicted by the LNP model, and there is an unpredicted sustained decrease in turn rate following a favorable change (at t = 0), but given the inherent variability of behavior and the simplicity of the LNP model, the reverse-correlation experiments predicted the temporal course of the larva's response to step changes surprisingly well.
We were concerned that over the course of the 20 min behavioral experiments, continuous exposure to red light might exhaust the ability of CsChrimson to excite neural activity or that larvae might adapt to the stimulus presentation and cease responding. To test whether this was the case, we separately analyzed the first and second 10 min of the experiments (Figure 2—figure supplement 1). In all cases, we recovered the same TTA (Figure 2—figure supplement 1A) using data from only the first 10 min, only the second 10 min, or the entire data set. We found that for visual and attractive odor inputs, the slope of the nonlinear function was steeper (Figure 2—figure supplement 1B) in the first 10 min than in the second 10, indicating larvae were slightly less responsive to stimulus changes in the latter half of the experiments. For fictive CO2, on the other hand, we found that larvae were actually more responsive in the second 10 min, representing sensitization rather than adaptation. In all cases, the results for the two halves of the experiments were similar enough to justify using all 20 min of data in our analyses. To test the self-consistency of our model, we used the parameters extracted from the first 10 min of experiments to predict the larva's turning rate in the second 10 min (Figure 2—figure supplement 1C). We found excellent agreement between predictions and measurements at lower turn rates. At higher turn rates, we found that in the second 10 min, larvae turned less than predicted for light and attractive odor cues and more than predicted for CO2 cues, again reflecting modest adaptation and sensitization.
Computations determining turn size and turn direction
Next, we explored how larvae bias the size and directions of turns. Larvae make larger turns when subjected to unfavorably changing conditions (Luo et al., 2010; Gershow et al., 2012; Kane et al., 2013), so we calculated the TTA for large and small turns separately (Figure 2D). For approximately 10–15 s prior to the start of large turns, there was an average gradual increase in blue light levels for visual experiments, and an average gradual decrease in red light levels for Or42a>CsChrimson and Or42b>CsChrimson experiments. Over the same time period, for small turns, there was a slight average decrease in blue light and increase in red light. Interestingly, immediately prior to the initiation of a turn, the average change in stimulus was the same for large and small turns. Thus, larvae consider the change in light intensity and attractive odor concentration over the previous 10–15 s when deciding the size of their turns, but the size of the stimulus change that leads the larva to actually initiate a turn appears not to influence turn size. In contrast, for Gr21a>CsChrimson larvae, the size of a turn was determined by the magnitude of the increase immediately preceding a turn.
After initiating turns, larvae use head-sweeps as probes to find a favorable direction for the next run (Luo et al., 2010; Gomez-Marin et al., 2011; Gershow et al., 2012; Kane et al., 2013; Gomez-Marin and Louis, 2014; Klein et al., 2014). Head-sweeps in favorable directions are more likely to be accepted, beginning a new run in that direction. Head-sweeps in unfavorable directions are more likely to be rejected, resulting in one or more additional head-sweeps. To characterize the larva's decision to accept or reject a head-sweep, we measured the head-sweep triggered average, aligned to the start of a head-sweep, separately for rejected and accepted head-sweeps (Figure 2E). All head-sweep triggered averages show a large change immediately before the start of the head-sweep; this is the stimulus change that triggered the larva's decision to turn. We found that during accepted head-sweeps, average blue light levels and Gr21a activity decreased and Or42a and Or42b activity increased, all favorable changes. During rejected head-sweeps, the reverse was true: average blue light and Gr21a activity levels increased and Or42a and Or42b activity decreased. Surprisingly, for Gr21a>CsChrimson larvae, larger increases in activity prior to the head-sweep start led to an increased probability of rejecting the head-sweep.
Our uni-modal experiments showed that CsChrimson induced activity in olfactory neurons evokes navigational behaviors and that reverse correlation can be used to identify both visual and olfactory computations. We also found that activity in CO2 receptor neurons is interpreted according to different rules than for light or attractive odors.
Odor-light integration—computations underlying the decision to turn
We next asked how the larva integrates visual and olfactory information when making navigational decisions. We carried out reverse-correlation experiments with simultaneous uncorrelated light and attractive odor stimuli, using dim blue light to activate the visual system and intense red light to activate CsChrimson expressed in Or42a receptor neurons. We found the TTA for both signals (Figure 3A), and we applied the resulting filters to our input signals to find xO(t) and xL(t), the outputs of the linear odor and light filters, at each point in time. We scaled the filters so that xO(t) and xL(t) had unit variance in the stimulus ensemble (Pillow and Simoncelli, 2006). To determine whether the larva's turning decisions result from independent olfactory and visual pathways, we examined the statistics of the turn-triggered ensemble (Figure 3B). In our white noise experiments, xO(t) and xL(t) are independent Gaussian variables with mean 0, so it can be shown (Bialek and van Steveninck, 2005)
In general, this value will be nonzero, but in the independent pathways model (Figure 3C, Figure 3—figure supplement 1), the mixed partial derivative is identically 0, so
In fact, we found , disfavoring the independent pathways hypothesis.
If larvae integrate odor and light information when making turning decisions, what form does this integration take? A potentially favorable (Ma et al., 2006; Angelaki et al., 2009) approach would be for the larva to use a simple linear combination of uni-modal filter outputs as the basis for downstream multi-modal processing (Figure 3—figure supplement 2). In this case, the turn rate would be given by
Here, θ is a constant reflecting the relative importance of each filter output to the computation (θ = 0 would mean larvae respond only to odor and θ = 90° would mean larvae respond only to light).
We used both the independent pathways and early linear combination models to fit the turn-triggered probability density of (xO, xL) and found better agreement between the data and the early linear combination prediction (Figure 3D) than the independent pathways prediction (Figure 3C).
In the early linear combination model, the turn rate is a function of a 1-dimensional stimulus vector——so a rotation of odor-light convolution space (Figure 3E)
should produce a single parameter, u, that carries as much information about turn decisions as the pair (xO, xL) together, and an orthogonal parameter, v, that carries no information at all. The Kullback-Leibler divergence between the stimulus and turn-triggered distributions describes the amount of information stimulus parameters carry about the decision to initiate a turn (Pillow and Simoncelli, 2006); we calculated this divergence for the pair (xO, xL) and for xO, xL, u, and v individually (Figure 3B) and found that u alone is nearly as informative as both xO and xL and that v contributes very little to the decision to turn, further supporting the early linear combination model.
Can the observed summation of visual and odor inputs be explained by blue light activation of the CsChrimson channel? To probe for cross-talk between visual and olfactory channels, we repeated the multi-sensory experiments (again presenting both red and blue stimuli simultaneously) using genetically blinded larvae expressing CsChrimson in Or42a neurons and using wild-type larvae not expressing CsChrimson (Figure 3—figure supplement 3). Blind larvae responded only to red light (Figure 3—figure supplement 3B) while larvae not expressing CsChrimson responded only to blue light (Figure 3—figure supplement 3C).
To further compare the independent pathways and early linear combination models, we measured larvae's responses to simultaneous step changes in Or42a receptor neuron activity and blue light (Figure 4). We presented larvae with all possible combinations of favorable, neutral, and unfavorable steps of red light (fictive odor) and blue light (visual cue). We used the kernels calculated from the reverse-correlation experiments and fit the nonlinear functions parameterizing the early linear combination and independent pathways model to the observed turn rates. We found that despite having fewer free fit parameters, the early linear combination model (magenta line, Figure 4) better predicted the response to conflicting and aligned multi-sensory input than the independent pathways model (cyan line, Figure 4).
For changes in only light or only odor, larvae increase their turn rates significantly more for unfavorable changes (panels ii and iii) than they decrease their turning in response to favorable changes (i and vi). Thus the independent pathways model, which sums separate rates for light and odor changes, predicts that in response to conflicting favorable and unfavorable changes (iv and viii), the larvae will still significantly increase their turning. Instead, conflicting changes in odor and light cancel each other out, as predicted by the early linear combination model. That larvae turn in response to increases in blue light (iii, v) but decreases in red light (ii, v) further confirms that the two light sources are activating different sensory pathways. For instance, if blue light were primarily activating CsChrimson, we would expect that decreasing blue and red light together (viii) would provoke more turning than decreasing red light alone (ii), but in fact increasing blue light while decreasing red light (v) provokes the largest increase in turning.
Odor-light integration—computations underlying turn size and turn direction
We wondered whether the larva might use the same linear combination of light and odor signals to make other navigational decisions, like whether to accept or reject head-sweeps. Although we previously determined a maximally informative combination of filtered odor and light inputs, the convolution kernels have similar shapes, so we might reasonably use the same rules to combine the raw input stimuli.
Here, and are the normalization factors required to make the convolution kernels have unit variance, and θ was determined as a parameter of the early linear combination model (Figure 3D). We carried out reverse-correlation analysis on these rotated coordinates. We found: the turn triggered average of ν(t) was nearly 0 (Figure 5A); the size-sorted TTA of ν(t) was nearly 0 and the same for both small and large turns (Figure 5B); and the head-sweep triggered average of ν(t) was nearly 0 and the same for accepted and rejected head-sweeps (Figure 5C). Thus, larvae used a single linear combination of odor and light—μ(t)—to determine whether to turn, how large of a turn to make, and whether to reject or accept head-sweeps, strongly suggesting odor and light inputs are combined at early stages of the navigational circuitry.
Odor-light integration—probing for shifts in attention
Finally, we asked whether the larva might shift its attention between stimulus inputs. For instance, if a larva initiates a turn due to an increase in light, might it prioritize light changes over odor changes in deciding whether or not to accept the turn's first head-sweep? To test this, we re-examined the head-sweep acceptances and rejections from the multi-stimulus white noise experiments, sorting them based on the favorability of light and odor changes preceding the turn start (Figure 6A). For instance, in quadrant II, larvae turned following a recent favorable odor change and unfavorable light change. If an unfavorable light change caused otherwise neutral larvae to attend more strongly to light, we would expect that following a quadrant II turn, larvae would be more attentive to light changes than average. Alternately, if some larvae in the population were already attending to light more strongly than odor, we would expect them to be over-represented in the group of larvae turning in response to unfavorable changes in light coupled with favorable changes in odor. Thus, we would again expect that following a quadrant II turn, larvae would be attending more strongly to light than in the average population. Similarly, following quadrant IV turns, we would expect larvae to be attending more strongly to odor.
To measure the importance of light and odor changes during head sweeps, we subtracted the average derivative of light level during accepted head sweeps from the average derivative of light level during rejected head sweeps (Figure 6B). Regardless of which stimulus likely triggered the decision to turn, for both light and odor, we found the same differences between accepted and rejected head-sweeps. Thus, we found no evidence that the larva modulated the relative importance of light or odor changes when deciding whether to accept or reject a head-sweep. Indeed, for all combinations of light and odor changes preceding a turn, the same linear combination of odor and light inputs appeared to be equally salient in deciding whether to accept or reject a head-sweep (Figure 6C).
Discussion
A key step in ‘cracking’ neural circuits is defining the computations carried out by those circuits (Olsen and Wilson, 2008; Clark et al., 2013). Recent work has refined the measurements of circuits' behavioral outputs, for example, from simply counting animals accumulating near an odor source (Monte et al., 1989) to specifying the sequence of motor outputs that allow odor gradient ascent (Gomez-Marin et al., 2011; Gershow et al., 2012; Gomez-Marin and Louis, 2014). Here, we carried on this refinement, quantifying the transformation from sensory activity to motor decision with sub-second temporal resolution. Our reverse-correlation analysis captured the essential features of the larva's navigational decision making, including the time scales and stimulus features associated with various decisions (Figure 2).
Our results are consistent with the understanding of how larvae navigate natural environments previously developed by observing behavior in structured environments of light or gaseous odors. For instance, when placed in environments with spatially varying Ethyl Butyrate (Gomez-Marin et al., 2011; Gomez-Marin and Louis, 2014) or Ethyl Acetate (Gershow et al., 2012) concentrations, larvae initiate turns more frequently when headed in directions of decreasing concentrations of these attractive odors. In this work, we showed that larvae initiate turns in response to a decrease in activity in Or42a or Or42b receptor neurons, the primary receptors for Ethyl Acetate and Ethyl Butyrate. Additionally, we showed that larvae mainly use only the previous two seconds of receptor activity to decide whether to turn (Figure 2A). This detail cannot be resolved from experiments in natural odor gradients, nor can the fact that larvae integrate changes in odor receptor activity over a much longer time period to decide the size of their turns (Figure 2D).
When larvae move their heads through a spatially heterogeneous environment, they generate changes in sensory input that could be used to decode local spatial gradients. It has been directly shown that warming a cold larva during a head-sweep causes the larva to accept that head-sweep, beginning a new run (Luo et al., 2010). For light and odor, a strong circumstantial case has been made that larvae use information gathered during head-sweeps to bias turn direction: the first head-sweep of a turn is unbiased (Gershow et al., 2012; Kane et al., 2013) but larvae are more likely to begin a run following a sweep in a direction of higher concentration of attractive odor, lower concentration of carbon dioxide, or lower luminosity (Gomez-Marin et al., 2011; Gershow et al., 2012; Kane et al., 2013; Gomez-Marin and Louis, 2014) and larvae with only a single functional odor receptor can still bias turn direction via head-sweeping (Gomez-Marin and Louis, 2014). In this work, we directly show that larvae do in fact use changes in odor receptor activity and light level measured during head-sweeps to determine whether to begin a new run or initiate a second head-sweep (Figure 2E).
Our experiments with a single stimulus also found a previously unknown difference in how larvae use CO2 receptor activity to modulate turn size and head-sweep acceptance compared to visual stimuli and to attractive olfactory receptor activity (Figure 2D,E). This could be related to a difference in how larvae modulate their forward motion in response to changes in CO2 concentration compared to changes in light intensity or EtAc concentration. We previously measured larvae's responses to linear temporal ramps of light intensity (Kane et al., 2013), and EtAc and CO2 concentrations (Gershow et al., 2012). For light and EtAc, larvae changed their rate of turning and the size of their turns in response to changing environmental conditions, but when they were actually engaged in forward movement, their speed of progress was the same whether conditions were improving or declining. In contrast, larvae dramatically decreased their forward run speed in response to increases in the concentration of CO2. Larvae with non-functional CO2 receptors did not change their speed at all in response to CO2, so this modulation was due to a sensory-motor transformation and not to metabolic effects.
Larvae move forward through a series of tail to head peristaltic waves of muscle contraction (Lahiri et al., 2011; Heckscher et al., 2012) and modulate their forward speed by changing the frequency with which they initiate these waves (Heckscher et al., 2012). The observed CO2 dependent speed modulation might therefore reflect the presence of a pathway by which Gr21a receptor neuron activity can down-regulate the probability of initiating forward peristaltic waves. In order to accept a head-sweep, that is, transition from head-sweeping to forward movement, larvae must initiate a new peristaltic wave (Lahiri et al., 2011). If an increase in Gr21a activity decreases the probability of initiating such a wave, this would explain why an increase in Gr21a activity prior to head-sweep initiation results in an increased probability of head-sweep rejection (Figure 2E). Similarly, an increase in Gr21a activity might bias the larva towards larger reorientations (Figure 2D) by decreasing the probability of quick, small course corrections.
In addition to defining the computations by which larvae navigate environments of varying light or varying odor, we also developed a quantitative model of odor-light integration. Previously, it has proven difficult to establish even a qualitative understanding of odor and light integration using static combinations of the two cues. Consider a simple experiment where a petri dish is divided into light and dark halves and a droplet of attractive odor is placed on the lighted half. If a larva moves towards the odor at the expense of moving out of darkness, is this because the larva naturally places more importance on odor than light regardless of intensity, because the particular concentrations of odor and intensities of light in the experiment favor a move towards odor, or because behavior is variable and larvae often make idiosyncratic choices? In our reverse-correlation experiments, we presented hundreds of larvae with thousands of combinations of light and odor variation and were thus able to resolve these ambiguities. We determined not just how larvae balance an overall attraction to odor and aversion to light, but how they combine transient odor and light signals to make individual navigational decisions.
Conclusion
Here, we demonstrated the power of reverse-correlation analysis of larvae's behavioral responses to white-noise visual and fictive olfactory stimuli to decode the computations underlying the Drosophila larva's navigation of natural environments. We showed that this analysis could be used to decode the rules by which the larva integrates signals from distinct sensory organs. Larvae appear to use a single linear combination of odor and light inputs to make all navigational decisions, suggesting these signals are combined at early stages of the navigational circuitry.
In this work, we used optogenetics to explore how perturbations in the activities of identified neurons are interpreted behaviorally. We expressed CsChrimson in specific neurons to relate patterns of activity in these neurons to decisions regulating the frequency, size, and direction of turns (Figure 2). Using model parameters extracted from reverse-correlation experiments, we were able to predict how larvae would respond to novel perturbations of these neurons' activities (Figure 2C). We explored how activity in one particular neuron type modulated the larva's responses to a natural light stimulus (Figures 3, 5, 6) and predicted how the larva's natural response to blue light steps (Figure 4-iii) would be altered by simultaneous perturbation of this neuron (Figure 4-iv,v). Here we addressed sensory neurons, but our approach can be used generally to identify computations carried out on activities of interneurons, to determine whether activity in a neuron is interpreted as attractive or aversive, to measure how that activity combines with other sources of information to produce decisions, and to find neurons most responsible for making navigational decisions (Koulakov et al., 2005).
Materials and methods
Fly strains
Request a detailed protocolThe following strains were used: Canton-S and Berlin wild type (gift of Justin Blau), w1118;;20XUAS-CsChrimson-mVenus (Bloomington Stock #55136, gift of Vivek Jayaraman and Julie Simpson, Janelia Research Campus), w*;;Gr21a-Gal4 (Bloomington stock #23890), w*;;Or42a-Gal4 (Bloomington stock #9969), w*;;Or42b-Gal4 (Bloomington stock #9972), GMR-hid/CyO,P{sevRas1.V12} (Bloomington stock #5771).
Crosses
Request a detailed protocol40 virgin female UAS-CsChrimson flies were crossed with 20 males of the selected Gal4 line. F1 progeny of both sexes were used for experiments.
Larva collection
Request a detailed protocolFlies were placed in 60 mm embryo-collection cages (59–100, Genesee Scientific, San Diego, CA) and allowed to lay eggs for 3 hr at 25°C on enriched food media (‘Nutri-Fly German Food’, Genesee Scientific). For all experiments except the Berlin response to blue light (Figure 2, top row and Figure 2—figure supplement 1, top row), the food was supplemented with 0.1 mM all-trans-retinal (ATR, R2500, Sigma Aldrich, St. Louis, MO), and cages were kept in the dark during egg laying. When eggs were not being collected for experiments, flies were kept either on plain food or agar (neither containing ATR).
Petri dishes containing eggs and larvae were kept at 25°C (ATR+ plates were wrapped in foil) for 48–60 hr. Second instar larvae were separated from the food using 30% sucrose solution and washed in deionized water. Larval stage was verified by size and spiracle morphology. Preparations for experiments were carried out in a dark room, under dim red (for photo-taxis experiments) or blue (for CsChrimson experiments) illumination. Prior to beginning experiments, larvae were dark adapted on a clean 2.5% agar surface for a minimum of 10 min.
Behavioral experiments
Request a detailed protocolApproximately 30–50 larvae were transferred with a wet paintbrush to a 23 cm square dish (Corning BioAssay Dish #431111, Fisher Scientific, Pittsburgh, PA), containing 2.5% (wt/vol) bacteriological grade agar (Apex, cat#20-274, Genesee Scientific) and 0.75% (wt/vol) activated charcoal (DARCO G-60, Fisher Scientific). The charcoal darkened the agar and improved contrast in our dark-field imaging setup. The plate was placed in a darkened enclosure and larvae were observed under strobed 850 nm infrared illumination (ODL-300-850, Smart Vision Lights, Muskegon, MI) using a 14 fps 5 MP rolling shutter CMOS camera (Basler acA2500-14gm, Graftek Imaging, Austin, TX) in global-reset-release mode and an 18 mm c-mount lens (54-857, Edmund Optics, Barrington, NJ) equipped with an IR-pass filter (Hoya R-72, Edmund Optics). The experiments of Figure 3—figure supplement 3B were recorded using a 4 MP global shutter CMOS camera (Basler acA2040-90umNIR, Graftek Imaging) operating at 20 fps and a 35 mm focal length lens (Fujinon CF35HA-1, B&H Photo, New York, NY). A microcontroller (Teensy++ 2.0, PJRC, Sherwood, OR) coordinated the infrared strobe and control of the stimulus light source, so stimulus presentation and images could be aligned to within the width of the strobe window (2–5 ms). Videos were recorded using custom software written in LABVIEW and analyzed using the MAGAT analyzer software package (Gershow et al., 2012). Further analysis was carried out using custom MATLAB scripts. Table 1 gives the number of experiments, animals, turns, and head sweeps analyzed for each experimental condition. Software is available at https://github.com/GershowLab.
Stimulus light source
Request a detailed protocolWe built a custom circuit board (Advanced Circuits, Colorado) containing 66 deep red high brightness LEDs (Philips Lumileds, LXM3-PD01, 655 nm central wavelength) and 12 royal blue high brightness LEDs (LXML-PR01-0500, 447.5 nm central wavelength) evenly distributed over ∼25 cm × 25 cm. The LEDs were driven at constant current by a switch-mode LED driver circuit (based on LT3518, linear technology) operating at a switching frequency of 2 MHz. The on-current was set by interchangeable feedback resistors and could be modulated separately for red and blue LEDs. The intensity of the red and blue LEDs was controlled separately by pulse-width-modulation. Illumination was provided from above the larvae; the LED circuit board was at the same height as the recording camera (∼50 cm above the behavioral arena).
For multi-sensory experiments, the maximum red light intensity (911 μW/cm2) was 300 times greater than the maximum blue light intensity (3 μW/cm2). CsChrimson is slightly more sensitive to 655 nm than 448 nm light, so the blue light signal perturbed olfactory receptor neuron activity by less than 0.3% of the red-light signal's perturbation.
We calibrated the optical power of the LEDs using a photodiode power meter (S121C, Thorlabs, New Jersey) set to the central wavelength of the LEDs. We measured the uniformity of the stimulus light sources by imaging a Lambertian projector screen (Dalite 41466, Cousin's Video, Ohio) placed in the plane of the experimental arena under stimulus LED illumination.
Stimulus sequences
Request a detailed protocolStimulus protocols were generated with MATLAB and stored on an SD card for use by the microcontroller. Light intensity was modulated using pulse-width-modulation with a frequency of ∼112 Hz (constrained to update exactly 8 eight times per camera frame).
Brownian light intensity
Request a detailed protocolWe chose a Brownian random walk, whose derivatives on all time scales are independent identically distributed Gaussian variables, to analyze the larva's response to derivatives of stimulus intensity. Light levels were specified by values between 0 (off) and 255 (maximum intensity). Sequences of light levels corresponding to a random walk with reflecting boundary conditions were generated according to these rules:
where N(0,σ) was a Gaussian random variable with mean 0 and variance σ2. For the experiments described in this work σ = 3. At an update rate of 112 Hz, this represents a diffusion constant of 504 (light levels)2/s. After the sequence of light levels was generated, the levels were rounded to the nearest integer value before being transferred to the microcontroller for use in experiments. Sequences were not reused within an experimental group but might be reused between groups. For multi-modal experiments, independent sequences were used for each stimulus.
Step responses
Request a detailed protocolFor step response experiments of Figure 2C, a square wave with a period of 20 s and duty cycle 50% (10 s high, 10 low) was presented. The low and high intensities were symmetrically distributed about the mean light intensity of the reverse-correlation experiments.
For the coordinated step response experiments of Figure 4, we presented steps of red and blue light intensity. Every 10 s, each signal either increased from low to high, decreased from high to low, or remained constant. The sequence of steps was chosen so that all combinations (except for both levels remaining constant) were presented. For each stimulus, the low and high intensities were symmetrically distributed about the mean light intensity of the reverse-correlation experiments.
Data analysis
Request a detailed protocolAs described previously (Gershow et al., 2012; Kane et al., 2013), videos of behaving larvae were recorded using LabView software into a compressed image format (mmf) that discards the stationary background. These videos were processed using computer vision software (written in C++ using the openCV library) to find the position and posture (head, tail, midpoint, and midline) of each larva and to assemble these into tracks, each following the movement of a single larva through time. These tracks were analyzed by Matlab software to identify behaviors, especially runs, turns, and head sweeps.
The sequence of light intensities presented to the larvae was stored with the video recordings and used for reverse-correlation analysis.
Reverse correlation analysis
Turn-triggered averages
Request a detailed protocolTurn-triggered averages (Figures 2A, 3A, 5A) with a bin size of 0.1 s were computed by averaging stimulus values at the corresponding times relative to the start of a turn; for example, the TTA at −1 s represents the average value of the derivative of the light intensity at all times that were between −0.95 and −1.05 s before the initiation of a turn. The TTA at +1 s represents the same average for times 0.95 to 1.05 s after the initiation of a turn. We computed the TTA at positive times as a control—we expected the average to be nearly 0 at positive times because behavior is causal (decisions contain no information about the future stimulus). Due to the reflecting boundary conditions, on long time scales, derivatives of the stimulus were anti-correlated; thus the TTA is not exactly 0 at positive times.
Convolution kernels
Request a detailed protocolWe smoothed the TTA by fitting it to the impulse response of a third order linear system used to describe the calcium dynamics of Caenorhabditis elegans olfactory neurons (Kato et al., 2014). This fit was used only to smooth the TTA; we do not ascribe any biological significance to the fit parameters. The smoothed kernel is shown as a black line in Figure 2A.
Filtered stimulus
Request a detailed protocolWe used the smoothed TTA as a convolution kernel to find the output of the linear filter stage of the LNP model. We scaled the kernel so that the variance of the filtered signal over the entire stimulus history was 1. For the Canton-S red light experiments (Figure 2, second row), a kernel could not be recovered from the TTA, so the kernel for Gr21a>CsChrimson was used to calculate the turn-rate.
Nonlinear turn rates
Request a detailed protocol(Figure 2B) The turn rate r(xf) and standard error σr(xf) as a function of filtered signal value (xf) were computed by
Nturn is the number of turns observed with the filtered signal within the histogram bin (size = 0.25) containing xf and Nall is the total number of data points where the filtered signal was in the histogram bin and larvae were in runs and thus capable of initiating turns, and ∆t was the sampling period (1/14 s).
By construction, the stimulus ensemble is Gaussian distributed with mean 0 and variance 1. If the turn-triggered ensemble is also Gaussian distributed, then the turn rate is given by a ratio-of-Gaussians (Pillow and Simoncelli, 2006)
T is the total time the larvae were in runs and therefore able to initiate turns. rROG(x) is plotted in Figure 2B as a black line. This rate function was used for the predictions in Figure 2C (cyan lines), with calculated directly from the turn-triggered ensemble.
Size-sorted TTAs
Request a detailed protocolSize-sorted TTAs (Figures 2D, 5B) were computed in the same manner, but the analysis was conducted separately for turns where the resulting heading change (difference in headings between end of the previous and beginning of the next runs) was larger or smaller than the rms heading change for the population over the course of the experiments. The turn-size is determined by the size of the initial head-sweep of the turn and by decisions made after turn-initiation (at positive times), so we did not expect the size-sorted TTA to be identically 0 at positive times.
Head sweep triggered averages
Request a detailed protocol(Figures 2E, 5C) As for the TTA, but the reference time (0) was chosen as the beginning of either rejected or accepted head sweeps. Because the decision to accept or reject a head sweep is made after the beginning of the head sweep, we expected that the average would be nonzero at positive times corresponding to the duration of a head sweep. To simplify interpretation of the resulting averages, we considered only the first head sweep of each turn.
Maximum-likelihood estimation of turn-rate parameters
Request a detailed protocolIn Figures 3, 4, we fit the nonlinear turn rate to the observed data using the ratio-of-Gaussians function with as fit parameters. The probability of observing at least one turn in an interval ∆t given an underlying turn rate r is 1 − e−r∆t; in the limit of short ∆t, this reduces to r∆t. The probability of not observing a turn is e−r∆t. Therefore given a model of the turn rate, the probability of observing a particular experimental outcome is given by
where x is the filtered signal, r(x) is the turn rate predicted by the model, and ∆t is the sampling rate. is the sum over all points when larvae were in runs and thus capable of initiating turns. We used the MATLAB function fmincon to find the parameters that maximized this log-likelihood.
For Figures 3C, 4 (cyan line), the separate pathways model rate function was given by
with fit parameters .
For Figures 3D, 4 (magenta line), the early linear combination model rate function was given by
with fit parameters .
Kullback-Leibler divergence
Request a detailed protocolWe estimated the KL divergences in Figure 3 using the k-nearest neighbors algorithm (Wang et al., 2009) as implemented in MATLAB by (Szabó, 2014). As a check, for Figure 3B, we also analytically computed the KL divergence between Gaussian distributions with the same means and (co-)variances as the sampled turn-triggered and stimulus ensembles (Pillow and Simoncelli, 2006), and for Figure 3C,D, we numerically calculated the KL divergence between the model predictions and a multivariate Gaussian with the same mean and covariance as the measured turn-triggered density. For the univariate distributions of 3B, we also estimated the divergence using an alternate method based on Szegö's theorem (Ramırez et al., 2009) as implemented by (Szabó, 2014). These estimates are shown in Table 2. None of the conclusions of this paper depend on the method of estimation used.
References
-
Multisensory integration: psychophysics, neurophysiology, and computationCurrent Opinion in Neurobiology 19:452–458.https://doi.org/10.1016/j.conb.2009.06.008
-
Features and dimensions: motion estimation in fly visionarXiv preprint q-bio/0505003.
-
Tonic signaling from O2 sensors sets neural circuit activity and behavioral stateNature Neuroscience 15:581–591.https://doi.org/10.1038/nn.3061
-
Genetic dissection of behavior: modulation of locomotion by light in the Drosophila melanogaster larva requires genetically distinct visual system functionsThe Journal of Neuroscience 19:3337–3344.
-
A simple white noise analysis of neuronal light responsesNetwork-Computation in Neural Systems 12:199–213.https://doi.org/10.1080/713663221
-
Theoretical neuroscience: computational and mathematical modeling of neural systemsTheoretical neuroscience: computational and mathematical modeling of neural systems, Cambridge, Mass: Massachusetts Institute of Technology Press.
-
Relationship between cellular response and behavioral variability in bacterial chemotaxisProceedings of the National Academy of Sciences of USA 105:3304–3309.https://doi.org/10.1073/pnas.0705463105
-
Behavioral responses of Drosophila to biogenic levels of carbon dioxide depend on life-stage, sex and olfactory contextThe Journal of Experimental Biology 209:2739–2748.https://doi.org/10.1242/jeb.02297
-
Motor output reflects the linear superposition of visual and olfactory inputs in DrosophilaThe Journal of Experimental Biology 207:123–131.https://doi.org/10.1242/jeb.00725
-
Controlling airborne cues to study small animal navigationNature Methods 9:290–296.https://doi.org/10.1038/nmeth.1853
-
Multilevel control of run orientation in Drosophila larval chemotaxisFrontiers in Behavioral Neuroscience 8:38.https://doi.org/10.3389/fnbeh.2014.00038
-
Active sampling and decision making in Drosophila chemotaxisNature Communications 2:441.https://doi.org/10.1038/ncomms1455
-
Photic input pathways that mediate the Drosophila larval response to light and circadian rhythmicity are developmentally related but functionally distinctThe Journal of Comparative Neurology 481:266–275.https://doi.org/10.1002/cne.20383
-
Characterization of Drosophila larval crawling at the level of organism, segment, and somatic body wall musculatureThe Journal of Neuroscience 32:12460–12471.https://doi.org/10.1523/JNEUROSCI.0222-12.2012
-
Sensorimotor structure of Drosophila larva phototaxisProceedings of the National Academy of Sciences of USA 110:E3868–E3877.https://doi.org/10.1073/pnas.1215295110
-
Distinct visual pathways mediate Drosophila larval light avoidance and circadian clock entrainmentJournal of Neuroscience 31:6527–6534.https://doi.org/10.1523/JNEUROSCI.6165-10.2011
-
Seeing the light: photobehavior in fruit fly larvaeTrends in Neurosciences 35:104–110.https://doi.org/10.1016/j.tins.2011.11.003
-
System identification of Drosophila olfactory sensory neuronsJournal of Computational Neuroscience 30:143–161.https://doi.org/10.1007/s10827-010-0265-0
-
Independent optical excitation of distinct neural populationsNature Methods 11:338–346.https://doi.org/10.1038/nmeth.2836
-
Sensory determinants of behavioral dynamics in Drosophila thermotaxisProceedings of the National Academy of Sciences of USA 112:E220–E229.https://doi.org/10.1073/pnas.1416212112
-
How to find decision makers in neural networksBiological Cybernetics 93:447–462.https://doi.org/10.1007/s00422-005-0022-z
-
The molecular basis of CO2 reception in DrosophilaProceedings of the National Academy of Sciences of USA 104:3574–3578.https://doi.org/10.1073/pnas.0700079104
-
The computational worm: spatial orientation and its neuronal basis in C. elegansCurrent Opinion in Neurobiology 21:782–790.https://doi.org/10.1016/j.conb.2011.06.009
-
Bilateral olfactory sensory input enhances chemotaxis behaviorNature Neuroscience 11:187–199.https://doi.org/10.1038/nn2031
-
Olfactory behavior of swimming C-elegans analyzed by measuring motile responses to temporal variations of odorantsJournal of Neurophysiology 99:2617–2625.https://doi.org/10.1152/jn.00053.2008
-
Navigational decision making in Drosophila thermotaxisThe Journal of Neuroscience 30:4261–4272.https://doi.org/10.1523/JNEUROSCI.4090-09.2010
-
Bayesian inference with probabilistic population codesNature Neuroscience 9:1432–1438.https://doi.org/10.1038/nn1790
-
Step-response analysis of chemotaxis in Caenorhabditis elegansThe Journal of Neuroscience 25:3369–3378.https://doi.org/10.1523/JNEUROSCI.5133-04.2005
-
The fundamental role of pirouettes in Caenorhabditis elegans chemotaxisThe Journal of Neuroscience 19:9557–9569.
-
Adult-like complexity of the larval antennal lobe of D. melanogaster despite markedly low numbers of odorant receptor neuronsThe Journal of Comparative Neurology 445:374–387.https://doi.org/10.1002/cne.10188
-
Entropy and Kullback-Leibler divergence estimation based on Szego's theorem
-
Reverse correlation in neurophysiologyCognitive Science 28:147–166.https://doi.org/10.1207/s15516709cog2802_2
-
Thermotaxis in Caenorhabditis elegans analyzed by measuring responses to defined thermal stimuliThe Journal of Neuroscience 22:5727–5733.
-
Blue- and green-absorbing visual pigments of Drosophila: ectopic expression and physiological characterization of the R8 photoreceptor cell-specific Rh5 and Rh6 rhodopsinsThe Journal of Neuroscience 19:10716–10726.
-
Temporal comparisons in bacterial chemotaxisProceedings of the National Academy of Sciences of USA 83:8987–8991.https://doi.org/10.1073/pnas.83.23.8987
-
Information theoretical estimators toolboxJournal of Machine Learning Research 15:283–287.
-
Dynamics of optomotor responses in Drosophila to perturbations in optic flowJournal of Experimental Biology 213:1366–1375.https://doi.org/10.1242/jeb.037945
-
Divergence estimation for multidimensional densities via -nearest-neighbor distancesIEEE Transactions on Information Theory 55:2392–2405.https://doi.org/10.1109/TIT.2009.2016060
-
Identification of nonlinear physiological systemsHoboken, NJ:, IEEE Press; Wiley-Interscience.
Article and author information
Author details
Funding
New York University (Startup)
- Ruben Gepner
- Mirna Mihovilovic Skanata
- Natalie M Bernat
- Marc Gershow
The funder had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank S Nathasha Egodage and Ruben Contreras for assistance with experiments, and Damon Clark, Katherine Nagel, and Andrew Leifer for valuable comments on the manuscript.
Copyright
© 2015, Gepner et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 3,889
- views
-
- 801
- downloads
-
- 84
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Computational and Systems Biology
- Neuroscience
Three recent studies use optogenetics, virtual ‘odor-scapes’ and mathematical modeling to study how the nervous system of fruit fly larvae processes sensory information to control navigation.
-
- Neuroscience
Brain water homeostasis not only provides a physical protection, but also determines the diffusion of chemical molecules key for information processing and metabolic stability. As a major type of glia in brain parenchyma, astrocytes are the dominant cell type expressing aquaporin water channel. How astrocyte aquaporin contributes to brain water homeostasis in basal physiology remains to be understood. We report that astrocyte aquaporin 4 (AQP4) mediates a tonic water efflux in basal conditions. Acute inhibition of astrocyte AQP4 leads to intracellular water accumulation as optically resolved by fluorescence-translated imaging in acute brain slices, and in vivo by fiber photometry in mobile mice. We then show that aquaporin-mediated constant water efflux maintains astrocyte volume and osmotic equilibrium, astrocyte and neuron Ca2+ signaling, and extracellular space remodeling during optogenetically induced cortical spreading depression. Using diffusion-weighted magnetic resonance imaging (DW-MRI), we observed that in vivo inhibition of AQP4 water efflux heterogeneously disturbs brain water homeostasis in a region-dependent manner. Our data suggest that astrocyte aquaporin, though bidirectional in nature, mediates a tonic water outflow to sustain cellular and environmental equilibrium in brain parenchyma.