Controlling gain one photon at a time
Abstract
Adaptation is a salient property of sensory processing. All adaptational or gain control mechanisms face the challenge of obtaining a reliable estimate of the property of the input to be adapted to and obtaining this estimate sufficiently rapidly to be useful. Here, we explore how the primate retina balances the need to change gain rapidly and reliably when photons arrive rarely at individual rod photoreceptors. We find that the weakest backgrounds that decrease the gain of the retinal output signals are similar to those that increase human behavioral threshold, and identify a novel site of gain control in the retinal circuitry. Thus, surprisingly, the gain of retinal signals begins to decrease essentially as soon as background lights are detectable; under these conditions, gain control does not rely on a highly averaged estimate of the photon count, but instead signals from individual photon absorptions trigger changes in gain.
https://doi.org/10.7554/eLife.00467.001eLife digest
To process the sights and sounds around us, our senses must be attuned to a huge range of signals: from barely audible whispers to deafening rock concerts, and from dim glimmers of light to bright spotlights. Sensory neurons face the challenge of encoding this huge range of inputs within their much more restricted response range. Thus, neurons in our eyes and ears must continually adjust their gain or sensitivity to match changes in the light and sound inputs. These gain control processes must operate rapidly to keep up with the ever-changing input signals, but must also operate accurately so as not to distort the inputs.
The trade-off between rapid and accurate gain control can be illustrated by considering how the retina processes information at low light levels. There are two main types of light-sensitive cells in the retina: rods and cones. Vision at night relies on the ability of the rods to detect single photons—the smallest unit of light. In starlight, an individual rod will register photons only rarely, and most of the time, the majority of the rods will not register any photons. Neurons in the retinal circuits that read out the rod signals receive input from hundreds or thousands of rods, and those rod inputs are highly amplified to allow detection of the responses produced when a tiny fraction of the rods absorbs a photon. But this amplification is dangerous, as it could easily saturate retinal signals when light levels increase. Gain control mechanisms are needed to avoid such saturation.
Schwartz and Rieke now add to our understanding of this process by examining how the retinas of non-human primates behave in low light. They reveal that levels of background light that can only just be detected behaviorally trigger retinal gain controls; these gain controls operate when less than 1% of rods absorb a photon. Under these conditions, the physics of light itself will cause considerable variability in the stream of photons arriving at the retina, leading to high variability in the gain of retinal responses. Nonetheless, changes in gain occurred rapidly following changes in background, indicating that the underlying mechanisms spend little time averaging incident photons. Taken together, these findings will require revisiting our ideas about how adaptational mechanisms balance the competing demands of speed and reliability to help us see the world around us.
https://doi.org/10.7554/eLife.00467.002Introduction
Sensory systems encode an enormous range of input signals—for example, a rock concert is ∼1012 times louder than a just detectable whisper. Maintaining sensitivity as inputs change requires adaptational mechanisms that adjust the gain or amplification of neural signals to match their limited dynamic range to the range of the input signals a cell receives. Such gain control mechanisms operate under challenging conditions as the inputs they encounter can vary rapidly in time and locally in the space of possible stimuli. For example, visual neurons can experience >1000-fold changes in input a few times a second as the eyes move to explore a typical scene (Frazor and Geisler, 2006). Standard cameras fail to capture the full structure of such scenes because they employ a single global gain control in the form of an exposure setting, which is often poorly matched to the brightest and dimmest regions of a scene. Sensory gain controls are clearly more sophisticated.
Effective gain control requires balancing the need to be rapid and local with the need to be accurate (reviewed by Rieke and Rudd, 2009). This is an example of the classic change detection problem: how many samples from a signal distribution are needed to determine whether or not the distribution has changed (Buracas et al., 1998; Deneve, 2008; Wark et al., 2009)? Gain control mechanisms operating near absolute visual threshold exemplify this problem. Human behavioral threshold begins to increase for backgrounds producing ∼0.01 isomerized rhodopsin molecules per rod per second (R*/rod/s) (reviewed by Donner, 1992). Under these conditions, the number of photons absorbed in a small time window fluctuates widely due to the Poisson statistics that govern photon absorption. In principle, increases in behavioral threshold could solely reflect this increased noise without gain changes (Barlow, 1965). However, several studies suggest that weak backgrounds decrease the gain of retinal signals (Donner, 1992; Brown and Rudd, 1998). Retinal gain control mechanisms operating at these low light levels must work in the presence of the irreducible noise associated with random photon arrivals.
At low light levels, rod-mediated signals traverse the retina through the specialized rod bipolar pathway: rods → rod bipolar cells → AII amacrine cells → cone bipolar cells → ganglion cells (Figure 1A; for review see Bloomfield and Dacheux, 2001; Field et al., 2005). The total number of rods that convey the signal increases at each stage of this pathway (Figure 1B). This convergence, together with amplification of signals by cellular and synaptic mechanisms, permits fully dark-adapted ganglion cells to generate one or more spikes to flashes producing photon absorptions in only ∼0.1% of the rods (Barlow et al., 1971; Mastronarde, 1983; P Ala-Laurila and F Rieke, unpublished). Left unchecked, this high gain would cause just detectable backgrounds to produce ganglion cell firing rates in excess of 100 spikes per second. Gain control mechanisms are needed to prevent such excessive firing.
Mechanisms controlling the gain of rod-mediated signals have been identified within the phototransduction cascade in the rods themselves (Schneeweis and Schnapf, 2000; Dunn and Rieke, 2006), and at the synapse between rod bipolar cells and AII amacrine cells (Dunn and Rieke, 2008). But the greater convergence at downstream locations in the rod bipolar pathway could provide a more reliable signal to control gain. Hence, we explored how the gain of retinal signals is controlled in dim backgrounds, with three main goals: (1) to determine if the gain of retinal signals is altered by backgrounds near the onset of changes in human behavioral threshold, (2) to determine how the retinal circuit averages over space and time to detect changes in the photon flux, and (3) to identify novel sites of gain control in the rod bipolar pathway.
Results
We focus on responses of primate On parasol (magnocellular projecting) ganglion cells. On parasol ganglion cells provide information to cortical circuits about subtle changes in contrast (Kaplan and Shapley, 1982) and receive abundant rod-mediated input at low light levels (Purpura et al., 1988; Field et al., 2009). Thus, these cells are likely to contribute critically to vision at low light levels. On parasol cells also provide a sensitive measure of the output of the rod bipolar pathway. This pathway dominates rod-mediated signaling across ganglion cell types at low light levels, and hence should provide shared steps in processing of rod signals. Indeed, as described below, we find that the gain of retinal signals at low light levels is controlled at a site located within the rod bipolar pathway.
Gain controls in the retinal circuitry operate near the onset of behavioral threshold changes
We measured spike responses (Figure 2A) and excitatory synaptic inputs (Figure 2B) of On parasol ganglion cells in response to brief flashes superimposed on a range of backgrounds (see also ‘Materials and methods’ and Figures 10 and 11). We focused specifically on backgrounds near the onset of changes in human behavioral threshold (0.01–0.2 isomerizations/rod/s or R*/rod/s). Flash strengths (0.001–0.006 R*/rod) were chosen to elicit responses well below saturation. Both individual responses (Figure 2A,B) and averages (Figure 2C) had a clear dependence on background. Furthermore, a cell’s excitatory synaptic input and its spike response changed similarly with changes in background (Figure 2C). To quantify the effect of background on a cell’s response, we determined the response gain by dividing the response amplitude (spike count or integrated current) by the flash strength; the gain measures the response per R*/rod. The gain of spike responses and excitatory input had a similar dependence on background (Figure 2D).
Figure 2C,D suggest that the effect of changes in background on a cell’s spike output is dominated by the changes in excitatory input. To further test this conclusion, we defined a detection threshold as the strength of the flash (in R*/rod) eliciting a response with a signal-to-noise ratio of 1 (see ‘Materials and methods’). Noise was measured from sections of recording prior to the flash. Detection thresholds for spike responses and excitatory synaptic inputs measured in the same cell were near identical across a range of backgrounds (Figure 2E). Consistent with the similarity of the spike responses and excitatory inputs, inhibitory synaptic inputs to the same stimuli were three to four times smaller than the excitatory inputs, and hence unlikely to contribute strongly to spike output (data not shown).
Figure 2 indicates the changes in the gain of an On parasol cell's spike output are dominated by changes in the cell's excitatory synaptic inputs. Below, we focus on how gain of the excitatory synaptic inputs is controlled.
Dependence of gain and noise on background
Changes in human behavioral threshold with background show several characteristic regions (reviewed by Barlow, 1965; Donner, 1992; Rieke and Rudd, 2009): (1) a ‘dark light’ region extending to ∼0.01 R*/rod/s in which threshold is independent of background, (2) a ‘Rose–deVries’ region in which threshold increases with the square root of the background (de Vries, 1943; Rose, 1948), and (3) a ‘Weber’ region in which threshold increases proportionally with the background. Since threshold depends on both signal and noise, the relationship between these behavioral measurements and gain control is unclear. Hence, the experiments below characterize gain, noise, and threshold of the On parasol responses across a range of background intensities spanning these behaviorally defined regions.
We extended experiments like those in Figure 2 to span a wide range of backgrounds (Figure 3). In this and all subsequent experiments, we adjusted the flash strength to elicit similar responses across backgrounds because the change in gain exceeded the cell’s linear response range (see ‘Materials and methods’ and Figures 10 and 11). Adjusting flash strength (and dividing the response by the flash strength to measure gain) allowed us to probe a ∼10,000-fold range of backgrounds. Across the entire range tested, the dependence of gain on background (Figure 3A) was well described by a modified Weber function:
where G is the gain and GD is its maximum value, IB is the background, and I0 is the background required to reduce the gain by 50%. Gain in Equation 1 is constant when IB << I0, begins to decrease when IB nears I0, and scales inversely with background when IB >> I0. For the cell in Figure 3A, I0 was 0.076 R*/rod/s (marked by the arrowhead); across cells, I0 was 0.08 ± 0.03 R*/rod/s (mean ± SD, n = 6). We observed a small but consistent reduction in gain in darkness relative to its maximal value at backgrounds ∼0.01 R*/rod/s. The reduced gain in darkness was highly dependent on the history of light exposure, and hence is only partially captured in Figure 3A because we returned to the dark condition after exposure to several backgrounds (see ‘Recordings and light stimulation’). The low dark gain reflects a nonlinear processing step that is engaged in the dark but relieved for backgrounds producing 0.005–0.01 R*/rod/s; this nonlinearity and its impact on visual sensitivity is the subject of another study (P Ala-Laurila and F Rieke, unpublished).
Two features of Figure 3A are notable. First, over a ∼1000-fold range of backgrounds gain closely followed Weber law behavior, even though multiple mechanisms contribute to gain control across this range. This indicates an orderly coordination of gain control mechanisms (see ‘Discussion’). Second, gain began to decrease for backgrounds near 0.01 or 0.02 R*/rod/s—close to the onset of changes in human behavioral threshold. We summarized the onset of gain changes across cells by choosing three regions spanning equal ranges of background intensities centered below, on, or above I0 (horizontal colored lines in Figure 3A). Figure 3D plots the exponent describing the dependence of gain on background (i.e., the slope on a log–log scale as in Figure 3A) in each region. Gain scaled inversely with background above 0.3 R*/rod/s, and more gradually at lower background intensities. Consistent with the ability of Equation 1 to describe the data, we did not see evidence for an extended region where gain scaled inversely with the square root of the background (see ‘Discussion’).
We quantified noise at each background by projecting the current prior to the flash along the same template used to measure signal (see ‘Analysis’). Noise also changed with background, but such changes were modest across those backgrounds near the onset of changes in behavioral threshold (Figure 3B,E); specifically, noise changed <10-fold over a range of backgrounds that produced an ∼10,000-fold change in gain. These changes in noise with background were much less than expected from Poisson fluctuations in photon absorption and no changes in gain. If Poisson fluctuations dominated noise and gain remained constant, the standard deviation of the current should increase as the square root of the background—that is, with slope 0.5—since the variance of a Poisson process is proportional to the mean. Noise changed much less with background than this prediction (Figure 3B,E). The largest increases in noise occurred between darkness and backgrounds <0.01 R*/rod/s. These changes are produced by a nonlinear processing step that reduces gain in the dark (see above; P Ala-Laurila and F Rieke, unpublished). The reduction in noise at backgrounds higher than 0.1 R*/rod/s likely reflects the stronger decrease in gain at these backgrounds, which more than compensates the increase in Poisson fluctuations.
Changes in noise, although modest, had a noticeable effect on detection threshold—defined as the strength of the flash eliciting a response with a signal-to-noise ratio of 1 (Figure 3C,F; see ‘Analysis’). This measure of threshold assumes a linear scaling of response with flash strength, which fails in the dark but holds for backgrounds exceeding 0.01 R*/rod/s (P Ala-Laurila and F Rieke, preprint). The threshold in Figure 3C,F corresponds to the threshold of an ideal observer of the ganglion cell's output, assuming that signal and noise are independent and additive. Thus, the threshold defined here provides a point of comparison to human behavioral threshold vs intensity curves. The threshold for On parasol responses increased for backgrounds as low as 0.02 R*/rod/s, in close correspondence with backgrounds that produce changes in behavioral threshold (Donner, 1992). Threshold increased with a slope <1 for backgrounds between 0.02 and 5 R*/rod/s (Figure 3F). The extended region over which the slope was less than unity reflected the increase in noise at backgrounds lower than those required to produce gain changes, a region near the onset of gain changes where noise was near constant, and the decrease in noise at backgrounds where gain began to decrease proportionally with background.
Properties of gain control
The experiments described above indicate that the gain of retinal signals begins to decline at backgrounds producing ∼0.02 R*/rod/s. Gain control under these conditions is challenging because photons arrive rarely at individual rod photoreceptors; retinal responses at these backgrounds are noisy, and hence changes in background will be difficult to discern without a large degree of spatial and/or temporal averaging. At the same time, left unabated, the high gain associated with fully dark-adapted vision would cause a parasol ganglion cell to generate hundreds of spikes per second for backgrounds producing ∼0.02 R*/rod/s. The experiments described in this section characterize several key properties of how gain is controlled—particularly the statistical feature of the input that sets gain and how the mechanism integrates over space and time.
Gain is controlled by mean not fluctuations
Changes in the mean background necessarily also change the magnitude of the fluctuations about the mean because of the division of light into discrete photons and the resulting statistical fluctuations in photon arrival. Such Poisson fluctuations in photon absorption are particularly large relative to the mean absorption rate at low backgrounds. Because these statistical fluctuations increase with the square root of the background, a gain control that directly depends on the magnitude of the noise would cause gain to scale inversely with the square root of the background (Brown and Rudd, 1998). The experiments below, however, indicate that gain at low backgrounds is controlled by the mean photon absorption rate and not by the magnitude of the fluctuations about the mean rate.
To isolate the potential effects of fluctuations about the mean on gain, we delivered a series of flashes before, during, and after a high contrast fluctuating stimulus while maintaining a constant mean background (Figure 4A). A Rose–deVries gain control mechanism based on the fluctuations about the mean predicts that gain should decrease linearly with standard deviation (dashed line in Figure 4B). Instead, contrast stimuli that substantially increased the variance of a ganglion cell’s excitatory synaptic inputs tended to increase, rather than decrease, the gain of the flash response. In nine cells, stimuli that increased the standard deviation of the baseline excitatory synaptic inputs by 43 ± 17% (mean ± SD) produced a 18 ± 11% increase in gain (Figure 4B). These data argue directly against noise controlling gain at low backgrounds, indicating instead that gain is controlled by the mean photon flux.
Gain changes rapidly
Gain control at low backgrounds requires averaging across rods and/or time to obtain a sufficient photon count to determine that the mean background has changed (Rushton, 1965). Too much spatial or temporal averaging could limit the effectiveness of gain control: spatial averaging across regions of a scene with different backgrounds could fail to protect retinal signals from local saturation, and temporal averaging could be ineffective if it introduces too long a delay between changes in input and changes in gain. What strategy, then, does the circuit adopt? We start by describing the kinetics of gain changes.
To test for slow changes in gain that would reflect extensive temporal averaging, we switched the background periodically between two levels while delivering flashes every second to monitor gain. The baseline firing rate and mean excitatory input changed slowly following a change in background, and had not reached an obvious steady-state level even after 200 s. Gain changes, however, occurred within a few seconds following a change in background—for example, in Figure 5—figure supplement 1, the ∼twofold change in gain between panels B and C is largely complete by the time of the first flash response (1 s after the background change). Gain did not change noticeably in the subsequent 60–200 s (Figure 5—figure supplement 1; see also Figures 10 and 11).
To resolve the initial rapid change in gain, we delivered flashes at times ranging from 0.1 to 2 s following either an increase or a decrease in background while measuring a cell’s excitatory synaptic inputs. We adjusted the flash strength to generate a near-constant response at the two backgrounds. Subtracting the response to the background step alone isolated responses to the flashes (Figure 5A, bottom). Following an increase in background, gain fell with a time constant of 0.10 ± 0.02 s (mean ± SEM, n = 5); following a decrease in background, gain increased with a time constant of 0.4 ± 0.1 s (n = 6). The decrease in gain at light onset tracked the development of the step response, with apparently little delay due to the gain control mechanism itself. Recovery of gain following a decrease in background took more time, as indicated by the slower kinetics at light offset.
The gain control mechanism has access to signals from many rods
The rapid kinetics of gain changes at both light onset and offset indicate a need for considerable integration of signals across rods. For example, in the 0.1 s following an increase in background from 0.02 to 0.08 R*/rod/s, <1 in 100 rods absorbs a photon. Thus, the observed gain changes cannot be explained by a mechanism operating on a small collection of rods; for example, a mechanism operating in single rods would only be engaged in 1 out of 100 rods, and hence could reduce overall gain at most by 1%. The halving of gain produced by this step in background requires a mechanism that integrates over at least 50 rods even if a single absorbed photon reduces gain to 0 (Figure 6). In this section, we describe experiments that probed the spatial scale of the gain control mechanism by measuring the extent to which a decrease in gain in one region of space transferred to neighboring regions.
We adapted subregions within the ganglion cell receptive field while probing the gain of responses elicited at distinct locations (Figure 7A). In the ‘baseline’ phase of the experiment, we flashed two different probe patterns consisting of a set of bars on a weak spatially uniform adapting background (0.02 R*/rod/s). In the ‘adaptation’ phase of the experiment, we presented a steady adapting bar pattern (bar intensity = 0.2 R*/rod/s) that overlapped exactly with one of the probe patterns (‘adapted’ location) and had no overlap with the other probe pattern (‘unadapted’ location). We then repeated measurements of the responses to the two probe patterns to determine the extent to which the adapting pattern affected gain in the adapted and unadapted locations.
By exploring a range of widths for the adapting bars, we were able to measure the distance over which gain changes from the adapted location transferred to the unadapted location. Figure 7B illustrates the logic of the experiment. Adapting bars that are narrow compared to the adapting subregions (circles in Figure 7B) should produce near-identical gain changes in each subregion since the total adapting pattern will vary little between subregions. In this case, the ganglion cell should respond similarly to probes at the adapted and unadapted locations, indicating complete or near-complete transfer of gain changes. Adapting bars that are wide compared to the size of the adapting subregions should produce variable changes in gain across subregions; in this case, the ganglion cell should respond more strongly at the unadapted location, indicating incomplete transfer of gain changes.
Figure 8A shows results from one such experiment. Gain changes at the adapted and unadapted location were measured by dividing responses to probes during the adaptation phase (gray traces) by those during the baseline phase (black traces). Adaptation transfer was defined as the gain change at the unadapted location divided by the gain change at the adapted location. For the cell in Figure 8A, the narrow bars produced considerably greater adaptation transfer than the wide bars.
Figure 8B collects results across bar sizes and cells. Gain changes transferred completely or near completely for bar widths up to 50 µm. Near-complete adaptation transfer at this bar width requires that the receptive field of the adapting mechanism have a diameter of at least 100 µm—so that the mechanism always samples both the bright and dark bars (see Figure 7B). A receptive field of this size would contain at least 500 rods given the rod density of ∼0.1/µm2 (Osterberg, 1935). Bar widths of 100 µm and larger produced incomplete adaptation transfer, proving an upper bound on the extent of spatial integration.
The experiments of Figures 7 and 8 indicate that gain control is mediated by a mechanism that has access to signals from hundreds of rods. This degree of spatial pooling is required to support the rapid kinetics described in Figure 5 and is present only downstream of the synapse between rod bipolar cells and AII amacrine cells (Figure 1).
Gain changes are mediated in rod bipolar pathway
To further constrain the possible sites of gain control, we looked for transfer of gain changes from rod- to cone-mediated signals (Figure 9). The rod bipolar pathway shares the cone bipolar cell and its synapse onto the ganglion cell with the pathways that convey signals transduced in cones to the ganglion cells (Figure 1A). Transfer of gain changes from the rod bipolar pathway to the cone pathway would indicate that gain is controlled in a circuit element shared between the two pathways—most likely the cone bipolar cell itself. Failure of gain changes to transfer would indicate that the mechanism is located at a circuit element providing input only to the rod bipolar pathway.
The spectral separation of the photopigments in rods and long-wavelength (L) cones and the considerably higher gain of rod-mediated signals allowed separation of rod- and cone-mediated inputs to a ganglion cell (Figure 9A; Dunn et al., 2007). Long-wavelength light stimuli produced a rapid L-cone–mediated response superimposed on a slower rod-mediated response (purple trace in Figure 9A). This reflects the ∼600-fold greater sensitivity of the L-cones compared to the rods for long wavelength light and a roughly equal compensating factor for the higher gain of rod-mediated signals. Stimulation with dim short-wavelength light (<0.1 R*/rod and <0.03 R*/cone) generated a nearly pure rod-mediated response (blue trace in Figure 9A). Appropriate scaling of the strengths of the two flashes produced matched rod responses to long- and short-wavelength stimuli. Subtracting the rod-mediated response from the mixed response isolated the cone-mediated response (red trace in Figure 9A).
We separated rod- and cone-mediated responses as in Figure 9A across a range of dim backgrounds (Figure 9B,C). Backgrounds that produced substantial reductions in gain of the rod-mediated signals failed to reduce the gain of the cone-mediated signals (Figure 9B–E). Thus, gain changes do not transfer from the rod pathway to the cone pathway, indicating that gain is controlled at a site prior to mixing of rod and cone signals in the cone bipolar cell. The lack of transfer from rod to cone pathways, together with the requirement that the gain control mechanism have access to signals from hundreds of rods (Figure 8), makes the AII amacrine cell and/or its gap junction with On cone bipolar cells likely sites.
Discussion
Statistical fluctuations in the stream of photons incident on the retina make controlling the gain of rod-mediated signals at low backgrounds challenging. Yet, such gain control is important because it protects retinal signals from saturating as backgrounds increase while permitting the high amplification required to detect absorption of a few photons under fully dark-adapted conditions. Here, we have explored the properties of retinal gain controls operating near visual threshold. Below, we relate our findings to the dependence of human behavioral threshold on background and to the general speed/accuracy trade-off associated with detecting a change in the statistics of a noisy signal.
Connection to behaviorally measured threshold
How do the properties of gain controls at low backgrounds in primate retina relate to human behavioral threshold verses intensity (TVI) measurements in humans? The region of the TVI curve in which threshold is unaffected by background light has long been associated with the intrinsic noise of the visual system (Fechner, 1860; Barlow, 1956). Threshold is increased only by backgrounds that produce a sufficient rate of photon absorption to exceed intrinsic noise. Human behavioral threshold begins to increase for backgrounds near 0.01 R*/rod/s, similar to the backgrounds (∼0.02 R*/rod/s) at which primate ganglion cell thresholds began to increase. Both of these are considerably higher than the rate at which spontaneous activation of rhodopsin generates photon-like noise events in primate rods (0.003–0.004 R*/rod/s) (GD Field and F Rieke, unpublished). They are, however, consistent with measures of the total noise (i.e., both discrete and continuous) generated by macaque rods (Schneeweis and Schnapf, 2000).
The Rose–deVries region of the TVI curve has long been assumed to reflect an increase in noise without a reduction in gain (Barlow, 1957). Consistent with this view, the gain of retinal signals measured via electroretinograms begins to decline only at backgrounds ∼fivefold higher than those that increase behavioral threshold (Frishman et al., 1996). Several other previous experiments, however, suggest that gain is reduced in the Rose–deVries range. First, behavioral brightness matching experiments, which should be sensitive to changes in neural gain but not noise, show a robust Rose–deVries region (Brown and Rudd, 1998). Second, the spike responses of toad ganglion cells exhibit an ∼10-fold range of backgrounds over which the threshold required to reach a criterion spike rate increases in proportion to the square root of the background (Donner et al., 1990). Experiments in cat (Barlow and Levick, 1969; Enroth-Cugell and Shapley, 1973) and mouse (Dunn et al., 2006) also find adaptation at dim backgrounds, but with an exponent >0.5.
Our measurements of how gain control mechanisms affect both the signal and noise of the responses of On parasol ganglion cells provide a direct comparison to human psychophysics. The gain of signals in the rod pathway indeed decreased at low backgrounds, and noise increased much more slowly with increasing background than expected from Poisson fluctuations in photon absorption. The region of the ganglion cell TVI curve with slope 0.5 was limited to a narrow range of backgrounds. This suggests that post-retinal mechanisms contribute substantially to the more extended Rose–deVries region measured in behavioral studies.
A panoply of gain control mechanisms
Our results place a number of constraints on the neural gain control mechanism that is engaged at the lowest backgrounds—for example, in starlight. The mechanism estimates the mean photon flux rather than its variance (Figure 4), it is rapid (Figure 5), it has access to signals from hundreds of rods (Figure 8), and it acts on rod-mediated but not cone-mediated signals (Figure 9). Previously described gain control mechanisms are sensitive to variance (reviewed by Demb, 2008), act at locations with insufficient rod convergence (Dunn et al., 2006; Dunn and Rieke, 2008), or affect cone signals (Dunn et al., 2007). The constraints above suggest a novel mechanism located in the AII amacrine cell or the synaptic connections it makes with cone bipolar cells (Figure 5). Recordings from these cells as well as the On cone bipolar cells to which they make gap junctions could uncover more mechanistic details.
Although we focused on gain changes in the inputs to On parasol ganglion cells, a location of the site of adaptation in the rod bipolar pathway indicates that it should be shared across ganglion cell types. Consistent with this prediction, On midget ganglion cells adapted very similarly to On parasol ganglion cells (data not shown).
The mechanism we identify here adds to a long list of gain controls in the retinal circuitry. Considering luminance alone, retinal ganglion cells encode stimuli over 10 log units of background, far exceeding the dynamic range of any single mechanism. In the rod pathway, there are at least three gain control mechanisms engaged across backgrounds, each matched to the rod convergence at the adapting location. Backgrounds producing approximately 10–20 R*/rod/s halve the gain of the phototransduction cascade in primate rods (Schneeweis and Schnapf, 2000). Backgrounds producing ∼0.4 R*/rod/s halve the gain of the rod bipolar to AII synapse by reducing the number of releasable vesicles (Dunn et al., 2006; Dunn and Rieke, 2008; Oesch and Diamond, 2011). And, as shown here, backgrounds ∼0.08 R*/rod/s engage a mechanism located downstream of the rod bipolar–AII synapse; the light levels at which this mechanism is engaged are consistent with backgrounds that are just detectable given the total noise generated by macaque rods (Schneeweis and Schnapf, 2000). Impressively, these mechanisms act in concert to create a smooth dependence of gain on background in the ganglion cell (e.g., Figure 3A), even extending to backgrounds at which signaling begins to switch from rods to cones and gain control mechanisms in the cone pathway become active (Dunn et al., 2007). At least five separate gain control mechanisms that contribute to a single smooth function relating background to gain over >5 log units on each axis (Figure 3A) suggest that this particular functional form for adaptation was a target of selective pressure in primate evolution.
Adapting to a noisy signal
Adapting at low backgrounds is inherently dangerous as statistical fluctuations in photon absorption introduce substantial noise into the neural signals accessible to a gain control mechanism; such noise would be expected to cause gain to vary widely. The impact of noise in the signals controlling gain could be mitigated by not adapting until backgrounds increase enough to make more photons available, or by integrating over time and/or rods to reduce noise. Surprisingly, retinal gain controls appear to operate at the lowest backgrounds physically possible—that is, each absorbed photon within the pool of rods providing input to an adaptational mechanism lowers gain.
Adaptation at the rod bipolar to AII synapse approaches the sensitivity limit imposed by convergence and integration time (Dunn and Rieke, 2008; see Figure 1B). That is, a single absorbed photon reduces the gain of the next single photon response. Rod convergence onto AII amacrine cells is not known precisely in primate, but the onset of adaptation is consistent with a single photon absorption in the AII receptive field reducing gain. Assuming a 0.1 s integration time (Figure 5), a mechanism operating on a pool of 200 rods would have to reduce gain by 40% for each photon absorbed for the gain to be halved at 0.08 R*/rod/s; a pool of 800 rods could achieve this level of gain control with a 11% gain reduction per photon (see ‘Modeling’).
Vision in the dark requires high gain of the retinal circuitry conveying rod-mediated signals to ganglion cells. This high gain could easily lead to saturation of retinal signals as backgrounds increase. Indeed, the onset of retinal gain control coincides with the dimmest detectable backgrounds given the intrinsic noise of the rods. These considerations help explain why retinal gain controls are engaged by each absorbed photon, even when adaptation under these conditions is necessarily noisy.
Materials and methods
Recordings and light stimulation
Request a detailed protocolAll recordings were from On parasol ganglion cells in peripheral (eccentricity typically >30°; ∼15° to 20° for the experiments of Figure 9) primate retina (Macaca nemestrina, fascicularis, and mulatta). Retina was obtained through the Tissue Distribution Program of the Regional Primate Center at the University of Washington. The retina was dark adapted for 1 hr while attached to the pigment epithelium and stored for up to 24 hr in a light-tight container at 32°C in Ames solution equilibrated with 95% O2/5% CO2. All subsequent procedures were performed under infrared light (>900 nm) using infrared-visible converters.
For recording, a roughly 4 × 4-mm piece of retina was removed from the pigment epithelium and mounted photoreceptor side down on a polylysine-coated glass coverslip forming the bottom of the recording chamber. The retina was secured by nylon wires stretched across a platinum ring. The retina was continuously superfused (8–10 ml/min) with warmed (32–34°C) Ames solution equilibrated with 95% O2/5% CO2. Calibrated light stimuli were delivered from LEDs focused on the retina by the microscope condenser. Spatial stimuli for Figures 7 and 8 were delivered using an OLED array (eMagin, Bellevue, WA). Stimulus intensities are given in terms of isomerizations per rod per second (R*/rod/s), based on the measured LED spectral output, the rod spectral sensitivity, and an assumed collecting area of 1 μm2.
Spike responses were measured in the cell-attached configuration using pipettes filled with Ames solution. Whole-cell voltage clamp recordings were made using patch pipettes filled with 105 mM CsCH3SO3, 10 mM TEA-Cl, 20 mM HEPES, 10 mM EGTA, 5 mM Mg-ATP, 0.5 mM Tris-GTP, and 2 mM QX-314 (pH ∼7.3 with CsOH, ∼280 mOsm). Reported holding voltages have been corrected for the ∼10 mV junction potential associated with this internal solution. Series resistance was typically 6–10 MΩ, and was compensated 50%.
All data came from parasol ganglion cells exhibiting high sensitivity when fully dark adapted. Recordings followed previous procedures (Trong and Rieke, 2008). We first used cell-attached recordings to test the spike response to a brief flash producing 0.001–0.002 R*/rod, and collected data only from cells that responded to these flashes with an average of 4–5 spikes. During experiments monitoring adaptation across a range of light levels (e.g., Figures 2, 3 and 9), we periodically returned to a ‘reference’ background near 0.05 R*/rod/s to check for slow changes in sensitivity. Figures 10 and 11 illustrate the basic timeline of such experiments for cell-attached recordings of spike responses (Figures 10) and whole-cell recordings of excitatory synaptic inputs (Figures 11). Figures 10B and 11B show the changes in flash strength (gray line and right axes) used to generate near-equal responses across backgrounds. The figures also illustrate, based on raw data, some of the key features quantified in the ‘Results’: (1) the sensitivity of gain to weak backgrounds (Figures 10A–C and 11A–C); (2) the rapid changes in gain following changes in background (Figure 10C and 11C); (3) the slow changes in baseline firing rate (Figure 10D) and excitatory synaptic input (Figure 11D) following changes in background; and (4) the changes in noise following changes in background (Figure 11E).
Analysis
A time window containing the flash response was chosen for each background and flash intensity by selecting the time points at which the average response exceeded 20% of its maximal value. The response amplitude was computed as the integrated current during this time window minus a baseline current recorded before the flash. Using a fixed time window across backgrounds and flash strengths yielded similar results. Gain values in Figures 2, 3, 10, and 11 and Figure 5—figure supplement 1 are the response amplitude divided by the flash strength.
We projected flash responses along a template to compute flash detection thresholds (Figures 2 and 3). The template was the average current trace in the time window described above. For each trial, we defined the signal γ as the projection of the measured current along the template divided by the flash strength, and the noise ν as the projection of the current during a time window before the flash. Detection threshold θ was defined as the flash strength required to give a signal-to-noise ratio of 1 according to the following equation:
Gain and threshold of spike responses were computed analogously using the peristimulus time histogram to define the response time window for spike counts (Figure 2).
Modeling
Request a detailed protocolProbabilities of photon absorptions depending on background, integration time, and rod convergence (Figure 6) were computed from a Poisson distribution as follows. For a given background (μ) in units of R*/rod/s, an integration time (τ), and a rod convergence (C) per neural element, the probability of a neural element collecting a particular number (k) of photons follows Poisson statistics.
Figure 6 plots the combination of values of μ, τ, and C required for half of the neural elements to collect at least one photon.
In the ‘Discussion’, we compute the gain reduction achieved for several size pools of converging rods. If each photon (k) collected by a neural element reduces the gain for the next photon response by a constant factor (α), the gain as a function of k and α can be computed as follows.
Therefore, the gain of a collection of neural elements (Γ) collecting photons according to Poisson statistics (normalized to Γ = 1 for maximal gain) is computed as follows.
References
-
Retinal noise and absolute thresholdJ Opt Soc Am 46:634–639.https://doi.org/10.1364/JOSA.46.000634
-
Increment thresholds at low intensities considered as signal/noise discriminationsJ Physiol 136:469–488.
-
Optic nerve impulses and Weber’s lawCold Spring Harb Symp Quant Biol 30:539–546.https://doi.org/10.1101/SQB.1965.030.01.052
-
Three factors limiting the reliable detection of light by retinal ganglion cells of the catJ Physiol 200:1–24.
-
Rod vision: pathways and processing in the mammalian retinaProg Retin Eye Res 20:351–384.https://doi.org/10.1016/S1350-9462(00)00031-8
-
Bayesian spiking neurons I: inferenceNeural Comput 20:91–117.https://doi.org/10.1162/neco.2008.20.1.91
-
The impact of photoreceptor noise on retinal gain controlsCurr Opin Neurobiol 16:363–370.https://doi.org/10.1016/j.conb.2006.06.013
-
Flux, not retinal illumination, is what cat retinal ganglion cells really care aboutJ Physiol 233:311–326.
-
Elemente dur psychophysikElemente dur psychophysik, Leipzig, Germany: Breitkopf and Hartel.
-
Local luminance and contrast in natural imagesVision Res 46:1585–1598.https://doi.org/10.1016/j.visres.2005.06.038
-
X and Y cells in the lateral geniculate nucleus of macaque monkeysJ Physiol 330:125–143.
-
Correlated firing of cat retinal ganglion cells. II. Responses of X- and Y-cells to single quantal eventsJ Neurophysiol 49:325–349.
-
Topography of the layer of rods and cones in the human retinaActa Ophthalmol pp. 1–103.
-
Background light and the contrast gain of primate P and M retinal ganglion cellsProc Natl Acad Sci USA 8:4534–4537.https://doi.org/10.1073/pnas.85.12.4534
-
Origin of correlated activity between parasol retinal ganglion cellsNat Neurosci 11:1343–1351.https://doi.org/10.1038/nn.2199
Article and author information
Author details
Funding
National Institutes of Health (EY11850)
- Fred Rieke
Howard Hughes Medical Institute
- Fred Rieke
Helen Hay Whitney Foundation
- Gregory W Schwartz
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Petri Ala-Laurila, Juan Angueyra, Jeff Diamond, and Michael Rudd for helpful comments, and Mark Cafaro and Paul Newman for technical assistance.
Ethics
Animal experimentation: Primate (Macaca fascicularis, fascicularis and mulatta) retinas were obtained through the Tissue Distribution Program of the Regional Primate Research Center at the University of Washington. All procedures were approved by the institutional animal care and use committee (protocol 4140-01).
Copyright
© 2013, Schwartz and Rieke
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,132
- views
-
- 155
- downloads
-
- 14
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
During rest and sleep, memory traces replay in the brain. The dialogue between brain regions during replay is thought to stabilize labile memory traces for long-term storage. However, because replay is an internally-driven, spontaneous phenomenon, it does not have a ground truth - an external reference that can validate whether a memory has truly been replayed. Instead, replay detection is based on the similarity between the sequential neural activity comprising the replay event and the corresponding template of neural activity generated during active locomotion. If the statistical likelihood of observing such a match by chance is sufficiently low, the candidate replay event is inferred to be replaying that specific memory. However, without the ability to evaluate whether replay detection methods are successfully detecting true events and correctly rejecting non-events, the evaluation and comparison of different replay methods is challenging. To circumvent this problem, we present a new framework for evaluating replay, tested using hippocampal neural recordings from rats exploring two novel linear tracks. Using this two-track paradigm, our framework selects replay events based on their temporal fidelity (sequence-based detection), and evaluates the detection performance using each event's track discriminability, where sequenceless decoding across both tracks is used to quantify whether the track replaying is also the most likely track being reactivated.
-
- Neuroscience
Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey–Osterrieth complex figure (ROCF) is the state-of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF drawing and quantifies deviations from the original figure. This manual procedure is time-consuming, slow and scores vary depending on the clinician’s experience, motivation, and tiredness. Here, we leverage novel deep learning architectures to automatize the rating of memory deficits. For this, we collected more than 20k hand-drawn ROCF drawings from patients with various neurological and psychiatric disorders as well as healthy participants. Unbiased ground truth ROCF scores were obtained from crowdsourced human intelligence. This dataset was used to train and evaluate a multihead convolutional neural network. The model performs highly unbiased as it yielded predictions very close to the ground truth and the error was similarly distributed around zero. The neural network outperforms both online raters and clinicians. The scoring system can reliably identify and accurately score individual figure elements in previously unseen ROCF drawings, which facilitates explainability of the AI-scoring system. To ensure generalizability and clinical utility, the model performance was successfully replicated in a large independent prospective validation study that was pre-registered prior to data collection. Our AI-powered scoring system provides healthcare institutions worldwide with a digital tool to assess objectively, reliably, and time-efficiently the performance in the ROCF test from hand-drawn images.