Functional reallocation of sensory processing resources caused by long-term neural adaptation to altered optics
Abstract
The eye’s optics are a major determinant of visual perception. Elucidating how long-term exposure to optical defects affects visual processing is key to understanding the capacity for, and limits of, sensory plasticity. Here, we show evidence of functional reallocation of sensory processing resources following long-term exposure to poor optical quality. Using adaptive optics to bypass all optical defects, we assessed visual processing in neurotypically-developed adults with healthy eyes and with keratoconus – a corneal disease causing severe optical aberrations. Under fully-corrected optical conditions, keratoconus patients showed altered contrast sensitivity, with impaired sensitivity for fine spatial details and better-than-typical sensitivity for coarse spatial details. Both gains and losses in sensitivity were more pronounced in patients experiencing poorer optical quality in their daily life and mediated by changes in signal enhancement mechanisms. These findings show that adult neural processing adapts to better match the changes in sensory inputs caused by long-term exposure to altered optics.
Introduction
Understanding how we see requires insights into the contribution of both optical and neural factors mediating visual perception, from the processing of images formed on the retina to the resulting perceptual representations. Visual processing is fundamentally limited by the eye’s optics, which determine retinal image quality and constrain performance. Human optics, however, are not fixed and can substantially change over our lifespan and in disease (Artal, 2008). Consequently, to achieve efficient perceptual processing, the brain must be able to continuously adjust to changes in sensory inputs over a range of different timescales and magnitudes. There is growing evidence that visual processing adapts to the presence of optical blur, altering neural processing to improve visual representations (e.g., Artal et al., 2004; Sawides et al., 2011; Webster, 2015; Webster et al., 2002). Neural adaptation mechanisms compensate for blur-induced reductions in physical contrast of high spatial frequency (SF) retinal signals, enhancing visual sensitivity for fine spatial details (George and Rosenfield, 2004; Mon-Williams et al., 1998; Webster, 2015; Webster et al., 2002). Even observers with typical (i.e., healthy) optical quality show evidence of neural adaptation to their own optical blur, such that modest changes in their own optical aberration pattern severely degrade perceived image quality (Artal et al., 2004).
Distinct neural adaptation mechanisms operate over different timescales (Bao and Engel, 2012; Bao et al., 2013; Glasser et al., 2011; Haak et al., 2014). Most studies have investigated the effects of blur adaptation over short-term periods (i.e., minutes to hours), and often for low magnitudes of blur, thus limiting our understanding of how the adult human brain adapts to large changes in optical quality over longer periods of time (i.e., months to years). This, in turn, limits the development of clinical rehabilitations of a significant part of the population that chronically experiences abnormal optics in their daily life. A major experimental challenge comes from the difficulties of empirically isolating neural from optical factors. Technological advances in the field of adaptive optics (AO) offer a unique opportunity to bypass the limits imposed by optical factors, while directly assessing visual processing of images free from any optical imperfection (Marcos et al., 2017; Roorda, 2011). AO is a powerful technology that can be used to improve optical systems, including the human eye, by deforming a mirror to correct the wavefront distortions caused by the eye’s optics. AO correction in ‘healthy’ eyes allows observers to detect a larger range of high SF information otherwise indiscernible in the presence of optical blur, improving contrast sensitivity (Liang et al., 1997) and visual acuity (VA) (Yoon and Williams, 2002). More importantly, AO correction can be used to assess how changes in optical quality alter neural functions by making it possible to assess visual processing under fully-corrected optical quality in both typical ‘healthy’ eyes (e.g., Artal et al., 2004; Liang et al., 1997; Sawides et al., 2011; Yoon and Williams, 2002; Zheleznyak et al., 2016) and those with severe optical abnormalities (e.g., Sabesan et al., 2007; Sabesan et al., 2017; Sabesan and Yoon, 2009).
In this context, keratoconus (KC) represents an ideal model of long-term neural adaptation to optical defects (Figure 1). KC is a severe corneal disease afflicting neurotypically-developed adults (Vazirani and Basu, 2013). The corneal stroma progressively thins and assumes a conical shape, resulting in a substantial increase in both lower-order (defocus and astigmatism) and higher-order optical aberrations (HOAs). KC is essentially a bilateral condition, although disease development may be highly asymmetric. The onset of KC occurs typically during the late teens or early twenties, with variable progression that can last until the third or fourth decade of life, when corneal shape generally becomes stable (Vazirani and Basu, 2013). Although HOAs are relatively small in typical eyes, abnormal corneal conditions (e.g., such as KC) can cause large magnitudes of HOAs that cannot be efficiently corrected by conventional optical devices (Maeda et al., 2002; Pantanelli et al., 2007). Thus, despite their habitual optical correction, KC patients are chronically exposed to severely degraded retinal inputs in their daily life. The resulting retinal image is mostly deprived of fine spatial details (i.e., high SFs) and weighted toward coarse spatial details (i.e., low SFs). It is safe to assume that this prolonged exposure to poor optical quality alters neural processing to compensate for the presence of blur. Neural compensation to image blur improves visual performance in the presence of blur but limits the benefits of improved optical correction (e.g., Sabesan and Yoon, 2009; Sabesan and Yoon, 2010; Sawides et al., 2011; Sawides et al., 2010; Vinas et al., 2012). When tested under full AO correction, KC patients exhibit considerably poorer VA than that predicted by optical theory or measured in observers with healthy eyes tested under similar AO-corrected optical quality (Sabesan and Yoon, 2009). However, little is known regarding the underlying mechanisms mediating such changes in visual processing following long-term exposure to severe optical aberrations.
Here, we used state-of-the-art AO to assess how long-term exposure (i.e., months to years) to optical defects alters neural processing of visual information in neurotypically-developed humans. To do so, we measured the impact of various amounts of optical aberrations – chronically experienced by control observers with typical, healthy eyes and KC patients – on the visual system’s ability to detect contrast over a wide range of SFs under fully-corrected optical quality. KC patients differ from neurotypically-developed adults with healthy eyes based on the amounts of habitual optical aberrations experienced in their daily life, which we can bypass using AO correction to assess differences in visual processing. For well over a century, contrast sensitivity has been a valuable tool for measuring the limits of visual perception, as well as for the assessment and early diagnosis of many disorders (Campbell and Green, 1965; Fechner, 1860). The visual system is composed of SF-selective filters whose combined sensitivity determines the shape of the contrast sensitivity function (CSF) (Blakemore and Campbell, 1969; Campbell and Green, 1965; DeValois and DeValois, 1988). Detection of alterations in the shape of the CSF allows inferences about changes in underlying physiological processes, such as in amblyopia (Hou et al., 2010), autism spectrum disorder (Guy et al., 2016), and aging (Yan et al., 2017).
Given that the impact of optical aberrations is more pronounced at high SFs, we expect deficits in contrast sensitivity for high-SF signals despite correcting all optical aberrations, whereas visual sensitivity to low-SF information should remain unaffected. Neural insensitivity to fine spatial details would account for the poorer VA observed in KC patients tested under AO correction (Sabesan and Yoon, 2009). However, whether neural processing in KC is simply impaired for visual inputs directly affected by the eye’s optics (i.e., high SFs) or undergoes a more adaptive reallocation of sensory processing resources in order to better match the degraded retinal inputs is unknown. In the present study, we provide compelling evidence that neural compensation to severe optical defects over prolonged periods of time alters visual processing across a wide range of SFs, attenuating sensitivity at high SFs but surprisingly enhancing sensitivity to low SFs. First, we show evidence of altered CSF (experiment 1) and poorer VA (experiment 2) in KC patients relative to control observers with healthy eyes, despite being tested under similar AO-corrected optical quality. Then, using an equivalent noise paradigm and a computational model of visual processing (perceptual template model [PTM]; Bejjanki et al., 2014; Burgess et al., 1981; Dosher and Lu, 1998; Lu and Dosher, 1999; Lu and Dosher, 2008; Park et al., 2017; Pelli and Farell, 1999), we identify the putative mechanisms underlying the changes in visual sensitivity observed in KC patients (experiment 3). The pattern of gains and losses in sensitivity in KC patients reflects SF-specific changes in signal enhancement mechanisms, with elevated and reduced internal noise levels at high and low SFs, respectively. Overall, our findings reveal that chronic exposure to poor optical quality does not result in neural deficits restricted to high SFs, but rather manifests in a functional reallocation of sensory processing resources over a wide range of SFs.
Results
Habitual aberrations and AO-corrected visual quality
We first need to quantify the varying amounts of habitual optical aberrations experienced by each observer before establishing that we can fully correct all optical aberrations to a similar level in both healthy and KC eyes. In total, 10 KC patients with mild-to-severe optical aberrations and 14 age-matched control observers with healthy eyes were tested monocularly (see 'Materials and methods' and Table 1). Habitual optical quality for the tested eye was estimated using our AO system (Figure 2A and 'Materials and methods') by collecting multiple wavefront measurements for each observer wearing their own, everyday optical corrective method, if any. Wavefront maps were fitted with Zernike polynomials to compute the total root mean square (total RMS; all optical aberrations) and higher-order RMS (hRMS+; HOAs only) for a 6-mm pupil (Figure 2B and 'Materials and methods'). Relative to the optical quality in age-matched control (CTRL) observers (mean total RMS 0.84 ± 0.26 µm, range 0.58–1.42), habitual optical quality in KC eyes (mean total RMS 3.18 ± 2.09 µm, range 1.36–7.84) remained suboptimal despite their own optical corrections (CTRL-vs-KC total RMS: Mann–Whitney U-test, U = 1, p<0.001, r = 0.99). Specifically, KC eyes were subject to a substantial amount of uncorrected HOAs (mean hRMS+ 1.91 ± 1.27 µm, range 0.33–4.55), much more than the healthy eyes of control observers (mean hRMS+ 0.37 ± 0.11 µm, range 0.22–0.55) (CTRL-vs-KC hRMS+: Welch’s t-test, t = 3.83, p=0.004, d = 1.71). As previously reported (Pantanelli et al., 2007), KC eyes were particularly affected by large amounts of vertical coma (mean absolute Z7 coefficient 1.38 ± 0.96 µm, range 0.03–2.89), much more than in typical, healthy eyes (0.12 ± 0.11 µm, range 0.02–0.34) (CTRL-vs-KC absolute Z7 coefficient: Welch’s t-test, t = 4.11, p=0.003, d = 1.84). The onset of KC in our patients was around their twenties and varied in its progression, as typically observed in this disease (Vazirani and Basu, 2013). As a result, the amount of habitual optical aberrations did not correlate with participant’s age (Pearson correlation with habitual RMS r=+0.29, p=0.169; with habitual hRMS+ r=+0.30, p=0.155).
Consistent with previous studies from our lab (e.g., Sabesan et al., 2007; Sabesan et al., 2017; Sabesan and Yoon, 2009; Sabesan et al., 2012; Zheleznyak et al., 2016), our AO system allowed us to measure visual performance while effectively maintaining aberration-free optical quality, even in severe KC eyes (Figure 2C). To maximize AO correction during stimulus presentation, observers were trained to blink between trials and to pause if the perceptual quality got unstably poor during testing (see 'Materials and methods'). Continuous closed-loop AO correction during visual testing resulted in a residual wavefront RMS that remained not significantly different from 0.055 µm for both healthy eyes (mean 0.051 ± 0.011 µm, range 0.033–0.067; Student t-test: t = 1.49, p=0.161, d = 0.4) and KC eyes (mean 0.059 ± 0.014 µm, range 0.046–0.083; Wilcoxon signed-rank test: Z = 31, p=0.770, r = 0.13). More importantly, aberration-free optical quality under AO correction was similar between CTRL and KC observers (Wilcoxon rank-sum test, U = 50, p=0.259, r = 0.29), with no relation between the individual AO-corrected residual RMS and the amount of habitual optical aberrations without AO correction (Pearson correlation with habitual RMS r=+0.30, p=0.155; with habitual hRMS+ r=+0.33, p=0.120).
The modulation transfer function (MTF) of the eye’s optics characterizes the reduction in signal contrast of individual SF contents imaged on the retina (Figure 2D, E). The reduction in contrast is pronounced at mid-to-high SFs, particularly in KC eyes due to the atypical levels of uncorrected blur (Figure 2D). Importantly, AO correction allowed us to correct all optical aberrations and maintain similar, diffraction-limited optical quality in all participants (Figure 2E). Thus, online AO correction effectively and continuously provided nearly perfect optical quality during visual testing, allowing us to bypass optical factors and assess differences in neural transfer function between CTRL with healthy eyes and KC patients chronically exposed to atypical amounts of optical aberrations.
Experiment 1: altered CSF following long-term exposure to optical defects
First, we assessed the CSF in both KC patients (N=10) and age-matched control observers (N=14) under aberration-free conditions. Observers performed an orientation discrimination task at fixation (Figure 3A) in which they reported the orientation of ±45°-tilted Gabor patches varying in both contrast and SF (in cycles per degree [cpd]). To optimize data collection, we used the quick CSF method (Hou et al., 2010; Hou et al., 2016; Lesmes et al., 2010), which combines Bayesian adaptive inference with a trial-by-trial information gain strategy to estimate the observer’s CSF as a truncated log-parabola with four parameters (Figure 3B and 'Materials and methods'): (1) peak sensitivity, ; (2) peak frequency, ; (3) bandwidth, ; and (4) low-SF truncation level, . The low-SF truncation level determines sensitivity at low SFs (). We also estimated the high-SF cutoff () from qCSF fits – a measure of VA. The qCSF method has been used to characterize CSF in both neurotypical and diverse clinical populations (Hou et al., 2010; Hou et al., 2016; Lesmes et al., 2010; Thurman et al., 2016; Yan et al., 2017).
Under similar, aberration-free optical quality, KC observers exhibited altered CSF relative to control observers (Figure 4A), showing impairments for high SFs (for SFs ≥ 8.13 cpd) but also improvements for low SFs (for SFs ≤ 0.92 cpd). In other words, even when both groups had matched retinal image quality, there were still substantial differences in contrast sensitivity. This pattern of gains and losses changed the shape of the CSF, revealing both impaired sensitivity at high SFs (; CTRL: 37.5 cpd [35.1–40.3; 95% CI]; KC 29.0 cpd [27.7–31.2]; p<0.001) and better sensitivity at low SF (; CTRL 4.60 [3.74–5.46]; KC 7.41 [5.82–8.62]; p<0.001). Improved sensitivity at low SFs reflected a reduction in the low-SF truncation level in KC (; CTRL +0.063 [+0.034 +0.101]; KC –0.021 [–0.055 +0.028]; p=0.0025). Moreover, the impairment in high-SF cutoff was marginally correlated with the reduction in low-SF truncation across observers (r=+0.38, p=0.0675). The overall result was a shift in peak SF toward lower SFs in KC (; CTRL 3.36 cpd [3.25–3.72]; KC 2.70 cpd [2.54–2.91]; p<0.001). Notably, these CSF changes were roughly balanced, resulting in the area under the CSF (AUCSF) being similar between groups (CTRL 2.63 [2.60–2.73]; KC 2.66 [2.60–2.73]; p=0.461). This is also consistent with the fact that we observed no significant changes in amplitude (; CTRL 67.00 [63.1–80.3]; KC 72.5 [63.8–83.5]; p=0.349) or bandwidth (; CTRL 2.82 [2.62–2.92]; KC 2.75 [2.60–2.89]; p=0.390).
Critically, both gains and losses in contrast sensitivity under aberration-free conditions were more pronounced in KC patients who experienced large amounts of optical aberrations in their everyday life (Figure 4B and Figure 4—figure supplement 1). Note that KC patients were split based on their habitual optical aberrations only for illustration purposes. Changes in qCSF parameters under full AO correction correlated with the amount of habitual aberrations each observer experienced in their everyday life (Figure 4C; Pearson correlation coefficients using hRMS+; : r=−0.72, p<0.001; : r=−0.61, p=0.002; : r=−0.75, p<0.001; : r=+0.57, p=0.003). No correlation was observed for other qCSF parameters (i.e., , , or AUCSF). A similar pattern was observed using the total RMS as an index of habitual optical quality (Figure 4C). Moreover, the age at disease onset in our patients was around their twenties, as typically observed in KC (Vazirani and Basu, 2013). Participant’s age is therefore a good proxy for the exposure duration to the optical aberrations caused by KC. Yet, none of the changes in CSF observed in KC patients actually correlated with participant’s age (Figure 4—figure supplement 2). There was a tendency for the AUCSF and amplitude () to decrease with participant's age, consistent with the overall reduction in sensitivity with age (e.g., Yan et al., 2017). Note that substantial changes in visual processing with age are typically observed in much older (>60 years old) observers (e.g., Derefeldt et al., 1979; Elliott et al., 1995; Yan et al., 2017).
Experiment 2: poorer VA following long-term exposure to optical defects
VA measurements using high-contrast Snellen E letters (Figure 5A and 'Materials and methods') showed that both groups had better than 20/20 vision when tested under full AO correction, as expected. However, KC patients (15.6 ± 1.9 Snellen VA, range 13.4–18.5) had poorer VA than control observers (12.6 ± 1.3 Snellen VA, range 10.6–15.5) (Figure 5B; CTRL-vs-KC logMAR VA: t = 4.68, p<0.001, d = 1.94). This deficit in high-contrast VA under full AO correction is consistent with previous findings (Sabesan and Yoon, 2009) and correlated with the participant’s amount of habitual aberrations experienced outside the AO (Figure 5C; total RMS: r=+0.74, p<0.001; hRMS+: r=+0.79, p<0.001), but not with participant’s age (Figure 5—figure supplement 1; r=+0.24, p=0.250). Moreover, VA deficits under AO correction correlated with the changes in qCSF parameters (Figure 5D), such as peak SF (r = −0.73, p<0.001), high-SF cutoff (r = −0.74, p<0.001), and notably low-SF truncation (r = −0.66, p<0.001) and low-SF sensitivity (r=+0.42, p=0.039). That is, poorer VA in KC under AO correction was predicted by both impaired high-SF sensitivity as well as improved low-SF sensitivity. Altogether, these findings indicate that long-term exposure to severe optical defects alters the CSF in a way that results in impaired fine spatial vision, but also in better sensitivity to coarser spatial information that is less affected by the eye’s optics. This pattern of results is suggestive of a functional reallocation of sensory processing resources across a broad range of SFs that is expected to optimize visual processing of severely aberrated retinal images, but limits perceptual quality under fully-corrected optical quality.
Experiment 3:altered internal additive noise levels following long-term exposure to optical defects
To better understand how long-term exposure to optical defects alters visual processing across SFs, we used an equivalent noise paradigm (Bejjanki et al., 2014; Burgess et al., 1981; Dosher and Lu, 1998; Lu and Dosher, 1999; Lu and Dosher, 2008; Park et al., 2017) in which we measured perceptual thresholds as a function of varying external noise levels (see 'Materials and methods'). Six KC patients and eight age-matched control observers (see 'Materials and methods' and Table 1) performed an orientation discrimination task under varying levels of dynamic white noise added to the stimuli (Figure 6A), judging whether a foveally presented grating was tilted ±45° from vertical. Five different SFs (0.5, 1, 3, 9, and 16 cpd) were tested across different experimental sessions. Stimulus presentation was controlled using the FAST method (Vul et al., 2010), an advanced adaptive psychophysical technique that allowed us to estimate relevant model parameters in just 480 trials per stimulus SF and per observer. Changes in perceptual thresholds with external noise result in a characteristic threshold-versus-noise (TvN) function, which can be fitted with the PTM (Dosher and Lu, 1998; Lu and Dosher, 1999; Lu and Dosher, 2008) to quantify the effects of noise on perception (Figure 6). The PTM is a computational model of visual processing that had been successfully used to identify the mechanisms underlying perceptual differences for a wide range of brain functions, such as attention (Dosher and Lu, 2000; Lu and Dosher, 1998) and perceptual learning (Dosher and Lu, 1998), as well as between specific populations, such as in amblyopia (Levi and Klein, 2003), autism (Park et al., 2017), dyslexia (Sperling et al., 2005), and cortical blindness (Cavanaugh et al., 2015).
The PTM considers that the differences in perceptual performance between groups can result from changes in three separate mechanisms (Figure 6): (1) signal enhancement, (2) signal selectivity, or (3) gain control (nonlinearity change). Each signal processing mechanism is implemented within the PTM observer model by changes in one of three possible sources of noise: (1) internal additive noise (), (2) external noise filtering (), and (3) multiplicative internal noise (). Signal enhancement improves the ratio of the signal relative to the internal additive noise. Elevated internal additive noise indicates impaired signal enhancement mechanisms and leads to worse perceptual thresholds at low external noise levels (Figure 6C, upper left). No difference is observed when high external noise is the primary limiting factor as both the signal and the external noise in the stimulus are amplified. Signal selectivity (tuning) determines the capacity of the perceptual template to filter out external noise, which affects performance only at high external noise levels (Figure 6C, upper right). A combined effect of higher internal additive noise and poorer external noise filtering elevates thresholds at all external noise levels, similarly across difficulty levels, which suggests channel reweighting (Figure 6C, lower left). Finally, higher multiplicative internal noise () would also impair thresholds at all external noise levels, but via a non-uniform shift in TvN functions across difficulty levels (Figure 6C, lower right). The magnitude of multiplicative internal noise is proportional to stimulus contrast: Higher results in greater elevation in internal noise with higher signal contrast, acting similarly to a gain control mechanism (i.e., compressive response at higher contrasts).
First, we analyzed the data using the conventional PTM (Dosher and Lu, 1998; Lu and Dosher, 1999; Lu and Dosher, 2008) to characterize the relative difference in noise-limiting factors between the CTRL and KC groups (see 'Materials and methods'). To do so, contrast thresholds were estimated for each observer as a function of external noise, difficulty level, and stimulus SF. Then, we fitted the data with the PTM in a conventional manner using a least-squares procedure (Figure 7). Given the large individual variability in KC habitual aberrations and its impact on the CSF, KC participants were split into two groups based on KC severity using a median split (total RMS 3.85 µm; hRMS+ 2.24 µm), resulting in three groups based on habitual optical quality: age-matched controls with healthy eyes (N = 8; total RMS 0.88 ± 0.28 µm; hRMS+ 0.34 ± 0.12 µm), mild/moderate KC (N = 3; total RMS 2.19 ± 0.87 µm; hRMS+ 1.25 ± 0.46 µm), and severe KC (N = 3; total RMS 5.82 ± 1.76 µm; hRMS+ 3.51 ± 0.91 µm). All the data from all five SFs were included in the analysis, with the model estimating separate TvNs for each group, each SF, and each difficulty levels (see 'Materials and methods'). The resulting TvN curves estimated by the PTM exhibited characteristic nonlinear patterns (Figure 7).
To assess the mechanisms underlying the differences in contrast sensitivity between groups, several variants of the PTM were fit to the data: no group difference (null model), changes in internal additive noise (Aadd), external noise filtering (Aext), or multiplicative internal noise (Amul), mixtures of them (Aadd + Amul; Aadd + Aext; Amul + Aext), and a full model assuming changes in all three mechanisms (Aadd + Aext + Amul). To account for the large differences in the number of free parameters across models, we computed the Bayesian information criterion (BIC) evidence that determines which model best fits the data while penalizing for a greater number of free parameters. Figure 7A shows the results of the best model (see Figure 7—figure supplements 1–4 for the results from each of the eight possible variants of the PTM). Overall, the differences in contrast thresholds between groups were best explained by a simple model assuming solely SF-dependent changes in internal additive noise (Figure 7B; Aadd; r2 = 94.02), followed by mixture models that included internal additive noise as one of the free parameters, and then by the full model. Other models that did not allow changes in internal additive noise (Aadd) could not account for the differences between groups. Relative to the control observers, severe KC patients showed a reduction in internal additive noise (Aadd) by −49.2% and −53.1% at 0.5 and 1 cpd, respectively. Mild/moderate KC patients did not show such benefits at low SFs, but rather a slight elevation in internal noise by +20.4% and +5.7% at 0.5 and 1 cpd, respectively. At 3 cpd, mild/moderate KC observers showed a negligible difference in internal additive noise (+1.1%) relative to control observers, whereas severe KC patients still showed a slight reduction in internal additive noise (−18.7%). At high SFs, all KC observers exhibited poorer thresholds due to large elevations in internal additive noise, by +21.2% and +110.8% at 9 and 16 cpd for mild/moderate KCs, and by +158.4% and +165% at 9 and 16 cpd for severe KC patients.
Additional PTM analyses, separately for low and high SFs (Figure 7—figure supplements 5 and 6), further supported SF-specific changes in internal additive noise as the primary mechanism underlying altered CSF following long-term exposure to poor optical quality. Furthermore, these results replicate the pattern of gains and losses in contrast sensitivity found in experiment 1 (Figure 7—figure supplement 7), despite differences between the two experiments (e.g., high uncertainty regarding the SF of the upcoming target stimulus on a given trial in experiment 1, whereas there was no uncertainty in experiment 3). When almost no external noise was added to the target stimuli, observers with severe KC showed higher contrast sensitivity for low SFs and impaired sensitivity for high SFs. This pattern was less pronounced in mild/moderate KC participants. At high external noise levels, contrast sensitivity was more comparable across groups, consistent with the predictions of the internal additive noise model (Figure 6C). Note that the differences at high SFs under high external noise (Figure 7—figure supplement 7) are likely due to the fact that the nonlinearity characteristic of TvN curves was not well captured and internal additive noise remained the main limiting factor even at the highest external noise level. Altogether, these results strongly support changes in internal additive noise (i.g., signal enhancement) as the primary mechanism underlying the differences in contrast sensitivity at both low SFs and high SFs in KC patients.
To better assess individual differences in the underlying sources of altered visual processing across SFs and relate them to each observer’s habitual optical quality, we estimated TvN curves and parameter estimates for each individual participant using a hierarchical Bayesian model (see 'Materials and methods'). By assuming that the variability between participants follows a population-level distribution, this method allowed us to estimate group-level ‘traits’ in terms of signal processing given the presence of external noise. We then tested whether the level of internal additive noise, as well as other individual PTM estimates, correlated with the amount of habitual optical aberrations experienced by each participant (Figure 8). Consistent with the SF-specific changes in sensitivity observed in KC patients, poorer habitual RMS was associated with reduced individual internal additive noise levels at low SFs (0.5 and 1 cpd) (Figure 8A; total RMS: r = −0.65, p=0.011; hRMS+: r = −0.63, p=0.016). At high SFs, individual noise estimates were more variable, particularly at 16 cpd where we could not reliably estimate the nonlinear segment of individual TvN curves. Thus, we restricted this analysis to individual noise estimates from the 9 cpd condition. We found that poorer habitual optical quality was positively correlated with elevated individual internal additive noise levels at high SFs (Figure 8A; total RMS: r=+0.65, p=0.012; hRMS+: r=+0.70, p=0.005). No correlation was found at low or high SFs with either multiplicative internal noise or external noise filtering (Figure 8B, C), supporting the finding that SF-specific changes in internal additive noise alone can account for the impact of long-term exposure to poor optical quality on visual processing.
Taken together, the present results reveal that long-term exposure to severe optical defects causes a broad functional reallocation of sensory processing resources across a wide range of SFs, which is mediated by SF-specific changes in signal enhancement mechanisms of SF-selective neurons.
Discussion
The present study combined advanced optics, psychophysical, and computational methods to assess neural compensation mechanisms in response to long-term (i.e., from several months up to several decades) exposure to poor optical quality. An AO vision simulator was used to fully bypass optical limitations and directly access and isolate visual processing in human adults who are otherwise exposed to various amounts of optical aberrations. Under AO correction, both control and KC observers can be considered as a single group of neurotypically-developed adults chronically exposed to varying levels of uncorrected optical aberrations in their daily life. Our results provide evidence of a broad, functional reallocation of sensory processing resources across a wide range of SFs following long-term exposure to severely degraded retinal inputs. Under fully-corrected optical conditions, KC patients showed a loss in sensitivity to high-SF information, which was due to elevated internal additive noise (i.e., impaired signal enhancement) of high-SF selective filters. Moreover, severe KC patients showed enhanced sensitivity to low-SF information due to reduced internal additive noise (i.e., improved signal enhancement) of low-SF selective filters. Notably, the magnitudes of low-SF enhancements and high-SF impairments were correlated across observers, and both effects were more pronounced in severe KC cases. This pattern of gains and losses in visual sensitivity reveals fundamental properties of adaptive neural mechanisms compensating for the chronic exposure to blurred retinal images.
A key function of sensory systems is to adapt to our sensory environment. Contrast sensitivity represents the foundation for the brain’s coding of visual information and is central for characterizing both visual functions and clinical disorders. The shape of the CSF likely reflects the visual system’s sensitivity to stimulus properties that are useful for perception. In typical observers with healthy eyes, the drop in sensitivity at high SFs is mostly due to blurring from the eye’s optics (Banks et al., 1987; Campbell and Green, 1965). Optical blur reduces the strength and reliability of high-SF retinal inputs, leading to weak and unreliable neural responses to fine spatial details. The drop in signal-to-noise ratio at high-SFs has also been linked to a stronger response to noise with increasing frequency rather than to a change in spatial sensitivity per se (Brady and Field, 1995). In KC, optical aberrations become approximately six times worse compared to typical levels (Pantanelli et al., 2007), strongly attenuating high-SF retinal signals and depriving the visual system from fine spatial information. Our findings show that the severe and prolonged exposure to optically degraded retinal inputs under natural viewing results in neural insensitivity to fine spatial details, even when viewing images that are near-perfect optically. Using the PTM, we found that this neural insensitivity to high-SF signals was due to elevated internal additive noise levels (i.e., impaired signal enhancement) of high-SF filters. Internal noise impairs the reliability of sensory representations and is a key factor in perceptual variability within the nervous system (Osborne et al., 2005). Increased internal noise levels of high-SF filters could account for the fact that when tested under AO correction, KC patients showed considerably poorer letter acuity than control observers with typical optical quality whose AO-corrected acuity approaches the limit imposed by photoreceptor sampling.
More importantly, chronic exposure to degraded high-SF inputs did not solely induce impairments in high-SF contrast sensitivity and high-contrast letter acuity under AO correction, but was also associated with better-than-normal sensitivity to low-SF signals. This improvement in contrast sensitivity at low SFs was mediated by a reduction in internal additive noise levels (i.e., improved signal enhancement) of low-SF selective filters, and correlated with the deficits in VA. Thus, the effects of long-term exposure to poor ocular optics cannot be simply characterized as deficits at high SFs, but rather as altered visual sensitivity across a broad SF range via changes in signal enhancement mechanisms that attenuate high-SF signals while enhancing low-SF information. This pattern of gains and losses in sensitivity can be understood by considering how habitual optics of KC eyes affect retinal image quality. While optical blur strongly degrades high-SF signals, lower SFs are less compromised by blur and become predominant and more reliable than higher SFs, especially under large amounts of blur. As a result, KC patients are in a low-pass state of adaptation during natural vision, being deprived of high-SF information and having to rely more on low-SF information to interact with their environment.
Adaptation acts to maintain sensory systems operating within the limited dynamic range afforded by the brain’s limited resources (Ghodrati et al., 2019). In this context, the CSF reflects an optimal allocation of the brain’s limited sensory resources to process a wide range of spatial details. The pattern of gains and losses in sensitivity we observed could reflect neural compensation mechanisms that optimize visual processing to the structure of the degraded retinal inputs. For instance, short-term adaptation to different stimulus speeds alters the spatiotemporal CSF over a broad range of spatial and temporal frequencies, optimizing visual sensitivity to the new environment (Gepshtein et al., 2013). Physiologically, cells in the primary visual cortex (V1) adaptively change their responses to match the input properties of natural (broadband) stimulation and enhance information transmission in visual processing (Sharpee et al., 2006). Moreover, brief adaptation to a single stimulus can reorganize neuronal correlations across an entire network, resulting in specific, stimulus-dependent changes in the population code’s efficiency (Gutnisky and Dragoi, 2008). What is unknown, however, is what kinds of neural changes occur in adult visual systems during years of adaptation periods, as experienced by participants with severe optical defects such as KC patients. We conjecture that long-term exposure to severely degraded retinal image quality results in a reallocation of the brain’s limited sensory resources, improving visual processing in KC patients across many stimuli and tasks. Indeed, whereas KC participants suffer from poorer acuity under full AO correction, they actually show substantially better acuity under their own optical quality than typical observers tested under the same degraded optical conditions (Sabesan and Yoon, 2010). It is worth noting that the changes in contrast sensitivity we observed do not necessarily imply similar changes in suprathreshold perception. Unlike contrast sensitivity, the perceived contrast of gratings above threshold is largely independent of SF (Georgeson and Sullivan, 1975). Contrast constancy is mediated by contrast gain adjustment mechanisms that compensate for earlier attenuation in sensitivity and achieve a ‘deblurring’ of the retinal image (Georgeson and Sullivan, 1975). Although we did not directly assess suprathreshold contrast perception, there is evidence that contrast constancy is tightly linked to the eye’s optics. For instance, astigmatic observers show suprathreshold compensation for the orientation-specific neural deficit in contrast sensitivity caused by their uncorrected blur (Georgeson and Sullivan, 1975). Thus, chronic exposure to severe amounts of optical aberrations might also impact suprathreshold perception in severe KC participants.
All KC patients included in our study reported an onset of the KC-induced optical aberrations around their twenties, which is typical in this disease (Vazirani and Basu, 2013). KC progression can vary from one individual to another, usually stabilizing after a few years. We found that individual differences in visual processing under AO correction were well accounted for by the amount of habitual optical aberrations experienced by each observer, regardless of participant’s age. Thus, neural compensation to the eye’s optics was primarily driven by the severity of uncorrected optical aberrations rather than by the number of years exposed to uncorrected blur per se. Of note, all the participants included in our study had stable optical quality for at least 1 year before testing. This allows us to conclude that 1 year of sustained exposure to poor optics is sufficient to cause the results reported here. Whether shorter periods of exposure to poor optics – months or even weeks – are sufficient to lead to a broad reallocation of sensory resources is unknown but plausible. Several studies have reported rapid changes in visual processing and early visual cortex activity following short-term (i.e., minutes to a few hours) periods of sensory deprivation (Binda et al., 2018; Jamal and Dilks, 2020; Keck et al., 2011; Kwon et al., 2009). Gradual improvements in vision with time are usually observed during the first months following refractive (Kohnen et al., 2004; Pesudovs, 2005) and cataract (Montés-Micó and Alió, 2003) surgery, or following correction of relatively low magnitudes of astigmatism (Vinas et al., 2012). Moreover, exposure to visual inputs deprived of vertical information over four consecutive days showed limits of neuronal adaptation mechanisms (Haak et al., 2014), which peaked during the first day but then dropped in strength despite the adapting environment remaining constant. Such limits of neural adaptation to altered sensory inputs over time are consistent with the notion that sensory processing must be plastic, to swiftly respond to changes in the sensory inputs, but remain stable, so that functions endure.
Another important factor to consider is the fact that participants were tested only in one eye. The two eyes of an individual routinely differ in their optical and neural properties, particularly in disease. However, differences in optical quality between the two eyes of our KC patients did not seem to affect the pattern of results we observed for the tested eye. For instance, the four most severe KC patients (KC7–10) all showed pronounced alterations of visual processing under AO correction, consistent with the large amounts of habitual optical aberrations present in their tested eye. Yet, KC9–10 had well-corrected optical quality in their untested eye, whereas KC7–8 had similar optical deficits in both eyes. Thus, the changes in monocular contrast sensitivity and VA we observed under AO correction were primarily driven by the habitual optical quality of the tested eye. It is likely that an accurate assessment of the optical and neural properties in both eyes would have revealed interocular factors influencing neural compensation to optical blur. Interocular differences between the eyes impact binocular visual functions, reducing binocular summation (Jiménez et al., 2006) and stereopsis (Lam et al., 1996; Ng et al., 2021). Moreover, in individuals with typical optics, perceived focus through either eye is more similar than predicted by the properties of each eye, suggesting the existence of cyclopean neural calibration mechanisms that help reduce perceptual differences between the eyes (Radhakrishnan et al., 2015).
Our methods are largely agnostic about the neural bases of long-term exposure to the eye’s optics. Physiologically, differences in signal enhancement mechanisms in the signal processing domain (i.e., PTM) could reflect changes in contrast gain of SF-selective neurons (Dosher and Lu, 2020). We hypothesize that our findings are likely to be due, at least partially, to neural changes occurring in V1. Pooled responses of V1 neurons can predict behavioral performance in contrast sensitivity tasks (Boynton et al., 1999), and perceptual CSF and neuronal CSF in V1 are highly correlated (Meng et al., 2013; Niemeyer and Paradiso, 2017), sharing a similar shape, amplitude, and peak SF. That is, the shape of the perceptual CSF is assumed to reflect properties of V1 neurons selective to a wide SF range. While responses in the lateral geniculate nucleus are primarily lowpass in SF, the majority of V1 neurons possess bandpass characteristics. The fall-off of the CSF at low SFs is generally attributed to lateral inhibition in retinal ganglion cells (Kelly, 1975), as well as normalization – a canonical neural computation in which the response of an individual neuron is divided by the summed activity of a pool (population) of neurons (Carandini and Heeger, 2012). Divisive normalization plays an important role in determining visual sensitivity, serving as a form of homeostatic control of V1 functional properties that optimize the network nonlinearities to the statistical structure of the visual input (Fournier et al., 2011). Here, severe optical blurring in KC eyes would reduce the contribution of high-SF neurons to the normalization pool, in turn increasing the response of neurons selective to lower SFs. Another, not mutually exclusive, neural account could involve interactions between SF-selective channels (Bauman and Bonds, 1991; Bredfeldt and Ringach, 2002; De Valois and Tootell, 1983; Webster, 1999). SF-specific inhibitory mechanisms refine SF selectivity of V1 neurons (Bauman and Bonds, 1991). For instance, SF-specific inhibition of low SFs plays a key role in the generation of bandpass V1 selectivity (Bredfeldt and Ringach, 2002; De Valois and Tootell, 1983), shifting preferred spatial selectivity to higher SFs. Moreover, adaptation effects at different spatial scales are not independent (Webster, 1999), ruling out simple linear filter models of cortical processing. Changes in normalization and/or SF-specific inhibition mechanisms would involve changes in neural sensitivity across many V1 neurons selective to a wide range of SFs, consistent with the SF-specific changes in sensitivity we observed in KC patients. Note that we cannot unequivocally rule out other types of plasticity that could affect the shape of the CSF, such as changes in the number of neurons selective for different SFs (DeValois and DeValois, 1988).
Finally, the effects of prolonged exposure to poor optical quality likely reflect the interaction of multiple mechanisms over time, from short-term adaptation effects to long-term learning experiences. Following short-term blur adaptation, humans with typical optical quality usually show enhanced high-SF sensitivity and reduced low-SF sensitivity (Rajeev and Metha, 2010; Webster, 1999). This pattern of results suggests that the visual system adapts to preserve functional homeostasis at first, adjusting contrast gain to better extract weak high-SF signals in the presence of blur. However, our results show that blur adaptation over considerably longer time periods has opposite effects on contrast sensitivity. Although distinct neural adaptation mechanisms have been shown to operate over different timescales (Bao and Engel, 2012; Bao et al., 2013), the effects of adaptation usually weaken over a span of days but remain qualitatively the same (Haak et al., 2014). One possible explanation is that neural compensation following long-term exposure to altered sensory inputs relies on the interactions between sensory adaptation and perceptual learning. Under natural viewing, KC patients have to learn how to best use the severely degraded retinal inputs to interact with their environment, which is extremely rich in terms of tasks and stimulus properties. Visual adaptation (Webster, 2011; Webster, 2015) and perceptual learning (Dosher and Lu, 2017; Kumano and Uka, 2013) are two forms of experience-dependent plasticity that can interact, despite having distinct neural mechanisms and perceptual consequences. For instance, training over multiple days has been shown to weaken the perceptual effects of visual adaptation (Dong et al., 2016). Moreover, perceptual learning is able to reconfigure the effects of visual adaptation (McGovern et al., 2012). While adaptation reduced sensitivity before training, learning while in an adapted state reversed the effects of adaptation, leading to an overall benefit following training (McGovern et al., 2012). This reversal in adaptation effects following repetitive training was specific to the trained adapted state, while untrained adapted states were associated with significant costs in sensitivity following training (McGovern et al., 2012). Such interactions between sensory adaptation and perceptual learning mechanisms may account for the qualitative differences between the effects of short-term and long-term exposure to blur on contrast sensitivity.
The atypical CSF and poorer acuity observed in KC patients tested under fully-corrected optical conditions reflect neural compensation mechanisms that improve visual processing of the degraded retinal inputs but limit the clinical benefits of improved optical correction. Our findings identified specific mechanisms at play that should be considered in the clinical treatment of patients with optical defects. The eye’s optics have been shown to limit the benefits of visual training on contrast sensitivity and VA in adult participants with healthy eyes (Zhou et al., 2012). Readaptation under improved optical correction devices could therefore be combined with targeted perceptual learning paradigms (Sabesan et al., 2017) to enhance the speed, efficiency, and generality of neural rehabilitation in patients with altered neural processing due to chronic exposure to poor optical quality.
In summary, the present study furthers our understanding of the impact of long-term (i.e., months to years) exposure to severely degraded habitual optics on visual sensitivity to a wide range of SFs. Our findings support the presence of marked neural plasticity in the adult visual system, which allows the brain to longitudinally compensate for optically-related sensory loss. Using AO correction, we were able to bypass optical factors in KC patients and uncovered evidence of a broad, functional reallocation of sensory processing resources mediated by SF-specific changes in signal enhancement mechanisms (i.e., internal additive noise levels). Overall, our results reveal the existence of neural compensation mechanisms that optimize visual processing to the altered retinal inputs, favoring perceptual information least affected by the eye’s optics. These findings have clinical implications, showing that optical correction alone is unlikely to fully improve patients’ perceptual quality. Instead, clinical rehabilitation approaches should take into consideration changes in visual sensitivity resulting from chronic exposure to poor optics. An important follow-up question in this context will be to assess how fast and to what extent the visual system of KC-afflicted individuals can readapt to perfectly corrected retinal images.
Materials and methods
Participants
A total of 10 keratoconus patients (KC1–9; mean age 34.7 ± 12.4, range 22–55) and 14 age-matched control observers with healthy eyes (CTRL1–14; mean age 33.6 ± 12.3, range 21–57) participated in this study (see Table 1 for demographic information). Six of the KC patients (mean age 35.8 ± 14.5, range 24–55) and eight of the age-matched control observers (mean age 37.5 ± 12.7, range 21–57) participated in experiment 3. Participants were cyclopleged with tropicamide (1%) to dilate the pupil and paralyze accommodation during visual testing. All participants were screened prior to the study by one of our ophthalmologists, providing standard information (e.g., corneal curvature, refractive error) and ensuring that dilation was safe. An additional screening session was performed to ensure we could obtain good quality wavefront measurements and reach stable aberration-free condition under AO correction. Three potential KC patients and one control observer did not pass this second screening stage and were not tested further along. All control observers were emmetropes or low myopes/hyperopes, with well-corrected optical quality in both eyes and no specific issues that may have affected their optical quality in their daily life (e.g., uncorrected or high myopia, dry eye). All KC patients included in the present study had been diagnosed with KC at least 12 months before testing, with a reported onset of the disease around their twenties. Importantly, all patients had been wearing the same habitual corrective method and did not report substantial changes in their vision for at least 12 months before testing. The eye of KC patients with the most severe habitual optical aberrations was selected for monocular testing under AO (except for KC2 due to the presence of scaring in the untested eye). A qualitative description of the optical quality of the untested eye based on the screening performed by the ophthalmologist is provided in Table 1. The Research Subjects Review Board at the University of Rochester Medical Center approved all experimental protocols, which were conducted according to the guidelines of the Declaration of Helsinki. Informed written consent was obtained from all subjects prior to participation. Participants were compensated $12/hr.
Adaptive optics vision simulator
Request a detailed protocolAn adaptive optics vision simulator (AOVS) allowed us to bypass any optical factors during psychophysical testing by measuring and correcting all monochromatic and polychromatic aberrations. As illustrated in a simplified schematic (Figure 2A; see also Figure 2—figure supplement 1), the AOVS consisted of a custom-built Shack–Hartmann wavefront sensor to measure the wavefront aberrations, a deformable mirror (ALPAO DM97, Montbonnot, France) to correct subjects’ wavefront aberrations, an artificial pupil set to 5.8 mm, and a calibrated visual display for psychophysical measurements. Wavefront aberrations were measured for a 6-mm pupil at fovea using an infrared (840 ± 20 nm) superluminescent diode. The AOVS was operated in continuous closed loop (~8 Hz), allowing to fully correct all aberrations over a 6-mm pupil using the deformable mirror. Visual testing was performed at fovea under white light conditions using a modified digital light processor display (Sharp XR-10X, Abeno-ku, Osaka, Japan) operating at 8 bits with 1024 × 768 (60 Hz) resolution, sustending 3.56 × 2.67 degrees of visual angle (dva). The display was calibrated with a PR-650 SpectraScan Colorimeter (Photo Research, Chatsworth, CA), and luminance precision was increased to 10.7 bits using the bitstealing technique. A dental impression bite bar mounted to motorized translation stages (x, y, z) with adjustable lateral headrests was used to stabilize head position and maintain pupil alignment during visual testing (Figure 2—figure supplement 1).
Optical quality estimation
Request a detailed protocolWavefront measurements were collected for each observer using their everyday correction method, if any, to estimate each participant’s habitual optical quality (Figure 2B). Wavefront aberrations were fitted to individual Zernike polynomials up to the 10th order, with 65 Zernike coefficients. The square root of the sum of Zernike coefficients was used to estimate the overall RMS error (total RMS: all Zernike coefficients) and the higher-order aberration (HOAs) RMS error (hRMS+: 6–65th Zernike coefficients), reported in microns (µm). Wavefront measurements were also collected during visual testing to estimate the quality and stability of the AO correction (Figure 2C). The MTF was computed for each participant under their habitual optical quality (Figure 2D) and under full AO correction (Figure 2E). Specifically, we computed the optical transfer function (OTF) from the individual subject’s aberrations at a center wavelength of 555 nm and for a pupil diameter of 6 mm. The MTF was calculated as the absolute value of the OTF, which was averaged radially. Full correction of all Zernike coefficients was applied for the entire duration of each testing session, with the exception of defocus for which appropriate defocus values were used to correct axial chromatic aberrations. Subjective defocus values were determined for all participants by asking them to adjust defocus using a motorized Badal prism to make a high-contrast Snellen letter ‘E’ as sharp as possible, while correcting all other aberrations using AO. Then, through-focus high-contrast VA measurements were used to objectively verify that the subjective defocus value applied during AO correction resulted in a very focused, perceived image and maximal VA performance. After this initial session, each experimental session started with VA measurements to ensure the quality and stability of the AO correction before data collection. To maximize AO correction during stimulus presentation, participants were trained to blinks between trials and to stop if the perceptual quality got unstable and/or poor quality. To minimize the influence of blinks when estimating the residual RMS under AO correction, the median RMS was computed across time for each measurement (Figure 2—figure supplement 2 and Figure 2—video 1). Then, the average residual RMS was computed for each participant from multiple wavefront measurements collected under AO correction (Figure 2C). As detailed and demonstrated in previous work (e.g., Ghosh et al., 2017; Ng et al., 2021; Sabesan et al., 2017; Sabesan and Yoon, 2009; Sabesan et al., 2012; Zheleznyak et al., 2016), our AOVS provided stable, aberration-free optical quality during visual testing in both typical and severely aberrated eyes. Statistical analyses indicated a violation of normality for the habitual total RMS of control and KC groups, as well as for the AO-corrected residual RMS of KC observers (Shapiro–Wilk test, p<0.05). A Mann–Whitney U test was therefore used to compare control and KC groups for these variables, with the effect size given by the rank biserial correlation. Welch’s t-tests were used to compare the amount of habitual hRMS+ and vertical coma between groups due to unequal variance between groups (Levene’s test, p<0.05), with the effect size given by Cohen’s d.
Experiment 1: contrast sensitivity measurements
Request a detailed protocolThe CSF of each participant was measured using a 2-AFC orientation discrimination task (Figure 3A). Each trial began with a dynamic fixation point. After a blank screen, a Gabor stimulus (Gaussian envelope SD 0.75 dva; SF range 0.25–30 cpd with 12 equal log-step values) oriented ±45° was presented at fovea. A 500-ms temporal Gaussian envelope was used to blend stimuli into the background and avoid onset/offset transients, and a brief tone signaled stimulus onset to reduce temporal uncertainty. Participants were asked to report whether the stimulus was tilted clockwise or counterclockwise. Auditory feedback was provided for both correct and incorrect responses. We used the qCSF method (Hou et al., 2010; Hou et al., 2016; Lesmes et al., 2010) to estimate 81%-correct contrast thresholds over a broad SF range. The qCSF method is a Bayesian adaptive strategy using a priori knowledge about the CSF's general form to obtain reasonably accurate estimates of sensitivity across SFs with as little as 100 trials. The qCSF method describes the CSF as a truncated log-parabola with four parameters (Figure 3B): (1) the peak sensitivity (amplitude) , (2) the peak frequency , (3) the bandwidth (full width in octaves at half maximum), and (4) the truncation level (plateau) at low SF . Without truncation, the CSF is defined as a function of the stimulus frequency () in decimal log as a log-parabola CS´(f):
This log-parabola is then truncated at SF below the peak SF with the truncation parameter , which determines contrast sensitivity at low SF ():
In addition, the high-SF cutoff () was estimated from the qCSF fits, corresponding to the frequency at which (i.e., 100% contrast). The test procedure was similar to that described in previous studies (e.g., Hou et al., 2010; Lesmes et al., 2010). Briefly, the stimulus space consisted of gratings with contrasts ranging from 0.1% to 99% in steps of 1.5 dB and SF from 0.25 to 30 cpd. After familiarization with the task, participants performed around 7 qCSF runs of 100 trials each (mean number of runs: 7±4 for CTRLs, 7±3 for KCs), which were then combined to compute individual qCSF functions using all trials. Confidence intervals (95% CIs) and p-values were computed from bootstrapping. Specifically, individual trials were randomly resampled with replacement to generate a resampled trial sequence, which was refitted using the qCSF procedure. We repeated this procedure of resampling and refitting 10,000 times to generate bootstrap distributions of the fitted parameters, along with associated confidence intervals. To assess statistical significance for differences in qCSF parameters and SF sensitivity estimates between groups, we computed the difference from the 10,000 random pairs of values from the bootstrap distributions of the two groups, and defined p-values as the proportion of samples that 'crossed' zero. Note that for all of the key comparisons significant p-values also correspond to non-overlapping confidence intervals. For group comparisons at each of the 12 SF levels, p-values were corrected for multiple comparisons using Bonferroni correction by dividing the alpha value level (*p < 0.05; **p < 0.01; ***p < 0.001) by the number of SF levels (i.e., 12).
Experiment 2: VA measurements
Request a detailed protocolVA thresholds were measured using a 4-AFC letter orientation task (Figure 5), in which observers judged whether a high-contrast Snellen ‘E’ letter presented for 250 ms at fixation was oriented upward, downward, leftward, or rightward. Stimuli were black letters presented on a white background. The size of each Snellen E letter was adjusted from trial to trial using the QUEST staircase method (Watson and Pelli, 1983) to estimate 62.5%-correct VA thresholds (in logMAR), with 40 trials per staircase. Multiple VA thresholds were collected under AO correction for each participant (mean number of runs: 7 ± 4 for CTRLs, 12 ± 7 for KCs). Each experimental session also started with VA testing to ensure the quality and stability of the AO correction before starting data collection.
Experiment 3: equivalent noise paradigm
Request a detailed protocolWe used an equivalent noise paradigm (Bejjanki et al., 2014; Burgess et al., 1981; Dosher and Lu, 1998; Lu and Dosher, 2008; Park et al., 2017) where perceptual thresholds are measured as a function of varying external noise levels added to the stimuli. Contrast thresholds were measured using a 2-AFC orientation discrimination task for various amounts of external noise (Figure 6A). Each trial began with a dynamic fixation point. After a blank screen, a ±45° oriented Gabor signal (cosine envelope diameter 2 dva) embedded in different intensity levels of dynamic white noise (eight levels, from 0 to 0.33 SD; check size 0.06°) was presented at fovea for 100 ms (six noise frames). Participants were asked to report the orientation (±45° from the vertical) of the Gabor patch presented on each trial. Each stimulus was accompanied with a brief tone to reduce temporal uncertainty, and auditory feedback was provided for both correct and incorrect responses. Stimulus presentation was controlled using the FAST method (Vul et al., 2010), an advanced adaptive psychophysical technique used to accurately estimate relevant model parameters in just 480 trials per participant for each SF. This allowed us to estimate contrast thresholds as a function of external noise contrast levels for both 70.71%-correct and 79.37%-correct difficulty levels, similar to previous studies (Bejjanki et al., 2014; Dosher and Lu, 1998; Lu and Dosher, 2008; Park et al., 2017). Five different SFs (0.5, 1, 3, 9, and 16 cpd) were tested across different experimental sessions of 480 trials each (divided into four blocks of 120 trials), for a total of 2400 trials per observer. Data from the equivalent noise experiment were pooled from the FAST structures to estimate psychophysical thresholds for each participant at each of the external noise levels (60 trials per level). This approach yielded independent, albeit noisy, contrast threshold estimates at each noise level. Thresholds were estimated by fitting a Weibull function at each external noise level independently:
where P denotes percent correct, c is stimulus contrast, α is contrast threshold at 75%-correct performance level, and η is the slope of the function. Similar to Park and colleagues (2017), we used a Bayesian model fitting method implementing a Markov Chain Monte Carlo (MCMC) technique to estimate the two free parameters of the Weibull function (η and α). Specifically, we sampled the posterior distributions of the parameters using JAGS software (http://mcmc-jags.sourceforge.net). We assumed a broad uniform prior on each parameter with a range that includes all practically possible values. Maximum a posteriori (the mode of the posterior) were used as the best estimates of the model parameters. We discarded the first 15,000 samples as a burn-in period and thinned the samples to reduce correlations by only selecting every 200 samples. A total of 10 chains were run in parallel, resulting in 1000 posterior samples per chain. Thresholds at 70.71% and 79.37% were then computed from the estimated Weibull functions.
Experiment 3: conventional PTM analysis
Request a detailed protocolThe PTM model (Dosher and Lu, 1998; Lu and Dosher, 2008) was used to estimate the sources of signal-to-noise changes responsible for performance differences between KC and age-matched control observers. Contrast thresholds for two difficulty levels (70.71% and 79.37%) and across external noise levels were fitted with the PTM to quantify the effects of noise on contrast perception. The PTM consists of five main components (Figure 6B): a perceptual template tuned to the signal, a nonlinear transducer function, a multiplicative internal noise source (Nmul), an additive internal noise source (Nadd), and a decision process. The output of the perceptual template is processed by two pathways: the signal pathway in which the output is processed by an expansive nonlinear transducer function, and the multiplicative internal noise pathway in which the output is processed by a rectified nonlinear transducer function. Multiplicative noise is an independent noise source whose amplitude is proportional to the (average) amplitude of the output from the perceptual template, acting as a gain control mechanism. Additive internal noise is another noise source whose amplitude does not vary with signal strength and is related to the gain of the perceptual template. Both multiplicative and additive noise sources are added to the output from template matching, and the noisy signal is submitted to a decision process. Here, contrast thresholds () are characterized by
where the input (signal + external noise ) is filtered through a perceptual template, resulting in the amplification of the signal via a gain factor . The output of the filter is then transformed through a nonlinear transducer function that amplifies the inputs to the power, with both internal additive noise () and multiplicative internal noise () being added to the output. remains constant across signal levels, while is proportional to the signal strength. is manipulated by the experimenter along with the input signal. Finally, a decision process determines the contrast threshold at a specific performance level (d´). The PTM (Dosher and Lu, 1998; Dosher and Lu, 2000; Lu and Dosher, 2008) considers that performance differences result from changes in three possible sources of inefficiency (Figure 6B, C): (1) changes in internal additive noise (Aadd), equivalent to changes in signal enhancement (amplification) of the perceptual template; (2) changes in external noise filtering (Aext), corresponding to changes in signal selectivity (tuning) of the perceptual template; and (3) changes in multiplicative internal noise (Amul), acting as a gain control mechanism compressing the perceptual template’s responses to signal contrast (nonlinearity change). Group averages of the independently estimated thresholds were used to fit the conventional PTM across SFs. To characterize group differences between CTRL and KC observers at each SF, the PTM introduces three coefficient indices (Amul(SF,group), Aadd(SF,group), and Aext(SF,group)) to Equation (4):
The coefficient indices for CTRL are fixed to 1 (Amul(CTRL) = Aadd(CTRL) = Aext(CTRL) = 1). Nadd(SF) and Nmul(SF) did not vary across groups, only across SFs to reflect differences in contrast thresholds related to stimulus SF. To estimate whether and how these three types of noise could account for group differences in KC group(s), we computed the relative differences in the effects of each source of noise between the groups. Elevated sources of noise in KC relative to CTRL would correspond to Amul(KC), Aadd(KC), and/or Aext(KC) estimates being higher than 1 (i.e., CTRL group), and to poorer contrast thresholds. Conversely, reduced sources of noise in KC relative to CTRL would correspond to estimates lower than 1, and to better contrast thresholds. These three coefficient indices for each KC group could be restricted, either varying or fixed at 1. We compared the results obtained by fitting the eight possible variants of the PTM (Figure 7, Figure 7—figure supplements 1–4), ranging from no change in any of the three noise reduction mechanisms to the full model with changes in all three noise-reduction mechanisms. We compared the control group to two groups of KC participants (mild/moderate and severe) at five different SFs. The full model consisted of 12 shared parameters across groups (β, γ, Nmul(SF1-5), Nadd(SF1-5)), and 15 noise parameters (Amul(SF1-5), Aadd(SF1-5), Aext(SF1-5)) for each of the two KC groups, for a total of 42 parameters. Model fitting was carried out using a least-square method, and goodness of fit () for each candidate model was computed as follows:
where and were computed across groups, SFs, external noise levels, and difficulty levels. Given the large differences in the number of free parameters across models, we computed the Bayesian Information Criterion (BIC) as a criterion for model selection. The BIC selects the best model while correcting for overfitting by introducing a penalty term for the number of free parameters in the model:
where is the number of predicted data points, is the residual sum of squares of the model, and is the number of parameters of the model. BIC approximates a transformation of a model's posterior probability. We then computed ∆BIC as
where corresponds to the model with the lowest BIC value (i.e., the best model).
Experiment 3: hierarchical Bayesian PTM analysis
Request a detailed protocolTo better assess the link between habitual optical quality and individual variability in the PTM noise estimates, we used a hierarchical Bayesian modeling technique to fit the PTM to each participant. This technique assumes that each participant is drawn from a population distribution (CTRL or KC), which increases statistical power. Importantly, this technique allows estimation of PTM parameters for each participant within a population, providing a better understanding of individual variability. We assumed that an individual’s response for a given trial is drawn from a Bernoulli distribution (i.e., ), where is the difficulty level, is the external noise level , and is the trial number. corresponds to the probability of making a correct response:
where corresponds to the stimulus contrast, η to the slope, to the contrast threshold, and to
The parameter corresponds to the difficulty level (i.e., either 70.71% or 79.37%). The PTM defined the contrast threshold as
Equation (11) is the same as Equation (4), except for the fact that a coefficient for external noise () is added here to characterize the impact of external noise on individual’s contrast thresholds. For each participant, we estimated three parameters , , and . We assumed a fixed β (1.25) and γ (2) for all participants to simplify the model, which was within a reasonable range reported in previous studies (e.g., Dosher and Lu, 1998; Lu and Dosher, 2008; Park et al., 2017). Note that similar results were observed using other values of β and γ. Similar to the Weibull fitting procedure, an MCMC technique was used to sample from the posterior distributions and estimate the free parameters. Here, we assumed hierarchical priors on each of the model parameters, meaning that each model parameter that characterized an individual participant was assumed to be drawn from an independent Gaussian population distribution with a mean and SD that characterized each group (CTRL or KC). Priors for population means and SDs were set to broad uniform distributions. Maximum a posteriori were used as the best parameter estimates for both individual and population parameters. We used 15,000 iterations for burn-in and only selected every 200 samples for thinning. Ten chains were run in parallel, each of which sampled 2000 posterior samples.
Data availability
All data are available from the OSF database URL: https://osf.io/p67hy/.
-
OSFID p67hy. Functional reallocation of sensory processing resources caused by long-term neural adaptation to altered optics.
References
-
Neural compensation for the eye's optical aberrationsJournal of Vision 4:4–287.https://doi.org/10.1167/4.4.4
-
BookAging Effects on the Optics of the EyeIn: Cavallotti C. A. P, Cerulli L, editors. Age-Related Changes of the Human Eye. Humana Press. pp. 35–44.https://doi.org/10.1007/978-1-59745-507-7_3
-
The physical limits of grating visibilityVision Research 27:1915–1924.https://doi.org/10.1016/0042-6989(87)90057-5
-
Neuronal basis of contrast discriminationVision Research 39:257–269.https://doi.org/10.1016/S0042-6989(98)00113-8
-
Dynamics of spatial frequency tuning in macaque V1The Journal of Neuroscience 22:1976–1984.https://doi.org/10.1523/JNEUROSCI.22-05-01976.2002
-
Optical and retinal factors affecting visual resolutionThe Journal of Physiology 181:576–593.https://doi.org/10.1113/jphysiol.1965.sp007784
-
Normalization as a canonical neural computationNature Reviews Neuroscience 13:51–62.https://doi.org/10.1038/nrn3136
-
Spatial-frequency-specific inhibition in cat striate cortex cellsThe Journal of Physiology 336:359–376.https://doi.org/10.1113/jphysiol.1983.sp014586
-
Age variations in normal human contrast sensitivityActa Ophthalmologica 57:679–690.https://doi.org/10.1111/j.1755-3768.1979.tb00517.x
-
Noise exclusion in spatial attentionPsychological Science 11:139–146.https://doi.org/10.1111/1467-9280.00229
-
Visual perceptual learning and modelsAnnual Review of Vision Science 3:343–363.https://doi.org/10.1146/annurev-vision-102016-061249
-
Visual acuity changes throughout adulthood in normal, healthy eyes: seeing beyond 6/6Optometry and Vision Science 72:186–191.https://doi.org/10.1097/00006324-199503000-00006
-
BookElemente der Psychophysik. Leipzig: Breithopf und Hertel, 1860In: Howes D. H, Boring E. C, Adler H. E, editors. Elements of Psychophysics. Holt, Rinehart, and Winston. pp. 280–286.
-
Adaptation of the simple or complex nature of V1 receptive fields to visual statisticsNature Neuroscience 14:1053–1060.https://doi.org/10.1038/nn.2861
-
Blur adaptation and myopiaOptometry and Vision Science 81:543–547.https://doi.org/10.1097/00006324-200407000-00016
-
Contrast constancy: deblurring in human vision by spatial frequency channelsThe Journal of Physiology 252:627–656.https://doi.org/10.1113/jphysiol.1975.sp011162
-
qCSF in clinical application: efficient characterization and classification of contrast sensitivity functions in amblyopiaInvestigative Opthalmology & Visual Science 51:5365–5377.https://doi.org/10.1167/iovs.10-5468
-
Binocular visual performance after LASIKJournal of Refractive Surgery 22:679–688.https://doi.org/10.3928/1081-597X-20060901-09
-
Spatial frequency selectivity in the retinaVision Research 15:665–672.https://doi.org/10.1016/0042-6989(75)90282-5
-
Neuronal mechanisms of visual perceptual learningBehavioural Brain Research 249:75–80.https://doi.org/10.1016/j.bbr.2013.04.034
-
Effect of naturally occurring visual acuity differences between two eyes in stereoacuityOphthalmic and Physiological Optics 16:189–195.https://doi.org/10.1046/j.1475-1313.1996.95000348.x
-
Noise provides some new signals about the spatial vision of amblyopesThe Journal of Neuroscience 23:2522–2526.https://doi.org/10.1523/JNEUROSCI.23-07-02522.2003
-
Supernormal vision and high-resolution retinal imaging through adaptive opticsJournal of the Optical Society of America A 14:2884–2892.https://doi.org/10.1364/JOSAA.14.002884
-
External noise distinguishes attention mechanismsVision Research 38:1183–1198.https://doi.org/10.1016/s0042-6989(97)00273-3
-
Characterizing human perceptual inefficiencies with equivalent internal noiseJournal of the Optical Society of America. A, Optics, Image Science, and Vision 16:764–778.https://doi.org/10.1364/josaa.16.000764
-
Perceptual learning reconfigures the effects of visual adaptationJournal of Neuroscience 32:13621–13629.https://doi.org/10.1523/JNEUROSCI.1363-12.2012
-
Neural correlates of stimulus spatial frequency-dependent contrast detectionExperimental Brain Research 225:377–385.https://doi.org/10.1007/s00221-012-3378-z
-
Improving vision: neural compensation for optical defocusProceedings of the Royal Society of London. Series B: Biological Sciences 265:71–77.https://doi.org/10.1098/rspb.1998.0266
-
Distance and near contrast sensitivity function after multifocal intraocular Lens implantationJournal of Cataract & Refractive Surgery 29:703–711.https://doi.org/10.1016/S0886-3350(02)01648-6
-
Contrast sensitivity, V1 neural activity, and natural visionJournal of Neurophysiology 117:492–508.https://doi.org/10.1152/jn.00635.2016
-
Why use noise?Journal of the Optical Society of America A 16:647–653.https://doi.org/10.1364/JOSAA.16.000647
-
Involvement of neural adaptation in the recovery of vision after laser refractive surgeryJournal of Refractive Surgery 21:144–147.https://doi.org/10.3928/1081-597X-20050301-08
-
Enhanced contrast sensitivity confirms active compensation in blur adaptationInvestigative Opthalmology & Visual Science 51:1242–1246.https://doi.org/10.1167/iovs.09-3965
-
Correcting highly aberrated eyes using large-stroke adaptive opticsJournal of Refractive Surgery 23:947–952.https://doi.org/10.3928/1081-597X-20071101-16
-
Binocular visual performance and summation after correcting higher order aberrationsBiomedical Optics Express 3:3176–3189.https://doi.org/10.1364/BOE.3.003176
-
Neural compensation for long-term asymmetric optical blur to improve visual performance in Keratoconic eyesInvestigative Opthalmology & Visual Science 51:3835–3839.https://doi.org/10.1167/iovs.09-4558
-
Deficits in perceptual noise exclusion in developmental dyslexiaNature Neuroscience 8:862–863.https://doi.org/10.1038/nn1474
-
Keratoconus: current perspectivesClinical Ophthalmology 7:2019–2030.https://doi.org/10.2147/OPTH.S50119
-
Functional adaptive sequential testingSeeing and Perceiving 23:483–515.https://doi.org/10.1163/187847510x532694
-
QUEST: a bayesian adaptive psychometric methodPerception & Psychophysics 33:113–120.https://doi.org/10.3758/BF03202828
-
BookContrast sensitivity under natural states of adaptationProc. SPIE 3644, Human Vision And Electronic Imaging IV.
-
Visual adaptationAnnual Review of Vision Science 1:547–567.https://doi.org/10.1146/annurev-vision-082114-035509
-
Visual performance after correcting the monochromatic and chromatic aberrations of the eyeJournal of the Optical Society of America A 19:266–275.https://doi.org/10.1364/JOSAA.19.000266
-
Optical and neural anisotropy in peripheral visionJournal of Vision 16:1.https://doi.org/10.1167/16.5.1
-
The eye limits the brain's learning potentialScientific Reports 2:364.https://doi.org/10.1038/srep00364
Article and author information
Author details
Funding
National Institutes of Health (R01 EY014999)
- Geunyoung Yoon
- Antoine Barbot
- Duje Tadin
- Krystel R Huxlin
National Institutes of Health (R01 EY027314)
- Krystel R Huxlin
- Duje Tadin
- Antoine Barbot
National Institutes of Health (P30 EY001319)
- Geunyoung Yoon
- Krystel R Huxlin
- Duje Tadin
Research to Prevent Blindness
- Geunyoung Yoon
- Krystel R Huxlin
- Duje Tadin
Schmitt Program on Integrative Neuroscience (Postdoctoral Fellowship)
- Antoine Barbot
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
This work was supported by NIH/NEI grants RO1 EY014999 (GY, DT, KRH, AB), RO1 EY027314 (KRH, DT, AB), P30 EY001319 (core grant to the Center for Visual Science, University of Rochester), Research to Prevent Blindness, and Schmitt Program on Integrative Neuroscience from the University of Rochester Medical Center (postdoctoral fellowship to AB). We thank Dr. Tara C Vaz, OD, and Dr. Len Zheleznyak for their help with participant screening and testing, as well as Olga Pikul for her help with recruitment of study participants.
Ethics
Human subjects: All experimental protocols were conducted according to the guidelines of the Declaration of Helsinki and approved by The Research Subjects Review Board at the University of Rochester Medical Center (#53149). Informed written consent was obtained from all participants prior to participation. Participants were compensated $12/hour.
Copyright
© 2021, Barbot et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 978
- views
-
- 131
- downloads
-
- 13
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Neural implants have the potential to restore lost sensory function by electrically evoking the complex naturalistic activity patterns of neural populations. However, it can be difficult to predict and control evoked neural responses to simultaneous multi-electrode stimulation due to nonlinearity of the responses. We present a solution to this problem and demonstrate its utility in the context of a bidirectional retinal implant for restoring vision. A dynamically optimized stimulation approach encodes incoming visual stimuli into a rapid, greedily chosen, temporally dithered and spatially multiplexed sequence of simple stimulation patterns. Stimuli are selected to optimize the reconstruction of the visual stimulus from the evoked responses. Temporal dithering exploits the slow time scales of downstream neural processing, and spatial multiplexing exploits the independence of responses generated by distant electrodes. The approach was evaluated using an experimental laboratory prototype of a retinal implant: large-scale, high-resolution multi-electrode stimulation and recording of macaque and rat retinal ganglion cells ex vivo. The dynamically optimized stimulation approach substantially enhanced performance compared to existing approaches based on static mapping between visual stimulus intensity and current amplitude. The modular framework enabled parallel extensions to naturalistic viewing conditions, incorporation of perceptual similarity measures, and efficient implementation for an implantable device. A direct closed-loop test of the approach supported its potential use in vision restoration.
-
- Neuroscience
Neuromodulatory inputs to the hippocampus play pivotal roles in modulating synaptic plasticity, shaping neuronal activity, and influencing learning and memory. Recently, it has been shown that the main sources of catecholamines to the hippocampus, ventral tegmental area (VTA) and locus coeruleus (LC), may have overlapping release of neurotransmitters and effects on the hippocampus. Therefore, to dissect the impacts of both VTA and LC circuits on hippocampal function, a thorough examination of how these pathways might differentially operate during behavior and learning is necessary. We therefore utilized two-photon microscopy to functionally image the activity of VTA and LC axons within the CA1 region of the dorsal hippocampus in head-fixed male mice navigating linear paths within virtual reality (VR) environments. We found that within familiar environments some VTA axons and the vast majority of LC axons showed a correlation with the animals’ running speed. However, as mice approached previously learned rewarded locations, a large majority of VTA axons exhibited a gradual ramping-up of activity, peaking at the reward location. In contrast, LC axons displayed a pre-movement signal predictive of the animal’s transition from immobility to movement. Interestingly, a marked divergence emerged following a switch from the familiar to novel VR environments. Many LC axons showed large increases in activity that remained elevated for over a minute, while the previously observed VTA axon ramping-to-reward dynamics disappeared during the same period. In conclusion, these findings highlight distinct roles of VTA and LC catecholaminergic inputs in the dorsal CA1 hippocampal region. These inputs encode unique information, with reward information in VTA inputs and novelty and kinematic information in LC inputs, likely contributing to differential modulation of hippocampal activity during behavior and learning.