Conditioning sharpens the spatial representation of rewarded stimuli in mouse primary visual cortex
Abstract
Reward is often employed as reinforcement in behavioral paradigms but it is unclear how the visuospatial aspect of a stimulus-reward association affects the cortical representation of visual space. Using a head-fixed paradigm, we conditioned mice to associate the same visual pattern in adjacent retinotopic regions with availability and absence of reward. Time-lapse intrinsic optical signal imaging under anesthesia showed that conditioning increased the spatial separation of mesoscale cortical representations of reward predicting- and non-reward predicting stimuli. Subsequent in vivo two-photon calcium imaging revealed that this improved separation correlated with enhanced population coding for retinotopic location, specifically for the trained orientation and spatially confined to the V1 region where rewarded and non-rewarded stimulus representations bordered. These results are corroborated by conditioning-induced differences in the correlation structure of population activity. Thus, the cortical representation of visual space is sharpened as consequence of associative stimulus-reward learning while the overall retinotopic map remains unaltered.
https://doi.org/10.7554/eLife.37683.001Introduction
Involvement of sensory processing in perceptual and stimulus-outcome learning can alter stimulus selectivity of neurons in the sensory cortex (Bao et al., 2001; Schoups et al., 2001; Ghose et al., 2002; Fritz et al., 2003; Yang and Maunsell, 2004; Blake et al., 2006; David et al., 2012; Xu et al., 2012; Goltstein et al., 2013; Jeanne et al., 2013; Poort et al., 2015). Even in the absence of an explicit behavioral paradigm, repeated reward pairing can by itself already lead to an improvement of stimulus processing in sensory cortex (Seitz et al., 2009). However, it is unclear how visuospatial aspects of stimulus-outcome learning translate to changes in neuronal representations. The ecological relevance of this question is underscored by adaptive behaviors of rodents that differentiate between segments of visual space, such as when coping with potential predators moving overhead (e.g. birds of prey; Zhang et al., 2012b; Shang et al., 2015; Wei et al., 2015), or visual stimulus patterns at ground level, possibly associated with food and water (Furtak et al., 2012). Specifically, it is unknown how neural coding in the retinotopically organized visual cortex is affected by learning when adjacent locations in the visual field are differentially predictive of reward or other outcomes.
Located early in the visual stream, the primary visual cortex (V1) has neurons that primarily seem to act as low-level feature detectors, responding selectively to properties such as orientation, contrast, temporal and spatial frequency of bars and gratings, eye-specific inputs and retinotopic location (Hubel and Wiesel, 1959; Hubel and Wiesel, 1962; Mrsic-Flogel et al., 2007; Niell and Stryker, 2008; Smith and Häusser, 2010; Freeman et al., 2013). However, recent studies have shown that activity in mouse V1 is strongly modulated by non-visual factors such as other sensory modalities, internal state, locomotion and anticipation of reward (Shuler and Bear, 2006; Niell and Stryker, 2010; Bennett et al., 2013; Lee et al., 2014; Keller et al., 2012; Saleem et al., 2013; Meijer et al., 2017). Widespread presence of feedback and neuromodulatory influences provide a means for learning experiences to drive plasticity and alter V1 local circuitry (Gilbert, 1996; Chubykin et al., 2013; Zhang et al., 2014; Ji et al., 2015).
Learning can affect neocortical function via a number of mechanisms. Neural responses in primary visual cortex may change to increase bottom-up saliency of a stimulus (Zhang et al., 2012a), for instance by a selective increase in amplitude of the response to conditioned stimuli (Fritz et al., 2003; Blake et al., 2006; Andermann et al., 2010; Goltstein et al., 2013; Poort et al., 2015). Alternatively, neurons can be recruited to become tuned to a conditioned stimulus (Weinberger et al., 1993), which in case of the tonotopic map of auditory cortex leads to an enlarged cortical region dedicated to this stimulus (Bao et al., 2001). Furthermore, the selectivity of neuronal tuning curves may be altered (David et al., 2012; Goltstein et al., 2013), for example amplifying small but relevant changes in stimulus properties to large changes in neuronal activity (Schoups et al., 2001). Finally, some changes can only be observed in simultaneously recorded neuronal populations, like changes in sparseness of population responses (Ghose et al., 2002; Gdalyahu et al., 2012) or the correlation structure of ensemble activity (Averbeck et al., 2006; Poort and Roelfsema, 2009; Jeanne et al., 2013; Montijn et al., 2015). While the effect of perceptual and reward learning in V1 is often restricted to smaller parts of the visual field (Gilbert et al., 2009; Seitz et al., 2009), less is known about how such plasticity unfolds with respect to the neuronal micro-architecture of V1’s retinotopic organization.
Here, we probe how visuospatial stimulus-reward learning affects the spatial cortical organization of the conditioned stimulus representation. First, we chronically tracked the mesoscale neural representation of the reward-predictive field location within the retinotopic map. Next, we used two-photon calcium imaging to test whether visuospatial information was processed more reliably and efficiently by neurons located at the border between the cortical representations of the rewarded and non-rewarded stimulus.
Results
Head-restrained classical conditioning using spatially confined stimuli
Adult male C57Bl/6 mice were conditioned to associate moving gratings of identical orientation, but presented at different locations in the visual field, with upcoming reward or absence of reward (Figure 1a,b,d and Figure 1—figure supplement 1a–e). Animals were exposed to the conditioning paradigm for 10 to 17 daily sessions of 40 to 60 trials each (Figure 1e). In a conditioning paradigm such as presented here (comparable to trace conditioning), anticipatory nasal and oral movements (unconditioned response, for example licks and sniffs) can emerge in direct relation to the unconditioned stimulus (approach of the reward arm; DeBold et al., 1965; Balsam, 1984; Huerta et al., 2000; Bensafi et al., 2003; Kehoe and Joscelyne, 2005; Drew et al., 2005; Joscelyne and Kehoe, 2007; Arzi et al., 2012; Raybuck and Lattal, 2014). Therefore, we detected and quantified such movements offline (Online Materials and methods; Figure 1c and Figure 1—figure supplement 2a) and plotted them as a function of time relative to arrival of the reward arm in the final position.
From the first conditioning session onwards, putative licks and sniffs emerged aligned to stimulus onset (−6 s), offset (−2 s), reward arm movement onset (−0.5 s) and reward delivery (0 s; Figure 1f, left panel and Figure 1—figure supplement 2b). Initially there were no differences in behavioral responses between rewarded trials and non-rewarded trials, up to the time of reward consumption (Wilcoxon Matched-Pairs Signed-Rank (WMPSR) test; Nasal movement: p=0.32; Oral movement: p=0.90, n = 10 mice; Figure 1f–g and Figure 1—figure supplement 2d). From the second conditioning session onwards, however, a difference in anticipatory oral and nasal movements began to emerge between rewarded and non-rewarded trials in the period of reward-arm movement, defined from −0.4 s to −0.16 s before (non-) reward time (Figure 1f and Figure 1—figure supplement 2c). During this brief time window before reward delivery, no distinction between rewarded and non-rewarded trials could yet be made by anything other than the conditioned stimulus alone, as reward-arm movement trajectory and speed were identical in rewarded and non-rewarded trials up to 55 ms before the time point at which reward was delivered or not (Online Materials and methods; Figure 1—figure supplement 1f). On the last day, all but one mouse showed increased nasal and oral movements during this reward-anticipation period (WMPSR test; Last day; Oral movements: p=0.004; Nasal movements: p=0.004, n = 10 mice; Figure 1g,h and Figure 1—figure supplement 2e,f). No differences in oral and nasal behaviors were found during the period of visual stimulation, which is not unexpected because reward was never available before the reward arm moved to the reward position. Therefore, the conditioning related increases in anticipatory nasal and oral movements during reward arm movement most likely reflect learned expectation of reward delivery.
Eye movements during head-restrained conditioning
Awake behaving rodents display eye movements despite the absence of foveal vision (Sakatani and Isa, 2004; Sakatani and Isa, 2007; Zoccolan et al., 2010; Adesnik et al., 2012; Keller et al., 2012; Wallace et al., 2013; Reimer et al., 2014; Vinck et al., 2015). Although mice track the movement of bars at low temporal frequencies (<1 Hz; van Alphen et al., 2010), it is not known whether they preferentially orient their eyes towards behaviorally relevant stimuli. Large-amplitude eye movements could, in our experiments, deteriorate retinotopic selectivity of visual stimuli. Therefore, pupil location and pupil diameter were tracked in six animals over the entire course of the behavioral experiment (Figure 1—figure supplement 3a). This revealed a slight but systematic bias of pupil orientation towards the location of a presented stimulus along the vertical axis (Data combined across last 4 days, WMPSR test, Vertical: p=0.00091, Horizontal: p=0.39, n = 6 mice; Figure 1—figure supplement 3b–g). Nonetheless, the amplitude of the shift in vertical eye position did not differ by more than 1.0 retinal degrees (Online Materials and methods; Figure 1—figure supplement 3c,d). Given that V1 receptive fields in the mouse cover much larger regions (i.e. diameter ≧10 retinal degrees; Smith and Häusser, 2010; Bonin et al., 2011) and that the conditioned stimulus size was 30 retinal degrees (Azimuth and Elevation), this subtle variation in eye position did not strongly reduce the retinotopic specificity of the visual stimulus during conditioning.
During the reward delivery period, eye movements and pupil dilations were more pronounced. The eye position showed a downward gaze-shift, potentially to the incoming reward spout (Figure 1—figure supplement 3c). Dilation of the pupil may have indicated arousal as a consequence of reward consumption (Data combined across last 4 days: WMPSR test, p=7.1⋅10−5, n = 6 mice; Figure 1—figure supplement 3i,j; Bradley et al., 2008). Thus, despite the lack of foveal vision, head restrained mice make eye-movement responses and show pupillary reactions to behaviorally relevant stimuli, like rewards. Differences in these behaviors between rewarded and non-rewarded trials were large during the reward delivery phase, while during stimulus presentation differences between the upper and lower visual field were negligible.
Mesoscopic shifts in cortical representations of trained stimuli
To follow the cortical retinotopic organization throughout learning, we used repeated transcranial imaging of intrinsic optical signals in area V1 of anesthetized mice. The retinotopic pattern of the mesoscale cortical response was quantified by reducing the spatial dimensionality of the intrinsic response maps to the axis that maximally separated the two stimulus locations (Online Materials and methods; Figure 2a–b and Figure 2—figure supplement 1a). To account for variation between sessions, the response to trained stimuli was referenced to the response to control stimuli that were presented in the same retinotopic location (and had an orientation that was not presented in the conditioning sessions; for example gray curves in Figure 2d and Figure 2—figure supplement 1b). Using this method, we observed that the response amplitude to the non-rewarded, trained stimulus was decreased after conditioning when compared to before conditioning (amplitude of non-rewarded minus orthogonal, across time points: Kruskal-Wallis, normalized per mouse, H(2, 24)=13.15, p=0.0014, post hoc WMPSR test, Before vs. After, p=0.0039; n = 9 mice; Figure 2d,g and Figure 2—figure supplement 1b). The response amplitude to the rewarded conditioned stimulus was not significantly reduced at the time point after conditioning (amplitude of rewarded minus orthogonal, mouse-normalized, across time points: Kruskal-Wallis, normalized per mouse, H(2, 24)=6.39, p=0.041, post hoc WMPSR test, Before vs. After, p=0.57, n = 9 mice).
The change in response amplitude was associated with an altered spatial distribution of the intrinsic signal response to the trained stimuli (see Figure 2d). In order to further quantify this, we calculated how much the intrinsic response to visual stimulation in each of the two adjacent locations of the trained stimuli overlapped with the other on the cortical surface (Figure 2c,e) and compared this with how much the response to the orthogonal control stimuli overlapped (difference between gray and colored lines in Figure 2f). This difference between spatial overlap of trained and spatial overlap of control stimuli (IOS ΔOverlap) inversely reflects how well the intrinsic responses to trained stimuli are segregated in cortical space, as compared to the control stimuli. After conditioning (i.e., on day 11–18), the IOS ΔOverlap was significantly reduced in the cortical region that responded to the rewarded stimulus (Kruskal-Wallis test, normalized per mouse, H(2,24) = 10.00, p=0.0067, post hoc WMPSR test, Before vs. After, p=0.020, n = 9 mice; Figure 2f,h). In the region responding to the non-rewarded stimulus, the IOS ΔOverlap was not significantly reduced as a function of training (Kruskal-Wallis test, normalized per mouse, H(2,24) = 0.98, p=0.61, n = 9 mice; Figure 2f,h). After training, the IOS ΔOverlap in the cortical region representing the rewarded stimulus was significantly reduced compared to the region mostly responsive to the non-rewarded stimulus (WSRMP test, p=0.039, n = 9 mice; Figure 2f,h).
Because the measure of overlap is sensitive to the absolute response amplitude, we also quantified the mesoscopic segregation of intrinsic cortical responses using a ratiometric index, the spatial selectivity index. This showed a similar effect of sharpened spatial selectivity for the rewarded condition and location (Kruskal-Wallis test, mouse-normalized, H(2,24) = 6.16, p=0.046, WMPSR test, rewarded vs. non-rewarded, p=0.039, n = 9 mice; Figure 2i). The magnitude of these above-mentioned effects (‘IOS-ΔOverlap’, ‘selectivity for stimulus location’ and ‘response amplitude to the non-rewarded trained stimulus’) correlated strongly within individual mice (IOS-ΔOverlap × Selectivity: r = −0.94, p=0.0002, n = 9 mice; Amplitude × Selectivity: r = 0.81, p=0.008, n = 9 mice; Amplitude × ΔOverlap: r = −0.65, p=0.058, n = 9 mice), which suggests that they resulted from closely related mechanisms that operated on the rewarded as well as the non-rewarded side of the stimulus representation.
Finally, to test whether the representation of the rewarded and non-rewarded trained stimuli drifted apart in cortical space, we quantified the distance between the peaks in the intrinsic response profiles. Despite a trend, this measure of spatial distance between trained stimulus representations did not significantly increase (Kruskal-Wallis test, normalized per mouse, H(2,24) = 0.57, p=0.75, n = 9 mice; Figure 2j). Hence, classical conditioning, using rewarded and non-rewarded stimuli that occupy neighboring regions of visual space, selectively reshaped the retinotopic organization for the trained stimuli compared to control stimuli, while the overall representations of the trained stimuli did not significantly drift apart.
Spatial organization of neuronal population activity for trained stimuli
To understand how formation of a visuospatial stimulus-reward association affects neuronal response properties within the retinotopic representation, we performed OGB1-calcium imaging (Stosiek et al., 2003) after the final conditioning session (Figure 3a). Recordings were made in multiple V1-subregions per animal, positioned along the rewarded/non-rewarded axis within V1 (Figure 3b). Every field-of-view was assigned to a cortical location group; Full non-rewarded, Border non-rewarded, Border rewarded and Full rewarded, based on the population response amplitude to visual stimulation in each of the retinotopic locations using moving gratings of non-trained orientations (Online Materials and methods; Figure 3b and Figure 3—figure supplement 1).
Using this location on the rewarded/non-rewarded axis, we compared findings obtained using intrinsic signal imaging with calcium imaging data. First, we calculated the measure Ca2+ ΔOverlap, which was defined as the overlap between the rewarded- and non-rewarded stimulus-evoked calcium response, using mean cellular calcium responses to the trained orientations for each imaging field. These overlap values were averaged across imaging fields per cortical location bin and subtracted by the (identically calculated) overlap of the orthogonal control stimuli. The Ca2+ ΔOverlap was significantly lower for imaging fields in the full rewarded region and at the rewarded/non-rewarded location border, compared to field-of-views that were located fully in the non-rewarded stimulus region (Kruskal-Wallis test, H(3,45) = 11.6, p=0.0088, n = 49 imaging fields; Figure 3c). The pattern of overlap in location selective responses based on calcium imaging data resembled the results obtained using intrinsic signal imaging (Gray line in Figure 3c indicates IOS ΔOverlap as in Figure 2d), showing the strongest reduction in Overlap (as compared to control) in the Border rewarded and Border non-rewarded regions. Also selectivity for retinotopic location, now calculated using calcium imaging data, was larger in the Full rewarded and Border rewarded regions, as compared to the Full non-rewarded region (Kruskal-Wallis test, H(3,45) = 19.3, p=0.0024, n = 49 imaging fields). The measured ΔOverlap in the rewarded stimulus location correlated strongly and significantly across methods (IOS vs. Ca2+, r = 0.81, p=0.016, n = 8 mice) and a weaker, but similarly positive correlation was found for retinotopic location selectivity (r = 0.69, p=0.058, n = 8 mice).
If the spatial segregation of the cortical population responses was driven by local map expansion, this would predict a larger fraction of neurons being tuned to rewarded or non-rewarded stimulus orientations compared to orthogonal orientations. The fraction of responsive neurons per stimulus orientation and location can be estimated only from the calcium imaging data acquired at single cell resolution and cannot be directly compared to intrinsic imaging data. Interestingly, the fraction of responsive cells per stimulus orientation was significantly reduced in the Full rewarded location and did not differ significantly between the Border rewarded and Border non-rewarded locations (2-way Anova, interaction effect of Location bin versus Preferred orientation, F(3,90) = 3.99, p=0.010; n = 49 recordings; Post hoc, Trained versus Orthogonal orientation for full-rewarded location: p<0.05; Figure 3d). Instead, we observed that the population response amplitude to rewarded stimuli increased more steeply from Border non-rewarded locations to Border rewarded locations compared to the increase of the population response to non-rewarded stimuli from Border rewarded to Border non-rewarded locations (2-way Anova, interaction effect of location vs. population response difference, Trained stimuli: F(3,85) = 3.59, p=0.017, Untrained stimuli: F(3,85) = 1.48, p=0.23; n = 49 recordings; Figure 3e). While the response amplitude to the non-rewarded trained orientation appeared also smaller compared to the non-rewarded control orientation, similar to what we observed in the intrinsic imaging data (see Figure 3e, inset right), this difference was not significant. Nonetheless, the reduction in response amplitude (trained orientation minus orthogonal control), as obtained using calcium imaging, did covary with the reduction in response amplitude that was observed in the intrinsic imaging data (IOS vs. Ca2+, r = 0.92, p=0.028, n = 5 mice for which we had both intrinsic imaging data and calcium imaging recordings from the non-rewarded location).
These results suggest that the observed mesoscopic disambiguation of the representation of the rewarded and non-rewarded stimulus (as observed using intrinsic imaging) is expressed at the single neuron level (as observed using calcium imaging) and is potentially mediated by a spatially restricted change in response patterns of a select population of neurons, rather than an overall expansion of the cortical map for rewarded or non-rewarded stimuli.
The rewarded conditioned stimulus drives a smaller population of orientation-tuned neurons with larger response amplitudes
To investigate how response patterns of orientation-tuned neurons were altered after conditioning, we quantified tuning curve parameters for individual neurons as a function of their imaging location (Full vs Border, with rewarded/non-rewarded pooled), whether the cell responded to the rewarded or non-rewarded stimulus location (rewarded vs non-rewarded, with Full/Border pooled), and the similarity of the neuron’s preferred orientation to the trained orientation. While the populations of orientation-tuned cells located in Border- and Full imaging regions did not show significant differences in fraction of neurons being tuned to trained and other orientations, response amplitude and tuning curve bandwidth (Kruskal-Wallis test, p>0.05; n = 11 mice; Figure 4—figure supplement 1), we observed significant differences between these parameters for cells that responded to the rewarded and non-rewarded stimulus location.
On average, the percentage of cells that preferred the rewarded and non-rewarded stimulus location was similar, although not identical (total: 32.2%, see Table 1 for fraction per mouse; rewarded: 17.8%, non-rewarded: 14.5%; WMPSR-test, p=0.58, n = 11 mice; Figure 4a). However, the relative fractions of cells preferring trained and other orientations differed significantly between groups that were tuned to rewarded and non-rewarded locations (these fractions were normalized to the overall fraction of responsive neurons per mouse, across all preferred orientations and locations and adjusted for relative bin width so that the expected fraction given a flat distribution of preferred orientations was 1.0; Figure 4b,c). Specifically, for cells tuned to the rewarded location there was a relatively smaller fraction of cells preferring the trained orientation, compared to the set of cells that responded to the non-rewarded (i.e. orthogonal) orientation (Kruskal-Wallis test, ‘Rewarded−Non-rewarded’ vs. ‘ΔOri. from trained’, H(4,50) = 9.76, p=0.045; post hoc WMPSR-test, ‘0°–10°’ vs. ‘50°–70°’, p=0.042, n = 11 mice; Figure 4d). This effect corresponds to what is shown in Figure 3d, in which we observed fewer neurons being responsive to the trained stimulus in the Full rewarded cortical region compared to the orthogonal control orientation.
Although the fraction of cells tuned to the conditioned orientation at the rewarded stimulus location was reduced, their response amplitude to the trained orientation was increased compared to cells responding to the non-rewarded location (Kruskal-Wallis test, ‘Rewarded−Non-rewarded’ vs. ‘ΔOri. from trained’, H(4,48) = 11.6, p=0.020; n = 11 mice; Figure 4e). Moreover, neurons with tuning curves that flanked the preferred orientation (ΔOri. from trained between 10° and 30°) had broader tuning curves (Kruskal-Wallis test, ‘ΔOri. from trained’, H(4,48) = 14.1, p=0.0068; Post hoc WMPSR test, ‘0°–10°’ vs. ‘10°–30°’, p=0.0039; n = 11 mice; Figure 4f). The latter effect indicates that neurons with preferred orientations that slightly differ from the trained orientation increased their response to the trained orientation (regardless of the reward-location association), rendering their orientation tuning curves broader (Goltstein et al., 2013). The orientation selectivity index did not significantly differ between rewarded and non-rewarded tuned neurons, or as function of angle between preferred orientation and the trained orientation (Kruskal-Wallis test, p>0.16; n = 11 mice). When we performed these analyses on tuning curves of the neurons that were not significantly tuned, we did not observe any of the above-described differences.
In order to test whether the differences described above reflected an overall sparser population response to rewarded conditioned stimuli, we quantified population sparseness (ap, lower values indicate a sparser population response; Rolls and Treves, 2011) for the tuning curve response of all neurons. The population response to trained stimuli in the rewarded location did not show a significantly lower sparseness compared to the population response to visual stimulation in the non-rewarded location (Kruskal-Wallis test, ‘ΔOri. from trained’, H(4,50) = 0.23, p=0.99; n = 11 mice; Figure 4g).
These differences in response properties of orientation-tuned neurons indicate that, although fewer neurons were significantly responsive to the conditioned stimulus orientation, the individual neurons that responded to the rewarded stimulus did so more strongly.
Improved neuronal population coding for trained stimulus location
Thus far our data obtained using intrinsic signal imaging as well as calcium imaging indicate that, after training, the cortical map for trained stimulus location and orientation became more selective for retinotopic position. We therefore hypothesized that populations of simultaneously recorded single neurons would show an improved ability to discriminate the location of trained stimuli as compared to the (same) locations of untrained control stimuli. To test this, we used a Bayesian algorithm with cross-validation to decode stimulus location from single trial responses to the very stimuli that were used in the conditioning paradigm. Performance of the decoding algorithm for those stimuli was compared with that for stimuli having orientations differing 45 or 90 degrees from the trained orientation (untrained stimuli).
First, we decoded calcium responses recorded in field-of-views located around the rewarded/non-rewarded border on the cortical surface (see Figures 3b and 5a, inset left). In this population of significantly tuned Border neurons, decoding of stimulus location was significantly better for the trained orientation as compared to the orthogonal orientation (WMPSR test, difference between ‘trained’ and ‘orthogonal orientation’ averaged across all sample sizes per mouse, p=0.0078; n = 9 mice; Figure 5a, left panel). Decoding of activity patterns from cells recorded in regions further away from the border (see Figure 5a, right panel) did not differ between trained and untrained orientations (WMPSR test, difference between ‘trained’ and ‘orthogonal orientation’ averaged across all sample sizes per mouse, p=0.46; n = 11 mice; Figure 5a, right panel).
Data from six separate animals contributed both behavioral measurements and Border-region imaging fields of view. Of these, five mice showed better decoding of trained stimulus location compared to untrained orientations, while a single animal did not show a difference. Moreover, the magnitude of the difference in decoding performance between trained and other (45° and 90°) orientations correlated significantly with the magnitude of the difference in anticipatory nasal and oral movements in the behavioral paradigm (Nasal movements: r = 0.83, p=0.041; Oral movements: r = 0.96, p=0.003; n = 6 mice; Figure 5b). Decoding performance did not correlate significantly with the total number of conditioning trials that the mice were exposed to (Total number of trials: r = −0.18, p=0.73; n = 6 mice). The single mouse that did not show a significant improvement in decoding performance also failed to show an increase of both anticipatory nasal- and oral-movements in the behavioral paradigm, while it was still exposed to 640 conditioning trials (see Table 1, mouse #09).
Conditioning-related suppression of noise correlations in high signal correlation pairs
Effects of conditioning were observed in a subset of similarly tuned neurons within the overall heterogeneously tuned group of V1 neurons. We assessed the degree to which cells in these subgroups can be seen as functional units by comparing similarity of tuning curves (signal correlation) and stimulus-independent covariations (noise correlation; see for example Averbeck et al., 2006; Montijn et al., 2016). Signal and noise correlations were calculated on tuning curves of all simultaneously recorded pairs of cells that were either responsive to the rewarded or non-rewarded location and grouped according to the similarity of their preferred orientations relative to the trained orientation, and whether they were located in the Full or Border stimulus region. However, there were no significant differences in average signal correlations and noise correlations between the trained and control orientations (Bootstrap confidence intervals, p>0.05; Figure 6a).
Interactions between signal and noise correlations can hamper or facilitate efficient population coding. For instance, population coding benefits when cells with high signal correlations have low noise correlations and vice versa (Oram et al., 1998; Averbeck et al., 2006; Poort and Roelfsema, 2009; Jeanne et al., 2013). To investigate whether such an effect occurred in our data, we selected pairs of cells that displayed the 10% highest and 10% lowest signal correlations and calculated noise correlations for these pairs separately (Jeanne et al., 2013). In the border imaging regions, high signal correlation pairs that were tuned to the trained orientations exhibited significantly lower noise correlations compared to pairs preferring other orientations (Bootstrap confidence intervals, p<0.01; nborder = 20 imaging fields of view; Figure 6b, right panel, solid lines). In addition, in the Full imaging regions, we observed that low signal correlation pairs had stronger noise correlations when they were tuned to the trained orientations as compared to the control orientations (Bootstrap confidence intervals, p<0.05; nfull = 24 imaging fields of view; Figure 6b, left panel, dotted lines). Thus, the effect of classical conditioning on noise correlations depends on the signal correlation of the pair of neurons, which can have the overall effect of enhancing the discriminability of trained stimuli in the population.
Discussion
Associative learning is known to affect neural responses across a range of spatial scales (Jehee et al., 2012; Bao et al., 2001; Goltstein et al., 2013), but how learning affects the spatial dimension of sensory cortical maps has remained elusive. Our results indicate how associative learning (by coupling a visual stimulus to reward) affects orientation-specific coding of single neurons in a retinotopically restricted fashion but fails to lead to an overall expansion of the cortical region representing the trained visual space, thus leaving the retinotopic map intact. These data demonstrate that learning-induced changes in single neurons emerge in concert with enhanced stimulus representations at the population level increasing location discriminability within the V1 cortical map.
Considerations regarding imaging methodology
The central finding in this study is improved coding for stimulus location by a population of neurons that preferred the trained orientation and was located within the cortical retinotopic region where the trained stimuli bordered. This enhanced selectivity for retinotopic location was observed using both a mesoscale (intrinsic imaging) and a microscale (calcium imaging) method. The data acquired using intrinsic imaging suggested that this effect was mediated by a reduction in response amplitude to the non-rewarded trained stimulus (Figure 2d,g). While visibly present, this reduction was less pronounced when observed at the single cell resolution using calcium imaging (Figure 3e). The difference in results may be inherent to the difference in methods, with intrinsic signal imaging picking up a widespread mixed, metabolic signal across cortical neurons (including dendrites, axons and synapses) and layers, and with calcium imaging focusing on somatic spiking activity in layer 2/3 neurons selectively. That the magnitude of reduction in trained stimulus-representation Overlap, as measured with each method (Figure 2f and Figure 3c), was correlated across mice suggests that the effects are related. What was observed at the mesoscale as an overall change in response amplitude, may in part reflect a subtler change in stimulus selectivity or jointly orchestrated activity patterns at the single neuron, somatic level within cortical layer 2/3.
It is of note that the results obtained with calcium imaging, such as differences in fraction and amplitude of responsive neurons and changes in population decoding for retinotopic location, were observed in comparison to untrained control orientations or control regions, and not compared to a hypothetical time point before learning. Therefore, it cannot be fully excluded that these effects were mediated, in part, by changes of the opposite sign in neurons that were tuned to untrained control orientations. However, some effects of conditioning were quite selective for the trained orientation as compared to different untrained control (i.e. oblique and orthogonal) orientations (see e.g. Figures 4e and 5). While this does not fully confirm that learning effects were only present in neurons tuned to the trained orientation, it indicates that, at least, the trained orientation stood out from the way the broader population of untrained stimuli was processed.
Sharper spatial tuning within the V1 retinotopic map
Cortical representations, as also found in the auditory cortical tonotopic map or the somatosensory homunculus, have been known to exhibit plasticity (Bakin and Weinberger, 1996; Buonomano and Merzenich, 1998; Bao et al., 2001). An example of map plasticity like observed here, however, has not been found before in visual cortex, where shifts in retinotopic organization were, until now, described as a consequence of selectively depriving cortical input only (Heinen and Skavenski, 1991; Gilbert and Wiesel, 1992; Keck et al., 2008). The kind of refinement of the retinotopic map as shown in our experiments—a sharper retinotopic gradient (Figure 3e) in calcium response patterns coupled to a reduced overlap in intrinsic optical responses (Figure 2e,f,h) and better location-decoding performance (Figure 5a)—is somewhat comparable to emerging discontinuities in the cortical digit representation after separation of webbed fingers (Mogilner et al., 1993) or fading discontinuities in the somatosensory map after surgical syndactyly (Allard et al., 1991). However, map-plasticity in these studies emerged by self-organizing plasticity, while in our study, appetitive conditioning directed the alterations in the retinotopic map. Not only is the treatment (learning paradigm) more subtle than the interventions in the studies mentioned above, but the observed map-plasticity underscores that also under naturalistic conditions stimulus-reward learning can direct functional changes in cortical maps, expressed in the way the cells in these maps encode sensory information.
The changes in neuronal tuning observed in our study can also be considered in the context of perceptual learning. Training to discriminate small differences in stimulus parameters can result in sharpening of tuning curves in the primary visual cortex (Schoups et al., 2001), an effect that has been suggested to help disambiguate fine differences in stimulus orientation. The presently reported learning-induced reduction in overlap of the population response to trained stimuli resembles such a mechanism of tuning curve sharpening, but now pertains to the cortical mapping of visual space. While our study did not directly compare the conditioned group with a sham-trained (randomly rewarded) group, we did observe a correlation between the amount of anticipatory behavior and changes in neuronal population coding (Figure 5), but no correlation to the number of trials. This argues that the observed effects are not merely the result of stimulus exposure but are associated with behavioral learning in the conditioning paradigm.
Mechanisms underlying learning-induced map plasticity in V1
Neuronal learning mechanisms underlying classic forms of map plasticity are generally thought to be Hebbian in nature (Buonomano and Merzenich, 1998), functioning through rapid induction of LTP and LTD for spared and deprived inputs respectively or via competition between inputs (Feldman and Brecht, 2005). Additionally, local secretion of neurotransmitters like acetylcholine and noradrenaline plays a role (Bear and Singer, 1986). In auditory cortex for instance, large shifts in tonotopic representations have been observed after pairing a tone with basal forebrain stimulation (Bakin and Weinberger, 1996; Kilgard and Merzenich, 1998). In the current study, we did not observe such a large-scale expansion of the conditioned stimulus representation, but rather an increase in selectivity of the cortical map. Recent work in the primary visual cortex of the mouse has established that cholinergic neuromodulation can act to improve neuronal selectivity and perception in a rapid and task specific way (Pinto et al., 2013). Moreover, during an appetitive conditioning paradigm, cholinergic input from basal forebrain to V1 induced strong local activity patterns leading up to the time of reward delivery (Liu et al., 2015), which may drive stimulus-selective plasticity (Chubykin et al., 2013). The plasticity in V1’s retinotopic map, which we induced here using appetitive conditioning, may therefore have been mediated by local release of acetylcholine. However, the strengthening of feedback connections from higher visual or other cortices (Pennartz, 1997; Makino and Komiyama, 2015) could provide an alternative or additional mechanism by which learning leads to changes in cortical maps. In addition, the observed reduction in response amplitude to the non-rewarded trained stimulus could indicate a role for an LTD type mechanism reducing excitatory drive of non-rewarded stimulus representation (Nabavi et al., 2014). Alternatively, it could reflect strengthening of long-range lateral connections from for example the rewarded retinotopic location, or feed-back from higher visual areas, onto inhibitory neurons in the non-rewarded retinotopic location to increase local inhibitory drive of the non-rewarded stimulus representation (Makino and Komiyama, 2015).
While neuromodulation and long-range connectivity are strong candidates to mediate learning in our behavioral paradigm, the conditioning-related improvement in retinotopic selectivity was observed under anesthesia, which makes it likely that these results depend to some degree on changes in feedforward or local recurrent synaptic connectivity. We hypothesize that these cells increase their local connectivity with neurons that are tuned to the same retinotopic location, thereby strengthening their spatial selectivity (see Figures 2f,h and 3c–e) but reducing precise selectivity for stimulus orientation (see Figure 4f). From this point of view, it will be interesting to perform an experiment studying the exact receptive field position and structure for each neuron along with its precise local synaptic connectivity. Such an experiment could also reveal whether the receptive field centers of certain subsets of neurons (e.g. cells tuned to the trained orientation) drift away from the border region, or whether the spatial extent of receptive fields selectively shrinks so that it is less likely to cross the trained stimulus border. That receptive fields may have shifted should not be considered a potential confounder, but rather as a part of the underlying mechanism improving discriminability of spatially adjacent cortical representations.
Learning-related interactions between signal and noise correlations
Several theoretical studies have shown that reduction of noise correlations between cells exhibiting high signal correlations can improve population coding (Zohary et al., 1994; Oram et al., 1998; Shadlen and Newsome, 1998; Abbott and Dayan, 1999; Averbeck et al., 2006; but see Montijn et al., 2016), but experimental evidence in support of these mechanisms being employed during learning is only sparsely available (Jeanne et al., 2013). Here, we show a decrease of noise correlations within high signal correlation pairs that was strongest at the V1 location where the trained stimuli bordered (Figure 6b). This provides support for the theoretical notion of how interactions between signal- and noise correlations can facilitate coding of stimulus information, and also shows that these effects can arise in the primary visual cortex as a result of associative learning. In addition, groups of cells exhibiting low (negative) signal correlations may improve population coding by increasing noise correlations, even without transmitting information in the structure of the noise correlation itself (Oram et al., 1998; Abbott and Dayan, 1999; Averbeck et al., 2006). Additionally, in imaging regions further away from the border of the trained stimuli, we observed stronger noise correlations in groups of trained orientation tuned cells with relatively low signal correlations. Possibly this effect depends on how heterogeneously a population of neurons is tuned to the behaviorally relevant stimulus and therefore only manifested in the Full imaging regions where the majority neurons might have been synchronously driven by a single (rewarded or non-rewarded) stimulus.
A less dense, but more efficient cortical representation for reward-associated stimuli
With or without stimulus awareness, stimulus-reward pairing can enhance feature detection in primary visual cortex (Shuler and Bear, 2006; Seitz et al., 2009; Frankó et al., 2010; Goltstein et al., 2013). While we observed that visual conditioning resulted in a reduced fraction of neurons being tuned to the trained orientation in the rewarded location (Figures 3d and 4d), those neurons that remained to prefer the conditioned or similar orientations responded with larger ΔF/F amplitudes to the reward associated stimulus (Figure 4e). This indicates that population coding for the conditioned orientation in the rewarded location, contained fewer neurons compared to their untrained orientation tuned counterparts, while maintaining the average population response amplitude, thus potentially rendering their response more efficient by representing the same information using fewer cells (see also Gdalyahu et al., 2012).
In summary, this study highlights a selective role for reward-dependent learning in refining the primary cortical retinotopic map. It demonstrates how coordinated changes in neuronal tuning and inter-neuronal correlations can result in a more optimal population code for trained stimuli and improve the local representation of visual space while leaving the overall retinotopic map intact.
Materials and methods
Animals
Experiments were conducted with approval of the ethical committee for animal experiments of the University of Amsterdam. Male C57BL/6 mice (for n, see Table 1; Harlan, The Netherlands) ranging in age from 70 to 116 days at the start of the experiment were housed pair-wise in large cages (40 cm length ×25 cm width ×25 cm height) on a reversed day night cycle (9 AM light-off; 9 PM light-on). Water and food were available ad libitum, except for a period of six to eight hours prior to behavioral training, when food was not available. Non head-fixed habituation of the mice to the conditioning environment and the frame for head-restraint spanned four to five days and included handling in the behavioral lab and free access to the reward substance, a semifluid vanilla-flavored dairy product (Figure 1—figure supplement 1a).
Visual conditioning of head-restrained mice
Request a detailed protocolMice were fitted with a stainless-steel cranial plate that allowed repeated head-restraint (Figure 1—figure supplement 1a; Dombeck et al., 2007; Niell and Stryker, 2010). In brief, under surgical anesthesia (Isoflurane inhalation, induction: 3% in O2; maintenance: 1.5% in O2) and analgesia (Buprenorphine, 0.05 mg kg−1 bodyweight, injected subcutaneously 30 min before surgery), three skull screws were placed, two in the frontal skull plates and one lateral-right in the occipital skull plate. The head bar was positioned with the central opening over cortical area V1 and attached with cyanoacrylate glue and black-pigmented dental cement to the skull and screws. The central opening was closed with a transparent silicone elastomer (Quick-sil, World Precision Instruments, Germany) and a cover glass. Mice were allowed to recover for four days, during which non head-fixed habituation was continued. In the next four to five days, animals were head-fixed in the behavioral apparatus while given free access to the vanilla-flavored reward through the feeding tube for 15 to 20 min per day.
Appetitive conditioning with retinotopically selective visual stimuli was done in 8 to 17 sessions. The number of conditioning sessions (8 to 17) before two-photon imaging depended on the order in which animals were used for calcium imaging, which was determined by chance. The number of trials ranged from 8 to 12 trials in the first training session to 20–35 in subsequent training sessions. The amount of rewarded and non-rewarded trials in each training session was nearly equal; on a single day, the number of rewarded and non-rewarded trials never differed by more than three trials and the total number of rewarded and non-rewarded trials differed by only 0.5% (3.1 out of 539.7 trials). The total number of conditioning trials that each mouse was exposed to is reported in Table 1. Conditioning sessions lasted 20–30 min, during which the animal was head-restrained facing a 21’ computer screen (Dell) at a distance of 20 cm (Figure 1a,b). The center of the screen was positioned 45° lateral (Azimuth) at the height of the eye of the mouse (0° elevation). Stimuli were oriented gratings (100% contrast square wave; spatial frequency: 0.05 cycles degree−1; temporal frequency: two cycles second−1) moving in a single direction, presented either in an area of 30 by 30 retinal degrees above, or below the horizontal meridian (Figure 1a, right panels). For each mouse, the rewarded stimulus was randomly assigned to one visual field location and the non-rewarded to the other (see Table 1). This assignment was varied across mice, with the rewarded stimulus being as often above the meridian as below it. Stimulus orientation and direction of the rewarded and non-rewarded stimuli were the same and all parameters remained unchanged during the entire behavioral experiment. Each rewarded or non-rewarded trial started with a click, followed by 4 to 6 s of stimulus presentation against a background with equal luminescence. Next followed a pre-reward delay of 1.5 to 2 s. In the last 0.4 s of the pre-reward delay a servo-controlled arm moved a small plastic tube to a position within licking distance of the mouse in rewarded trials, while the arm stopped just out of range of the mouse in non-rewarded trials (Figure 1b,d and Figure 1—figure supplement 1b–e). By applying back-pressure on the tube using a syringe pump (RE-S, RAZEL, United Kingdom), an amount of 20–40 µl reward substance was delivered in each rewarded trial. After a reward consumption period of 4 s, the arm moved back and an inter-trial interval of 20 to 30 s was inserted between subsequent trials. The temporal offset between reward delivery and visual stimulation was implemented to prevent consumption-related eye-movements or other motion artifacts during visual stimulus presentation.
Behavioral parameters were monitored using a standard visible light CCD camera fitted with a wide-field low-magnification lens at a frame rate of 25 Hz (Figure 1, ‘Behavior tracking’). This camera was positioned on the left side of the mouse to record its silhouette and that of the reward arm against the grey background of the screen, as well as to record the rewarded and non-rewarded stimulus presentation (Figure 1b and Figure 1—figure supplement 1b,d). Behavioral parameters were aligned to stimulus onset and (non-) reward delivery time, which was determined by the arm arriving at the endpoint (Figure 1b and Figure 1—figure supplement 1c,e). The trajectory and speed of the arm was identical in rewarded and non-rewarded trials up to the point where, in rewarded trials, the arm exceeded the non-reward endpoint. The traversal from the non-reward endpoint to the reward endpoint happened within a single 40 ms image frame (Figure 1—figure supplement 1f). The measured time-difference between detection of the arm arriving at the non-reward endpoint and detection at the reward endpoint across all trials was on average 55 ms, implying a movement speed between 0.5 and 1.0 m s−1. We added an extra margin of 100 ms to the 55 ms difference in end point arrival time to buffer possible variations in movement speed. As a result, we excluded behavioral data in the period from 160 ms before the reward or non-reward endpoint in the comparison of learning effects.
Nasal movements (putative sniffs) and oral movements (putative licks) were quantified by applying a threshold to each video frame at the mean intensity, resulting in a binary silhouette of the mouse, and counting the number of pixels that changed intensity compared to the previous video frame in the nasal or oral region (Figure 1c and Figure 1—figure supplement 2a, red box). Licks are rapid, sparsely occurring events; therefore a threshold was applied to the number of pixels changed in each frame, which resulted in ‘all or none’ detection of oral movement. Sniffs are slower and more continuous events that are better reflected by a continuous measure. We therefore used the mean number of pixels that changed intensity as a consequence of nasal-movement directly as a measure for sniffing.
Eye-tracking
Request a detailed protocolPosition and diameter of the pupil was monitored using a near infrared CCD camera (Jai, United States) through a high magnification long working distance lens (Thorlabs, Germany) with a frame rate of 25 Hz (see Figure 1 for camera position at ‘Eye tracking’). Eye-tracking was done offline using a custom written algorithm (Zoccolan et al., 2010). For each video frame, location of the center of the pupil was estimated by applying a radial symmetry transform (Loy and Zelinsky, 2003). The edge of the pupil was detected from this point of origin into all directions with 10° angular resolution. Outlier edge detection points (beyond mean ±3 SD) were removed and the remaining data points were fitted with a circle (Figure 1—figure supplement 3a). This procedure provides estimates for the X and Y position and diameter of the pupil in pixels. Using the estimated average diameter of the mouse eye (3.3 mm; Jeon et al., 1998) and the field of view of our camera, a 1-pixel displacement/enlargement in pupil-tracking data was estimated to correspond to approximately 2–2.5 retinal degrees of visual field.
Transcranial optical imaging of intrinsic signals
Request a detailed protocolIntrinsic optical imaging (Bonhoeffer et al., 1996) was performed using a commercially available setup (Optical Imaging Ltd, Israel). The mouse was head-restrained while being under anesthesia (isoflurane inhalation, induction: 3% in O2; maintenance: 1–1.5% in O2). This procedure kept the animal immobile, whereas the eye-blink reflex was just noticeable. The skull was illuminated through the cover glass with 630 nm (bandpass filtered) light. Images were acquired at an effective sampling rate of 2 Hz. A screen was placed at the exact same position as in the behavioral setup (see Figure 1a). Five stimuli (the rewarded stimulus, the non-rewarded stimulus, stimuli at the same location but with orthogonal orientations, and an isoluminant grey screen, the null stimulus; Figure 2a, left panels) were presented in 20 trials each. During the entire imaging experiment, the screen displayed the isoluminant null stimulus, except when a grating stimulus was presented. Each trial started with the recording of a four-second baseline period, followed by four seconds of continuous stimulus presentation and seven seconds of post-stimulus response time. The intertrial interval lasted an additional five seconds.
Analysis of intrinsic optical signals
Request a detailed protocolIntrinsic signal images were referenced per trial against the mean of the first 8 (baseline) frames, resulting in a percentage signal increase per pixel. A region in the primary visual cortex, large enough to contain the responses to both rewarded and non-rewarded stimuli, was selected manually and within-trial signal drift was corrected for by subtracting the value of each pixel in this region by the average intensity of a non-responsive image-region a few millimeters anterior. For each recording, a single mean and standard deviation was calculated per pixel across all stimuli and repetitions and each pixel was subsequently z-scored by subtracting the mean and dividing over the standard deviation.
Within the region of V1, the location of maximum activation for the rewarded and non-rewarded area was automatically detected by locating the largest activation in smoothed average response images for visual stimulation by the orthogonal stimuli in the rewarded area and non-rewarded area. Using this (untrained) template response map, we calculated the angle that aligned an imaginary line, connecting peaks of maximal visual activity evoked by stimulation in the different visual fields, parallel to the vertical axis of the template image (Figure 2a, red windows). In most mice this rotation was around 25° clockwise. All further data from each recording was automatically rotated to the calculated rotation angle. Next, cutouts of this 2-dimensional rotated image, from −5 to +5 pixels centered on the vertical transection of the average peak responses in the (untrained) template, were averaged to a 1-dimensional spatial response profile for each time point separately that represented response strength as a function of cortical distance aligned to the Rewarded/Non-rewarded axis (Figure 2b, left panels, cutout before averaging the x-dimension). Response profiles from different time points (imaging frames) of the same trial were concatenated to cortical distance ×time matrices (Figure 2b, right panels). On a total of 10 mice, one mouse was removed from these analyses because the peak location of the intrinsic response could not be (automatically) detected in both the rewarded and the non-rewarded location due to blood vessel response artifacts in the imaging data.
Amplitude time courses (Figure 2—figure supplement 1b) of the intrinsic optical signal response were calculated by averaging values of pixels in the spatial dimension over a range of −5 to +5 pixels around the maximum pixel in the cortical distance ×time matrices. Amplitude-cortical space profiles (Figure 2d) were constructed similarly, by averaging intensity values in the period where the response peaked (i.e. 3 to 7 s after stimulus onset) over the time dimension. Overlap of cortical space profiles was calculated by, for each spatial point on the profile, subtracting the sum of the individual profile data points from their maximum, resulting in the part of the response that was shared (see Figure 2c and Figure 2f). ΔOverlap (Figure 2h) indicated the difference between overlap calculated for trained and for orthogonal stimulus orientations presented at the same location. Spatial selectivity was calculated similarly by, for each spatial point on the profile, dividing the difference of the responses to the rewarded (Rrewarded) and non-rewarded (Rnon-rewarded) locations by their sum (Rrewarded - Rnon-rewarded) / (Rrewarded + Rnon-rewarded).
Calcium imaging
Request a detailed protocolUnder surgical anesthesia (Isoflurane inhalation, induction: 3% in O2; maintenance: 1.5% in O2) and analgesia (Buprenorphine, 0.05 mg kg−1 bodyweight, injected subcutaneously 30 min before surgery), a craniotomy was performed over the area of V1 that was identified to respond to the trained stimuli using intrinsic optical imaging. In these regions, cells were loaded with the fluorescent calcium indicator Oregon Green BAPTA1-AM (OGB) and Sulforhodamine 101 (SR101; for staining astrocytes/glial cells) using a protocol for multi-cell bolus loading (Stosiek et al., 2003; Nimmerjahn et al., 2004; Goltstein et al., 2013; Goltstein et al., 2015). After surgical procedures were completed, the Isoflurane concentration was carefully lowered and maintained at 0.8% for the entire course of the experiment (such that the mouse remained under anesthesia).
Two-photon laser scanning microscopy was performed with a Leica SP5 resonant scanner and a Spectra-Physics Mai Tai High Performance Mode Locked Ti:Sapphire laser (wavelength 810 nm). Fluorescence was collected in non-descanned photo-multiplier tubes, filtered at 525 nm (maximum range 500–550 nm) for OGB and 585 nm (maximum range 565–605 nm) for SR101. Frame-averaged images (eight frames, 512 × 512 pixels) from a square region of approximately 330 × 330 μm were acquired at a scan speed of approximately 2.8 Hz. Visual stimulation was done with moving gratings identical to those used for behavioral conditioning, but now 8 directions of movement (four orientations) were shown in either visual field (10 repetitions with a duration of 8 scan frames per stimulus).
Analysis of calcium imaging data
Request a detailed protocolImages acquired with two-photon microscopy were realigned to compensate for small movement artifacts in the x–y plane using an algorithm that relies on the cross-correlation between the two-dimensional Fourier transforms of the to-be-aligned image and a reference image (Guizar-Sicairos et al., 2008). Neurons were manually identified and outlined and the mean fluorescence was calculated for each image frame. The fluorescence time series of each neuron was corrected for possible contamination by non cell-specific fluorescence signals that originate from the neuropil using previously described methods (Kerlin et al., 2010; Goltstein et al., 2015). Visual responses were quantified per trial as ∆F/F, or in more detail: (F–F0)/F0. F was determined from the average fluorescence in the 8-frame (~2.8 s) period during visual stimulation. F0 was calculated from the average fluorescence in the 8-frame period preceding visual stimulation, when a gray screen with equal luminance was presented.
For each field of view, an imaging location index was calculated from the mean response of all neurons to the orthogonal (untrained) orientations (Equation 1). This index approaches the value of −1 for fields of view that have primarily cells tuned to the non-rewarded location and +1 when most cells are tuned to the rewarded location. For fields of view where the fraction of cells responding to the rewarded and non-rewarded location was similar the index has a value around 0:
Where N is the total number of neurons in a recording session and ROrth(RewLoc)n is the mean response of the nth neuron to the orientation orthogonal to the trained orientation, presented in the reward-predictive visual field.
Based on the imaging location index, the dataset was divided in four groups along the rewarded/non-rewarded axis (Figure 3b). Two groups consisted of recordings that were made in regions that were mostly driven by one retinotopic location; the ‘Full rewarded’ and ‘Full non-rewarded’ groups (Imaging location index <−0.66 for Full-nRw and >0.66 for Full-Rew). The two other groups consisted of recordings obtained from the region of cortex where the rewarded and non-rewarded retinotopic representations bordered; the ‘Border rewarded’ and ‘Border non-rewarded’ groups (Imaging location index >−0.66 but <0 for Border-nRw and >0 but<0.66 for Border-Rew). The cut-off of 0.66 was chosen such that only cortical regions that were strongly driven by one stimulus location compared to the other stimulus location (~5 times stronger) would be classified as Full rewarded or Full non-rewarded.
The number of recordings in each location group ranged from 8 to 14 (Figure 3—figure supplement 1a) and the average within-group imaging-location index showed a linear increase across location groups along the rewarded/non-rewarded axis (Figure 3—figure supplement 1b). The latter indicates that each location-group represented a part of the visual space that was approximately equally distant from the neighboring location groups in cortical space and thus validates the approach. An important aspect here is that, as in the analysis of intrinsic imaging data, the imaging location index was calculated using responses to untrained stimuli, which facilitates the comparison between results obtained using these two imaging techniques.
Neurons were classified as being orientation-tuned or non-tuned by testing for a difference in their responses across eight directions in the upper or lower visual field separately using a 1-way Anova against p<0.05. Neurons that displayed significant orientation tuning, but for which the ∆F/F response to the preferred direction did not exceed 2%, were considered to be false positives, or to have a low signal to noise ratio and were therefore discarded from the analysis. Tuning curves for movement direction were constructed by fitting the mean responses across all directions in each area separately by a two-peaked Gaussian function (Li et al., 2008). Tuning curve bandwidth was calculated as the half-width of the fitted tuning curve at 1/√2 height (Ringach et al., 2002). Orientation selectivity (OSI) was calculated by dividing the difference between response to the preferred orientation and the orthogonal orientation by the sum of these: (Rpref-ori - Rortho-ori)/(Rpref-ori + Rortho-ori) (Niell and Stryker, 2008).
Population sparseness ap (Equation 2) was quantified as described in Rolls and Treves, 2011. The vector y contains mean ∆F/F responses of all N neurons to a single stimulus and yn is the response of a single neuron n to a single stimulus. Higher values of ap indicate that many neurons in the population were responsive to the stimulus. Lower values of ap indicate a sparser population response, with only few strongly responding neurons resulting in a more skewed distribution of ∆F/F amplitudes:
Population decoding of the stimulated visual field (rewarded or non-rewarded location), was done using an algorithm based on Bayes theorem (Equation 3; Oram et al., 1998; Dayan and Abbott, 2001). Single trial responses were decoded using a ‘leave one trial-block out’ (cross-validated) principle. One trial from each stimulus category (rewarded or non-rewarded location) was removed from the dataset and each of the removed trials was decoded separately. The probability for a single-trial calcium response r of an individual neuron to be observed in a certain stimulus condition s, p(r|s), was calculated from a Gaussian probability distribution, estimated by the mean and SD of all remaining responses of the decoded neuron in that stimulus condition. When multiple neurons were used for decoding, probabilities of the individual neurons’ responses were multiplied. The prior, p(s), was identical across stimuli and the overall probability of observing the decoded response, p(r), was estimated from all remaining responses (Equation 3; Oram et al., 1998). This procedure gave two probabilities per decoded trial; one for the stimulation delivered at the rewarded location and one for the non-rewarded location. The highest probability was chosen as decoder output. Performance for decoding single neuron or population (multiple simultaneously recorded neurons) calcium responses was quantified by comparing the decoder output with actual stimulus position and resulted in a fraction correct (the theoretical chance level of 50% correct was experimentally confirmed).
Signal correlations between pairs of cells were quantified by calculating the mean Pearson correlation coefficient of the average responses of those cells to all 16 stimulus types (eight directions × 2 locations). Noise correlations were quantified by subtracting the average response to the preferred orientation from the individual trial responses to that orientation (because of 8 repeats per stimulus for the rewarded and non-rewarded location this resulted in a vector of 16 mean-subtracted single trial responses), and subsequently calculating the Pearson correlation coefficient between the mean-subtracted single trial responses of the pair of cells, but only for the preferred stimulus in the rewarded and non-rewarded location (Hofer et al., 2011; Jeanne et al., 2013).
Statistics
All data are presented and tested as mean ± SEM across mice unless otherwise noted. Most parameters that were reported in this manuscript were likely not-normally distributed and were therefore tested with a Mann-Whitney U test or a Wilcoxon matched-pairs signed-rank test (WMPSR). When multiple groups were involved, we applied a Kruskal-Wallis test, with posthoc Mann-Whitney U tests or WMPSR tests; or an Anova with posthoc t-tests if the data followed a normal distribution (Figure 3d,e). When iterating comparisons between multiple groups without first using a test for multiple groups (Anova/Kruskal-Wallis test), we corrected the P-value using Bonferroni’s method.
Signal- and noise correlations (Figure 6) were calculated per imaging field of view, on all simultaneously recorded pairs of neurons. Next, 95% and 99% confidence intervals were calculated using bootstrap resampling on the resulting dataset with signal- or noise correlations from all fields of view (resampling with replacement; Sample size of 250 pairs; 10000 resamples; Efron, 1979).
Data availability
The full dataset of this study is available on gin.g-node, url: https://web.gin.g-node.org/pgoltstein/goltstein_meijer_pennartz_2018
-
Behavioral-, intrinsic imaging-, calcium imaging- and eye-tracking-dataPublicly available at the Gin: Modern Research Data Management for Neuroscience website.
References
-
Reorganization of somatosensory area 3b representations in adult owl monkeys after digital syndactylyJournal of Neurophysiology 66:1048–1058.https://doi.org/10.1152/jn.1991.66.3.1048
-
Chronic cellular imaging of mouse visual cortex during operant behavior and passive viewingFrontiers in Cellullar Neuroscience 4:3.https://doi.org/10.3389/fncel.2010.00003
-
Humans can learn new information during sleepNature Neuroscience 15:1460–1465.https://doi.org/10.1038/nn.3193
-
Neural correlations, population coding and computationNature Reviews Neuroscience 7:358–366.https://doi.org/10.1038/nrn1888
-
Relative time in trace conditioningAnnals of the New York Academy of Sciences 423:211–227.https://doi.org/10.1111/j.1749-6632.1984.tb23432.x
-
Olfactomotor activity during imagery mimics that during perceptionNature Neuroscience 6:1142–1144.https://doi.org/10.1038/nn1145
-
BookOptical Imaging based on intrinsic signals: the methodologyIn: Mazziotta J. C, Toga A. W, editors. Brain Mapping; the Methods. Academic Press. pp. 55–97.
-
Local diversity and fine-scale organization of receptive fields in mouse visual cortexJournal of Neuroscience 31:18506–18521.https://doi.org/10.1523/JNEUROSCI.2974-11.2011
-
Cortical plasticity: from synapses to mapsAnnual Review of Neuroscience 21:149–186.https://doi.org/10.1146/annurev.neuro.21.1.149
-
Effect of strength of drive determined by a new technique for appetitive classical conditioning of ratsJournal of Comparative and Physiological Psychology 59:102–108.https://doi.org/10.1037/h0021632
-
Temporal control of conditioned responding in goldfishJournal of Experimental Psychology: Animal Behavior Processes 31:31–39.https://doi.org/10.1037/0097-7403.31.1.31
-
Bootstrap methods: another look at the jackknifeThe Annals of Statistics 7:1–26.https://doi.org/10.1214/aos/1176344552
-
Dissociable neural effects of long-term stimulus-reward pairing in macaque visual cortexJournal of Cognitive Neuroscience 22:1425–1439.https://doi.org/10.1162/jocn.2009.21288
-
A functional and perceptual signature of the second visual area in primatesNature Neuroscience 16:974–981.https://doi.org/10.1038/nn.3402
-
Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortexNature Neuroscience 6:1216–1223.https://doi.org/10.1038/nn1141
-
Physiological correlates of perceptual learning in monkey V1 and V2Journal of Neurophysiology 87:1867–1888.https://doi.org/10.1152/jn.00690.2001
-
Perceptual learning and adult cortical plasticityThe Journal of Physiology 587:2743–2751.https://doi.org/10.1113/jphysiol.2009.171488
-
Plasticity in visual perception and physiologyCurrent Opinion in Neurobiology 6:269–274.https://doi.org/10.1016/S0959-4388(96)80083-3
-
Efficient subpixel image registration algorithmsOptics Letters 33:156–158.https://doi.org/10.1364/OL.33.000156
-
Recovery of visual responses in foveal V1 neurons following bilateral foveal lesions in adult monkeyExperimental Brain Research 83:670–674.https://doi.org/10.1007/BF00229845
-
Receptive fields of single neurones in the cat's striate cortexThe Journal of Physiology 148:574–591.https://doi.org/10.1113/jphysiol.1959.sp006308
-
Receptive fields, binocular interaction and functional architecture in the cat's visual cortexThe Journal of Physiology 160:106–154.https://doi.org/10.1113/jphysiol.1962.sp006837
-
Perceptual learning selectively refines orientation representations in early visual cortexJournal of Neuroscience 32:16747–16753.https://doi.org/10.1523/JNEUROSCI.6112-11.2012
-
The Major cell populations of the mouse retinaThe Journal of Neuroscience 18:8936–8946.https://doi.org/10.1523/JNEUROSCI.18-21-08936.1998
-
Fast radial symmetry for detecting points of interestIEEE Transactions on Pattern Analysis and Machine Intelligence 25:959–973.https://doi.org/10.1109/TPAMI.2003.1217601
-
Learning enhances the relative impact of top-down processing in the visual cortexNature Neuroscience 18:1116–1122.https://doi.org/10.1038/nn.4061
-
Audiovisual modulation in mouse primary visual cortex depends on Cross-Modal stimulus configuration and congruencyThe Journal of Neuroscience 37:8783–8796.https://doi.org/10.1523/JNEUROSCI.0468-17.2017
-
Highly selective receptive fields in mouse visual cortexJournal of Neuroscience 28:7520–7536.https://doi.org/10.1523/JNEUROSCI.0623-08.2008
-
The 'Ideal Homunculus': decoding neural population signalsTrends in Neurosciences 21:259–265.https://doi.org/10.1016/S0166-2236(97)01216-2
-
Fast modulation of visual perception by basal forebrain cholinergic neuronsNature Neuroscience 16:1857–1863.https://doi.org/10.1038/nn.3552
-
Bridging the interval: theory and neurobiology of trace conditioningBehavioural Processes 101:103–111.https://doi.org/10.1016/j.beproc.2013.08.016
-
Orientation selectivity in macaque V1: diversity and laminar dependenceThe Journal of Neuroscience 22:5639–5651.https://doi.org/10.1523/JNEUROSCI.22-13-05639.2002
-
The neuronal encoding of information in the brainProgress in Neurobiology 95:448–490.https://doi.org/10.1016/j.pneurobio.2011.08.002
-
PC-based high-speed video-oculography for measuring rapid eye movements in miceNeuroscience Research 49:123–131.https://doi.org/10.1016/j.neures.2004.02.002
-
Integration of visual motion and locomotion in mouse visual cortexNature Neuroscience 16:1864–1869.https://doi.org/10.1038/nn.3567
-
The variable discharge of cortical neurons: implications for connectivity, computation, and information codingThe Journal of Neuroscience 18:3870–3896.https://doi.org/10.1523/JNEUROSCI.18-10-03870.1998
-
Reward timing in the primary visual cortexScience 311:1606–1609.https://doi.org/10.1126/science.1123513
-
Parallel processing of visual space by neighboring neurons in mouse visual cortexNature Neuroscience 13:1144–1149.https://doi.org/10.1038/nn.2620
-
Three-dimensional optokinetic eye movements in the C57BL/6J mouseInvestigative Opthalmology & Visual Science 51:623–630.https://doi.org/10.1167/iovs.09-4072
-
Processing of visually evoked innate fear by a non-canonical thalamic pathwayNature Communications 6:6756.https://doi.org/10.1038/ncomms7756
-
Activity recall in a visual cortical ensembleNature Neuroscience 15:449–455.https://doi.org/10.1038/nn.3036
-
The effect of perceptual learning on neuronal responses in monkey visual area V4Journal of Neuroscience 24:1617–1626.https://doi.org/10.1523/JNEUROSCI.4442-03.2004
Article and author information
Author details
Funding
Nederlandse Organisatie voor Wetenschappelijk Onderzoek (433-09-208)
- Cyriel MA Pennartz
Horizon 2020 Framework Programme (Grant Agreement No. 785907 (Human Brain Project SGA2))
- Cyriel MA Pennartz
Nederlandse Organisatie voor Wetenschappelijk Onderzoek (918.46.609)
- Cyriel MA Pennartz
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
The authors thank Laura van Mourik-Donga for technical assistance and Lior Cohen, Jorrit Montijn, Mark Hübener and Tobias Rose for helpful comments on the manuscript. This work was supported by the NWO Program for Excellence, Brain and Cognition, 433-09-208, NWO VICI Grant 918.46.609 and the European Union’s Horizon 2020 Research and Innovation Program under Grant Agreement No. 785907 (Human Brain Project SGA2).
Ethics
Animal experimentation: Experiments were conducted with approval of the ethical committee for animal experiments of the University of Amsterdam (Protocol number DED162).
Copyright
© 2018, Goltstein et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 3,015
- views
-
- 390
- downloads
-
- 31
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Medicine
- Neuroscience
The advent of midazolam holds profound implications for modern clinical practice. The hypnotic and sedative effects of midazolam afford it broad clinical applicability. However, the specific mechanisms underlying the modulation of altered consciousness by midazolam remain elusive. Herein, using pharmacology, optogenetics, chemogenetics, fiber photometry, and gene knockdown, this in vivo research revealed the role of locus coeruleus (LC)-ventrolateral preoptic nucleus noradrenergic neural circuit in regulating midazolam-induced altered consciousness. This effect was mediated by α1 adrenergic receptors. Moreover, gamma-aminobutyric acid receptor type A (GABAA-R) represents a mechanistically crucial binding site in the LC for midazolam. These findings will provide novel insights into the neural circuit mechanisms underlying the recovery of consciousness after midazolam administration and will help guide the timing of clinical dosing and propose effective intervention targets for timely recovery from midazolam-induced loss of consciousness.
-
- Neuroscience
Gamma oscillations in brain activity (30–150 Hz) have been studied for over 80 years. Although in the past three decades significant progress has been made to try to understand their functional role, a definitive answer regarding their causal implication in perception, cognition, and behavior still lies ahead of us. Here, we first review the basic neural mechanisms that give rise to gamma oscillations and then focus on two main pillars of exploration. The first pillar examines the major theories regarding their functional role in information processing in the brain, also highlighting critical viewpoints. The second pillar reviews a novel research direction that proposes a therapeutic role for gamma oscillations, namely the gamma entrainment using sensory stimulation (GENUS). We extensively discuss both the positive findings and the issues regarding reproducibility of GENUS. Going beyond the functional and therapeutic role of gamma, we propose a third pillar of exploration, where gamma, generated endogenously by cortical circuits, is essential for maintenance of healthy circuit function. We propose that four classes of interneurons, namely those expressing parvalbumin (PV), vasointestinal peptide (VIP), somatostatin (SST), and nitric oxide synthase (NOS) take advantage of endogenous gamma to perform active vasomotor control that maintains homeostasis in the neuronal tissue. According to this hypothesis, which we call GAMER (GAmma MEdiated ciRcuit maintenance), gamma oscillations act as a ‘servicing’ rhythm that enables efficient translation of neural activity into vascular responses that are essential for optimal neurometabolic processes. GAMER is an extension of GENUS, where endogenous rather than entrained gamma plays a fundamental role. Finally, we propose several critical experiments to test the GAMER hypothesis.