Abstract
In visual cortex, neural correlates of subjective perception can be generated by modulation of activity from beyond the classical receptive field (CRF). In macaque V1, activity generated by nonclassical receptive field (nCRF) stimulation involves different intracortical circuitry than activity generated by CRF stimulation, suggesting that interactions between neurons across V1 layers differ under CRF and nCRF stimulus conditions. Using Neuropixels probes, we measured border ownership modulation within large, local populations of V1 neurons. We found that neurons in single columns preferred the same side of objects located outside of the CRF. In addition, we found that cross-correlations between pairs of neurons situated across feedback/horizontal and input layers differed between CRF and nCRF stimulation. Furthermore, independent of the comparison with CRF stimulation, we observed that the magnitude of border ownership modulation increased with the proportion of information flow from feedback/horizontal layers to input layers. These results demonstrate that the flow of signals between layers covaries with the degree to which neurons integrate information from beyond the CRF.
Introduction
The classical receptive field (CRF) defines the region of the sensory periphery where appropriate stimulation evokes a spiking response in a neuron (Hartline, 1938, Alonso and Chen, 2009). Those evoked responses are largely driven by feedforward inputs from earlier stages of sensory processing. In macaque primary visual cortex (V1), neuronal activity is largely determined by ascending input from the dorsal lateral geniculate nucleus (dLGN) which arrives principally in layers 4Cα, 4Cβ and 6 (Hubel and Wiesel, 1972, Hendrickson et al., 1978, Blasdel and Lund, 1983, Callaway, 1998, Callaway, 2004). However, considerable evidence has established that the responses of sensory cortical neurons are also robustly influenced by stimulation concurrently presented outside of the CRF (Allman et al., 1985, Fitzpatrick, 2000, Albright and Stoner, 2002, Roelfsema, 2006, Angelucci et al., 2017). Specifically, whereas stimulation outside of the CRF alone fails to evoke spiking responses, such stimulation nonetheless alters the responses evoked by stimulation within the CRF. In the visual cortex, these nonclassical receptive field (nCRF) effects often contribute to the neural correlates of visual perceptual phenomena, such as illusory contours (von der Heydt et al., 1984, Ramsden et al., 2001), visual salience and boundary segmentation (Knierim and van Essen, 1992, Sillito et al., 1995, Yan et al., 2018, Lee et al., 2002, Nothdurft et al., 1999), contour integration (Nelson and Frost, 1985, Kapadia et al., 1995, Li et al., 2006), figure-ground segregation (Lamme, 1995, Zipser et al., 1996, Poort et al., 2012), and border ownership (Zhou et al., 2000, von der Heydt, 2015, von der Heydt, 2023).
In contrast to the feedforward mechanisms underlying the CRF, nCRF effects are thought to be generated either by feedback from neurons with larger CRFs in higher areas (Hupe et al., 1998, Bullier et al., 2001, Bair et al., 2003, Nassi et al., 2013, Chen et al., 2017, Klink et al., 2017, Zhang et al., 2014, Nurminen et al., 2018, Keller et al., 2020, Pak et al., 2020, Vangeneugden et al., 2019, Gieselmann and Thiele, 2022, Chen et al., 2014, van Kerkoerle et al., 2014), or through intracortical horizontal connections (Adesnik et al., 2012, Chisum et al., 2003, Stettler et al., 2002), or by both (Angelucci and Bressloff, 2006, Schwabe et al., 2006, Ichida et al., 2007, Angelucci et al., 2017, Liang et al., 2017, Self et al., 2013). In contrast to feedforward inputs, feedback and horizontal inputs to V1 both avoid layer 4C and terminate predominantly in superficial and deep layers (Rockland and Lund, 1983, Rockland and Pandya, 1979, Rockland and Virga, 1989, Anderson and Martin, 2009, Markov et al., 2014, Federer et al., 2021, Gilbert and Wiesel, 1983, Shmuel et al., 2005, Siu et al., 2021). These differences between feedforward and feedback/horizontal circuitry suggest that the flow of signals across V1 layers should covary with the type of visual stimulation.
Newly developed, high-density Neuropixels probes have enabled recordings from a large, dense population of neurons (Jun et al., 2017, Trautmann et al., 2023), and dramatically increase the quantity of identifiable functional interactions between pairs of neurons, particularly in non-human primates (Trepka et al., 2022). Recently, this approach was used to recapitulate known circuit properties, such as the pairwise lead-lag relationship between simple and complex cells and the canonical laminar input-output relationship in macaque V1 (Trepka et al., 2022), as well as the visual hierarchy in mouse visual cortical (Siegle et al., 2021, Jia et al., 2022) and subcortical areas (Sibille et al., 2022).
Here, using Neuropixels probes, we recorded the activity of hundreds of neurons simultaneously from single V1 columns in anesthetized macaques during CRF and nCRF stimulation. We leveraged the high yields obtained from different layers to examine the organization and circuitry underlying contextual modulation, specifically border ownership (Bown). Bown is a form of contextual modulation in which neurons signal the occluding border between the background and a foreground object using stimulus information beyond the CRF. This function appears to be crucial for natural scene segmentation and object recognition (Nakayama et al., 1995). It has been shown that many neurons in early visual areas, including V1, respond differently to identical edges (borders) of objects when those objects lie at different locations outside the CRFs (Zhou et al., 2000, Franken and Reynolds, 2021, Hesse and Tsao, 2016, Hesse and Tsao, 2023). Bown emerges rapidly after visual response onset (Sugihara et al., 2011), yet the relative contributions of feedforward, feedback, and horizontal circuits to Bown remain unknown. Also unknown is whether Bown is present under anesthesia. Several other types of contextual modulation have been demonstrated in anesthetized animals (Ramsden et al., 2001, Hupe et al., 1998, Bair et al., 2003, Allman et al., 1985, Gilbert and Wiesel, 1990, Nothdurft et al., 1999, Webb et al., 2003, Zarella and Ts’o, 2016, Muller et al., 2003, Henry et al., 2013, Bijanzadeh et al., 2018, although see Lamme et al., 1998) and can involve inter-cortical feedback (Nurminen et al., 2018). Moreover, Bown has been shown to occur independently of attention (Qiu et al., 2007, O’Herron and von der Heydt, 2009), and before object shape recognition (Williford and von der Heydt, 2016, Ko and von der Heydt, 2018), suggesting it may not rely on higher cognitive control or object recognition areas. Rather, Bown may emerge through pre-attentive, automatic grouping mechanism in low/middle level visual areas, signifying a representation of “proto-objects” in the early visual cortex (von der Heydt, 2015, von der Heydt, 2023, Self et al., 2019).
Results
Classical RF stimulation in single V1 columns
Neuronal activity was recorded from two anesthetized rhesus macaques (M1 and M2, Macaca mulatta) using high-density, multi-contact Neuropixels probes (version 3A, IMEC Inc., Belgium) (Figure 1A) (Methods). These animals had no prior experience with awake experiments or exposure to the stimuli used in this study. Neuropixels probes were inserted into the lateral operculum of V1 with the aid of a surgical microscope at angles nearly perpendicular to the cortical surface. Prior to insertion, the probes were coated with a DiI derivative for subsequent histological visualization of the tracks (Methods) (Supplementary Figure S1). Four Neuropixels probe penetrations were made either in the opercular surface (M1, pen 1-2, ∼4-6° eccentricities) or within the underlying calcarine sulcus (M2, pen 3-4, ∼6-10° eccentricities) using the programmable channel selection feature of the Neuropixels probe. The boundaries of laminar compartments were estimated by combining current-source density (CSD) measurements and histological data (Figure 1B; Supplementary Figure S1) (Methods). Each recorded neuron was assigned to one of four laminar compartments, specifically 5/6, 4C, 4A/B, 2/3 (mean thickness: 489, 281, 311, 650 µm, respectively, consistent with previous anatomical (O’Kusky and Colonnier, 1982, Lund, 1973) and CSD (Self et al., 2013, Chen et al., 2017) studies). We measured the responses from a total of 677 visually driven neurons (N = 159, 181, 210, and 127 per recording) to classical receptive field (CRF) stimulation, and 621 neurons (N = 142, 179, 152, and 148 per recording) to nonclassical receptive field (nCRF) stimulation (Methods). As a result of the nearly perpendicular penetrations, the visual CRFs of V1 neurons were largely overlapping across the cortical depth (Figure 1C).
During each recording session, neurons were first tested with CRF stimuli consisting of drifting Gabor gratings with 1.5 degrees of visual angle (dva) in diameter, presented at the joint CRF location of simultaneously recorded neurons (Methods). In each of the four recordings, neurons across cortical depth exhibited very similar preferences to grating orientations (Figure 1D). The modal pairwise difference in preferred orientation between neurons across layers was near zero (pen1 = 5°; pen2 = 5°; pen3 = 1°; pen4 = 1°). This result confirmed that our recordings were nearly perpendicular and included neurons predominantly from single orientation columns.
Gratings were sized to largely restrict the stimuli within the CRFs of recorded neurons to maximize the extent to which V1 responses were driven in large proportion by feedforward circuitry. In V1, geniculocortical inputs initially drive neurons within layers 4Cα, 4Cβ, and layer 6 (Hubel and Wiesel, 1972, Hendrickson et al., 1978, Blasdel and Lund, 1983), which then propagate to supragranular and infragranular layers (Callaway, 1998, Callaway, 2004).
Nonclassical RF stimulation and border ownership
Within each of the recordings, we also examined the responses of V1 neurons to nCRF stimuli. It is known that neurons in primate visual cortex integrate visual information from far beyond their CRFs (Albright and Stoner, 2002, Allman et al., 1985, Fitzpatrick, 2000, Roelfsema, 2006, Angelucci et al., 2017). One example of contextual modulation is the selectivity of neurons to border ownership (Bown). Specifically, neurons in early visual areas respond differently to identical edges (borders) of objects when those objects lie at different locations outside the CRFs (Zhou et al., 2000, Franken and Reynolds, 2021, Hesse and Tsao, 2016, Hesse and Tsao, 2023) (Figure 2). As with other forms of nCRF modulation, Bown is thought to emerge either by feedback from higher areas (Craft et al., 2007, Jehee et al., 2007, Layton et al., 2012, Eguchi and Stringer, 2016, Wagatsuma et al., 2021, Mehrani and Tsotsos, 2021) or from horizontal connections within the same area (Zhaoping, 2005, Kogo et al., 2010). In V1, feedback and horizontal inputs arrive principally within supragranular and infragranular layers, i.e., they avoid layer 4 (Rockland and Pandya, 1979, Rockland and Lund, 1983, Rockland and Virga, 1989, Anderson and Martin, 2009, Markov et al., 2014, Federer et al., 2021, Gilbert and Wiesel, 1983, Shmuel et al., 2005, Siu et al., 2021). Thus, V1 activity generated by nCRF stimulation is known to involve different circuits compared to the activity generated by CRF stimulation.
In this study, border ownership test stimuli consisted of uniformly white or black objects (squares, 8 x 8 dva) on a black or white background, respectively, as in previous studies (Zhou et al., 2000) (Methods). One border of the object fell within the CRFs of the recorded neurons. Within the CRF, the oriented border could either be a dark-light edge or light-dark edge, resulting in two different local contrast polarity (LC) conditions (Figure 2A). Outside the CRF, the stimulus configuration differed for the same LC condition such that the oriented border could belong to opposite sides of an object relative to the CRF. Crucially, across these two object side conditions, the stimulus falling within the CRF was identical (Figure 2B) and was identical within an area that extended well beyond the CRF (8 x 16, dva). In this stimulus configuration, differences in evoked responses between the two object side conditions signify selectivity to border ownership (Zhou et al., 2000). The statistical significance was determined by a two-factor ANOVA on the mean spike counts for each condition, with object side (Side 1 and Side 2) and local contrast (LC1 and LC2) as the factors, along with their interaction (Methods).
We observed neurons with Bown in our recordings from macaque V1. Figures 2C and 2D shows examples of four neurons selective to Bown. Each of these neurons exhibited a preference for LC, with two neurons preferring one contrast polarity and two preferring the other. In addition, each neuron responded differently depending on which side of the object appeared relative to the CRF, thus exhibiting Bown. Three of the neurons responded more vigorously to borders belonging to the lower-left side of object (Side 1) (p < 10-14, 10-10, 10-3 for neurons 1, 2, and 4, respectively), while one neuron responded more vigorously to the border belonging to the upper-right side of the object (Side 2) (p = 0.014, neuron 3). Furthermore, one of the neurons showed a consistent preference for Side 1 across both LCs (neuron 4).
To quantify the Bown, as in previous studies (Zhou et al., 2000), we calculated a Bown modulation index, defined as the difference in neuronal responses to borders belonging to opposite sides of objects, normalized by the maximum response for each neuron (Methods). Responses to the same side of object, but under opposite LC conditions, were averaged together to control for global luminance differences in the overall display. Across the 621 neurons recorded in four sessions, we found that 133 neurons (21.4% overall; pen1 = 28.2%; pen2 = 27.9%; pen3 = 18.4%; pen4 = 8.4%) responded differently to identical borders yet belonging to opposite sides of the object, a proportion consistent with previous studies in awake monkeys (Zhou et al., 2000). Neurons with Bown were found within all cortical laminar compartments, including input layer 4C (5/6: 28/144 = 19.4%; 4C: 48/212 = 22.6%; 4A/B: 19/114 = 16.7%; 2/3: 28/99 = 28.3%) (Table S1), and the proportion was independent of laminar compartment (χ2(3) = 4.78, p = 0.19, chi-square test of homogeneity). Of all V1 neurons, 96 (15.5%) exhibited Bown depending on the LC (5/6: 11.1%; 4C: 17.9%; 4A/B: 14.0%; 2/3: 20.2%), while 37 (6.0%) showed significant effects independent of local contrast (5/6: 8.3%; 4C: 4.7%; 4A/B: 2.6%; 2/3: 8.1%). Thus, the majority of V1 neurons with Bown exhibited selectivity for only one local contrast, and neurons with Bown invariant to local contrast were rare, also consistent with previous observations (Zhou et al., 2000).
Columnar organization of border ownership selectivity
We next considered whether neurons with Bown comprised a distinct group, or instead reflected a general tendency of neurons to prefer one side of the object, with statistically significant neurons falling at the tails of the distribution. We leveraged the large number of simultaneously recorded single neurons to measure the distribution of Bown modulation across laminar compartments in each session. We found that in each of the four recordings, the distributions of Bown modulation generally appeared unimodal, with neurons exhibiting Bown falling at the distribution tails (Figure 2E). Surprisingly, we also found that within individual recordings, neurons across the cortical depth tended to share similar preferences for the side of the object. That is, for each recording, the Bown modulation index differed significantly from 0 (Median modulation index: pen1 = 0.14, p < 10-12; pen2 = 0.08, p = 0.04; pen3 = –0.18, p < 10-15; pen4 = 0.10, p < 10-5, sign test against zero-median). For example, the first recording (pen1) was performed in a column in which most neurons preferred an orientation of 135°. In addition, within that column, neurons tended to exhibit higher responses to a border when it belonged to the lower-left side of an object (side 1), as opposed to the upper-right side (side 2). Thus, V1 exhibited a continuum of Bown, and neurons within single columns tended to prefer the same side of objects located outside of the CRF.
Interlaminar cross-correlations among neurons within single V1 columns
The large number of simultaneously recorded neurons from each session also allowed us to measure interlaminar information flow among single neurons under different visual stimulation conditions. Temporally precise cross-correlations in spike trains offer a unique means of assessing functional interactions among neurons in neural circuits (Perkel et al., 1967). Cross-correlations can be interpreted as suggesting one of myriad putative circuit arrangements among neuronal ensembles (Moore et al., 1970, Aertsen and Gerstein, 1985, Melssen and Epping, 1987, Ostojic et al., 2009). The identification of such interactions has played an important role in elucidating neural circuits in the mammalian visual system (Ts’o et al., 1986, Schwarz and Bolz, 1991, Reid and Alonso, 1995, Alonso et al., 1996, Alonso and Martinez, 1998, Usrey et al., 1998, Nelson et al., 1992, Briggs et al., 2013, Roe and Ts’o, 1999, Senzai et al., 2019, Denman and Contreras, 2014, Siegle et al., 2021, Jia et al., 2022, Trepka et al., 2022, Smith and Kohn, 2008, Sibille et al., 2022). In particular, it has been useful in specifying the flow of signals through local neural circuits (Trepka et al., 2022) and distributed networks (Siegle et al., 2021, Jia et al., 2022, Sibille et al., 2022). Notably, past studies have demonstrated that neuronal cross-correlations are dynamic and can depend on stimulus context and behavioral variables (Hembrook-Short et al., 2019, Martin and von der Heydt, 2015, Hung et al., 2007, Hirabayashi and Miyashita, 2005, Hirabayashi et al., 2010, Steinmetz et al., 2000).
Given that V1 activity generated by nCRF stimulation is thought to involve different circuitry than activity generated by CRF stimulation (Angelucci et al., 2017), we next asked if the pattern of cross-correlations measured under classical and nonclassical stimulus conditions might differ in a manner consistent with models of their underlying circuitry. Specifically, modulation of visual responses during nCRF stimulation, such as border ownership stimuli, is thought to emerge from either feedback from higher areas or horizontal connections within the same areas (Bair et al., 2003, Bullier et al., 2001, Hupe et al., 1998, Chen et al., 2017, Gieselmann and Thiele, 2022, Keller et al., 2020, Klink et al., 2017, Nassi et al., 2013, Nurminen et al., 2018, Angelucci et al., 2017, Angelucci and Bressloff, 2006, Ichida et al., 2007, Schwabe et al., 2006, Pak et al., 2020, Vangeneugden et al., 2019, Zhang et al., 2014, Adesnik et al., 2012, Chisum et al., 2003, Stettler et al., 2002, Liang et al., 2017, Craft et al., 2007, Jehee et al., 2007, Chen et al., 2014, Self et al., 2013, van Kerkoerle et al., 2014), both arriving principally in superficial and deep layers (Rockland and Lund, 1983, Rockland and Pandya, 1979, Rockland and Virga, 1989, Markov et al., 2014, Federer et al., 2021, Anderson and Martin, 2009, Gilbert and Wiesel, 1983, Shmuel et al., 2005, Siu et al., 2021). In contrast, CRF responses are driven predominantly by feedforward circuitry and geniculocortical inputs to layers 4C and 6 (Hubel and Wiesel, 1972, Hendrickson et al., 1978, Blasdel and Lund, 1983, Callaway, 1998, Callaway, 2004). This suggests that the pattern of cross-correlations among neurons across V1 layers may differ under CRF and nCRF stimulus conditions.
Across recording sessions, we calculated cross-correlograms (CCGs) from all possible pairwise combinations of neuronal spike trains during both CRF (Gabor gratings) and nCRF (border ownership) stimulation conditions. Figure 3A shows an example recording session (M1, pen1) in which 159 visually responsive neurons were recorded during CRF stimulation, and CCGs were computed for 7,956 pairwise combinations of neurons (Methods). CCGs were determined to be significant if the jitter-corrected CCG peak occurred within 10ms of zero-time lag, and exceeded 7 standard deviations (SD) above the mean of the noise distribution (Siegle et al., 2021, Trepka et al., 2022) (Methods). In this recording, 13.8% of the total CCGs computed were found to be significant. Eight significant pairs are highlighted in Figure 3A, with their corresponding CCGs shown in Figure 3B. The peak lag (PL), defined as the relative time delay in occurrence of peak correlation between two spike trains, was restricted to within 10ms. This metric approximates the synchrony and/or the direction of information flow between neuronal pairs (Aertsen and Gerstein, 1985, Moore et al., 1970, Melssen and Epping, 1987, Ostojic et al., 2009). These examples illustrate the tendency of CCGs to corroborate the circuitry within V1 columns under CRF conditions in that 1) PLs generally increase with larger distances between pairs, and 2) layer 4 neurons tend to lead superficial neurons (Trepka et al., 2022). We exploited this latter point to test the extent to which the sequence of information flow across layers differs between CRF and nCRF conditions.
Comparison of cross-correlations during CRF and nCRF stimulation
From the 677 and 621 neurons recorded across the 4 recording sessions during CRF and nCRF stimulation, there were 41,759 and 28,430 pairwise combinations included, respectively (Methods). Of those, we found that 6,937 (16.6%) and 4,826 (17.0%) of the CCGs were significant (CRF: pen1: 1099/7956 = 13.8%, pen2: 2402/11431 = 21.0%, pen3: 2174/17780 = 12.2%, pen4: 1262/4592 = 27.5%; nCRF: pen1: 447/2473 = 18.1%, pen2: 2750/11823 = 23.3%, pen3: 839/6998 = 12.0%, pen4: 790/7136 = 11.1%). Notably, the rates were nearly identical under the two stimulus conditions, and also were within the range observed in previous studies of macaque V1 (Chu et al., 2014, Hembrook-Short et al., 2019, Smith and Kohn, 2008, Kohn and Smith, 2005).
As noted above, modulation of visual responses during nCRF stimulation, such as border ownership stimuli, is thought to be generated principally by feedback/horizontal connections arriving within superficial and deep layers, which contrasts with feedforward input driving CRF stimulation (Figure 3C). Thus, we asked whether cross-correlations between pairs of neurons situated across laminar compartments depended on the type of visual stimulation. We focused our analysis on CCGs computed from pairs of neurons in which one neuron was located within laminar compartments receiving feedback/horizontal inputs (FHi) and the other was located within compartments largely devoid of those inputs, namely 4C and 4A/B. This analysis compared the relative spike timing between neuronal pairs during CRF and nCRF stimulation. If indeed FHi contribute more to activity during the latter than the former, then we should expect this to be reflected in lead-lag relationships of the CCGs.
A comparison of V1 CCGs from key interlaminar neuronal pairs during CRF and nCRF stimulation is shown for an example recording session (M1, pen1) in Figure 3D. During CRF stimulation, the timing of spikes within compartments 4C and 4A/B generally preceded, or was simultaneous with, spikes within FHi compartments (CRF: 4C-2/3PL = 2ms, p < 10-7; 4A/B-2/3PL = 2ms, p < 10-28; 4C-5/6PL = 0ms, p = 0.52; 4A/B-5/6PL = 0ms, p = 0.64; Sign test against zero-median). In contrast, during nCRF stimulation, relative spike timing was shifted in favor of neurons in FHi compartments. Specifically, during nCRF stimulation, the timing of spikes within compartments 4C and 4A/B lagged or was simultaneous with, spikes within FHi compartments (nCRF: 4C-2/3PL = 0ms, p = 0.80; 4A/B-2/3PL = 0ms, p = 0.70; 4C-5/6PL = –2.5ms, p = 0.11; 4A/B-5/6PL = 0ms, p = 0.56; Sign test against zero median). To further quantify the apparent shift in lead-lag relationships, we calculated an asymmetry index for each CCG. The asymmetry index is computed as the difference in the CCG integral on either side of zero-time lag, and summarizes the lead-lag relationship independent of the CCG peak (Jia et al., 2022) (Methods). Consistent with the analyses of PL, we found that CCG asymmetries differed significantly between CRF and nCRF stimulation for each of the interlaminar comparisons. In each case, the distribution of asymmetries during nCRF stimulation shifted to favor neurons in FHi laminar compartments, when compared to CRF stimulation (4C-2/3: CRFAsym = 0.036, nCRFAsym = –0.004, Δ = –0.04, p < 10-6; 4A/B-2/3: CRFAsym = 0.046, nCRFAsym = –0.005, Δ = –0.051, p < 10-11; 4C-5/6: CRFAsym = –0.010, nCRFAsym = –0.044, Δ = –0.034, p = 0.0015; 4A/B-5/6: CRFAsym = 0.012, nCRFAsym = –0.028, Δ = –0.04, p < 10-5; Wilcoxon rank-sum test). Thus, CCG data from this single recording session indicated that relative spike timing was earlier within FHi laminar compartments during nCRF stimulation than during CRF stimulation.
Across all recordings, we identified a total of 2,573 and 2,118 significant neuronal pairs from the four interlaminar combinations during CRF (pen1 = 274; pen2 = 1187; pen3 = 560; pen4 = 302) or nCRF stimulation (pen1 = 210; pen2 = 1226; pen3 = 382; pen4 = 300), respectively, and compared their CCG asymmetries. Similar to the pattern observed in the example recording, we observed a consistent shift in lead-lag relationships for each of the interlaminar comparisons (Figure 4). Specifically, during nCRF stimulation, the distribution of asymmetries during nCRF stimulation shifted to favor neurons in FHi laminar compartments, when compared to CRF stimulation (4C-2/3: CRFAsym = 0.028, nCRFAsym = 0.012, Δ = –0.016, p < 10-9; 4A/B-2/3: CRFAsym = 0.038, nCRFAsym = 0.022, Δ = –0.016, p < 10-9; 4C-5/6: CRFAsym = –0.033, nCRFAsym = –0.047, Δ = –0.014, p < 10-5; 4A/B-5/6: CRFAsym = –0.018, nCRFAsym = –0.05, Δ = –0.032, p < 10-20; Wilcoxon rank-sum test). Thus, relative spike timing was earlier within FHi laminar compartments during nCRF stimulation than during CRF stimulation in the combined dataset, suggesting that the proportion of information flow from FHi layers to input layers increased during nCRF stimulation. This observation was consistent across individual recording sessions (Table S2). Notably, we observed a similar pattern when instead of asymmetry, we compared CCG peak lags (Supplementary Figure S2A), and when we compared the total number of both significant and nonsignificant pairs (CRF = 15,920; nCRF = 11,263) (Supplementary Figure S2B), and when we compared CCGs with a more stringent significance criterion (10 SDs) in the combined dataset (Supplementary Figure S2C-D).
Lastly, we asked whether interlaminar information flow was related specifically to border ownership modulation, independent of the comparisons between CRF and nCRF stimulation. Since CRF and nCRF stimuli differed in ways potentially unrelated to nonclassical modulation (e.g., variations within the CRF), we sought to assess the extent to which information flow from FHi to input layers predicted the magnitude of nCRF modulation. To this end, we computed two modulation indices from the same Bown test stimuli (Figure 2A), specifically the Bown modulation index and the local contrast (LC) index. In contrast to the Bown modulation index, which reflects nCRF modulation, the LC index measures selectivity to luminance contrast polarity (dark-light vs. light-dark) within the CRF. We hypothesized that if the relative timing of spiking activity within FHi laminar compartments is indicative of nCRF modulation, we should expect earlier relative spike timing in FHi compartments, i.e., lower CCG asymmetries with respect to other compartments, to be associated with greater Bown. In contrast, we should not expect that relationship with the LC index.
Consistent with our hypothesis, we observed a negative relationship between the Bown modulation index and CCG asymmetry across the population and within individual sessions (linear regression: population slope (β) = –0.32, p < 10-27; individual sessions: pen1 = –0.52, p < 10-5; pen2 = –0.06, p = 0.14; pen3 = –0.25, p < 10-4; pen4 = –0.20, p = 0.008) (Figure 5A). This result suggests that the magnitude of Bown modulation for neuronal pairs depended on the proportion of information flow from FHi compartment to input layers. In contrast, the opposite was true for the LC index. That is, LC index was positively correlated with CCG asymmetry across the population (linear regression: population slope (β) = 0.46, p<10-28) (Figure 5B). However, this relationship was not consistent across sessions (individual sessions: pen1 = –0.30, p = 0.09; pen2 = 0.33, p < 10-5; pen3 = 0.23, p = 0.006; pen4 = 0.14, p = 0.04). To explore both results further, we built generalized linear models (GLMs) to assess the dependence of Bown or LC modulation on CCG asymmetry to incorporate variations across interlaminar combinations and recording sessions. For LC modulation, this analysis indicated that the magnitude of LC modulation was not reliably predicted by interlaminar information flow (GLM: coefficient = –0.04, p = 0.30; R2 = 0.27) (Table S3). In contrast, for Bown modulation, this analysis confirmed that the magnitude of modulation was reliably predicted by interlaminar information flow, independent of variations across interlaminar combinations and recording sessions (GLM: coefficient = –0.16 p = 1.1*10-6; R2 = 0.11). These results demonstrate that interlaminar information flow was related specifically to the magnitude of border ownership modulation.
Discussion
We measured the sensitivity of neurons to nCRF stimulation, specifically border ownership, within large, local populations in macaque V1. Consistent with previous studies on awake animals, we observed V1 neurons with border ownership selectivity even under anesthesia. We observed that neurons within single columns tended to prefer the same side of objects located outside of the CRF. In addition, we found that cross-correlations among pairs of neurons situated across FHi and other laminar compartments differed between CRF and nCRF stimulation. Specifically, neurons within FHi laminar compartments were more likely to lead pairwise interactions with neurons in other compartments during nCRF stimulation than during CRF stimulation. Moreover, the magnitude of border ownership modulation was predicted by greater information flow from FHi laminar compartments, independent of the comparisons between CRF and nCRF stimulation. These results demonstrate that the flow of signals between neurons in FHi and other laminar compartments depends on the degree to which those neurons integrate visual information from beyond the CRF. Below we discuss some potential limitations of the results as well as their implications for the mechanisms underlying contextual modulation.
Each of the laminar compartments designated in this study comprised more than a single distinct anatomical layer. This was done to mitigate the uncertainty in determining exact laminar boundaries, to achieve comparable numbers of neurons across compartments, and to maximize statistical power. In addition, combining layers allowed us to combine feedback with horizontal input layers. It is known that feedback and horizontal connections exhibit layer specificity within superficial and deep layers, e.g., horizontal connections are most prominent in layer 2/3 and layer 5 (Rockland and Lund, 1983, Gilbert and Wiesel, 1983), where feedback connections target primarily in layers 1, upper layer 2, and 5/6 (Rockland and Pandya, 1979, Federer et al., 2021, Shmuel et al., 2005). Yet, they both largely avoid layer 4 (Angelucci et al., 2017). Nonetheless, given that the number of anatomically distinct layers within macaque V1 well exceeds the four designated laminar compartments used here, it is important to consider the extent to which collapsing layers limits the conclusions one can draw from our observations. For example, although layer 6 receives feedback input, it also receives feedforward input directly from the LGN (Hubel and Wiesel, 1972, Hendrickson et al., 1978, Blasdel and Lund, 1983, Callaway, 1998). In addition, layer 4A is generally considered an input layer whereas 4B is not (Callaway, 1998, Hubel and Wiesel, 1972, Blasdel and Lund, 1983, Hendrickson et al., 1978). Thus, the designation of any compartment as nominally input, or feedback was relative and not absolute. That is, superficial and deep layers receive higher proportions of feedback/horizontal inputs than the 4A/B and 4C compartments. Indeed, previous studies of primate visual cortex have used a similar approach in comparing input and feedback/horizontal laminar compartments (e.g. Hansen et al., 2012, Nandy et al., 2017, van Kerkoerle et al., 2017, Pettine et al., 2019). Thus, the observed changes in pattern of cross-correlations between neurons situated across compartments with different relative feedforward and feedback/horizontal input can be interpreted in light of those input differences.
Another important consideration is that a key challenge of studying classical and nonclassical RF effects simultaneously in large neuronal populations is the difficulty in achieving alignment of all CRFs with the test stimuli. Although our probe penetrations were largely normal to the surface and neurons showed minimal deviations in orientation selectivity across the cortical depth, V1 neurons nonetheless exhibit noteworthy RF scatter (location/size) even within single cortical columns (Tootell et al., 1988, Gur et al., 2005, Li et al., 2022). This means that the positioning of stimuli relative to the CRF inevitably varied across simultaneously recorded neurons (e.g., Figure 1C). Moreover, this means that although neurons were generally well driven by CRF grating stimuli and exhibited clear orientation tuning, CRF stimulation was not guaranteed to fall solely within the CRF of all neurons. Nonetheless, involvement of the surround, especially far surround was considerably less extensive for CRF stimulation than for nCRF stimulation. Furthermore, in the latter case, regardless of variability in the CRF location, stimuli falling within the CRF were always matched across nCRF stimulus conditions, and the surrounds were also identical within 8° of the CRF (Figure 2A, B).
The experiments described here were performed in anesthetized animals. Several other types of contextual modulation have been demonstrated in anesthetized animals (Ramsden et al., 2001, Hupe et al., 1998, Bair et al., 2003, Allman et al., 1985, Gilbert and Wiesel, 1990, Nothdurft et al., 1999, Webb et al., 2003, Zarella and Ts’o, 2016, Muller et al., 2003, Henry et al., 2013, Bijanzadeh et al., 2018), and can involve inter-cortical feedback (Nurminen et al., 2018). Nonetheless, anesthesia is known to affect certain types of contextual responses in area V1. For example, the “figure-ground segregation” effect, where neurons respond more strongly to a texture in a “figure” region than to the same texture in a “ground” region, has been shown to be suppressed under anesthesia (Lamme et al., 1998) and when figure stimuli are not perceived (Super et al., 2001). However, there has been debate over whether this effect depends on attention and awareness (Marcus and Van Essen, 2002, Jones et al., 2015, Poltoratski and Tong, 2020, Poort et al., 2012, Huang et al., 2020). It is worth noting that in that case, RFs are centered on the figure regions, and the modulation likely involves detecting feature discontinuities around boundaries, followed by region-filling and background suppression. Each step could be influenced differently by behavioral variables. Nevertheless, the center figure enhancement emerges late in the V1 response, ∼55ms after response onset (Poort et al., 2012). In contrast, border ownership involves RFs centered on the boundaries, with modulation emerging much earlier at ∼10-35ms after response onset (Sugihara et al., 2011). Therefore, although both forms of modulation may involve feedback/horizontal input, the underlying circuitry may differ. Our finding of border ownership modulation in anesthetized animals aligns with previous studies showing that border ownership modulation can act separately even without attention (Qiu et al., 2007, O’Herron and von der Heydt, 2009) or before object shape recognition (Williford and von der Heydt, 2016, Ko and von der Heydt, 2018), perhaps signifying a representation of “proto-objects” in the early visual cortex through automatic, pre-attentive grouping mechanism (von der Heydt, 2015, von der Heydt, 2023, Self et al., 2019).
Border ownership enables neurons with small CRFs in the early visual cortex to assign the occluding border between image regions to a foreground object, which is crucial for natural scene segmentation and object recognition (Nakayama et al., 1995). Human imaging studies have demonstrated the existence of Bown in both lower (Fang et al., 2009) and higher visual areas (Kourtzi and Kanwisher, 2001, Andrews et al., 2002), yet the underlying circuitry is still poorly understood. Several computational models have been proposed to explain Bown, including feedforward models (Walker et al., 1999, Sakai and Nishimura, 2006, Super et al., 2010), horizontal models (Zhaoping, 2005, Kogo et al., 2010), and feedback models (Craft et al., 2007, Jehee et al., 2007, Jeurissen et al., 2016). Yet cues for determining Bown often lie far from the CRF and beyond the extents of geniculocortical and horizontal V1 connections (Angelucci et al., 2017). Furthermore, conduction along horizontal fibers appears too slow (0.1-0.4 mm/ms) (Grinvald et al., 1994, Bringuier et al., 1999, Girard et al., 2001) to account for the rapid (∼10-35ms) emergence of Bown and its independence from object size (Zhang and von der Heydt, 2010, Sugihara et al., 2011). In contrast, feedback inputs can be conducted through fibers 10 times faster (20-60 mm/ms) (Girard et al., 2001), even via monosynaptic connections (Siu et al., 2021), and contribute to modulating the early responses of V1 neurons (Hupe et al., 2001, Bair et al., 2003). Thus, although we combined feedback and horizontal recipient layers, the differences in interlaminar signal flow we observed were likely driven predominantly by feedback inputs.
In primates, V1 receives inter-cortical feedback connections primarily from areas V2, V3, V4, MT (Rockland et al., 1994, Markov et al., 2014). Thus, V1 Bown signals could be generated via inputs from these areas (Zhou et al., 2000, Hesse and Tsao, 2016, Hesse and Tsao, 2023, Franken and Reynolds, 2021, Zhu et al., 2020). Our results resonate with a recent study reporting that in area V4, Bown emerges earliest in deep layers compared to input layers (Franken and Reynolds, 2021). This suggests that the earliest component of Bown in V4 is not inherited from feedforward inputs, i.e., from V1/V2, but is generated within deep layers de nova, or through feedback connections that arrive at deep layers (Franken and Reynolds, 2021). This further supports the view that Bown in V1 emerges via feedback from higher visual areas. In addition, similar to what we observed in V1, columnar organization of Bown was observed in V4 (Franken and Reynolds, 2021). Indeed, neurons with Bown are clustered into patches in a wide range of primate visual areas, including area V2, V3, V3A, V4, V4A (Hesse and Tsao, 2023). Thus, the evidence of Bown modularity we observed in V1 could arise from organized feedback from the Bown modules in those areas. This is supported by recent anatomical evidence suggesting that feedback terminals in V1 are clustered and functionally specific (Angelucci et al., 2002, Federer et al., 2021, Shmuel et al., 2005, Siu et al., 2021).
Methods
Experimental Model and Subject Details
Anesthetized recordings were conducted in two adult male rhesus macaques (Macaca mulatta, M1, 13 kg; M2, 8 kg). All experimental procedures were in accordance with the National Institutes of Health Guide for the Care and Use of Laboratory Animals, the Society for Neuroscience Guidelines and Policies, and with approved Institutional Animal Care and Use Committee (IACUC) protocol (#APLAC-9900) of Stanford University.
Electrophysiological Recordings
Prior to each recording session, treatment with dexamethasone phosphate (2 mg per 24 h) was instituted 24 h to reduce cerebral edema. After administration of ketamine HCl (10 mg per kilogram body weight, intramuscularly), monkeys were ventilated with 1-2% isoflurane in a 1:1 mixture of N2O and O2 to maintain general anesthesia. Electrocardiogram, respiratory rate, body temperature, blood oxygenation, end-tidal CO2, urine output and inspired/expired concentrations of anesthetic gasses were monitored continuously. Normal saline was given intravenously at a variable rate to maintain adequate urine output. After a cycloplegic agent (atropine sulfate, 1%) was administered, the eyes were focused with contact lenses on an LCD monitor. Vecuronium bromide (60 μg/kg/h) was infused to prevent eye movements.
With the anesthetized monkey in the stereotaxic frame, an occipital craniotomy was performed over the opercular surface of V1. The dura was reflected to expose a small (∼3 mm2) patch of cortex. Next, a region relatively devoid of large surface vessels was selected for implantation, and the Neuropixels probe was inserted with the aid of a surgical microscope. Given the width of the probe (70 µm x 20 µm), insertion of it into the cortex sometimes required multiple attempts if it flexed upon contacting the pia. The junction of the probe tip and the pia could be visualized via the (Zeiss) surgical scope, and the relaxation of pia dimpling was used to indicate penetration, after which the probe was lowered at least 3-4 mm. Prior to probe insertion, it was dipped in a solution of the DiI derivative FM1-43FX (Molecular Probes, Inc) for subsequent histological visualization of the electrode track.
Given the length of the probe (1 cm), and the complete distribution of electrode contacts throughout its length, recordings could be made either in the opercular surface cortex (M1, pen 1-2) or within the underlying calcarine sulcus (M2, pen 3-4), by selecting a subset of contiguous active contacts (n = 384) from the total number (n=986). Recordings were made at 1 to 2 sites in one hemisphere of each monkey. At the end of the experiment, monkeys were euthanized with pentobarbital (150 mg/kg) and perfused with normal saline followed by 1 liter of 1% (wt/vol) paraformaldehyde in 0.1 M phosphate buffer, pH 7.4.
Visual Stimulation
Visual stimuli were presented at manually mapped receptive field (RF) locations for each recording session on an LCD monitor (Model NEC-4010, dimensions: 88.5 cm (H) x 49.7 cm (V), resolution: 1360 x 768 pixels, frame rate: 60 Hz) positioned 114 cm from the monkeys. RF eccentricities were ∼4-6° (M1) and ∼6-10° (M2). Visual stimuli were generated using customized MATLAB scripts with the Psychophysics Toolbox extensions (version PTB-3) (Kleiner et al., 2007). A photodiode was used to measure stimulus timing.
Classical receptive field (CRF) stimuli consisted of drifting Gabor gratings (2 deg./sec., 100% Michelson contrast) with a diameter of 1.5 degrees of visual angle (dva), positioned within the joint receptive fields (RFs) of recorded neurons. This size was selected to largely constrain the stimuli within the CRFs of recorded neurons, typically ∼0.5-1 dva, as determined manually online. Gratings drifted in 36 different directions, from 0 to 360° in 10° steps, in a pseudorandom order. Each stimulus condition was presented for 1 s and repeated 5 or 10 times. A blank screen with equal luminance to the Gabor patch was presented for 0.25 s during the stimulus interval. Stimuli were presented either monocularly (pen 1, 3) or both monocularly and binocularly (pen 2, 4). Four spatial frequencies (0.5, 1, 2, 4 cycles/deg.) were tested. The optimal eye and spatial frequency conditions were determined offline for further analysis.
Nonclassical receptive field (nCRF) stimuli used in this study, i.e., Border ownership test stimuli consisted of uniformly white or black objects (square, 8 x 8 dva) presented on a black or white background, respectively, like previous studies (Zhou et al., 2000). One border of the object fell within the CRFs of the recorded neurons at an orientation that varied in 45° steps. Objects were either 4 x 4 dva or 8 x 8 dva in size, and only conditions with 8 x 8 dva were selected for quantifying border ownership selectivity to tolerate the variation in the CRF locations. Stimuli were presented monocularly. For each of the 4 orientation conditions, there were 4 basic conditions (Figure 2A). Within the CRF, the oriented border could either be a dark-light edge or light-dark edge, resulting in two different local contrast (LC) polarity conditions, namely, LC1 and LC2. For the same LC condition, the stimulus configuration outside of the CRF differed such that the oriented border could belong opposite sides of objects, resulting in two different sides of object conditions, namely, side 1 and side 2. Each stimulus condition was presented for 1 s and repeated 10 or 20 times. A blank screen with equal luminance to the mean of object and background luminance was presented for 0.5s during the stimulus interval.
Receptive field mapping
In some sessions, the receptive fields of V1 neurons were tested systemically for offline use. CRFs were mapped from a 10 x 10 array (4 x 4 dva) using probe stimuli. The array was centered at the manually determined RFs location. The stimuli consisted of circular sine wave gratings of 0.4 dva in diameter, and 100% Michelson contrast. Gratings were presented at the optimal orientation determined manually online for each recording session and drifted at speed of 2 deg./sec. Each stimulus condition was presented for 0.2s, interleaved with 0.3s of blank screen with equal luminance, and repeated 15 times.
Mean spike counts from 0.05 to 0.25s after each stimulus onset were calculated, resulting in a 10 x 10 matrix containing mean spike rates to each grid location. This 2D matrix was then interpolated to a 40 x 40 matrix (MATLAB function ‘interp2’) and then smoothed with a 2D Gaussian filter (MATLAB function ‘imgaussfilt’, σ=2). The outline of the CRF was defined as the contour isoline at 80% of the maximum response using MATLAB function ‘contour3’. Neurons with only 1 contour region at the threshold were selected.
Data acquisition and spike sorting
Raw spike-band data were sampled and recorded at 30kHz. They were then median-subtracted and high-pass filtered at 300 Hz during the pre-processing stage. Spike sorting was carried out with Kilosort 3 (Pachitariu et al., 2024) to find spike times and assign each spike to different templates (neurons). Default parameters in Kilosort 3 were used for spike sorting, specifically, Ops.th = [9,9]; Ops.lam = 20; Ops.AUCsplit = 0.8; Ops.ThPre = 8; Ops.sig = 20; Ops.nblocks = 5; Ops.spkTh = –6. The raw sorted data were then manually curated in Phy (https://github.com/cortex-lab/phy) to remove templates with very few spikes or with atypical waveforms and to perform minimal templates merging and splitting. Double-counted spikes from the algorithm fitting the residuals to a new template were identified using established criteria (Siegle et al., 2021), by counting spikes from two templates separated by less than 50μm (∼5 channels) and with spike activity occurring within 5 samples (0.167ms). Double-counted spikes from the template smaller in amplitude were removed from further analysis. Visual responsiveness of each unit was assessed under CRF, nCRF, or RF mapping stimulation. For each type of stimulation, a paired-sample t test was performed to determine whether the mean spike counts after each stimulus presentation exceeded the preceding blank period at a significance level of 0.01. Only neurons showing significant visual responsiveness were included for further analysis.
Layer Assignment
The laminar locations of our recorded neurons were estimated based on a combination of functional analysis and histology results. For each recording, we first performed the current source density (CSD) analysis on the stimulus-triggered average of local field potentials (LFP). LFP were low-pass filtered at 200 Hz and recorded at 2500 Hz. LFP signals recorded from every 4 nearby channels were averaged and realigned to the onset of visual stimulus. CSD was estimated as the second-order derivatives of signals along the probe axis using the common five-point formula (Nicholson and Freeman, 1975). The result was then smoothed across space (σ = 120 μm) to reduce the artifacts caused by varied electrode impedance. We located the lower boundary of the major sink (the reversal point of sink and source) as the border between layer 4C and layer 5/6. We also considered anatomical data in order to localize recorded neurons within gray matter, allowing for minor adjustments (±1 group channel) in layer boundary placement. Subsequent layer boundaries were determined by offsetting the cortical thickness derived from histological slices (Supplementary Fig S1).
Single neuron properties during CRF stimulation
To assess the orientation tuning for each neuron, the spike rates during 0.1 to 1s after each stimulus onset were calculated and averaged for each orientation condition (N= 18). The orientation tuning responses were first smoothed with a Hanning window (half-width at half-height of 20°), and then fitted with a von Mises function (Swindale, 1998)
The location of the peak of the fitted curve was determined as the preferred orientation. Only neurons well fit by the function (R2>0.7) were included for determining pairwise differences in preferences for all combinations in each recording session.
Modulation index for border ownership
As in previous studies (Zhou et al., 2000), we calculated a Bown modulation index to quantify the selectivity of each neuron for Bown. The Bown modulation index is defined as
Here, RLC, Side represents the average spike rate from 0.05 to 0.5 s after stimulus onset for one of four basic conditions, which are derived from the combination of two different Local Contrast conditions (LC1 and LC2) and two Side conditions (Side 1 and Side 2). Baseline activity was not subtracted. Since the border within the CRF can vary in 45° steps from 0° to 180°, we only selected the optimal orientation for each recording population to calculate the Bown index. Rmax was defined as the maximum response for each neuron across the four basic conditions and four orientations. We used Rmax instead of summing responses across the four basic conditions to account for the slight variations in orientation preferences among neurons within each recording session. The statistical significance of Bown was evaluated using a two-factor ANOVA (MATLAB function ‘anovan’) on the average spike rates for each condition. The two factors were object Side (with two levels: Side 1 and Side 2) and Local Contrast (with two levels: LC 1 and LC2), including their interactions. A significance level of 0.05 was used. Neurons were considered to exhibit significant Bown modulation if they showed a significant main effect for the object Side factor. Whether they were invariant to local contrast was determined by the main effect of the Local Contrast factor.
Cross-correlograms (CCGs)
To measure correlated firing, we computed the cross-correlations between spike trains of all pairs of simultaneously recorded neurons. For each recording session, we calculated cross-correlograms (CCGs) from pairwise combinations of neuronal spike trains during either CRF (Gabor gratings) or nCRF (border ownership) stimulation conditions, respectively. We only included neuronal pairs with geometric mean firing rates more than 0.5 spikes/sec for further analysis. For both conditions, we focused on the spiking activity within the 0.25 –1s window during each stimulus presentation, to mitigate the influence of the transient visual response after stimulus onset. The CCG function for a given pair of neurons was defined as follows:
where j denotes the first/reference neuron and k denotes the second/target neuron in the CCG function. 1″ is the time lag between the two spike trains and from neuron j and k, during trial i. The value of and is 1 if there is a spike at time bin t and is zero otherwise. M is the total number of trials; N is the number of time bins within a trial. θ(τ) = N − |τ|, is a triangular function that corrects for the degree of overlap in the two spike trains at each time lag. λj and λk: are the mean firing rates of neuron j and k computed over the same bins used to compute the CCG at each time lag. The normalization by the geometric mean of spike rates is commonly used by previous studies to account for the influence of firing rates on the CCG peaks (Bair et al., 2001, Kohn and Smith, 2005).
To correct for correlations due to stimulus-locking or slow fluctuations in the population responses (e.g., gamma-band activity), we computed a jitter-corrected CCG by subtracting a jittered CCG from the original CCG:
The jittered CCG (CCGjittered) reflects the expected value of CCG computed from all possible jitters of each spike train within a given jitter window (Harrison and Geman, 2009, Smith and Kohn, 2008). The jittered spike train preserves both the PSTH of the original spike train across trials and the spike counts in the jitter window within each trial. As a result, jitter correction removes the correlation between PSTHs (stimulus-locking) and correlation on timescales longer than the jitter window (slow population correlations). Here, a 25-ms jitter window was chosen based on previous studies (Jia et al., 2013, Siegle et al., 2021). Jitter-corrected CCG (CCGcorrected) was then smoothed with a 5ms kernel [0.05, 0.25, 0.4, 0.25, 0.05] (Kohn and Smith, 2005, Smith and Kohn, 2008) before further analysis.
We classified a CCG as significant if the peak of the jitter-corrected CCG occurred within 10 ms of zero and exceeded 7 standard deviations (SD) above the mean of the noise distribution, similar to previous studies (Siegle et al., 2021). The noise distribution for a CCG was defined as the flanks of the jitter-corrected CCG ({CCG(τ)|100 ≥ |τ| ≥ 50 ms}). All analyses presented in the main text involve only significant, jitter-corrected CCGs. In the supplementary material, we also applied a more stringent criterion, requiring that significant CCG peaks exceed 10 SD above the noise, and a less stringent criterion that includes both significant and non-significant CCGs. These ensure that our results are robust across the choices of threshold (Supplementary Figure S2). To assess the directionality of functional interactions or signal flow between pairs of neurons, we focused on two metrics derived from the CCG functions. One is the peak lag (PL), which describes the time lag of peak correlation between the spike trains of neuron k (target) relative to neuron j (reference). PL is positive if the reference neuron j leads target neuron k in spike timing, negative if j lags k, and zero if j and k fire synchronously. The second metric we used to assess the signal flow is CCG asymmetry, computed by subtracting the sum of CCG values during the [-13, 0] ms time window from the sum of CCG values during the [0, 13] ms. Similar to PL, a positive CCG asymmetry indicates that reference neuron j leads k, while a negative asymmetry indicates that j lags k. The 13ms window was chosen as half of the 25ms jitter window, consistent with previous studies (Jia et al., 2022). Compared to peak lag, CCG asymmetry additionally captures the strength of the functional interactions between pairs of neurons and is less dependent on the exact shape of the CCG peak, which is often more complex in corticocortical functional interactions (Alonso and Martinez, 1998).
Relationship between Bown modulation and interlaminar signal flow
To determine whether the magnitude of border ownership or local contrast modulation is predicted by interlaminar signal flow during nCRF stimulation, we first performed linear regression (MATLAB, ‘fitlm’, ordinary least squares) and then built generalized linear models (GLMs) using predictors including CCG asymmetry, interlaminar combinations, and recording sessions. We focused on the four key interlaminar combinations (4C-2/3, 4A/B-2/3, 4C-5/6, 4A/B-5/6), where the latter laminar compartments receive feedback/horizontal inputs (FHi). Only neuronal pairs with significant CCGs were included as individual samples in the GLM. The resulting GLM equations were:
Bown (pair) and LC (pair) were calculated as the geometric mean of the Bown and LC indices for the constituent neurons in each pair. Specifically, , where abs(Bown(j)) and abs(Bown(k)) represent the absolute Bown modulation indices for constituent neurons j and k. A similar calculation was performed for LC (pair). CCG asymmetries were calculated from the nCRF stimulation condition where neurons in the input layers were selected as reference neurons and the ones in FHi compartments were target neurons in the CCG. Additional predictors, including interlaminar combinations and recording sessions, were included in the models to incorporate variations when pooling the dataset.
Statistical tests
Bown for each neuron was assessed with ANOVA. The proportion of Bown neurons within different layers was assessed using chi-squared test of homogeneity. The sign of populational border ownership preferences from individual recording session was tested with sign test. The sign of populational CCG peak lag for a given laminar compartment combination was assessed with sign test. The comparisons of peak lag and CCG asymmetry between CRF and nCRF stimulation condition for each laminar compartment combination were evaluated using Wilcoxon rank-sum tests. The dependence between CCG asymmetry and Bown for pair of neurons was assessed using linear regression and GLM.
Acknowledgements
We thank Jonathan C. Horton for extensive help with the recordings and histology, Danielle A. Lopes, Stephen Cital, Shellie Hyde and Sam Baker for technical assistance, Tim Harris and Karel Svoboda for providing the Neuropixels probes. This work was supported by NIH Grant EY029759, Brain and Behavior Research Foundation Grant to X.C.; NIH Grants EY014924, NS116623, and a Ben Barres Professorship to T.M.
Additional information
Author Contributions
Conceptualization, S.Z., X.C. and T.M.; Investigation, S.Z., X.C. and T.M.; Software, S.Z. and E.T.; Formal Analysis, S.Z. and Y.J.O.; Visualization, S.Z., Y.J.O.; Writing – Original Draft, S.Z. and T.M.; Writing – Review and Editing, S.Z., Y.J.O., E.T., X.C., T.M.; Funding Acquisition, X.C. and T.M.
Declaration of Interests
The authors declare no competing interests.
Data and Code Availability
All raw data generated in this study will be deposited in a public repository upon acceptance and made publicly available prior to publication.
The code developed for data analysis has been deposited to GitHub (https://github.com/szhu-007/Zhu_V1_interlaminar-signal-flow) and is freely available for access.
References
- 1.A neural circuit for spatial summation in visual cortexNature 490:226–31
- 2.Evaluation of neuronal connectivity: sensitivity of cross-correlationBrain Res 340:341–54
- 3.Contextual influences on visual processingAnnu Rev Neurosci 25:339–79
- 4.Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neuronsAnnu Rev Neurosci 8:407–30
- 5.Receptive fieldScholarpedia 4
- 6.Functional connectivity between simple cells and complex cells in cat striate cortexNature Neuroscience 1:395–403
- 7.Precisely correlated firing in cells of the lateral geniculate nucleusNature 383:815–9
- 8.The synaptic connections between cortical areas V1 and V2 in macaque monkeyJ Neurosci 29:11283–93
- 9.Activity in the fusiform gyrus predicts conscious perception of Rubin’s vase-face illusionNeuroimage 17:890–901
- 10.Circuits and Mechanisms for Surround Modulation in Visual CortexAnnu Rev Neurosci 40:425–451
- 11.Contribution of feedforward, lateral and feedback connections to the classical receptive field center and extra-classical receptive field surround of primate V1 neuronsProg Brain Res 154:93–120
- 12.Circuits for local and global signal integration in primary visual cortexJ Neurosci 22:8633–46
- 13.Time course and time-distance relationships for surround suppression in macaque V1 neuronsJ Neurosci 23:7690–701
- 14.Correlated firing in macaque visual area MT: time scales and relationship to behaviorJ Neurosci 21:1676–97
- 15.Distinct Laminar Processing of Local and Global Context in Primate Primary Visual CortexNeuron 100:259–274
- 16.Termination of afferent axons in macaque striate cortexJ Neurosci 3:1389–413
- 17.Attention enhances synaptic efficacy and the signal-to-noise ratio in neural circuitsNature 499:476–80
- 18.Horizontal propagation of visual activity in the synaptic integration field of area 17 neuronsScience 283:695–9
- 19.The role of feedback connections in shaping the responses of visual cortical neuronsProg Brain Res 134:193–204
- 20.Local circuits in primary visual cortex of the macaque monkeyAnnu Rev Neurosci 21:47–74
- 21.Feedforward, feedback and inhibitory connections in primate visual cortexNeural Netw 17:625–32
- 22.Incremental integration of global contours through interplay between visual cortical areasNeuron 82:682–94
- 23.Synergistic Processing of Visual Contours across Cortical Layers in V1 and V2Neuron 96:1388–1402
- 24.Emergent properties of layer 2/3 neurons reflect the collinear arrangement of horizontal connections in tree shrew visual cortexJ Neurosci 23:2947–60
- 25.Tuning dissimilarity explains short distance decline of spontaneous spike correlation in macaque V1Vision Res 96:113–32
- 26.A neural model of figure-ground organizationJ. Neurophysiol 97:4310–4326
- 27.The structure of pairwise correlation in mouse primary visual cortex reveals functional organization in the absence of an orientation mapCereb Cortex 24:2707–20
- 28.Neural network model develops border ownership representation through visually guided learningNeurobiol Learn Mem 136:147–165
- 29.Border ownership selectivity in human early visual cortex and its modulation by attentionJ Neurosci 29:460–5
- 30.Stream-specific feedback inputs to the primate primary visual cortexNat Commun 12
- 31.Seeing beyond the receptive field in primary visual cortexCurr Opin Neurobiol 10:438–43
- 32.Columnar processing of border ownership in primate visual cortexElife 10
- 33.Stimulus dependence of directed information exchange between cortical layers in macaque V1Elife 11
- 34.Clustered intrinsic connections in cat visual cortexJ Neurosci 3:1116–33
- 35.The influence of contextual stimuli on the orientation selectivity of cells in primary visual cortex of the catVision Res 30:1689–701
- 36.Feedforward and feedback connections between areas V1 and V2 of the monkey have similar rapid conduction velocitiesJ Neurophysiol 85:1328–31
- 37.Cortical point-spread function and long-range lateral interactions revealed by real-time optical imaging of macaque monkey primary visual cortexJ Neurosci 14:2545–68
- 38.Orientation and direction selectivity of neurons in V1 of alert monkeys: functional relationships and laminar distributionsCereb Cortex 15:1207–21
- 39.Correlated variability in laminar cortical circuitsNeuron 76:590–602
- 40.A rate and history-preserving resampling algorithm for neural spike trainsNeural Comput 21:1244–58
- 41.THE RESPONSE OF SINGLE OPTIC NERVE FIBERS OF THE VERTEBRATE EYE TO ILLUMINATION OF THE RETINAAmerican Journal of Physiology-Legacy Content 121:400–415
- 42.Attention Enhances the Efficacy of Communication in V1 Local CircuitsJ Neurosci 39:1066–1076
- 43.The neuroanatomical organization of pathways between the dorsal lateral geniculate nucleus and visual cortex in Old World and New World primatesJ Comp Neurol 182:123–36
- 44.Functional characterization of the extraclassical receptive field in macaque V1: contrast, orientation, and temporal dynamicsJ Neurosci 33:6230–42
- 45.Consistency of Border-Ownership Cells across Artificial Stimuli, Natural Stimuli, and Stimuli with Ambiguous ContoursJ Neurosci 36:11338–11349
- 46.Functional modules for visual scene segmentation in macaque visual cortexProc Natl Acad Sci U S A 120
- 47.Dynamically modulated spike correlation in monkey inferior temporal cortex depending on the feature configuration within a whole objectJ Neurosci 25:10299–307
- 48.Triphasic dynamics of stimulus-dependent information flow between single neurons in macaque inferior temporal cortexJ Neurosci 30:10407–21
- 49.A source for awareness-dependent figure-ground segregation in human prefrontal cortexProc Natl Acad Sci U S A 117:30836–30847
- 50.Laminar and columnar distribution of geniculo-cortical fibers in the macaque monkeyJ Comp Neurol 146:421–50
- 51.A functional circuitry for edge-induced brightness perceptionNat Neurosci 10:1185–90
- 52.Feedback connections act on the early part of the responses in monkey visual cortexJ Neurophysiol 85:134–45
- 53.Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neuronsNature 394:784–7
- 54.Response facilitation from the “suppressive” receptive field surround of macaque V1 neuronsJ Neurophysiol 98:2168–81
- 55.Boundary assignment in a recurrent network architectureVision Res 47:1153–65
- 56.Serial grouping of 2D-image regions with object-based attention in humansElife 5
- 57.. gamma and the coordination of spiking activity in early visual cortexNeuron 77:762–74
- 58.Multi-regional module-based signal transmission in mouse visual cortexNeuron 110
- 59.Figure-ground modulation in awake primate thalamusProc Natl Acad Sci U S A 112:7085–90
- 60.Fully integrated silicon probes for high-density recording of neural activityNature 551:232–236
- 61.Improvement in visual sensitivity by changes in local context: parallel studies in human observers and in V1 of alert monkeysNeuron 15:843–56
- 62.Feedback generates a second receptive field in neurons of the visual cortexNature 582:545–549
- 63.What’s new in Psychtoolbox-3?Perception 36:14–14
- 64.Distinct Feedforward and Feedback Effects of Microstimulation in Visual Cortex Reveal Neural Mechanisms of Texture SegregationNeuron 95:209–220
- 65.Neuronal responses to static texture patterns in area V1 of the alert macaque monkeyJ Neurophysiol 67:961–80
- 66.Figure-ground organization in the visual cortex: does meaning matter?J Neurophysiol 119:160–176
- 67.Surface construction by a 2-D differentiation-integration process: a neurocomputational model for perceived border ownership, depth, and lightness in Kanizsa figuresPsychol Rev 117:406–39
- 68.Stimulus dependence of neuronal correlation in primary visual cortex of the macaqueJ Neurosci 25:3661–73
- 69.Representation of perceived object shape by the human lateral occipital complexScience 293:1506–9
- 70.The neurophysiology of figure-ground segregation in primary visual cortexJ Neurosci 15:1605–15
- 71.Figure-ground activity in primary visual cortex is suppressed by anesthesiaProc Natl Acad Sci U S A 95:3263–8
- 72.Dynamic coding of border-ownership in visual cortexJ Vis 12
- 73.Neural activity in early visual cortex reflects behavioral experience and higher-order perceptual saliencyNat Neurosci 5:589–97
- 74.Contour saliency in primary visual cortexNeuron 50:951–62
- 75.Cascaded normalizations for spatial integration in the primary visual cortex of primatesCell Rep 40
- 76.Interactions between feedback and lateral connections in the primary visual cortexProc Natl Acad Sci U S A 114:8637–8642
- 77.Organization of neurons in the visual cortex, area 17, of the monkey (Macaca mulatta)J Comp Neurol 147:455–96
- 78.Scene segmentation and attention in primate cortical areas V1 and V2J Neurophysiol 88:2648–58
- 79.Anatomy of hierarchy: feedforward and feedback pathways in macaque visual cortexJ Comp Neurol 522:225–59
- 80.Spike synchrony reveals emergence of proto-objects in visual cortexJournal of Neuroscience 35:6860–6870
- 81.Early recurrence enables figure border ownershipVision Res 186:23–33
- 82.Detection and estimation of neural connectivity based on crosscorrelation analysisBiol Cybern 57:403–14
- 83.Statistical signs of synaptic interaction in neuronsBiophys J 10:876–900
- 84.Local signals from beyond the receptive fields of striate cortical neuronsJ Neurophysiol 90:822–31
- 85.Visual Surface Representation: A Critical Link between Lower-Level and Higher-Level VisionAn Invitation to Cognitive Science, Volume 2: Visual Cognition The MIT Press
- 86.Laminar Organization of Attentional Modulation in Macaque Visual Area V4Neuron 93:235–246
- 87.Corticocortical feedback contributes to surround suppression in V1 of the alert primateJ Neurosci 33:8504–17
- 88.Intracortical facilitation among co-oriented, co-axially aligned simple cells in cat striate cortexExp Brain Res 61:54–61
- 89.Spatial and temporal coherence in cortico-cortical connections: a cross-correlation study in areas 17 and 18 in the catVis Neurosci 9:21–37
- 90.Theory of current source-density analysis and determination of conductivity tensor for anuran cerebellumJ Neurophysiol 38:356–68
- 91.Response modulation by texture surround in primate area V1: correlates of “popout” under anesthesiaVis Neurosci 16:15–34
- 92.Top-down feedback controls spatial summation and response amplitude in primate visual cortexNat Commun 9
- 93.Short-term memory for figure-ground organization in the visual cortexNeuron 61:801–809
- 94.A laminar analysis of the number of neurons, glia, and synapses in the adult cortex (area 17) of adult macaque monkeysJ Comp Neurol 210:278–90
- 95.How connectivity, background activity, and synaptic properties shape the cross-correlation between spike trainsJ Neurosci 29:10234–53
- 96.Spike sorting with Kilosort4Nat Methods 21:914–921
- 97.Top-Down Feedback Controls the Cortical Representation of Illusory Contours in Mouse Primary Visual CortexJ Neurosci 40:648–660
- 98.Neuronal spike trains and stochastic point processes. II. Simultaneous spike trainsBiophys J 7:419–40
- 99.Laminar segregation of sensory coding and behavioral readout in macaque V4Proc Natl Acad Sci U S A 116:14749–14754
- 100.Resolving the Spatial Profile of Figure Enhancement in Human V1 through Population Receptive Field ModelingJ Neurosci 40:3292–3303
- 101.The role of attention in figure-ground segregation in areas V1 and V4 of the visual cortexNeuron 75:143–56
- 102.Figure-ground mechanisms provide structure for selective attentionNature Neuroscience 10:1492–1499
- 103.Real and illusory contour processing in area V1 of the primate: a cortical balancing actCereb Cortex 11:648–65
- 104.Specificity of monosynaptic connections from thalamus to visual cortexNature 378:281–4
- 105.Intrinsic laminar lattice connections in primate visual cortexJ Comp Neurol 216:303–18
- 106.Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkeyBrain Res 179:3–20
- 107.Divergent feedback connections from areas V4 and TEO in the macaqueVis Neurosci 11:579–600
- 108.Terminal arbors of individual “feedback” axons projecting from area V2 to V1 in the macaque monkey: a study using immunohistochemistry of anterogradely transported Phaseolus vulgaris-leucoagglutininJ Comp Neurol 285:54–72
- 109.Specificity of color connectivity between primate V1 and V2J Neurophysiol 82:2719–30
- 110.Cortical algorithms for perceptual groupingAnnu Rev Neurosci 29:203–27
- 111.Surrounding suppression and facilitation in the determination of border ownershipJ Cogn Neurosci 18:562–79
- 112.The role of feedback in shaping the extra-classical receptive field of cortical neurons: a recurrent network modelJ Neurosci 26:9117–29
- 113.Functional specificity of a long-range horizontal connection in cat visual cortex: a cross-correlation studyJ Neurosci 11:2995–3007
- 114.The Segmentation of Proto-Objects in the Monkey Primary Visual CortexCurr Biol 29:1019–1029
- 115.Distinct roles of the cortical layers of area V1 in figure-ground segregationCurr Biol 23:2121–9
- 116.Layer-Specific Physiological Features and Interlaminar Interactions in the Primary Visual Cortex of the MouseNeuron 101:500–513
- 117.Retinotopic axis specificity and selective clustering of feedback projections from V2 to V1 in the owl monkeyJ Neurosci 25:2117–31
- 118.High-density electrode recordings reveal strong and specific connections between retinal ganglion cells and midbrain neuronsNature Communications 13
- 119.Survey of spiking in the mouse visual system reveals functional hierarchyNature 592:86–92
- 120.Visual cortical mechanisms detecting focal orientation discontinuitiesNature 378:492–6
- 121.A direct interareal feedback-to-feedforward circuit in primate visual cortexNat Commun 12
- 122.Spatial and temporal scales of neuronal correlation in primary visual cortexJ Neurosci 28:12591–603
- 123.Attention modulates synchronized neuronal firing in primate somatosensory cortexNature 404:187–90
- 124.Lateral connectivity and contextual interactions in macaque primary visual cortexNeuron 36:739–50
- 125.The speed of context integration in the visual cortexJ Neurophysiol 106:374–85
- 126.Feed-forward segmentation of figure-ground and assignment of border-ownershipPLoS One 5
- 127.Two distinct modes of sensory processing observed in monkey primary visual cortex (V1)Nat Neurosci 4:304–10
- 128.Orientation tuning curves: empirical description and estimation of parametersBiol Cybern 78:45–56
- 129.Functional anatomy of macaque striate cortex. II. Retinotopic organizationJ Neurosci 8:1531–68
- 130.Large-scale high-density brain-wide neural recording in nonhuman primatesbioRxiv
- 131.Functional interactions among neurons within single columns of macaque V1Elife 11
- 132.Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysisJ Neurosci 6:1160–70
- 133.Paired-spike interactions and synaptic efficacy of retinal inputs to the thalamusNature 395:384–7
- 134.Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortexProc Natl Acad Sci U S A 111:14332–41
- 135.Layer-specificity in the effects of attention and working memory on activity in primary visual cortexNat Commun 8
- 136.Activity in Lateral Visual Areas Contributes to Surround Suppression in Awake Mouse V1Curr Biol 29:4268–4275
- 137.Figure-ground organization and the emergence of proto-objects in the visual cortexFrontiers in Psychology 6
- 138.Visual cortical processing—From image to object representationFrontiers in Computer Science 5
- 139.Illusory contours and cortical neuron responsesScience 224:1260–2
- 140.Analysis of spiking synchrony in visual cortex reveals distinct types of top-down modulation signals for spatial and object-based attentionPLoS Comput Biol 17
- 141.Asymmetric suppression outside the classical receptive field of the visual cortexJ Neurosci 19:10536–53
- 142.Gain control from beyond the classical receptive field in primate primary visual cortexVis Neurosci 20:221–30
- 143.Figure-Ground Organization in Visual Cortex for Natural SceneseNeuro 3
- 144.Bottom-up saliency and top-down learning in the primary visual cortex of monkeysProc Natl Acad Sci U S A 115:10499–10504
- 145.Cue combination encoding via contextual modulation of V1 and V2 neuronsEye Brain 8:177–193
- 146.Analysis of the context integration mechanisms underlying figure-ground organization in the visual cortexJournal of Neuroscience 30:6482–6496
- 147.Selective attention. Long-range and local circuits for top-down modulation of visual cortex processingScience 345:660–5
- 148.Border ownership from intracortical interactions in visual area v2Neuron 47:143–53
- 149.Coding of border ownership in monkey visual cortexJ Neurosci 20:6594–611
- 150.Searching for object pointers in the visual cortexJournal of Neurophysiology 123:1979–1994
- 151.Contextual modulation in primary visual cortexJ Neurosci 16:7376–89
Article and author information
Author information
Version history
- Sent for peer review:
- Preprint posted:
- Reviewed Preprint version 1:
Copyright
© 2024, Zhu et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.