Multiple objects evoke fluctuating responses in several regions of the visual pathway
- Department of Neurobiology, Duke University, United States
- Center for Cognitive Neuroscience, Duke University, United States
- Duke Institute for Brain Sciences, Duke University, United States
- Department of Psychiatry, University of Michigan, United States
- Department of Statistical Science, Duke University, United States
- Department of Ophthalmology, University of Pittsburgh, United States
- American Medical Group Association, United States
- Department of Neurobiology, University of Chicago, United States
- The Rockefeller University, United States
- Department of Psychology & Neuroscience, Duke University, United States
- Department of Computer Science, Duke University, United States
- Department of Biomedical Engineering, Duke University, United States
Figures
Figure 1 with 1 supplement
Description of datasets.
(a) Middle temporal area (MT) gratings datasets from Ruff and Cohen, 2016b and Ruff et al., 2016a. (a.1). For the adjacent gratings, the two stimuli were placed side by side and roughly within the MT neuron’s receptive field. The superimposed gratings were larger and each was placed at the same position, also within the MT neuron’s receptive field. (a.2) Monkeys performed an attention task during the presentation of the adjacent gratings; only trials in which attention was successfully directed to the stimulus in the ipsilateral hemifield were included in this study. (a.3) Monkeys performed a fixation task during presentation of the superimposed gratings. (b) MT random dot patch dataset from Li et al., 2016. Patches of moving dots were presented within apertures placed within the receptive field of an MT neuron. Attention was directed to the fixation target for the trials included in the present study. (c) Face patch stimulus conditions (Ebihara, 2015). (c.1) Monkeys performed a fixation task and stimuli were presented either at the center of the receptive field or from one of eight locations surrounding it. (c.2) ‘Preferred’ faces were faces that evoked a strong response, and were presented in the center of the receptive field. Non-preferred faces or non-face objects were presented at one of the other locations. Combinations of stimuli involved the preferred face in the center and one of the non-preferred stimuli at one of the adjacent locations. (c.3) Additional examples of stimuli used in the face patch datasets.
Figure 1—figure supplement 1
Properties of the datasets and application of exclusion criteria.
(a) Average A, B, and AB trial counts for each included triplet (after Poisson, trial count, and response separation screening). (b) The distribution of variance-to-mean ratios, or Fano factors, on A- and B-alone trials across the different datasets.Results shown involve the average A and B Fano factors for a given triplet (computed after the screening for minimum trial count and A and B response separation). (c) A and B response separations, computed as an index of the difference between A and B responses as a fraction of their sum, for included triplets (after Poisson, trial count, and response separation screening). Note that the middle temporal area (MT) plaid dataset differs from the other 4 datasets in that many of the included triplets have much smaller A and B response separations than those that are included for other datasets. This is likely due to the larger numbers of trials providing greater confidence that the A and B responses did indeed differ at smaller difference levels. (d) Average ‘winning probability’ for the ‘mixture’ model (see Materials and methods: Data analysis) as a function of the response separation. Average ‘mixture’ winning probability was higher for all four datasets involving distinguishable stimuli (MT adjacent gratings and dot patches, the face patch datasets) than for the MT plaid dataset, across all levels of A vs. B response separation.
Figure 2
Statistical comparisons to be made across datasets.
We assign each trial into a ‘triplet’ consisting of trials in which stimulus A (red), stimulus B (blue), or both stimulus A and B (AB, black) were presented. (a) Within each triplet, spike count distributions are compared to determine how the AB distribution relates to the A and B distributions. (b) The AB spike count distribution may be: a mixture of the A and B distributions, suggesting fluctuations between the responses to the two stimuli; an intermediate rate between the A and B distributions, suggesting averaging (or fluctuations on a faster time scale than the analysis period); a rate that matches either the single A or B distribution, suggesting a winner-take-all strategy; or a rate outside the range bounded by the A and B distributions, suggesting addition or subtraction of the responses. Spike counts are assumed to be drawn from Poisson distributions, with a weighting parameter alpha defining the relative contribution of the individual A and B distributions in ‘mixtures’ and ‘intermediates’.
Figure 3
Example individual unit responses and population results for middle temporal area (MT).
(a) An example unit’s response to two simultaneous adjacent gratings (AB, black solid lines) in comparison to the mean response to each grating individually (A and B, red and blue dotted lines). (b) A different example unit’s response to simultaneous dot patches. In both (a) and (b), gray bars indicate the raw distributions. The black lines indicate a smoothed fit for display purposes; this fit was generated by convolution with a 3-point sliding window of which the middle point is weighted twice as much as either of the two outer points followed by cubic spline interpolation. Spike counts were computed for a window 200 ms in duration (see Materials and Methods); multiply x-axis by 5 to convert to spike rates in Hz. (c) Number of triplets classified into each category (as shown in Figure 2) when responses to two simultaneous gratings (dark blue) or dot patches (light blue) are recorded in MT. Only triplets for which the winning model garnered a posterior probability of 0.67 or greater are shown. (d) Same as (c) but for fused objects, created by overlaying two gratings to form a plaid. (e) Comparison of (c) and (d) showing that fluctuating (mixture) responses are only present when two objects are distinct, and not when two objects are fused into one. Results in this figure only include triplet conditions for which the average variance-to-mean ratio (Fano factor) of activity on the A- and B-only trials was less than 3. See Figure 4—figure supplement 1 for corresponding findings using stricter inclusion criteria.
Figure 4 with 1 supplement
Example individual unit responses and population results for IT face patches middle fundus (MF) and AL.
(a) An example single MF unit’s response to two simultaneous faces (AB, black solid lines) in comparison to the mean response to each face individually (A and B, red and blue dotted lines). (b) Same as (a) but in response to one face and one object. (c) Same as (a) but recorded in AL. (d) Same as (b) but recorded in AL. In (a) through (d), distributions were smoothed for display purposes via convolution with a 3-point sliding window of which the middle point is weighted twice as much as either of the two outer points, followed by cubic spline interpolation. Gray bars show the raw spike counts for the 200 ms spike counting windows (multiply x-axis scale by 5 to convert to spike rates in Hz). (e) Number of triplets classified into each category (as shown in Figure 2) when responses to a face–face pair (dark brown) or a face–object pair (mustard color) are recorded in face patch MF. Only triplets for which the winning model garnered a posterior probability of 0.67 or greater are shown. (f) Same as (e) but recorded in face patch AL. (g) Comparison of (e) and (f) showing that more conditions display a fluctuating (mixture) pattern in AL than in MF. In MF, there were more ‘mixtures’ among face–face pairs than among face–object pairs. Results in this figure only include triplet conditions for which the average variance-to-mean ratio (Fano factor) of activity on the A- and B-only trials was less than 3. See Figure 4—figure supplement 1 for corresponding findings using stricter inclusion criteria.
Figure 4—figure supplement 1
Same as population results in Figures 3 and 4, but using a Fano factor criterion of 2 instead of 3.
All trends in the data are maintained compared to the comparisons with a criterion of 3, other than the loss of significance between face–face and face–object comparisons in middle fundus (MF).
Tables
Table 1
Comparison of datasets.
| Dataset name | Citation | Brain area | Stimuli | Stimulus locations | Task | Recording method |
|---|---|---|---|---|---|---|
| MT adjacent gratings | Ruff and Cohen, 2016b | MT | Drifting images of two gratings | Adjacent (3 degrees eccentric) | Detect orientation change of a different, ipsilateral stimulus | Array, single and multi-unit |
| MT dot patches | Li et al., 2016 | MT | Moving dots | Adjacent | Detect change in fixation stimulus | Single electrode, single unit |
| MT plaid | Ruff et al., 2016a | MT | Drifting images of gratings and plaids | Same location | Passive fixation | Array, single and multi-unit |
| IT face patch MF | Ebihara, 2015; Caruso et al., 2018 | MF | Images of faces and objects | Adjacent | Passive fixation | Single electrode, single unit |
| IT face patch AL | Ebihara, 2015 | AL | Images of faces and objects | Adjacent | Passive fixation | Single electrode, single unit |
Additional files
-
MDAR checklist
- https://cdn.elifesciences.org/articles/91129/elife-91129-mdarchecklist1-v1.pdf
-
Source data 1
Source data for the figures and analyses in this article.
Spreadsheets are included for the analysis output from each dataset. Individual file names indicate which datasets they relate to.
- https://cdn.elifesciences.org/articles/91129/elife-91129-data1-v1.zip
Download links
A two-part list of links to download the article, or parts of the article, in various formats.
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Multiple objects evoke fluctuating responses in several regions of the visual pathway
eLife 13:e91129.
https://doi.org/10.7554/eLife.91129
