Cortical entrainment to hierarchical contextual rhythms recomposes dynamic attending in visual perception

  1. Peijun Yuan
  2. Ruichen Hu
  3. Xue Zhang
  4. Ying Wang  Is a corresponding author
  5. Yi Jiang  Is a corresponding author
  1. State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, China
  2. Department of Psychology, University of Chinese Academy of Sciences, China
  3. Chinese Institute for Brain Research, China
  4. Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, China
7 figures and 1 additional file

Figures

Schematics of stimuli and results for Experiments 1a and 1b.

(A) In the AB task, participants were presented with rapid serial visual presentation (RSVP) streams at 10 Hz (top). Each stream contained two capital letter targets embedded in fourteen number distractors. Black and gray ‘T1’ and ‘T2’ denote two alternative options for target locations in the short-SOA conditions. These targets were located either in two adjacent cycles (the between-cycle condition, displayed on violet background for illustration only) or within the same rhythmic cycle (the within-cycle condition, displayed on green background for illustration only) defined by a rhythmic auditory context in Experiment 1a (middle). Arrhythmic context was used as a control in Experiment 1b (bottom). (B and C) T2 detection accuracy conditioned on correct T1 response for the experiments using rhythmic and arrhythmic contexts. Note that in the baseline (visual-only) session, the labels of ‘between’ and ‘within’ were used to refer to the conditions where the two targets shared the same absolute positions with their corresponding conditions in the context (audiovisual) session. Error bars represent 1 SEM; *p<0.05.

Figure 1—source data 1

T2 detection accuracy for individual participants in Experiments 1a and 1b.

https://cdn.elifesciences.org/articles/65118/elife-65118-fig1-data1-v1.xlsx
Stimuli and results for Experiments 1 c, 1d and 1e.

(A) Contextual tone sequences with pitch changed every five tones (2 Hz, upper) and every three tones (3.3 Hz, lower) in Experiment 1 c. (B) T2 performance in short-SOA conditions for 2 Hz(upper) and 3.3 Hz (lower) sequence in Experiment 1 c. (C) The auditory context was grouped irregularly into four chunks with different numbers of tones (Irreg-G) in Experiment 1d (upper) and into four regular chunks (four tones in each) but with irregular onset timing (Irreg-T) in Experiment 1e (lower). (D) T2 performance in Experiment 1d (upper) and 1e (lower). Error bars represent 1 SEM; *p<0.05, **p<0.01.

Figure 2—source data 1

T2 detection accuracy for individual participants in Experiments 1 c, 1d, and 1e.

https://cdn.elifesciences.org/articles/65118/elife-65118-fig2-data1-v1.xlsx
Stimuli and results for Experiments 2 and 3 using the visual contexts.

(A) The visual context with or without periodic changes in the background color and (B) the T2 performance in Experiment 2a. (C) The visual context with or without the background color changed irregularly and (D) the T2 performance in Experiment 2b. (E) Contextual rhythms defined by cyclic/random motion at a constant speed and (F) the T2 performance in Experiment 3. Error bars represent 1 SEM; *p<0.05, **p<0.01.

Figure 3—source data 1

T2 detection accuracy for individual participants in Experiments 2a, 2b, and 3.

https://cdn.elifesciences.org/articles/65118/elife-65118-fig3-data1-v1.xlsx
Figure 4 with 1 supplement
Neural entrainment to contextual rhythms and its correlation with the attentional modulation effect.

(A) The power spectrum of EEG signals averaged across all epochs and channels. For each frequency, power was normalized by subtracting the mean power of the two nearest neighboring frequencies from the power of the center frequency. Shaded areas indicate standard errors of the mean. (B) The 2.5 Hz power entrainment effect at the parieto-occipital cluster and the frontal cluster, as respectively indicated by orange and green stars in the scalp topographic map, significantly correlated with the behavioral modulation index (BMI). (C and D) Analysis of inter-trial phase coherence (ITPC) results yielded similar patterns to those for power.

Figure 4—figure supplement 1
Neural entrainment to contextual rhythms indexed by induced power and its correlation with the attentional modulation effect.

(A) The induced power spectrum estimated based on the average of single-trial spectral transforms across all epochs and channels. For each frequency, the resulting power was normalized by subtracting the mean power of the two nearest neighboring frequencies from the power of the center frequency. In the normalized power spectrum, peaks can be observed at stimulus frequencies—2.5 Hz (t(15) = 1.185, p=0.042, uncorrected) and 10 Hz (t(15) = 6.582, p<0.001, FDR-corrected with a p-value threshold <0.001; only positive peaks were shown). Shaded areas indicate standard errors of the mean. (B) The 2.5 Hz induced power is significantly correlated with the behavioral modulation index (BMI; r = 0.606, p=0.006) in a parieto-occipital cluster (P7, PO7, PO5, PO3, as indicated by orange stars in the scalp topographic map).

Modulation effect of the alpha power and its coupling with the delta phase.

(A) 10 Hz alpha power averaged within the time window of −100–0 ms (left) and 0–100 ms (right) relative to the T2 onset was significantly higher in the between-cycle condition than in the within-cycle condition in a left parieto-occipital cluster (indicated by white stars). (B) The modulation index of phase-amplitude coupling (PAC) between the delta and alpha bands was higher for the between-cycle condition than for the within-cycle condition, and (C) the difference in normalized PAC strength could predict the BMI across individuals. Shadowed area in the topographic plot indicates the cluster showing significant behavioral relevance in both delta- and alpha-band activities. Error bars represent 1 SEM; *p<0.05, **p<0.01.

Author response image 1
ERPs aligned to stream onset.

EEG signals were filtered between 1–30 Hz, baseline-corrected (-200 to 0 ms before stream onset), and averaged across the electrodes in left parieto-occipital area where 10-Hz alpha power showed attentional modulation effect.

Author response image 2
ERPs aligned to T1 onset.

EEG signals were filtered between 1–30 Hz, and baseline-corrected using signals -100 to 0 ms before T1 onset. The two dash lines indicate the onset of T1 and T2, respectively.

Additional files

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Peijun Yuan
  2. Ruichen Hu
  3. Xue Zhang
  4. Ying Wang
  5. Yi Jiang
(2021)
Cortical entrainment to hierarchical contextual rhythms recomposes dynamic attending in visual perception
eLife 10:e65118.
https://doi.org/10.7554/eLife.65118