1. Neuroscience
Download icon

Neural tracking of speech mental imagery during rhythmic inner counting

  1. Lingxi Lu
  2. Qian Wang
  3. Jingwei Sheng
  4. Zhaowei Liu
  5. Lang Qin
  6. Liang Li
  7. Jia-Hong Gao  Is a corresponding author
  1. Peking University, China
  2. Sanbo Brain Hospital, Capital Medical University, China
  3. The University of Hong Kong, China
Research Article
Cite this article as: eLife 2019;8:e48971 doi: 10.7554/eLife.48971
5 figures, 2 tables, 1 data set and 1 additional file

Figures

Sensor-level responses in neural tracking of speech mental imagery.

(a) Under the mental imagery condition (left), a sequence of pure tones was presented with 250 ms onset-to-onset intervals. The participants were asked to loudly count in their minds by grouping every five numbers (with the imagery task), forming an imagery-rate frequency of 0.8 Hz and a stimulus-rate frequency of 4 Hz. Under the baseline condition (right), the participants passively listened to the same sounds without performing a task. (b) Significant spectral peaks were found at 0.8 Hz and its harmonics under the mental imagery condition, and significant 4 Hz peaks were found under both conditions (paired one-sided t test, FDR corrected). The topographic distribution was right-lateralized at 4 Hz but not at 0.8 Hz. The shaded area represents the standard error (SE). ***p<0.001, *p<0.05, m.s. represents marginally significant.

https://doi.org/10.7554/eLife.48971.002
Figure 1—source data 1

MEG sensor-level responses data.

https://doi.org/10.7554/eLife.48971.003
Power of spectral peaks at the imagery-rate frequency and stimulus-rate frequency.

(a) Mental imagery increased the peak power at the imagery-rate frequency of 0.8 Hz. No significant difference in peak power at 4 Hz was observed between the conditions. (b) A significant negative correlation was observed between the grand averaged power at 4 Hz and 0.8 Hz under the mental imagery condition but not under the baseline condition. **p<0.01, *p<0.05.

https://doi.org/10.7554/eLife.48971.004
Figure 2—source data 1

Data for the power of spectral peaks.

https://doi.org/10.7554/eLife.48971.005
Source-level brain activation at the imagery-rate frequency and stimulus-rate frequency.

Under the mental imagery condition (upper panel), the left central-frontal lobe, the left inferior occipital gyrus and the right inferior parietal lobe were activated at an imagery-rate frequency of 0.8 Hz, and a distributive brain network extending from the auditory cortex to the frontal and parietal regions was activated at a stimulus-rate frequency of 4 Hz (cluster level p<0.01, FWE corrected with a voxel-level threshold of p<0.001). Under the baseline condition (lower panel), stimulus-induced brain activation centring in the auditory temporal cortex was observed at 4 Hz.

https://doi.org/10.7554/eLife.48971.007
Comparisons of ROI activation among three significant spectral peaks.

The brain activation in the left IOG at 0.8 Hz under the mental imagery condition was stronger than that at 4 Hz. The brain activation in the right MFG at 4 Hz under the mental imagery condition was stronger than that under the baseline condition. In the left HG, left STG, left INS, left SMG, right HG, right STG, right INS, right PrG, right PoG and right MTG, the activation at 4 Hz under the mental imagery condition and/or the baseline condition was stronger than that at 0.8 Hz under the mental imagery condition. Multiple comparisons were Bonferroni corrected. ***p<0.001, **p<0.01, *p<0.05, m.s. represents marginally significant.

https://doi.org/10.7554/eLife.48971.008
Figure 5 with 1 supplement
SEEG responses to speech mental imagery.

(a) Subject one with contacts in the left operIFG, middle STG, posterior INS and anterior SMG. Significant spectral responses at 0.8 Hz were detected in the operIFG, and the remaining contacts were responsive to the 4 Hz frequency. (b) The cluster including the operIFG from MEG sources is presented in the upper panel. The electrode with contact in the operIFG in Subject one was projected in the MNI space and is shown in the lower panel. SEEG localization supports the MEG source estimation results. (c) Averaged time course of high gamma activity in the operIFG in Subject 1. Periodical changes presented every 1.25 s (0.8 Hz) with increasing amplitude near the onset of the last number (black arrow) in each mentally constructed group under the mental imagery condition (red line) but not the baseline condition (blue line). (d) Subject two with contacts in the left HG. Significant spectral peaks were observed at 4 Hz in the HG. (e) Subject three with contacts in the right middle STG. Significant spectral peaks were observed at 4 Hz in the middle STG. (f) Contact locations in the MNI space. Different colored marks represent each subject’s responsive contacts with significant spectral peaks at 0.8 Hz and/or 4 Hz. Gray marks represent non-responsive contacts with no significant spectral peaks. (g) In each brain region with contacts responsive at 4 Hz, the normalized peaks were significantly larger than zero under the baseline condition (blue stars). Among these peaks, the normalized peaks were significant in the left posterior INS, left anterior SMG, left HG and right middle STG (red stars). The peaks in the bilateral middle STG were smaller under the mental imagery condition than the baseline condition (gray stars). ***p<0.001, **p<0.01, *p<0.05.

https://doi.org/10.7554/eLife.48971.010
Figure 5—figure supplement 1
SEEG results of subjects 4–5.

(a) Subject four with a contact in the left HG. A significant spectral peak was observed at 4 Hz in the imagery condition. (b) Subject five with contacts in the left anterior SMG and right middle MTG. Significant spectral peaks were observed at 4 Hz in the anterior SMG under both conditions and in the middle MTG under the baseline condition.

https://doi.org/10.7554/eLife.48971.011

Tables

Table 1
Major brain activity at the source level.
https://doi.org/10.7554/eLife.48971.006
Brain regionPeak MNI coordinateT value
XYZ
Imagery condition at 0.8 Hz
R postcentral gyrus56−22294.0
L postcentral gyrus−51-7234.9
L precentral gyrus−50-6214.7
L inferior frontal gyrus−463283.2
L inferior occipital gyrus−40−75-65.3
R supramarginal gyrus60−31246.0
Imagery condition at 4 Hz
R superior temporal gyrus61−12810.9
L superior temporal gyrus−51-555.7
R middle temporal gyrus67−19-38.5
L Heschl’s gyrus−50-755.3
R Heschl’s gyrus58−10810.3
R postcentral gyrus59−16178.2
L postcentral gyrus−57−19176.4
R precentral gyrus550197.3
L precentral gyrus−50-6214.7
R insula46−1086.9
L insula−46-923.8
R middle frontal gyrus650−114.0
L supramarginal gyrus−58−21176.2
Baseline condition at 4 Hz
R superior temporal gyrus56−16111.0
L superior temporal gyrus−50−18127.3
R middle temporal gyrus55−2707.3
L Heschl’s gyrus−42−22127.0
R Heschl’s gyrus54−13810.8
R postcentral gyrus61−15158.8
L postcentral gyrus−53−11188.7
R precentral gyrus45-8296.3
L precentral gyrus−54-4215.9
R insula48−1046.9
L insula−38−24226.8
L supramarginal gyrus−43−27238.3
Table 2
Statistical details for the sEEG results
https://doi.org/10.7554/eLife.48971.013
Contact localizationSubject no.DfTCorrected PCohen’s d
Mental imagery condition at 4 Hz
L posterior insula1195.57<0.0011.24
L anterior supramarginal gyrus1193.400.0340.76
1192.990.0840.67
5183.290.0460.75
L Heschl’s gyrus2155.000.0021.25
2154.640.0041.16
4194.570.0021.02
R middle superior temporal gyrus3194.080.0070.91
3195.29<0.0011.18
Baseline condition at 4 Hz
L middle superior temporal gyrus1194.470.0031.00
L posterior insula1198.06<0.0011.80
L anterior supramarginal gyrus1193.350.0370.75
5183.430.0340.79
L Heschl’s gyrus2194.410.0030.99
2194.580.0021.02
2194.600.0021.03
2193.440.0310.77
R middle superior temporal gyrus3195.29<0.0011.18
3194.350.0040.97
3193.810.0130.85
3193.970.0090.89
3193.790.0140.85
R middle middle temporal gyrus5184.520.0031.34

Data availability

Source data files have been provided for Figures 1, 2, 4 and 5. MEG and sEEG data have been provided on the Open Science Framework under the identifier bacge (https://osf.io/bacge/).

The following data sets were generated
  1. 1

Additional files

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Download citations (links to download the citations from this article in formats compatible with various reference manager tools)

Open citations (links to open the citations from this article in various online reference manager services)