Lip movements entrain the observers’ low-frequency brain oscillations to facilitate speech intelligibility
- University of Glasgow, United Kingdom
Figures
Figure 1
Experimental conditions and behavioral results.
(A) Four experimental conditions. ‘A’ denotes auditory stimulus and ‘V’ denotes visual stimulus.The number refers to the identity of each talk. All congruent condition: Natural audiovisual speech …
Figure 2 with 3 supplements
Lip signals in continuous speech and its entrainment in the brain.
(A) Lip signals in the continuous audiovisual speech.Lip contour was extracted for each video frame and corresponding area was computed (see Figure 2—figure supplement 1A,B,C for details). One …
Figure 2—figure supplement 1
A schematic figure for the analysis of coupling between lip movements and brain activity.
We extracted lip movement signals by automatically computing for each video frame the lip contour using our in-house MATLAB script (A). The contour was converted into the three quantities area, …
Figure 2—figure supplement 2
Brain activity entrained by lip movements.
We show lip-entrained brain activity by coherence in natural audiovisual speech condition (All congruent) at 1 Hz (dominant frequency component in lip signals) in Figure 2D. Here we show the same …
Figure 2—figure supplement 3
Brain activity entrained by lip movements and sound envelope.
We show entrained brain activity by coherence separately for lip movements (A) and sound speech envelope (B) at each frequency from 2 to 5 Hz for All congruent condition in addition to 1 Hz shown in …
Figure 3 with 2 supplements
Lip-brain partial coherence.
(A) Modulation of partial lip-brain coherence by attention and congruence in visual ROI.AV congruent condition was compared to the other conditions (paired t-test, df: 43, red dashed line: p<0.05, …
Figure 3—figure supplement 1
Lip-brain coherence.
(A, B) Modulation of lip entrainment by attention and congruence in ROIs.Contrasting AV congruent with All congruent for the effect of attention and with All incongruent for the effect of congruence …
Figure 3—figure supplement 2
Partial coherence between lip movements and left motor cortex.
We here show a frequency-specific plot for partial coherence between lip movements and left motor cortex.We extracted the maximum voxel in the left motor cortex (precentral gyrus) from the contrast …
Figure 4
Behavioral correlates of attentional lip entrainment.
(A) Lip-entrained brain regions predicted by attention-modulated comprehension accuracy.Regression analysis using comprehension accuracy across participants on the partial coherence map was …
Author response image 1
Author response image 2
Author response image 3
Author response image 4
Author response image 5
