Lip movements entrain the observers' low-frequency brain oscillations to facilitate speech intelligibility

  1. Hyojin Park  Is a corresponding author
  2. Christoph Kayser
  3. Gregor Thut
  4. Joachim Gross
  1. University of Glasgow, United Kingdom

Abstract

During continuous speech, lip movements provide visual temporal signals that facilitate speech processing. Here, using MEG we directly investigated how these visual signals interact with rhythmic brain activity in participants listening to and seeing the speaker. First, we investigated coherence between oscillatory brain activity and speaker's lip movements and demonstrated significant entrainment in visual cortex. We then used partial coherence to remove contributions of the coherent auditory speech signal from the lip-brain coherence. Comparing this synchronization between different attention conditions revealed that attending visual speech enhances the coherence between activity in visual cortex and the speaker's lips. Further, we identified a significant partial coherence between left motor cortex and lip movements and this partial coherence directly predicted comprehension accuracy. Our results emphasize the importance of visually entrained and attention-modulated rhythmic brain activity for the enhancement of audiovisual speech processing.

Article and author information

Author details

  1. Hyojin Park

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    For correspondence
    Hyojin.Park@glasgow.ac.uk
    Competing interests
    The authors declare that no competing interests exist.
  2. Christoph Kayser

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  3. Gregor Thut

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  4. Joachim Gross

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.

Reviewing Editor

  1. Andrew J King, University of Oxford, United Kingdom

Ethics

Human subjects: This study was approved by the local ethics committee (CSE01321; University of Glasgow, Faculty of Information and Mathematical Sciences) and conducted in conformity with the Declaration of Helsinki. All participants provided informed written consent before participating in the experiment and received monetary compensation for their participation.

Version history

  1. Received: January 18, 2016
  2. Accepted: May 3, 2016
  3. Accepted Manuscript published: May 5, 2016 (version 1)
  4. Version of Record published: June 9, 2016 (version 2)

Copyright

© 2016, Park et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 4,772
    views
  • 840
    downloads
  • 127
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Hyojin Park
  2. Christoph Kayser
  3. Gregor Thut
  4. Joachim Gross
(2016)
Lip movements entrain the observers' low-frequency brain oscillations to facilitate speech intelligibility
eLife 5:e14521.
https://doi.org/10.7554/eLife.14521

Share this article

https://doi.org/10.7554/eLife.14521

Further reading

    1. Neuroscience
    Annette Pisanski, Mitchell Prostebby ... Silvia Pagliardini
    Research Article

    The lateral parafacial area (pFL) is a crucial region involved in respiratory control, particularly in generating active expiration through an expiratory oscillatory network. Active expiration involves rhythmic abdominal (ABD) muscle contractions during late-expiration, increasing ventilation during elevated respiratory demands. The precise anatomical location of the expiratory oscillator within the ventral medulla’s rostro-caudal axis is debated. While some studies point to the caudal tip of the facial nucleus (VIIc) as the oscillator’s core, others suggest more rostral areas. Our study employed bicuculline (a γ-aminobutyric acid type A [GABA-A] receptor antagonist) injections at various pFL sites (–0.2 mm to +0.8 mm from VIIc) to investigate the impact of GABAergic disinhibition on respiration. These injections consistently elicited ABD recruitment, but the response strength varied along the rostro-caudal zone. Remarkably, the most robust and enduring changes in tidal volume, minute ventilation, and combined respiratory responses occurred at more rostral pFL locations (+0.6/+0.8 mm from VIIc). Multivariate analysis of the respiratory cycle further differentiated between locations, revealing the core site for active expiration generation with this experimental approach. Our study advances our understanding of neural mechanisms governing active expiration and emphasizes the significance of investigating the rostral pFL region.

    1. Neuroscience
    Max Schulz, Malte Wöstmann
    Insight

    Asymmetries in the size of structures deep below the cortex explain how alpha oscillations in the brain respond to shifts in attention.