Lip movements entrain the observers' low-frequency brain oscillations to facilitate speech intelligibility

  1. Hyojin Park  Is a corresponding author
  2. Christoph Kayser
  3. Gregor Thut
  4. Joachim Gross
  1. University of Glasgow, United Kingdom

Abstract

During continuous speech, lip movements provide visual temporal signals that facilitate speech processing. Here, using MEG we directly investigated how these visual signals interact with rhythmic brain activity in participants listening to and seeing the speaker. First, we investigated coherence between oscillatory brain activity and speaker's lip movements and demonstrated significant entrainment in visual cortex. We then used partial coherence to remove contributions of the coherent auditory speech signal from the lip-brain coherence. Comparing this synchronization between different attention conditions revealed that attending visual speech enhances the coherence between activity in visual cortex and the speaker's lips. Further, we identified a significant partial coherence between left motor cortex and lip movements and this partial coherence directly predicted comprehension accuracy. Our results emphasize the importance of visually entrained and attention-modulated rhythmic brain activity for the enhancement of audiovisual speech processing.

Article and author information

Author details

  1. Hyojin Park

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    For correspondence
    Hyojin.Park@glasgow.ac.uk
    Competing interests
    The authors declare that no competing interests exist.
  2. Christoph Kayser

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  3. Gregor Thut

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  4. Joachim Gross

    Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.

Ethics

Human subjects: This study was approved by the local ethics committee (CSE01321; University of Glasgow, Faculty of Information and Mathematical Sciences) and conducted in conformity with the Declaration of Helsinki. All participants provided informed written consent before participating in the experiment and received monetary compensation for their participation.

Copyright

© 2016, Park et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 4,931
    views
  • 859
    downloads
  • 138
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Hyojin Park
  2. Christoph Kayser
  3. Gregor Thut
  4. Joachim Gross
(2016)
Lip movements entrain the observers' low-frequency brain oscillations to facilitate speech intelligibility
eLife 5:e14521.
https://doi.org/10.7554/eLife.14521

Share this article

https://doi.org/10.7554/eLife.14521

Further reading

    1. Neuroscience
    Kaspar E Vogt, Ashwinikumar Kulkarni ... Robert W Greene
    Research Article

    Sleep loss increases AMPA-synaptic strength and number in the neocortex. However, this is only part of the synaptic sleep loss response. We report an increased AMPA/NMDA EPSC ratio in frontal-cortical pyramidal neurons of layers 2–3. Silent synapses are absent, decreasing the plastic potential to convert silent NMDA to active AMPA synapses. These sleep loss changes are recovered by sleep. Sleep genes are enriched for synaptic shaping cellular components controlling glutamate synapse phenotype, overlap with autism risk genes, and are primarily observed in excitatory pyramidal neurons projecting intra-telencephalically. These genes are enriched with genes controlled by the transcription factor, MEF2c, and its repressor, HDAC4. Sleep genes can thus provide a framework within which motor learning and training occur mediated by the sleep-dependent oscillation of glutamate-synaptic phenotypes.

    1. Neuroscience
    Christopher Bell, Lukas Kilo ... Stefanie Ryglewski
    Research Article

    At many vertebrate synapses, presynaptic functions are tuned by expression of different Cav2 channels. Most invertebrate genomes contain only one Cav2 gene. The Drosophila Cav2 homolog, cacophony (cac), induces synaptic vesicle release at presynaptic active zones (AZs). We hypothesize that Drosophila cac functional diversity is enhanced by two mutually exclusive exon pairs that are not conserved in vertebrates, one in the voltage sensor and one in the loop binding Caβ and Gβγ subunits. We find that alternative splicing in the voltage sensor affects channel activation voltage. Only the isoform with the higher activation voltage localizes to AZs at the glutamatergic Drosophila larval neuromuscular junction and is imperative for normal synapse function. By contrast, alternative splicing at the other alternative exon pair tunes multiple aspects of presynaptic function. While expression of one exon yields normal transmission, expression of the other reduces channel number in the AZ and thus release probability. This also abolishes presynaptic homeostatic plasticity. Moreover, reduced channel number affects short-term plasticity, which is rescued by increasing the external calcium concentration to match release probability to control. In sum, in Drosophila alternative splicing provides a mechanism to regulate different aspects of presynaptic functions with only one Cav2 gene.