Lip movements entrain the observers' low-frequency brain oscillations to facilitate speech intelligibility
Abstract
During continuous speech, lip movements provide visual temporal signals that facilitate speech processing. Here, using MEG we directly investigated how these visual signals interact with rhythmic brain activity in participants listening to and seeing the speaker. First, we investigated coherence between oscillatory brain activity and speaker's lip movements and demonstrated significant entrainment in visual cortex. We then used partial coherence to remove contributions of the coherent auditory speech signal from the lip-brain coherence. Comparing this synchronization between different attention conditions revealed that attending visual speech enhances the coherence between activity in visual cortex and the speaker's lips. Further, we identified a significant partial coherence between left motor cortex and lip movements and this partial coherence directly predicted comprehension accuracy. Our results emphasize the importance of visually entrained and attention-modulated rhythmic brain activity for the enhancement of audiovisual speech processing.
Article and author information
Author details
Ethics
Human subjects: This study was approved by the local ethics committee (CSE01321; University of Glasgow, Faculty of Information and Mathematical Sciences) and conducted in conformity with the Declaration of Helsinki. All participants provided informed written consent before participating in the experiment and received monetary compensation for their participation.
Copyright
© 2016, Park et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 4,931
- views
-
- 859
- downloads
-
- 138
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Sleep loss increases AMPA-synaptic strength and number in the neocortex. However, this is only part of the synaptic sleep loss response. We report an increased AMPA/NMDA EPSC ratio in frontal-cortical pyramidal neurons of layers 2–3. Silent synapses are absent, decreasing the plastic potential to convert silent NMDA to active AMPA synapses. These sleep loss changes are recovered by sleep. Sleep genes are enriched for synaptic shaping cellular components controlling glutamate synapse phenotype, overlap with autism risk genes, and are primarily observed in excitatory pyramidal neurons projecting intra-telencephalically. These genes are enriched with genes controlled by the transcription factor, MEF2c, and its repressor, HDAC4. Sleep genes can thus provide a framework within which motor learning and training occur mediated by the sleep-dependent oscillation of glutamate-synaptic phenotypes.
-
- Neuroscience
At many vertebrate synapses, presynaptic functions are tuned by expression of different Cav2 channels. Most invertebrate genomes contain only one Cav2 gene. The Drosophila Cav2 homolog, cacophony (cac), induces synaptic vesicle release at presynaptic active zones (AZs). We hypothesize that Drosophila cac functional diversity is enhanced by two mutually exclusive exon pairs that are not conserved in vertebrates, one in the voltage sensor and one in the loop binding Caβ and Gβγ subunits. We find that alternative splicing in the voltage sensor affects channel activation voltage. Only the isoform with the higher activation voltage localizes to AZs at the glutamatergic Drosophila larval neuromuscular junction and is imperative for normal synapse function. By contrast, alternative splicing at the other alternative exon pair tunes multiple aspects of presynaptic function. While expression of one exon yields normal transmission, expression of the other reduces channel number in the AZ and thus release probability. This also abolishes presynaptic homeostatic plasticity. Moreover, reduced channel number affects short-term plasticity, which is rescued by increasing the external calcium concentration to match release probability to control. In sum, in Drosophila alternative splicing provides a mechanism to regulate different aspects of presynaptic functions with only one Cav2 gene.