1. Neuroscience

Parallel processing in speech perception with local and global representations of linguistic context

  1. Christian Brodbeck  Is a corresponding author
  2. Shohini Bhattasali
  3. Aura AL Cruz Heredia
  4. Philip Resnik
  5. Jonathan Z Simon
  6. Ellen Lau
  1. University of Connecticut, United States
  2. University of Maryland, United States
  3. University of Pennsylvania, United States
https://doi.org/10.7554/eLife.72056
Share this article
Cite this article
  1. Christian Brodbeck
  2. Shohini Bhattasali
  3. Aura AL Cruz Heredia
  4. Philip Resnik
  5. Jonathan Z Simon
  6. Ellen Lau
(2022)
Parallel processing in speech perception with local and global representations of linguistic context
eLife 11:e72056.
https://doi.org/10.7554/eLife.72056
  2. Download BibTeX
  3. Download .RIS

Abstract

Speech processing is highly incremental. It is widely accepted that human listeners continuously use the linguistic context to anticipate upcoming concepts, words, and phonemes. However, previous evidence supports two seemingly contradictory models of how a predictive context is integrated with the bottom-up sensory input: Classic psycholinguistic paradigms suggest a two-stage process, in which acoustic input initially leads to local, context-independent representations, which are then quickly integrated with contextual constraints. This contrasts with the view that the brain constructs a single coherent, unified interpretation of the input, which fully integrates available information across representational hierarchies, and thus uses contextual constraints to modulate even the earliest sensory representations. To distinguish these hypotheses, we tested magnetoencephalography responses to continuous narrative speech for signatures of local and unified predictive models. Results provide evidence that listeners employ both types of models in parallel. Two local context models uniquely predict some part of early neural responses, one based on sublexical phoneme sequences, and one based on the phonemes in the current word alone; at the same time, even early responses to phonemes also reflect a unified model that incorporates sentence level constraints to predict upcoming phonemes. Neural source localization places the anatomical origins of the different predictive models in non-identical parts of the superior temporal lobes bilaterally, with the right hemisphere showing a relative preference for more local models. These results suggest that speech processing recruits both local and unified predictive models in parallel, reconciling previous disparate findings. Parallel models might make the perceptual system more robust, facilitate processing of unexpected inputs, and serve a function in language acquisition.

Data availability

The raw data and predictors used in this study are available for download from Dryad at https://doi.org/10.5061/dryad.nvx0k6dv0

The following data sets were generated

Article and author information

Author details

  1. Christian Brodbeck

    Department of Psychological Sciences, University of Connecticut, Storrs, United States
    For correspondence
    christianbrodbeck@me.com
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8380-639X

  2. Shohini Bhattasali

    Department of Linguistics, University of Maryland, College Park, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-6767-6529

  3. Aura AL Cruz Heredia

    Department of Psychology, University of Pennsylvania, Philadelphia, United States
    Competing interests
    The authors declare that no competing interests exist.

  4. Philip Resnik

    Department of Linguistics, University of Maryland, College Park, United States
    Competing interests
    The authors declare that no competing interests exist.

  5. Jonathan Z Simon

    Institute for Systems Research, University of Maryland, College Park, United States
    Competing interests
    The authors declare that no competing interests exist.

  6. Ellen Lau

    Department of Linguistics, University of Maryland, College Park, United States
    Competing interests
    The authors declare that no competing interests exist.

Funding

University of Maryland (BBI Seed Grant)

  • Jonathan Z Simon
  • Ellen Lau

National Science Foundation (BCS-1749407)

  • Ellen Lau

National Institutes of Health (R01DC014085)

  • Jonathan Z Simon

National Science Foundation (SMA-1734892)

  • Jonathan Z Simon

Office of Naval Research (MURI Award N00014-18-1-2670)

  • Philip Resnik

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: The study was approved by the IRB of the University of Maryland under the protocol titled "MEG Studies of Speech and Language Processing" (reference # 01153), on August 22, 2018 and September 9, 2019 (approval duration: 1 year). All participants provided written informed consent prior to the start of the experiment.

Reviewing Editor

  1. Virginie van Wassenhove, CEA, DRF/I2BM, NeuroSpin; INSERM, U992, Cognitive Neuroimaging Unit, France

Publication history

  1. Preprint posted: July 3, 2021 (view preprint)
  2. Received: July 8, 2021
  3. Accepted: January 16, 2022
  4. Accepted Manuscript published: January 21, 2022 (version 1)
  5. Version of Record published: February 10, 2022 (version 2)
  6. Version of Record updated: April 5, 2022 (version 3)

Copyright

© 2022, Brodbeck et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,989
    Page views
  • 430
    Downloads
  • 5
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Christian Brodbeck
  2. Shohini Bhattasali
  3. Aura AL Cruz Heredia
  4. Philip Resnik
  5. Jonathan Z Simon
  6. Ellen Lau
(2022)
Parallel processing in speech perception with local and global representations of linguistic context
eLife 11:e72056.
https://doi.org/10.7554/eLife.72056

Categories and tags

Research organism

Further reading

    1. Neuroscience

    Distinct roles of forward and backward alpha-band waves in spatial visual attention

    Andrea Alamia, Lucie Terral ... Rufin VanRullen
    Research Article Updated

    Previous research has associated alpha-band [8–12 Hz] oscillations with inhibitory functions: for instance, several studies showed that visual attention increases alpha-band power in the hemisphere ipsilateral to the attended location. However, other studies demonstrated that alpha oscillations positively correlate with visual perception, hinting at different processes underlying their dynamics. Here, using an approach based on traveling waves, we demonstrate that there are two functionally distinct alpha-band oscillations propagating in different directions. We analyzed EEG recordings from three datasets of human participants performing a covert visual attention task (one new dataset with N = 16, two previously published datasets with N = 16 and N = 31). Participants were instructed to detect a brief target by covertly attending to the screen’s left or right side. Our analysis reveals two distinct processes: allocating attention to one hemifield increases top-down alpha-band waves propagating from frontal to occipital regions ipsilateral to the attended location, both with and without visual stimulation. These top-down oscillatory waves correlate positively with alpha-band power in frontal and occipital regions. Yet, different alpha-band waves propagate from occipital to frontal regions and contralateral to the attended location. Crucially, these forward waves were present only during visual stimulation, suggesting a separate mechanism related to visual processing. Together, these results reveal two distinct processes reflected by different propagation directions, demonstrating the importance of considering oscillations as traveling waves when characterizing their functional role.

    1. Developmental Biology
    2. Neuroscience

    Origin of wiring specificity in an olfactory map revealed by neuron type-specific, time-lapse imaging of dendrite targeting

    Kenneth Kin Lam Wong, Tongchao Li ... Liqun Luo
    Research Article

    How does wiring specificity of neural maps emerge during development? Formation of the adult Drosophila olfactory glomerular map begins with patterning of projection neuron (PN) dendrites at the early pupal stage. To better understand the origin of wiring specificity of this map, we created genetic tools to systematically characterize dendrite patterning across development at PN type-specific resolution. We find that PNs use lineage and birth order combinatorially to build the initial dendritic map. Specifically, birth order directs dendrite targeting in rotating and binary manners for PNs of the anterodorsal and lateral lineages, respectively. Two-photon- and adaptive optical lattice light-sheet microscope-based time-lapse imaging reveals that PN dendrites initiate active targeting with direction-dependent branch stabilization on the timescale of seconds. Moreover, PNs that are used in both the larval and adult olfactory circuits prune their larval-specific dendrites and re-extend new dendrites simultaneously to facilitate timely olfactory map organization. Our work highlights the power and necessity of type-specific neuronal access and time-lapse imaging in identifying wiring mechanisms that underlie complex patterns of functional neural maps.

    1. Neuroscience

    Generative network modeling reveals quantitative definitions of bilateral symmetry exhibited by a whole insect brain connectome

    Benjamin D Pedigo, Mike Powell ... Joshua T Vogelstein
    Research Article

    Comparing connectomes can help explain how neural connectivity is related to genetics, disease, development, learning, and behavior. However, making statistical inferences about the significance and nature of differences between two networks is an open problem, and such analysis has not been extensively applied to nanoscale connectomes. Here, we investigate this problem via a case study on the bilateral symmetry of a larval Drosophila brain connectome. We translate notions of'bilateral symmetry' to generative models of the network structure of the left and right hemispheres, allowing us to test and refine our understanding of symmetry. We find significant differences in connection probabilities both across the entire left and right networks and between specific cell types. By rescaling connection probabilities or removing certain edges based on weight, we also present adjusted definitions of bilateral symmetry exhibited by this connectome. This work shows how statistical inferences from networks can inform the study of connectomes, facilitating future comparisons of neural structures.