We are all familiar with the difficulty of trying to pay attention to a person speaking in a noisy environment, something often known as the ‘cocktail party problem’. This can be especially challenging when the background noise we are trying to filter out is another conversation that we can understand. In order to avoid being distracted in these kinds of situation, we need selective attention, the cognitive process that allows us to attend to one stimulus and to ignore other irrelevant sensory information. How the brain processes the sounds in our environment and prioritizes them is still not clear.

One of the central questions is whether we can take in information from several speakers at the same time or whether we can only understand speech from one speaker at a time. Neuroimaging techniques can shed light on this matter by measuring brain activity while participants listen to competing speech stimuli, helping researchers understand how this information is processed by the brain.

Now, Har-Shai Yahav and Zion Golumbic measured the brain activity of 30 participants as they listened to two speech streams in their native language, Hebrew. They heard each speech in a different ear and tried to focus their attention on only one of the speakers. Participants always had to attend to natural speech, while the sound they had to ignore could be either natural speech or unintelligible syllable sequences. The activity of the brain was registered using magnetoencephalography, a non-invasive technique that measures the magnetic fields generated by the electrical activity of neurons in the brain.

The results showed that unattended speech activated brain areas related to both hearing and language. Thus, unattended speech was processed not only at the acoustic level (as any other type of sound would be), but also at the linguistic level. In addition, the brain response to the attended speech in brain regions related to language was stronger when the competing sound was natural speech compared to random syllables. This suggests that the two speech inputs compete for the same processing resources, which may explain why we find it difficult to stay focused in a conversation when there are other people talking in the background.

This study contributes to our understanding on how the brain processes multiple auditory inputs at once. In addition, it highlights the fact that selective attention is a dynamic process of balancing the cognitive resources allocated to competing information rather than an all-or-none process. A potential application of these findings could be the design of smart devices to help individuals focus their attention in noisy environments.

The seminal speech-shadowing experiments conducted in the 50 s and 60 s set the stage for studying one of the primary cognitive challenges encountered in daily life: how do our perceptual and linguistic systems deal effectively with competing speech inputs? (Cherry, 1953; Broadbent, 1958; Treisman, 1960). Over the past decades, a wealth of behavioral and neural evidence has accumulated showing that when only one speech-stream is behaviorally relevant, auditory and linguistic resources are devoted to its preferential encoding at the expense of other task-irrelevant input. Consequentially, this so-called ‘attended’ message can be repeated, comprehended, and remembered, whereas very little of competing task-irrelevant speech is explicitly recalled (Glucksberg, 1970; Ambler et al., 1976; Neely and LeCompte, 1999; Oswald et al., 2000; Brungart et al., 2001). This attentional selection is accompanied by attenuation of speech-tracking for unattended speech in auditory regions (Mesgarani and Chang, 2012; Horton et al., 2013; Zion Golumbic et al., 2013a; O'Sullivan et al., 2015; Fiedler et al., 2019; Teoh and Lalor, 2019) as well as language-related regions (Zion Golumbic et al., 2013b), particularly for linguistic-features of the speech (Brodbeck et al., 2018a; Broderick et al., 2018; Ding et al., 2018; Brodbeck et al., 2020a). However, as demonstrated even in the earliest studies, the content of task-irrelevant speech is probably not fully suppressed and can affect listener behavior in a variety of ways (Moray, 1959; Bryden, 1964; Yates, 1965). Indeed, despite decades of research, the extent to which concurrent speech are processed and the nature of the competition for resources between ‘attended’ and ‘task-irrelevant’ input in multi-speaker contexts is still highly debated (Kahneman, 1973; Driver, 2001; Lachter et al., 2004; Bronkhorst, 2015).

Fueling this debate are often-conflicting empirical findings regarding whether or not task-irrelevant speech is processed for semantic and linguistic content. Many studies fail to find behavioral or neural evidence for processing task-irrelevant speech beyond its acoustic features (Carlyon et al., 2001; Lachter et al., 2004; Ding et al., 2018). However, others are able to demonstrate that at least some linguistic information is gleaned from task-irrelevant speech. For example, task-irrelevant speech is more distracting than non-speech or incomprehensible distractors (Rhebergen et al., 2005; Iyer et al., 2010; Best et al., 2012; Gallun and Diedesch, 2013; Carey et al., 2014; Kilman et al., 2014; Swaminathan et al., 2015; Kidd et al., 2016), and there are also indications for implicit processing of the semantic content of task-irrelevant speech, manifest through priming effects or memory intrusions (Tun et al., 2002; Dupoux et al., 2003; Rivenez et al., 2006; Beaman et al., 2007; Carey et al., 2014; Aydelott et al., 2015; Schepman et al., 2016). Known as the ‘Irrelevant Sound Effect’ (ISE), these are not always accompanied by explicit recall or recognition (Lewis, 1970; Bentin et al., 1995; Röer et al., 2017a), although in some cases task-irrelevant words, such as one’s own name, may also ‘break in consciousness’ (Cherry, 1953; Treisman, 1960; Wood and Cowan, 1995; Conway et al., 2001).

Behavioral findings indicating linguistic processing of task-irrelevant speech have been interpreted in two opposing ways. Proponents of Late-Selection attention theories understand them as reflecting the system’s capability to apply linguistic processing to more than one speech stream in parallel, albeit mostly pre-consciously (Deutsch and Deutsch, 1963; Parmentier, 2008; Parmentier et al., 2018; Vachon et al., 2020). However, others maintain an Early-Selection perspective, namely, that only one speech stream can be processed linguistically due to inherent processing bottlenecks, but that listeners may shift their attention between concurrent streams giving rise to occasional (conscious or pre-conscious) intrusions from task-irrelevant speech (Cooke, 2006; Vestergaard et al., 2011; Fogerty et al., 2018). Adjudicating between these two explanations experimentally is difficult, due to the largely indirect-nature of the operationalizations used to assess linguistic processing of task-irrelevant speech. Moreover, much of the empirical evidence fueling this debate focuses on detection of individual ‘task-irrelevant’ words, effects that can be easily explained either by parallel processing or by attention-shifts, due to their short duration.

In attempt to broaden this conversation, here we use objective neural measures to evaluate the level of processing applied to task-irrelevant speech. Using a previously established technique of hierarchical frequency-tagging (Ding et al., 2016; Makov et al., 2017), we are able to go beyond the question of detecting individual words and probe whether linguistic processes that require integration over longer periods of time – such as syntactic structure building – are applied to task-irrelevant speech. To study this, we recorded brain activity using Magnetoencephalography (MEG) during a dichotic listening selective-attention experiment. Participants were instructed to attend to narratives of natural speech presented to one ear, and to ignore speech input from the other ear (Figure 1). Task-irrelevant stimuli consisted of sequences of syllables, presented at a constant rate (4 Hz), with their order manipulated to either create linguistically Structured or Non-Structured sequences. Specifically, for the Non-Structured syllables were presented in a completely random order, whereas in the Structured stimuli syllables were ordered to form coherent words, phrases, and sentences. In keeping with the frequency-tagging approach, each of these linguistic levels is associated with a different frequency (words - 2 Hz, phrases - 1 Hz, sentences - 0.5 Hz). By structuring task-irrelevant speech in this way, the two conditions were perfectly controlled for low-level acoustic attributes that contribute to energetic masking (e.g. loudness, pitch, and fine-structure), as well as for the presence of recognizable acoustic-phonetic units, which proposedly contributes to phonetic interference during speech-on-speech masking (Rhebergen et al., 2005; Shinn-Cunningham, 2008; Kidd et al., 2016). Rather, the only difference between the conditions was in the order of the syllables which either did or did not form linguistic structures. Consequentially, if the neural signal shows peaks at frequencies associated with linguistic-features of Structured task-irrelevant speech, as has been reported previously when these type of stimuli are attended or presented without competition (Ding et al., 2016; Ding et al., 2018; Makov et al., 2017), this would provide evidence that integration-based processes operating on longer time-scales are applied to task-irrelevant speech, for identifying longer linguistic units comprised of several syllables. In addition, we also tested whether the neural encoding of the to-be-attended speech itself was affected by the linguistic structure of task-irrelevant speech, which could highlight the source of potential tradeoffs or competition for resources when presented with competing speech (Zion Golumbic et al., 2013b; O'Sullivan et al., 2015; Fiedler et al., 2019; Teoh and Lalor, 2019).

Figure 1 with 2 supplements see all

Download asset Open asset

Data from one participant was excluded from all analyses due to technical problems during MEG recording. Six additional participants were removed only from source estimation analysis due to technical issues. The full behavioral and neural data are available at: https://osf.io/e93qa.

Behavioral results

Behavioral results reflecting participants response accuracy on comprehension questions about narratives were significantly above chance (M = 0.715, SD = ± 0.15; t(28)=26.67, p<0.001). There were no significant differences in behavior as a function of whether task-irrelevant speech was Structured or Non-Structured (t(28)=−0.31, p=0.75; Figure 2). Additionally, to test for possible interactions between answering questions about the to-be-attended speech and linguistic neural representation of task-irrelevant speech, we performed a median-split analysis of the behavioral scores across participants. Specifically, we used the magnitude of the ITPC value at 1 Hz in the Structured condition (averaged across all sensors), in order to split the sample into two groups – with high and low 1 Hz responses. We performed a between-group t-test on the behavioral results in the Structured condition, and also on the difference between conditions (Structured – Non-Structured). Neither test showed significant differences in performance between participants whose 1 Hz ITPC was above vs. below the median (Structured condition: t(27) = −1.07, p=0.29; Structured – Non-Structured: t(27) = −1.04, p=0.15). Similar null-results were obtained when the median-split was based on the source-level data.

Figure 2

Download asset Open asset

Hierarchical frequency-tagged responses to task-irrelevant speech

Scalp-level spectra of the Inter-trial phase coherence (ITPC) showed a significant peak at the syllabic-rate (4 Hz) in response to both Structured and Non-Structured hierarchical frequency-tagged speech, with a four-pole scalp-distribution common to MEG recorded auditory responses (Figure 3a) (p<10^−9; large effect size, Cohen's d > 1.5 in both). As expected, there was no significant difference between Structured and Non-Structured condition in the 4 Hz response (p=0.899). Importantly, we also observed a significant peak at 1 Hz in the Structured condition (p<0.003; moderate effect size, Cohen's d = 0.6), but not in the Non-Structured condition (p=0.88). Comparison of the 1 Hz ITPC between these conditions also confirmed a significant difference between them (p=0.045; moderate effect size, Cohen's d = 0.57). The scalp-distribution of the 1 Hz peak did not conform to the typical auditory response topography, suggesting different neural generators. No other significant peaks were observed at any other frequencies, including the 2 Hz or 0.5 Hz word and sentence-level rates, nor did the responses at these rates differ significantly between conditions.

Figure 3

Download asset Open asset

In order to determine the neural source of the 1 Hz peak in the Structured condition, we repeated the spectral analysis in source-space. An inverse solution was applied to individual trials and the ITPC was calculated in each voxel. As shown in Figure 3b, the source-level ITPC spectra, averaged over each hemisphere separately, is qualitatively similar to that observed at the scalp-level. The only significant peaks were at 4 Hz in both conditions (p<10⁻⁸; large effect size, Cohen's d > 1.7 in both conditions and both hemispheres) and at 1 Hz in the Structured condition (left hemisphere p=0.052, Cohen's d = 0.43; right hemisphere p<0.007, Cohen's d = 0.6), but not in the Non-Structured condition. Statistical comparison of the 1 Hz peak between conditions revealed a significant difference between the Structured and Non-Structured condition over the left hemisphere (p=0.026, Cohen's d = 0.57), but not over the right hemisphere (p=0.278).

Figure 3c shows the source-level distribution within the left hemisphere of the difference in 1 Hz ITPC between the Structured and Non-Structured condition. The effect was observed primarily in frontal and parietal regions. Statistical testing evaluating the difference between conditions was performed in 22 pre-determined ROIs per hemisphere, using a permutation test. This indicated significant effects in several ROIs in the left hemisphere including the inferior-frontal cortex and superior parietal cortex, as well as the mid-cingulate and portions of the middle and superior occipital gyrus (cluster-corrected p=0.002). No ROIs survived multiple-comparison correction in the right hemisphere (cluster-corrected p=0.132), although some ROIs in the right cingulate were significant at an uncorrected level (p<0.05).

With regard to the 4 Hz peak, it was localized as expected to bilateral auditory cortex and did not differ significantly across conditions in either hemisphere (left hemisphere: p=0.155, right hemisphere: p=0.346). We therefore did not conduct a more fine-grained analysis of different ROIs. As in the scalp-level data, no peaks were observed at 2 Hz and no significant difference between conditions (left hemisphere: p=0.963, right hemisphere: p=0.755).

Speech tracking of to-be-attended speech

Speech tracking analysis of responses to the to-be-attended narrative yielded robust TRFs (scalp-level predictive power r = 0.1, p<0.01 vs. permutations). The TRF time-course featured two main peaks, one ~ 80 ms and the other ~140 ms, in line with previous TRF estimations (Akram et al., 2017; Fiedler et al., 2019; Brodbeck et al., 2020b). Both the scalp-level and source-level TRF analysis indicated that TRFs were predominantly auditory – showing the common four-pole distribution at the scalp-level (Figure 4a) and in the source-level analysis was localized primarily to auditory cortex (superior temporal gyrus and sulcus; STG/STS) as well as left insula/IFG (Figure 4b; 140 ms).

Figure 4

Download asset Open asset

When comparing the TRFs to the to-be-attended speech as a function of whether the competing task-irrelevant stimulus was Structured vs. Non-Structured, some interesting differences emerged. Spatial-temporal clustering permutation test on the scalp-level TRFs revealed significant differences between the conditions between 70–180 ms (p<0.05; cluster corrected), including both the early and late TRF peaks, at a large number of sensors primarily on the left (Figure 4a and c). Specifically, TRF responses to the to-be-attended speech were enhanced when the task-irrelevant stimulus was Structured vs. Non-Structured. The effect was observed at the scalp-level with opposite polarity in frontal vs. medial sensors, and was localized at the source-level to a single cluster in the left inferior-frontal cortex, that included portions of the insula and orbito-frontal cortex (Figure 4c; spatial-temporal clustering p=0.0058).

In this MEG study, frequency-tagged hierarchical speech was used to probe the degree to which linguistic processing is applied to task-irrelevant speech, and how this interacts with processing speech that is presumably in the focus of attention (‘to-be-attended’). As expected, we observe obligatory acoustic representation of task-irrelevant speech, regardless of whether it was Structured or Non-Structured, which manifest as a 4 Hz syllable-level response localized to bilateral auditory regions in the STG/STS. Critically, for Structured task-irrelevant speech, we also find evidence for neural tracking of the phrasal structure, with a 1 Hz peak localized primarily to left inferior-frontal cortex and left posterior-parietal cortex. The regions are not associated with low-level processing, but rather play an important role in speech processing and higher order executive functions (Dronkers et al., 2004; Humphries et al., 2006; Linden, 2007; Corbetta et al., 2008; Edin et al., 2009; Hahn et al., 2018). Additionally, we find that the speech-tracking response to the to-be-attended speech in left inferior frontal cortex was also affected by whether task-irrelevant speech was linguistically Structured or not. These results contribute to ongoing debates regarding the nature of the competition for processing resources during speech-on-speech masking, demonstrating that linguistic processes requiring integration of input over relatively long timescales can indeed be applied to task-irrelevant speech.

The Full MEG data and examples of the stimuli are now available on the Open Science Framework repository (https://osf.io/e93qa).

1. 1. Har-shai Yahav P
   2. Zion Golumbic E

   (2021) Open Science Framework

   ID e93qa. Linguistic processing of task-irrelevant speech at a Cocktail Party.

   https://osf.io/e93qa

1. 1. Akram S
   2. Simon JZ
   3. Babadi B

   (2017) Dynamic estimation of the auditory temporal response function from MEG in Competing-Speaker environments

   IEEE Transactions on Biomedical Engineering 64:1896–1905.

   https://doi.org/10.1109/TBME.2016.2628884

   • Google Scholar
2. 1. Ambler BA
   2. Fisicaro SA
   3. Proctor RW

   (1976) Temporal characteristics of primary-secondary message interference in a dichotic listening task

   Memory & Cognition 4:709–716.

   https://doi.org/10.3758/BF03213238

   • Google Scholar
3. 1. Aydelott J
   2. Jamaluddin Z
   3. Nixon Pearce S

   (2015) Semantic processing of unattended speech in dichotic listening

   The Journal of the Acoustical Society of America 138:964–975.

   https://doi.org/10.1121/1.4927410

   • PubMed
   • Google Scholar
4. 1. Beaman CP

   (2004) The irrelevant sound phenomenon revisited: what role for working memory capacity?

   Journal of Experimental Psychology: Learning, Memory, and Cognition 30:1106–1118.

   https://doi.org/10.1037/0278-7393.30.5.1106

   • PubMed
   • Google Scholar
5. 1. Beaman CP
   2. Bridges AM
   3. Scott SK

   (2007) From dichotic listening to the irrelevant sound effect: a behavioural and neuroimaging analysis of the processing of unattended speech

   Cortex 43:124–134.

   https://doi.org/10.1016/S0010-9452(08)70450-7

   • PubMed
   • Google Scholar
6. 1. Bentin S
   2. Kutas M
   3. Hillyard SA

   (1995) Semantic processing and memory for attended and unattended words in dichotic listening: behavioral and electrophysiological evidence

   Journal of Experimental Psychology: Human Perception and Performance 21:54–67.

   https://doi.org/10.1037/0096-1523.21.1.54

   • Google Scholar
7. 1. Berens P

   (2009) CircStat : a MATLAB toolbox for circular statistics

   Journal of Statistical Software 31:1–21.

   https://doi.org/10.18637/jss.v031.i10

   • Google Scholar
8. 1. Best V
   2. Marrone N
   3. Mason CR
   4. Kidd G

   (2012) The influence of non-spatial factors on measures of spatial release from masking

   The Journal of the Acoustical Society of America 131:3103–3110.

   https://doi.org/10.1121/1.3693656

   • PubMed
   • Google Scholar
9. 1. Blank IA
   2. Fedorenko E

   (2020) No evidence for differences among language regions in their temporal receptive windows

   NeuroImage 219:116925.

   https://doi.org/10.1016/j.neuroimage.2020.116925

   • PubMed
   • Google Scholar
10. Software

    1. Boersma P

    (2011) Praat : Doing Phonetics by Computer [Computer Program]

    Praat : Doing Phonetics by Computer [Computer Program].

    http://www.praat.org/
11. Book

    1. Broadbent DE

    (1958)

    Perception and Communication

    London: Pergamon Press.

    • Google Scholar
12. 1. Brodbeck C
    2. Hong LE
    3. Simon JZ

    (2018a) Rapid transformation from auditory to linguistic representations of continuous speech

    Current Biology 28:3976–3983.

    https://doi.org/10.1016/j.cub.2018.10.042

    • PubMed
    • Google Scholar
13. 1. Brodbeck C
    2. Presacco A
    3. Simon JZ

    (2018b) Neural source dynamics of brain responses to continuous stimuli: speech processing from acoustics to comprehension

    NeuroImage 172:162–174.

    https://doi.org/10.1016/j.neuroimage.2018.01.042

    • Google Scholar
14. Preprint

    1. Brodbeck C
    2. Jiao A
    3. Hong LE
    4. Simon JZ

    (2020a) Dynamic processing of background speech 1 at the cocktail party: evidence for early 2 active cortical stream segregation

    bioRxiv.

    https://doi.org/10.1101/866749

    • Google Scholar
15. 1. Brodbeck C
    2. Jiao A
    3. Hong LE
    4. Simon JZ

    (2020b) Neural speech restoration at the cocktail party: auditory cortex recovers masked speech of both attended and ignored speakers

    PLOS Biology 18:e3000883.

    https://doi.org/10.1371/journal.pbio.3000883

    • PubMed
    • Google Scholar
16. 1. Broderick MP
    2. Anderson AJ
    3. Di Liberto GM
    4. Crosse MJ
    5. Lalor EC

    (2018) Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech

    Current Biology 28:803–809.

    https://doi.org/10.1016/j.cub.2018.01.080

    • Google Scholar
17. 1. Broderick MP
    2. Anderson AJ
    3. Lalor EC

    (2019) Semantic context enhances the early auditory encoding of natural speech

    The Journal of Neuroscience 39:7564–7575.

    https://doi.org/10.1523/JNEUROSCI.0584-19.2019

    • Google Scholar
18. 1. Bronkhorst AW

    (2015) The cocktail-party problem revisited: early processing and selection of multi-talker speech

    Attention, Perception, & Psychophysics 77:1465–1487.

    https://doi.org/10.3758/s13414-015-0882-9

    • Google Scholar
19. 1. Brouwer S
    2. Van Engen KJ
    3. Calandruccio L
    4. Bradlow AR

    (2012) Linguistic contributions to speech-on-speech masking for native and non-native listeners: language familiarity and semantic content

    The Journal of the Acoustical Society of America 131:1449–1464.

    https://doi.org/10.1121/1.3675943

    • PubMed
    • Google Scholar
20. 1. Brungart DS
    2. Simpson BD
    3. Ericson MA
    4. Scott KR

    (2001) Informational and energetic masking effects in the perception of multiple simultaneous talkers

    The Journal of the Acoustical Society of America 110:2527–2538.

    https://doi.org/10.1121/1.1408946

    • PubMed
    • Google Scholar
21. 1. Bryden MP

    (1964) The manipulation of strategies of report in dichotic listening

    Canadian Journal of Psychology/Revue Canadienne De Psychologie 18:126–138.

    https://doi.org/10.1037/h0083290

    • PubMed
    • Google Scholar
22. 1. Buiatti M
    2. Peña M
    3. Dehaene-Lambertz G

    (2009) Investigating the neural correlates of continuous speech computation with frequency-tagged neuroelectric responses

    NeuroImage 44:509–519.

    https://doi.org/10.1016/j.neuroimage.2008.09.015

    • Google Scholar
23. 1. Calandruccio L
    2. Dhar S
    3. Bradlow AR

    (2010) Speech-on-speech masking with variable access to the linguistic content of the Masker speech

    The Journal of the Acoustical Society of America 128:860–869.

    https://doi.org/10.1121/1.3458857

    • PubMed
    • Google Scholar
24. 1. Carey D
    2. Mercure E
    3. Pizzioli F
    4. Aydelott J

    (2014) Auditory semantic processing in dichotic listening: effects of competing speech, ear of presentation, and sentential Bias on N400s to spoken words in context

    Neuropsychologia 65:102–112.

    https://doi.org/10.1016/j.neuropsychologia.2014.10.016

    • PubMed
    • Google Scholar
25. 1. Carlyon RP
    2. Cusack R
    3. Foxton JM
    4. Robertson IH

    (2001) Effects of attention and unilateral neglect on auditory stream segregation

    Journal of Experimental Psychology: Human Perception and Performance 27:115–127.

    https://doi.org/10.1037/0096-1523.27.1.115

    • PubMed
    • Google Scholar
26. 1. Carlyon RP

    (2004) How the brain separates sounds

    Trends in Cognitive Sciences 8:465–471.

    https://doi.org/10.1016/j.tics.2004.08.008

    • PubMed
    • Google Scholar
27. 1. Cherry EC

    (1953) Some experiments on the recognition of speech, with one and with two ears

    The Journal of the Acoustical Society of America 25:975–979.

    https://doi.org/10.1121/1.1907229

    • Google Scholar
28. 1. Conway AR
    2. Cowan N
    3. Bunting MF

    (2001) The cocktail party phenomenon revisited: the importance of working memory capacity

    Psychonomic Bulletin & Review 8:331–335.

    https://doi.org/10.3758/BF03196169

    • PubMed
    • Google Scholar
29. 1. Cooke M

    (2006) A glimpsing model of speech perception in noise

    The Journal of the Acoustical Society of America 119:1562–1573.

    https://doi.org/10.1121/1.2166600

    • PubMed
    • Google Scholar
30. 1. Cooke M
    2. Garcia Lecumberri ML
    3. Barker J

    (2008) The foreign language cocktail party problem: energetic and informational masking effects in non-native speech perception

    The Journal of the Acoustical Society of America 123:414–427.

    https://doi.org/10.1121/1.2804952

    • PubMed
    • Google Scholar
31. 1. Corbetta M
    2. Patel G
    3. Shulman GL

    (2008) The reorienting system of the human brain: from environment to theory of mind

    Neuron 58:306–324.

    https://doi.org/10.1016/j.neuron.2008.04.017

    • PubMed
    • Google Scholar
32. 1. Cowan N
    2. Elliott EM
    3. Scott Saults J
    4. Morey CC
    5. Mattox S
    6. Hismjatullina A
    7. Conway AR

    (2005) On the capacity of attention: its estimation and its role in working memory and cognitive aptitudes

    Cognitive Psychology 51:42–100.

    https://doi.org/10.1016/j.cogpsych.2004.12.001

    • PubMed
    • Google Scholar
33. 1. Dale AM
    2. Liu AK
    3. Fischl BR
    4. Buckner RL
    5. Belliveau JW
    6. Lewine JD
    7. Halgren E

    (2000) Dynamic statistical parametric mapping: combining fMRI and MEG for high-resolution imaging of cortical activity

    Neuron 26:55–67.

    https://doi.org/10.1016/s0896-6273(00)81138-1

    • PubMed
    • Google Scholar
34. 1. David SV
    2. Mesgarani N
    3. Shamma SA

    (2007) Estimating sparse spectro-temporal receptive fields with natural stimuli

    Network: Computation in Neural Systems 18:191–212.

    https://doi.org/10.1080/09548980701609235

    • Google Scholar
35. 1. Davis MH
    2. Ford MA
    3. Kherif F
    4. Johnsrude IS

    (2011) Does semantic context benefit speech understanding through "top-down" processes? Evidence from time-resolved sparse fMRI

    Journal of Cognitive Neuroscience 23:3914–3932.

    https://doi.org/10.1162/jocn_a_00084

    • PubMed
    • Google Scholar
36. 1. Davis MH
    2. Johnsrude IS

    (2003) Hierarchical processing in spoken language comprehension

    The Journal of Neuroscience 23:3423–3431.

    https://doi.org/10.1523/JNEUROSCI.23-08-03423.2003

    • PubMed
    • Google Scholar
37. 1. Deutsch JA
    2. Deutsch D

    (1963) Attention: some theoretical considerations

    Psychological Review 70:80–90.

    https://doi.org/10.1037/h0039515

    • Google Scholar
38. 1. Ding N
    2. Melloni L
    3. Zhang H
    4. Tian X
    5. Poeppel D

    (2016) Cortical tracking of hierarchical linguistic structures in connected speech

    Nature Neuroscience 19:158–164.

    https://doi.org/10.1038/nn.4186

    • PubMed
    • Google Scholar
39. 1. Ding N
    2. Pan X
    3. Luo C
    4. Su N
    5. Zhang W
    6. Zhang J

    (2018) Attention is required for Knowledge-Based sequential grouping: insights from the integration of syllables into words

    The Journal of Neuroscience 38:1178–1188.

    https://doi.org/10.1523/JNEUROSCI.2606-17.2017

    • PubMed
    • Google Scholar
40. 1. Ding N
    2. Simon JZ

    (2012) Emergence of neural encoding of auditory objects while listening to competing speakers

    PNAS 109:11854–11859.

    https://doi.org/10.1073/pnas.1205381109

    • PubMed
    • Google Scholar
41. 1. Ding N
    2. Simon JZ

    (2014) Cortical entrainment to continuous speech: functional roles and interpretations

    Frontiers in Human Neuroscience 8:311.

    https://doi.org/10.3389/fnhum.2014.00311

    • PubMed
    • Google Scholar
42. 1. Donhauser PW
    2. Baillet S

    (2020) Two distinct neural timescales for predictive speech processing

    Neuron 105:385–393.

    https://doi.org/10.1016/j.neuron.2019.10.019

    • PubMed
    • Google Scholar
43. 1. Driver J

    (2001) A selective review of selective attention research from the past century

    British Journal of Psychology 92:53–78.

    https://doi.org/10.1348/000712601162103

    • Google Scholar
44. 1. Dronkers NF
    2. Wilkins DP
    3. Van Valin RD
    4. Redfern BB
    5. Jaeger JJ

    (2004) Lesion analysis of the brain Areas involved in language comprehension

    Cognition 92:145–177.

    https://doi.org/10.1016/j.cognition.2003.11.002

    • PubMed
    • Google Scholar
45. 1. Drullman R
    2. Bronkhorst AW

    (2004) Speech perception and talker segregation: effects of level, pitch, and tactile support with multiple simultaneous talkers

    The Journal of the Acoustical Society of America 116:3090–3098.

    https://doi.org/10.1121/1.1802535

    • PubMed
    • Google Scholar
46. 1. Dupoux E
    2. Kouider S
    3. Mehler J

    (2003) Lexical access without attention? explorations using dichotic priming

    Journal of Experimental Psychology: Human Perception and Performance 29:172–184.

    https://doi.org/10.1037/0096-1523.29.1.172

    • PubMed
    • Google Scholar
47. 1. Durlach NI
    2. Mason CR
    3. Shinn-Cunningham BG
    4. Arbogast TL
    5. Colburn HS
    6. Kidd G

    (2003) Informational masking: counteracting the effects of stimulus uncertainty by decreasing target-masker similarity

    The Journal of the Acoustical Society of America 114:368–379.

    https://doi.org/10.1121/1.1577562

    • PubMed
    • Google Scholar
48. 1. Edin F
    2. Klingberg T
    3. Johansson P
    4. McNab F
    5. Tegnér J
    6. Compte A

    (2009) Mechanism for top-down control of working memory capacity

    PNAS 106:6802–6807.

    https://doi.org/10.1073/pnas.0901894106

    • PubMed
    • Google Scholar
49. 1. Elliott EM
    2. Briganti AM

    (2012) Investigating the role of attentional resources in the irrelevant speech effect

    Acta Psychologica 140:64–74.

    https://doi.org/10.1016/j.actpsy.2012.02.009

    • Google Scholar
50. 1. Fairnie J
    2. Moore BC
    3. Remington A

    (2016) Missing a trick: auditory load modulates conscious awareness in audition

    Journal of Experimental Psychology: Human Perception and Performance 42:930–938.

    https://doi.org/10.1037/xhp0000204

    • PubMed
    • Google Scholar
51. 1. Fedorenko E
    2. Scott TL
    3. Brunner P
    4. Coon WG
    5. Pritchett B
    6. Schalk G
    7. Kanwisher N

    (2016) Neural correlate of the construction of sentence meaning

    PNAS 113:E6256–E6262.

    https://doi.org/10.1073/pnas.1612132113

    • PubMed
    • Google Scholar
52. 1. Fedorenko E
    2. Blank IA

    (2020) Broca's Area Is Not a Natural Kind

    Trends in Cognitive Sciences 24:270–284.

    https://doi.org/10.1016/j.tics.2020.01.001

    • PubMed
    • Google Scholar
53. 1. Fiedler L
    2. Wöstmann M
    3. Herbst SK
    4. Obleser J

    (2019) Late cortical tracking of ignored speech facilitates neural selectivity in acoustically challenging conditions

    NeuroImage 186:33–42.

    https://doi.org/10.1016/j.neuroimage.2018.10.057

    • PubMed
    • Google Scholar
54. 1. Fischl B
    2. Sereno MI
    3. Tootell RBH
    4. Dale AM

    (1999) High-resolution intersubject averaging and a coordinate system for the cortical surface

    Human Brain Mapping 8:272–284.

    https://doi.org/10.1002/(SICI)1097-0193(1999)8:4<272::AID-HBM10>3.0.CO;2-4

    • Google Scholar
55. 1. Fogerty D
    2. Carter BL
    3. Healy EW

    (2018) Glimpsing speech in temporally and spectro-temporally modulated noise

    The Journal of the Acoustical Society of America 143:3047–3057.

    https://doi.org/10.1121/1.5038266

    • PubMed
    • Google Scholar
56. 1. Forster S
    2. Lavie N

    (2008) Failures to ignore entirely irrelevant distractors: the role of load

    Journal of Experimental Psychology: Applied 14:73–83.

    https://doi.org/10.1037/1076-898X.14.1.73

    • PubMed
    • Google Scholar
57. 1. Francart T
    2. van Wieringen A
    3. Wouters J

    (2011) Comparison of fluctuating maskers for speech recognition tests

    International Journal of Audiology 50:2–13.

    https://doi.org/10.3109/14992027.2010.505582

    • PubMed
    • Google Scholar
58. 1. Freyman RL
    2. Balakrishnan U
    3. Helfer KS

    (2001) Spatial release from informational masking in speech recognition

    The Journal of the Acoustical Society of America 109:2112–2122.

    https://doi.org/10.1121/1.1354984

    • PubMed
    • Google Scholar
59. 1. Friederici AD
    2. Kotz SA

    (2003) The brain basis of syntactic processes: functional imaging and lesion studies

    NeuroImage 20 Suppl 1:S8–S17.

    https://doi.org/10.1016/j.neuroimage.2003.09.003

    • PubMed
    • Google Scholar
60. 1. Gagné J-P
    2. Besser J
    3. Lemke U

    (2017) Behavioral assessment of listening effort using a Dual-Task paradigm

    Trends in Hearing 21:233121651668728.

    https://doi.org/10.1177/2331216516687287

    • Google Scholar
61. Conference

    1. Gallun FJ
    2. Diedesch AC

    (2013) Exploring the factors predictive of informational masking in a speech recognition task

    Proceedings of Meetings on Acoustics. Acoustical Society of America ASA.

    https://doi.org/10.1121/1.4799107

    • Google Scholar
62. 1. Gazzaley A
    2. Nobre AC

    (2012) Top-down modulation: bridging selective attention and working memory

    Trends in Cognitive Sciences 16:129–135.

    https://doi.org/10.1016/j.tics.2011.11.014

    • PubMed
    • Google Scholar
63. 1. Getz H
    2. Ding N
    3. Newport EL
    4. Poeppel D

    (2018) Cortical tracking of constituent structure in language acquisition

    Cognition 181:135–140.

    https://doi.org/10.1016/j.cognition.2018.08.019

    • PubMed
    • Google Scholar
64. 1. Glasser MF
    2. Coalson TS
    3. Robinson EC
    4. Hacker CD
    5. Harwell J
    6. Yacoub E
    7. Ugurbil K
    8. Andersson J
    9. Beckmann CF
    10. Jenkinson M
    11. Smith SM
    12. Van Essen DC

    (2016) A multi-modal parcellation of human cerebral cortex

    Nature 536:171–178.

    https://doi.org/10.1038/nature18933

    • PubMed
    • Google Scholar
65. 1. Glucksberg S

    (1970) Memory for nonattended auditory material*1

    Cognitive Psychology 1:149–156.

    https://doi.org/10.1016/0010-0285(70)90010-1

    • Google Scholar
66. 1. Gramfort A
    2. Luessi M
    3. Larson E
    4. Engemann DA
    5. Strohmeier D
    6. Brodbeck C
    7. Goj R
    8. Jas M
    9. Brooks T
    10. Parkkonen L
    11. Hämäläinen M

    (2013) MEG and EEG data analysis with MNE-Python

    Frontiers in Neuroscience 7:267.

    https://doi.org/10.3389/fnins.2013.00267

    • PubMed
    • Google Scholar
67. 1. Gramfort A
    2. Luessi M
    3. Larson E
    4. Engemann DA
    5. Strohmeier D
    6. Brodbeck C
    7. Parkkonen L
    8. Hämäläinen MS

    (2014) MNE software for processing MEG and EEG data

    NeuroImage 86:446–460.

    https://doi.org/10.1016/j.neuroimage.2013.10.027

    • PubMed
    • Google Scholar
68. 1. Hagoort P

    (2003) How the brain solves the binding problem for language: a neurocomputational model of syntactic processing

    NeuroImage 20 Suppl 1:S18–S29.

    https://doi.org/10.1016/j.neuroimage.2003.09.013

    • PubMed
    • Google Scholar
69. 1. Hahn B
    2. Robinson BM
    3. Leonard CJ
    4. Luck SJ
    5. Gold JM

    (2018) Posterior parietal cortex dysfunction is central to working memory storage and broad cognitive deficits in schizophrenia

    The Journal of Neuroscience 38:8378–8387.

    https://doi.org/10.1523/JNEUROSCI.0913-18.2018

    • PubMed
    • Google Scholar
70. 1. Hervais-Adelman AG
    2. Carlyon RP
    3. Johnsrude IS
    4. Davis MH

    (2012) Brain regions recruited for the effortful comprehension of noise-vocoded words

    Language and Cognitive Processes 27:1145–1166.

    https://doi.org/10.1080/01690965.2012.662280

    • Google Scholar
71. 1. Hickok G
    2. Poeppel D

    (2007) The cortical organization of speech processing

    Nature Reviews Neuroscience 8:393–402.

    https://doi.org/10.1038/nrn2113

    • PubMed
    • Google Scholar
72. 1. Hill KT
    2. Miller LM

    (2010) Auditory attentional control and selection during cocktail party listening

    Cerebral Cortex 20:583–590.

    https://doi.org/10.1093/cercor/bhp124

    • PubMed
    • Google Scholar
73. 1. Hohlfeld A
    2. Sommer W

    (2005) Semantic processing of unattended meaning is modulated by additional task load: evidence from electrophysiology

    Cognitive Brain Research 24:500–512.

    https://doi.org/10.1016/j.cogbrainres.2005.03.001

    • Google Scholar
74. 1. Horton C
    2. D'Zmura M
    3. Srinivasan R

    (2013) Suppression of competing speech through entrainment of cortical oscillations

    Journal of Neurophysiology 109:3082–3093.

    https://doi.org/10.1152/jn.01026.2012

    • PubMed
    • Google Scholar
75. 1. Humphries C
    2. Binder JR
    3. Medler DA
    4. Liebenthal E

    (2006) Syntactic and semantic modulation of neural activity during auditory sentence comprehension

    Journal of Cognitive Neuroscience 18:665–679.

    https://doi.org/10.1162/jocn.2006.18.4.665

    • PubMed
    • Google Scholar
76. 1. Iyer N
    2. Brungart DS
    3. Simpson BD

    (2010) Effects of target-masker contextual similarity on the multimasker penalty in a three-talker diotic listening task

    The Journal of the Acoustical Society of America 128:2998–3010.

    https://doi.org/10.1121/1.3479547

    • PubMed
    • Google Scholar
77. Book

    1. Kahneman D

    (1973)

    Attention and Effort

    Prentice-Hall.

    • Google Scholar
78. Book

    1. Kidd G
    2. Mason CR
    3. Richards VM
    4. Gallun FJ
    5. Durlach NI

    (2008) Informational Masking

    Springer.

    https://doi.org/10.1007/978-0-387-71305-2_6

    • Google Scholar
79. 1. Kidd G
    2. Mason CR
    3. Swaminathan J
    4. Roverud E
    5. Clayton KK
    6. Best V

    (2016) Determining the energetic and informational components of speech-on-speech masking

    The Journal of the Acoustical Society of America 140:132–144.

    https://doi.org/10.1121/1.4954748

    • PubMed
    • Google Scholar
80. 1. Kilman L
    2. Zekveld A
    3. Hällgren M
    4. Rönnberg J

    (2014) The influence of non-native language proficiency on speech perception performance

    Frontiers in Psychology 5:651.

    https://doi.org/10.3389/fpsyg.2014.00651

    • PubMed
    • Google Scholar
81. 1. Lachter J
    2. Forster KI
    3. Ruthruff E

    (2004) Forty-five years after Broadbent (1958): still no identification without attention

    Psychological Review 111:880–913.

    https://doi.org/10.1037/0033-295X.111.4.880

    • PubMed
    • Google Scholar
82. Preprint

    1. Lambez B
    2. Agmon G
    3. Har-Shai Yahav P
    4. Rassovsky Y
    5. Zion Golumbic E

    (2020) Paying attention to speech: the role of working memory capacity and professional experience. attention

    bioRxiv.

    https://doi.org/10.1101/655274

    • Google Scholar
83. 1. Lavie N
    2. Hirst A
    3. de Fockert JW
    4. Viding E

    (2004) Load theory of selective attention and cognitive control

    Journal of Experimental Psychology: General 133:339–354.

    https://doi.org/10.1037/0096-3445.133.3.339

    • PubMed
    • Google Scholar
84. 1. Lavie N
    2. Beck DM
    3. Konstantinou N

    (2014) Blinded by the load: attention, awareness and the role of perceptual load

    Philosophical Transactions of the Royal Society B: Biological Sciences 369:20130205.

    https://doi.org/10.1098/rstb.2013.0205

    • PubMed
    • Google Scholar
85. 1. Lewis JL

    (1970) Semantic processing of unattended messages using dichotic listening

    Journal of Experimental Psychology 85:225–228.

    https://doi.org/10.1037/h0029518

    • PubMed
    • Google Scholar
86. 1. Linden DE

    (2007) The working memory networks of the human brain

    The Neuroscientist 13:257–267.

    https://doi.org/10.1177/1073858406298480

    • PubMed
    • Google Scholar
87. Preprint

    1. Luo C
    2. Ding N

    (2020) Delta-band cortical tracking of acoustic and linguistic features in natural spoken narratives

    bioRxiv.

    https://doi.org/10.1101/2020.07.31.231431

    • Google Scholar
88. 1. Ma L
    2. Steinberg JL
    3. Hasan KM
    4. Narayana PA
    5. Kramer LA
    6. Moeller FG

    (2012) Working memory load modulation of parieto-frontal connections: evidence from dynamic causal modeling

    Human Brain Mapping 33:1850–1867.

    https://doi.org/10.1002/hbm.21329

    • PubMed
    • Google Scholar
89. 1. Makov S
    2. Sharon O
    3. Ding N
    4. Ben-Shachar M
    5. Nir Y
    6. Zion Golumbic E

    (2017) Sleep disrupts High-Level speech parsing despite significant basic auditory processing

    The Journal of Neuroscience 37:7772–7781.

    https://doi.org/10.1523/JNEUROSCI.0168-17.2017

    • PubMed
    • Google Scholar
90. 1. Makov S
    2. Zion Golumbic E

    (2020) Irrelevant predictions: distractor rhythmicity modulates neural encoding in auditory cortex

    Cerebral Cortex 30:5792–5805.

    https://doi.org/10.1093/cercor/bhaa153

    • PubMed
    • Google Scholar
91. 1. Marrone N
    2. Mason CR
    3. Kidd G

    (2008) Tuning in the spatial dimension: evidence from a masked speech identification task

    The Journal of the Acoustical Society of America 124:1146–1158.

    https://doi.org/10.1121/1.2945710

    • PubMed
    • Google Scholar
92. 1. Matchin W
    2. Hammerly C
    3. Lau E

    (2017) The role of the IFG and pSTS in syntactic prediction: evidence from a parametric study of hierarchical structure in fMRI

    Cortex 88:106–123.

    https://doi.org/10.1016/j.cortex.2016.12.010

    • PubMed
    • Google Scholar
93. 1. Mattys SL
    2. Davis MH
    3. Bradlow AR
    4. Scott SK

    (2012) Speech recognition in adverse conditions: a review

    Language and Cognitive Processes 27:953–978.

    https://doi.org/10.1080/01690965.2012.705006

    • Google Scholar
94. 1. Matusz PJ
    2. Dikker S
    3. Huth AG
    4. Perrodin C

    (2019) Are we ready for Real-world neuroscience?

    Journal of Cognitive Neuroscience 31:327–338.

    https://doi.org/10.1162/jocn_e_01276

    • PubMed
    • Google Scholar
95. 1. McNab F
    2. Klingberg T

    (2008) Prefrontal cortex and basal ganglia control access to working memory

    Nature Neuroscience 11:103–107.

    https://doi.org/10.1038/nn2024

    • Google Scholar
96. 1. Mesgarani N
    2. Chang EF

    (2012) Selective cortical representation of attended speaker in multi-talker speech perception

    Nature 485:233–236.

    https://doi.org/10.1038/nature11020

    • PubMed
    • Google Scholar
97. 1. Meyer L
    2. Cunitz K
    3. Obleser J
    4. Friederici AD

    (2014) Sentence processing and verbal working memory in a white-matter-disconnection patient

    Neuropsychologia 61:190–196.

    https://doi.org/10.1016/j.neuropsychologia.2014.06.014

    • PubMed
    • Google Scholar
98. 1. Meyer L
    2. Grigutsch M
    3. Schmuck N
    4. Gaston P
    5. Friederici AD

    (2015) Frontal-posterior theta oscillations reflect memory retrieval during sentence comprehension

    Cortex 71:205–218.

    https://doi.org/10.1016/j.cortex.2015.06.027

    • PubMed
    • Google Scholar
99. 1. Miller KJ
    2. Sorensen LB
    3. Ojemann JG
    4. den Nijs M

    (2009) Power-Law scaling in the brain surface electric potential

    PLOS Computational Biology 5:1000609.

    https://doi.org/10.1371/journal.pcbi.1000609

    • Google Scholar
100. 1. Moray N

     (1959) Attention in dichotic listening: affective cues and the influence of instructions

     Quarterly Journal of Experimental Psychology 11:56–60.

     https://doi.org/10.1080/17470215908416289

     • Google Scholar
101. 1. Morgan EU
     2. van der Meer A
     3. Vulchanova M
     4. Blasi DE
     5. Baggio G

     (2020) Meaning before grammar: a review of ERP experiments on the neurodevelopmental origins of semantic processing

     Psychonomic Bulletin & Review 27:441–464.

     https://doi.org/10.3758/s13423-019-01677-8

     • PubMed
     • Google Scholar
102. 1. Müller JA
     2. Wendt D
     3. Kollmeier B
     4. Debener S
     5. Brand T

     (2019) Effect of speech rate on neural tracking of speech

     Frontiers in Psychology 10:449.

     https://doi.org/10.3389/fpsyg.2019.00449

     • PubMed
     • Google Scholar
103. 1. Murphy S
     2. Spence C
     3. Dalton P

     (2017) Auditory perceptual load: a review

     Hearing Research 352:40–48.

     https://doi.org/10.1016/j.heares.2017.02.005

     • Google Scholar
104. 1. Naveh-Benjamin M
     2. Kilb A
     3. Maddox GB
     4. Thomas J
     5. Fine HC
     6. Chen T
     7. Cowan N

     (2014) Older adults do not notice their names: a new twist to a classic attention task

     Journal of Experimental Psychology: Learning, Memory, and Cognition 40:1540–1550.

     https://doi.org/10.1037/xlm0000020

     • PubMed
     • Google Scholar
105. 1. Neely CB
     2. LeCompte DC

     (1999) The importance of semantic similarity to the irrelevant speech effect

     Memory & Cognition 27:37–44.

     https://doi.org/10.3758/BF03201211

     • Google Scholar
106. 1. Nelson MJ
     2. El Karoui I
     3. Giber K
     4. Yang X
     5. Cohen L
     6. Koopman H
     7. Cash SS
     8. Naccache L
     9. Hale JT
     10. Pallier C
     11. Dehaene S

     (2017) Neurophysiological dynamics of phrase-structure building during sentence processing

     PNAS 114:E3669–E3678.

     https://doi.org/10.1073/pnas.1701590114

     • PubMed
     • Google Scholar
107. 1. Nourski KV
     2. Reale RA
     3. Oya H
     4. Kawasaki H
     5. Kovach CK
     6. Chen H
     7. Howard MA
     8. Brugge JF

     (2009) Temporal envelope of time-compressed speech represented in the human auditory cortex

     Journal of Neuroscience 29:15564–15574.

     https://doi.org/10.1523/JNEUROSCI.3065-09.2009

     • PubMed
     • Google Scholar
108. 1. Nozaradan S
     2. Schönwiesner M
     3. Keller PE
     4. Lenc T
     5. Lehmann A

     (2018) Neural bases of rhythmic entrainment in humans: critical transformation between cortical and lower-level representations of auditory rhythm

     European Journal of Neuroscience 47:321–332.

     https://doi.org/10.1111/ejn.13826

     • PubMed
     • Google Scholar
109. 1. O'Sullivan JA
     2. Power AJ
     3. Mesgarani N
     4. Rajaram S
     5. Foxe JJ
     6. Shinn-Cunningham BG
     7. Slaney M
     8. Shamma SA
     9. Lalor EC

     (2015) Attentional selection in a cocktail party environment can be decoded from Single-Trial EEG

     Cerebral Cortex 25:1697–1706.

     https://doi.org/10.1093/cercor/bht355

     • PubMed
     • Google Scholar
110. 1. Obleser J
     2. Kotz SA

     (2010) Expectancy constraints in degraded speech modulate the language comprehension network

     Cerebral Cortex 20:633–640.

     https://doi.org/10.1093/cercor/bhp128

     • PubMed
     • Google Scholar
111. 1. Olguin A
     2. Bekinschtein TA
     3. Bozic M

     (2018) Neural encoding of attended continuous speech under different types of interference

     Journal of Cognitive Neuroscience 30:1606–1619.

     https://doi.org/10.1162/jocn_a_01303

     • PubMed
     • Google Scholar
112. 1. Østby Y
     2. Tamnes CK
     3. Fjell AM
     4. Walhovd KB

     (2011) Morphometry and connectivity of the fronto-parietal verbal working memory network in development

     Neuropsychologia 49:3854–3862.

     https://doi.org/10.1016/j.neuropsychologia.2011.10.001

     • PubMed
     • Google Scholar
113. 1. Oswald CJ
     2. Tremblay S
     3. Jones DM

     (2000) Disruption of comprehension by the meaning of irrelevant sound

     Memory 8:345–350.

     https://doi.org/10.1080/09658210050117762

     • PubMed
     • Google Scholar
114. 1. Parmentier FB

     (2008) Towards a cognitive model of distraction by auditory novelty: the role of involuntary attention capture and semantic processing

     Cognition 109:345–362.

     https://doi.org/10.1016/j.cognition.2008.09.005

     • PubMed
     • Google Scholar
115. 1. Parmentier FBR
     2. Pacheco-Unguetti AP
     3. Valero S

     (2018) Food words distract the hungry: evidence of involuntary semantic processing of task-irrelevant but biologically-relevant unexpected auditory words

     PLOS ONE 13:e0190644.

     https://doi.org/10.1371/journal.pone.0190644

     • PubMed
     • Google Scholar
116. 1. Peelle JE

     (2018) Listening effort: how the cognitive consequences of acoustic challenge are reflected in brain and behavior

     Ear & Hearing 39:204–214.

     https://doi.org/10.1097/AUD.0000000000000494

     • Google Scholar
117. 1. Postle BR
     2. Ferrarelli F
     3. Hamidi M
     4. Feredoes E
     5. Massimini M
     6. Peterson M
     7. Alexander A
     8. Tononi G

     (2006) Repetitive transcranial magnetic stimulation dissociates working memory manipulation from retention functions in the prefrontal, but not posterior parietal, cortex

     Journal of Cognitive Neuroscience 18:1712–1722.

     https://doi.org/10.1162/jocn.2006.18.10.1712

     • PubMed
     • Google Scholar
118. 1. Pritchard WS

     (1992) The brain in fractal time: 1/f-like power spectrum scaling of the human electroencephalogram

     International Journal of Neuroscience 66:119–129.

     https://doi.org/10.3109/00207459208999796

     • PubMed
     • Google Scholar
119. 1. Pulvermüller F
     2. Shtyrov Y
     3. Hasting AS
     4. Carlyon RP

     (2008) Syntax as a reflex: neurophysiological evidence for early automaticity of grammatical processing

     Brain and Language 104:244–253.

     https://doi.org/10.1016/j.bandl.2007.05.002

     • PubMed
     • Google Scholar
120. 1. Puvvada KC
     2. Simon JZ

     (2017) Cortical representations of speech in a multitalker auditory scene

     The Journal of Neuroscience 37:9189–9196.

     https://doi.org/10.1523/JNEUROSCI.0938-17.2017

     • PubMed
     • Google Scholar
121. 1. Pylkkänen L

     (2019) The neural basis of combinatory syntax and semantics

     Science 366:62–66.

     https://doi.org/10.1126/science.aax0050

     • PubMed
     • Google Scholar
122. 1. Rämä P
     2. Relander-Syrjänen K
     3. Carlson S
     4. Salonen O
     5. Kujala T

     (2012) Attention and semantic processing during speech: an fMRI study

     Brain and Language 122:114–119.

     https://doi.org/10.1016/j.bandl.2012.04.018

     • PubMed
     • Google Scholar
123. 1. Rhebergen KS
     2. Versfeld NJ
     3. Dreschler WA

     (2005) Release from informational masking by time reversal of native and non-native interfering speech

     The Journal of the Acoustical Society of America 118:1274–1277.

     https://doi.org/10.1121/1.2000751

     • PubMed
     • Google Scholar
124. 1. Rimmele JM
     2. Zion Golumbic E
     3. Schröger E
     4. Poeppel D

     (2015) The effects of selective attention and speech acoustics on neural speech-tracking in a multi-talker scene

     Cortex 68:144–154.

     https://doi.org/10.1016/j.cortex.2014.12.014

     • PubMed
     • Google Scholar
125. 1. Risko EF
     2. Richardson DC
     3. Kingstone A

     (2016) Breaking the fourth wall of cognitive science

     Current Directions in Psychological Science 25:70–74.

     https://doi.org/10.1177/0963721415617806

     • Google Scholar
126. 1. Rivenez M
     2. Darwin CJ
     3. Guillaume A

     (2006) Processing unattended speech

     The Journal of the Acoustical Society of America 119:4027–4040.

     https://doi.org/10.1121/1.2190162

     • PubMed
     • Google Scholar
127. 1. Rivenez M
     2. Guillaume A
     3. Bourgeon L
     4. Darwin CJ

     (2008) Effect of voice characteristics on the attended and unattended processing of two concurrent messages

     European Journal of Cognitive Psychology 20:967–993.

     https://doi.org/10.1080/09541440701686201

     • Google Scholar
128. 1. Röer JP
     2. Körner U
     3. Buchner A
     4. Bell R

     (2017a) Semantic priming by irrelevant speech

     Psychonomic Bulletin & Review 24:1205–1210.

     https://doi.org/10.3758/s13423-016-1186-3

     • PubMed
     • Google Scholar
129. 1. Röer JP
     2. Körner U
     3. Buchner A
     4. Bell R

     (2017b) Attentional capture by taboo words: a functional view of auditory distraction

     Emotion 17:740–750.

     https://doi.org/10.1037/emo0000274

     • PubMed
     • Google Scholar
130. 1. Rosen S
     2. Souza P
     3. Ekelund C
     4. Majeed AA

     (2013) Listening to speech in a background of other talkers: effects of talker number and noise vocoding

     The Journal of the Acoustical Society of America 133:2431–2443.

     https://doi.org/10.1121/1.4794379

     • PubMed
     • Google Scholar
131. 1. Rottschy C
     2. Langner R
     3. Dogan I
     4. Reetz K
     5. Laird AR
     6. Schulz JB
     7. Fox PT
     8. Eickhoff SB

     (2012) Modelling neural correlates of working memory: a coordinate-based meta-analysis

     NeuroImage 60:830–846.

     https://doi.org/10.1016/j.neuroimage.2011.11.050

     • PubMed
     • Google Scholar
132. 1. Schell M
     2. Zaccarella E
     3. Friederici AD

     (2017) Differential cortical contribution of syntax and semantics: an fMRI study on two-word phrasal processing

     Cortex 96:105–120.

     https://doi.org/10.1016/j.cortex.2017.09.002

     • PubMed
     • Google Scholar
133. 1. Schepman A
     2. Rodway P
     3. Pritchard H

     (2016) Right-lateralized unconscious, but not conscious, processing of affective environmental sounds

     Laterality: Asymmetries of Body, Brain and Cognition 21:606–632.

     https://doi.org/10.1080/1357650X.2015.1105245

     • PubMed
     • Google Scholar
134. 1. Shavit-Cohen K
     2. Zion Golumbic E

     (2019) The dynamics of attention shifts among concurrent speech in a naturalistic Multi-speaker virtual environment

     Frontiers in Human Neuroscience 13:386.

     https://doi.org/10.3389/fnhum.2019.00386

     • PubMed
     • Google Scholar
135. 1. Shinn-Cunningham BG

     (2008) Object-based auditory and visual attention

     Trends in Cognitive Sciences 12:182–186.

     https://doi.org/10.1016/j.tics.2008.02.003

     • PubMed
     • Google Scholar
136. 1. Smirnov D
     2. Glerean E
     3. Lahnakoski JM
     4. Salmi J
     5. Jääskeläinen IP
     6. Sams M
     7. Nummenmaa L

     (2014) Fronto-parietal network supports context-dependent speech comprehension

     Neuropsychologia 63:293–303.

     https://doi.org/10.1016/j.neuropsychologia.2014.09.007

     • PubMed
     • Google Scholar
137. 1. Surprenant AM
     2. Neath I
     3. LeCompte DC

     (1999) Irrelevant speech, phonological similarity, and presentation modality

     Memory 7:405–420.

     https://doi.org/10.1080/741944920

     • Google Scholar
138. 1. Swaminathan J
     2. Mason CR
     3. Streeter TM
     4. Best V
     5. Kidd, Jr G
     6. Patel AD

     (2015) Musical training, individual differences and the cocktail party problem

     Scientific Reports 5:1–11.

     https://doi.org/10.1038/srep11628

     • Google Scholar
139. 1. Teoh ES
     2. Lalor EC

     (2019) EEG decoding of the target speaker in a cocktail party scenario: considerations regarding dynamic switching of talker location

     Journal of Neural Engineering 16:036017.

     https://doi.org/10.1088/1741-2552/ab0cf1

     • PubMed
     • Google Scholar
140. 1. Todd JJ
     2. Marois R

     (2004) Capacity limit of visual short-term memory in human posterior parietal cortex

     Nature 428:751–754.

     https://doi.org/10.1038/nature02466

     • PubMed
     • Google Scholar
141. 1. Treisman AM

     (1960) Contextual cues in selective listening

     Quarterly Journal of Experimental Psychology 12:242–248.

     https://doi.org/10.1080/17470216008416732

     • Google Scholar
142. 1. Tun PA
     2. O'Kane G
     3. Wingfield A

     (2002) Distraction by competing speech in young and older adult listeners

     Psychology and Aging 17:453–467.

     https://doi.org/10.1037/0882-7974.17.3.453

     • PubMed
     • Google Scholar
143. 1. Vachon F
     2. Marsh JE
     3. Labonté K

     (2020) The automaticity of semantic processing revisited: auditory distraction by a categorical deviation

     Journal of Experimental Psychology: General 149:1360–1397.

     https://doi.org/10.1037/xge0000714

     • PubMed
     • Google Scholar
144. 1. Vandenberghe R
     2. Nobre AC
     3. Price CJ

     (2002) The response of left temporal cortex to sentences

     Journal of Cognitive Neuroscience 14:550–560.

     https://doi.org/10.1162/08989290260045800

     • PubMed
     • Google Scholar
145. 1. Vandierendonck A

     (2014) Symbiosis of executive and selective attention in working memory

     Frontiers in Human Neuroscience 8:588.

     https://doi.org/10.3389/fnhum.2014.00588

     • PubMed
     • Google Scholar
146. 1. Vestergaard MD
     2. Fyson NR
     3. Patterson RD

     (2011) The mutual roles of temporal glimpsing and vocal characteristics in cocktail-party listening

     The Journal of the Acoustical Society of America 130:429–439.

     https://doi.org/10.1121/1.3596462

     • PubMed
     • Google Scholar
147. 1. Wild CJ
     2. Yusuf A
     3. Wilson DE
     4. Peelle JE
     5. Davis MH
     6. Johnsrude IS

     (2012) Effortful listening: the processing of degraded speech depends critically on attention

     Journal of Neuroscience 32:14010–14021.

     https://doi.org/10.1523/JNEUROSCI.1528-12.2012

     • PubMed
     • Google Scholar
148. 1. Wood N
     2. Cowan N

     (1995) The cocktail party phenomenon revisited: how frequent are attention shifts to one's name in an irrelevant auditory channel?

     Journal of Experimental Psychology: Learning, Memory, and Cognition 21:255–260.

     https://doi.org/10.1037/0278-7393.21.1.255

     • Google Scholar
149. 1. Yates AJ

     (1965) Delayed auditory feedback and shadowing

     Quarterly Journal of Experimental Psychology 17:125–131.

     https://doi.org/10.1080/17470216508416421

     • Google Scholar
150. 1. Yue Q
     2. Martin RC
     3. Hamilton AC
     4. Rose NS

     (2019) Non-perceptual regions in the left inferior parietal lobe support phonological Short-term memory: evidence for a buffer account?

     Cerebral Cortex 29:1398–1413.

     https://doi.org/10.1093/cercor/bhy037

     • PubMed
     • Google Scholar
151. 1. Zion Golumbic E
     2. Cogan GB
     3. Schroeder CE
     4. Poeppel D

     (2013a) Visual input enhances selective speech envelope tracking in auditory cortex at a "cocktail party"

     Journal of Neuroscience 33:1417–1426.

     https://doi.org/10.1523/JNEUROSCI.3675-12.2013

     • PubMed
     • Google Scholar
152. 1. Zion Golumbic EM
     2. Ding N
     3. Bickel S
     4. Lakatos P
     5. Schevon CA
     6. McKhann GM
     7. Goodman RR
     8. Emerson R
     9. Mehta AD
     10. Simon JZ
     11. Poeppel D
     12. Schroeder CE

     (2013b) Mechanisms underlying selective neuronal tracking of attended speech at a "cocktail party"

     Neuron 77:980–991.

     https://doi.org/10.1016/j.neuron.2012.12.037

     • PubMed
     • Google Scholar

Acceptance summary:

Using a clever adaptation of a classic experimental paradigm, the authors assessed linguistic processing of task-irrelevant speech. By structuring the stimulus so that phonemes, words, phrases and sentence have nested but identifiable discrete rates. the authors were able to identify neural processing corresponding to each stimulus organizational level from magnetoencephalography responses. This study, which will interest those studying attention, language, or the organization of the auditory system, reveals linguistic processing of irrelevant speech at the phrasal level, which is an unexpected and intriguing result.

Decision letter after peer review:

Thank you for submitting your article "Linguistic processing of task-irrelevant speech at a Cocktail Party" for consideration by eLife. Your article has been reviewed by 3 peer reviewers, and the evaluation has been overseen by Barbara Shinn-Cunningham as the Senior and Reviewing Editor. The following individuals involved in review of your submission have agreed to reveal their identity: Phillip E Gander (Reviewer #1); Ross K Maddox (Reviewer #2).

The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.

Essential revisions:

1. It is surprising that your results do not replicate previous results showing peaks related to sentence- and word-level frequencies. Ideally, some other control experiment would be performed to directly address this issue. If such controls cannot be performed, the claims of the paper must be toned down.

2. The main effects is a change in a small peak that appears at 1 Hz, the frequency of the phrasal structure of the to-be-ignored speech. However, the reviewers raised a number of issues about the reliability of this peak measurement. Further analyses are needed to convince that the peak is real, especially given that the measured spectra are noisy-such as a quantification of effect sizes, quantification of the modulation spectrum of the natural, to-be-attended speech (and a consideration of how this interacts with the manipulated spectrum of the to-be-ignored speech), or related analyses.

3. Related to point 2, please clarify exactly how the ITPC normalized and how this relates to the noise floor in your measures (see Reviewer 3's remarks).

4. To strengthen your claims, please explore whether individual subject data are correlated when you compare response accuracy in the structured condition with the strength of the phrasal-level ITPC. If there is no significant relationship, please offer some interpretation as to why there is not.

5. Lapses of attention that are not especially prolonged could contribute to or even explain some of your results. While you mention this and are careful with your language, your Discussions should consider this issue more fully and fairly.

6. Please discuss how "natural" the manipulated speech stimuli were, and whether this differed across conditions (or is different in important ways compared to previous studies). Do you believe any such differences explain what you observed?

In resubmitting your paper, please also consider the many suggestions and questions that the reviewers raise in their full reviews, below.

Reviewer #1:

The present study sought to better characterize how listeners deal with competing speech streams from multiple talkers, that is, whether unattended speech in a multi talker environment competes for exclusively lower-level acoustic/phonetic resources or whether it competes for higher-level linguistic processing resources as well. The authors recorded MEG data and used hierarchical frequency tagging in an unattended speech stream presented to one ear while listeners were instructed to attend to stories presented in the other ear. The study found that when the irrelevant speech contained structured (linguistic) content, an increase in power at the phrasal level (1 Hz) was observed, but not at the word level (2 Hz) or the sentence level (0.5 Hz). This suggests that some syntactic information in the unattended speech stream is represented in cortical activity, and that there may be a disconnect between lexical (word level) processing and syntactic processing. Source analyses of the difference between conditions indicated activity in left inferior frontal and left posterior parietal cortices. Analysis of the source activity underlying the linear transformation of the stimulus and response revealed activation in left inferior frontal (and nearby) cortex. Implications for the underlying mechanisms (whether attentional shift or parallel processing) are discussed. The results have important implications for the debate on the type and amount of representation that occurs to unattended speech streams.

The authors utilize clever tools which arguably provided a unique means to address the main research question, i.e., they used hierarchical frequency tagging for the distractor speech, which allowed them to assess linguistic representations at different levels (syllable-, word-, phrase-, and sentence-level). This technique enabled the authors to make claims about what level of language hierarchy the stimuli are being processed, depending on the observed frequency modulation in neural activity. These stimuli were presented during MEG recording, which let the authors assess changes in neurophysiological processing in near real time – essential for research on spoken language. Source analyses of these data provided information on the potential neural mechanisms involved in this processing. The authors also assessed a temporal response function (TRF) based on the speech envelope to determine the brain regions involved at these different levels for linguistic analysis of the distractor speech.

1. Speech manipulation:

In general, it is unclear what predictions to make regarding the frequency tagging of the unattended distractor speech. On the one hand, the imposed artificial rhythmicity (necessary for the frequency tagging approach) may make it easier for listeners to ignore the speech stream, and thus seeing an effect at higher-level frequency tags may be of greater note, although not entirely plausible. On the other hand, having the syllables presented at a consistent rate may make it easier for listeners to parse words and phrasal units because they know precisely when in time a word/phrase/sentence boundary is going to occur, allowing listeners to check on the irrelevant speech stream at predictable times. For both the frequency tagging and TRF electrophysiological results, the task-irrelevant structured speech enhancement could be interpreted as an infiltration of this information in the neural signal (as the authors suggest), but because the behavioral results are not different this latter interpretation is not easily supported. This pattern of results is difficult to interpret.

2. Behavioral Results:

Importantly, no behavioral difference in accuracy was observed between the two irrelevant speech conditions (structured vs. non-structured), which makes it difficult to interpret what impact the structured irrelevant speech had on attentive listening. If the structured speech truly "infiltrates" or "competes" for linguistic processing resources, the reader would assume a decrease in task accuracy in the structured condition. This behavioral pattern has been observed in other studies. This calls into questions the face validity of the stimuli and task being used.

3. Attention:

• In this study activation of posterior parietal cortex was found, that could be indicative of a strong attentional manipulation, and that the task was in fact quite attentionally demanding in order for subjects to perform. This may align with the lack of behavioral difference between structured and non-structured irrelevant stimuli. Perhaps subjects attempted to divide their attention which may have been possible between speech that was natural and speech that was rather artificial. The current results may align with a recent proposal that inferior frontal activity may be distinguished by language selective and domain general patterns.

4. Lack of word level response:

• A major concern is that the results do not seem to replicate from an earlier study with the same structured stimuli, i.e., the effects were seen for sentence and word level frequency tagging. As the authors discuss, it seems difficult to understand how a phrasal level of effect could be obtained without word-level processing, and so a response at the word level is expected.

5. Familiarization phase:

The study included a phase of familiarization with the stimuli, to get participants to understand the artificial speech. However it would seem that it is much easier for listeners to report back on structured rather than unstructured stimuli. This is relevant to understanding any potential differences between the two conditions. It is unclear if any quantification was made of performance/understanding at this phase. If there is no difference in the familiarization phase, this might explain why there was no difference in behavior during the actual task between the two conditions. Or, if there is a difference at the familiarization phase (i.e. structured sequences are more easily repeated back than non-structured sequences), this might help explain the neural data result at 1 Hz, given that some higher level of processing must have occurred for the structured speech (such as "chunking" into words/phrasal units).

6. Speech manipulation:

• To assist interpretation of the pattern of results it would be helpful to know something about the listening experience to the stimuli. Was there any check on abnormality of the attended speech that was changed in gender, i.e., how natural did this sound? Why was the gender manipulation imposed, instead of initially recording the stimuli in a male voice?

• Similarly, how natural-sounding was the task-irrelevant structured speech?

7. Behavioral Results:

• It is difficult to reconcile why there are no significant differences in response accuracy between non-structured and structured conditions. How do the authors interpret this discrepancy alongside the observed neural differences across these two conditions? Is it possible this is reflective of the stimulus, i.e., that the structured speech is so artificial that it is not intrusive on the attended signal (thus no difference in behavior)? It seems less plausible that the non-structured speech was equally as intrusive as the structured speech, given the cited literature. These issues relate to the speech manipulation.

• Did the authors check on task behavior before running the experiment?

• How does this relate to the irrelevant stimuli were used in the experiment in Makov et al. 2017. Is it possible this is important, can the authors comment?

• It would be helpful to understand why no behavioral result occurred, and whether this was related to the speech manipulation specifically by obtaining behavioral results with other versions of the task.

• There is a rather large range in response accuracy across subjects. One analysis that might strengthen the argument that the increase in 1 Hz ITPC truly reflects phrasal level information would be to look for a correlation between response accuracy in the structured condition with 1 Hz ITPC. One might predict that listeners which show lower behavioral accuracy would show greater 1 Hz ITPC (i.e. greater interference from linguistic content of the unattended structured speech).

8. Attention:

• An attentional load account is interesting, but load is not directly manipulated in this experiment. And it is difficult to reconcile the claim that the Ding experiment was less natural than the current one, as both were transformations of time.

• Federenko and Blank, 2020 propose an account of inferior frontal mechanisms that may relate to the present pattern of results regarding, in particular that there may be a stronger manipulation of attention (domain general) than linguistic processes.

9. Lack of word level response:

• Again it might be relevant with respect to potential stimulus differences to previous versions of the stimuli. If this is the case then it might have important implications for only a 1Hz effect being found.

• If SNR is an issue it calls into question the current results in addition to the possibility that it was an underestimation.

10. Familiarization phase:

• If they exist, what are the behavioral data / accuracy between conditions (structured v. non-structured) from the familiarization phase? Or did subjects comment on any differences?

11. ROIs:

• A representation or list of the ROIs might be helpful. It is unclear from Figure 1 if the whole cortical mantle is included in the 22 ROIs. In addition these ROI boundaries look considerably larger than the 180 in each hemisphere from Glasser et al. 2016. Please clarify.

Reviewer #2:

This paper by Har-shai Yahav and Zion Golumbic investigates the coding of higher level linguistic information in task-irrelevant speech. The experiment uses a clever design, where the task-irrelevant speech is structured hierarchically so that the syllable, word, and sentence levels can be ascertained separately in the frequency domain. This is then contrasted with a scrambled condition. The to-be-attended speech is naturally uttered and the response is analyzed using the temporal response function. The authors report that the task-irrelevant speech is processed at the sentence level in the left fronto-temporal area and posterior parietal cortex, in a manner very different from the acoustical encoding of syllables. They also find that the to-be-attended speech responses are smaller when the distractor speech is not scrambled, and that this difference shows up in exactly the same fronto-temporal area – a very cool result.

This is a great paper. It is exceptionally well written from start to finish. The experimental design is clever, and the results were analyzed with great care and are clearly described.

The only issue I had with the results is that the possibility (or likelihood, in my estimation) that the subjects are occasionally letting their attention drift to the task-irrelevant speech rather than processing in parallel can't be rejected. To be fair, the authors include a nice discussion of this very issue and are careful with the language around task-relevance and attended/unattended stimuli. It is indeed tough to pull apart. The second paragraph on page 18 states "if attention shifts occur irregularly, the emergence of a phase-rate peak in the neural response would indicate that bits of 'glimpsed' information are integrated over a prolonged period of time." I agree with the math behind this, but I think it would only take occasional lapses lasting 2 or 3 seconds to get the observed results, and I don't consider that "prolonged." It is, however, much longer than a word, so nicely rejects the idea of single-word intrusions.

Reviewer #3:

The use of frequency tagging to analyze continuous processing at phonemic, word, phrasal and sentence-levels offers a unique insight into neural locking at higher-levels. While the approach is novel, there are major concerns regarding the technical details and interpretation of results to support phrase-level responses to structured speech distractors.

– Is the peak at 1Hz real and can it be attributed solely to the structured distractor?

* The study did not comment on the spectral profile of the "attended" speech, and how much low modulation energy is actually attributed to the prosodic structure of attended sentences? To what extent does the interplay of the attended utterance and distractor shapes the modulation dynamics of the stimulus (even dichotically)?

* How is the ITPC normalized? Figure 2 speaks of a normalization but it is not clear how? The peak at 1Hz appears extremely weak and no more significant (visually) than other peaks – say around 3Hz and also 2.5Hz in the case of non-structured speech? Can the authors report on the regions in modulation space that showed any significant deviations? What about effect size of the 1Hz peak relative to these other regions?

* It is hard to understand where the noise floor in this analysis – this floor will rotate with the permutation test analysis performed in the analysis of the ITPC and may not be fully accounted for. This issue depends on what the chosen normalization procedure is. The same interpretation put forth by the author regarding a lack of a 0.5Hz peak due to noise still raises the question of interpreting the observed 1Hz peak?

– Control of attention during task performance

* The author present a very elegant analysis of possible alterative accounts of the results, but they acknowledge that possible attention switches, even if irregular, could result in accumulated information that could emerge as a small neurally-locked response at the phrase-level? As indicated by the authors, the entire experimental design to fully control for such switches is a real feat. That being said, additional analyses could shed some light on variations of attentional state and their effect on observed results. For instance, analysis of behavioral data across different trials (wouldn't be conclusive, but could be informative)

* This issue is further compounded by the fact that a rather similar study (Ding et al.) did not report any phrasal-level processing, though there are design differences. The authors suggest differences in attentional load as a possible explanation and provide a very appealing account or reinterpretation of the literature based on a continuous model of processing based on task demands. While theoretically interesting, it is not clear whether any of the current data supports such account. Again, maybe a correlation between neural responses and behavioral performance in specific trials could shed some light or strengthen this claim.

– What is the statistic shown for the behavioral results? Is this for the multiple choice question? Then what is the t-test on?

– Beyond inter-trial phase coherence, can the authors comment on actual power-locked responses at the same corresponding rates?

In line with concerns regarding interpretation of experimental findings, some control experiment appears to be critical to establish a causal link between the observed neural processing the 1Hz rhythm and the phrasal processing of the distractor. What do the author expect from a similarly structured distractor but unintelligible, in an unfamiliar language or even reversed?

Essential revisions:

1. It is surprising that your results do not replicate previous results showing peaks related to sentence- and word-level frequencies. Ideally, some other control experiment would be performed to directly address this issue. If such controls cannot be performed, the claims of the paper must be toned down.

Indeed, the lack of a response at the word-level was not expected. All the reviewers point this out and we too try to grapple with this issue. We too expected, based on previous findings, that if linguistic-responses were observed for task-irrelevant speech, this would be observed at both the word- and phrase- levels. Indeed, this is the case when participants listen to these stimuli from single-speaker, without competition; e.g., Ding et al. 2016, Makov et al. 2017. As detailed below in our response to reviewers #1 and #3 and revised methods and Results section, we conducted additional analyses of the data to confirm the validity of the 1Hz peak (despite the lack of a 2Hz peak), and this result still stands. Since these are the data, which we now share in full on OSF (https://osf.io/e93qa), we offer some thoughts as to why the word-level peak is not observed when frequency-tagged speech is the ‘task-irrelevant’ stimulus in a two-speaker paradigm (as opposed to a single, attended speaker). For a more elaborate response see section “why no word-level response” in our revised paper (Discussion, p. 23), and our detailed response to reviewers #1 and #3 below.

2. The main effects is a change in a small peak that appears at 1 Hz, the frequency of the phrasal structure of the to-be-ignored speech. However, the reviewers raised a number of issues about the reliability of this peak measurement. Further analyses are needed to convince that the peak is real, especially given that the measured spectra are noisy-such as a quantification of effect sizes, quantification of the modulation spectrum of the natural, to-be-attended speech (and a consideration of how this interacts with the manipulated spectrum of the to-be-ignored speech), or related analyses.

We understand the reviewers’ concerns about the validity of the 1Hz peak, and we have several responses to this comment:

1. We have added a new analysis to independently assess the significance of the 1Hz peak. In this analysis, we compared ITPC at each frequency to the average ITPC in the surrounding frequencies (2 bins from each side) using a t-test. This approach addresses the concern of frequency-specific noise-floor, for example due to the inherent 1/f noise structure (see similar implementations e.g., in Mouraux et al., 2011; Retter and Rossion, 2016, Nozaradan et al. 2017, 2018). Results of this analysis confirmed that the only significant ITPC peaks were at 4Hz (in both conditions) and at 1Hz (in the Structured condition only), further validating the robustness of the 1Hz phrase-level response. Note that the other peaks that stand-out visually (at 2.5Hz and 3Hz) were not statistically significant in this analysis. The new analysis is now described in the methods (pp. 11) and Results sections (pp. 14).

2. Although the magnitude of the 1Hz peak is smaller than the 4Hz, this is to be expected since the 4Hz peak is a direct consequence of the acoustic input whereas the 1Hz peak proposedly reflects linguistic representation and/or chunking. Similar ratios between the acoustic and linguistic peaks have been observed in previous studies using this frequency-tagging approach (e.g., Ding et al. 2016, Makov et al. 2017). Therefore, the smaller relative magnitude of the 1Hz peak does not invalidate it. We have now added quantification of all effect sizes to the Results section.

3. The reviewers suggests that, perhaps, the acoustics of the task-relevant stream could have contributed to the observed 1Hz ITPC peak, and that the peak might not solely be attributed to the Structured stimuli. However, this is not the case for two main reasons:

a. In our response to reviewer #3 we show the modulation spectrum of the narratives used as task-relevant speech. As can be seen, the spectrum does not contain a distinct peak at 1Hz.

b. The narratives used as task-relevant speech were fully randomized between the Structured and Non-Structured conditions and between participants. Therefore, if these stimuli had contributed to the 1Hz peak, this should have been observed in both conditions. We have now clarified this point in the methods (p.6).

3. Related to point 2, please clarify exactly how the ITPC normalized and how this relates to the noise floor in your measures (see Reviewer 3's remarks).

The normalization used for the ITPC was a z-score of the resultant phase-locking factor, as implemented in the circ_rtest function in the Matlab circular statistics toolbox (Berens, 2009). We have now clarified this in the methods section (p. 11) and the caption of Figure 3 (p. 14).

4. To strengthen your claims, please explore whether individual subject data are correlated when you compare response accuracy in the structured condition with the strength of the phrasal-level ITPC. If there is no significant relationship, please offer some interpretation as to why there is not.

To test whether the 1Hz ITPC peak was stronger in participants who performed poorly we have added a new analysis. We split the participants into two groups according to the median of the 1Hz ITPC value in the Structured condition and tested whether there was a significant difference in the behavioral scores of the two groups. However, this median-split analysis did not reveal any significant effects that would indicate a ‘trade-off’ between linguistic representation of task-irrelevant speech and performance on the attended task. That said, as we elaborate in our response to reviewer #1/critique #2 below and in the revised methods and discussion, the task used here (answering 4 multiple-choice questions after each 45-second long narrative) was not sufficiently sensitive for adequately capturing behavioral consequences of task-irrelevant stimuli. Therefore, in our opinion, this null-effect should not necessarily be taken as indication that both types of task-irrelevant stimuli were similarly distracting. We have added this new analysis to the paper (p. 13-14).

5. Lapses of attention that are not especially prolonged could contribute to or even explain some of your results. While you mention this and are careful with your language, your Discussions should consider this issue more fully and fairly.

Indeed, as the reviewers points out, one possible interpretation for the current results is that the strict rhythmic/hierarchical structure of task-irrelevant speech-stimuli enabled participants to employ a ‘rhythmic-glimpsing listening strategy’. In this strategy the task irrelevant stream could be sampled (‘glimpsed’) at the most informative points in time, allowing participants to glean sufficient linguistic information to process the task-irrelevant speech. We agree (and discuss in the paper; pp. 20) that the phrase-rate peak observed here in the Structured condition could, potentially, reflect this type of ‘glimpsing’ strategy (even though we cannot validate or disprove this possibility in the current study, since we do not have direct insight into participants’ listening strategy).

However, even if this is the case, employing a ‘rhythmic glimpsing strategy’ is in-and-of-itself an indication that the linguistic structure of the task-irrelevant stream was detected and is parsed correctly. This is because, given the hierarchical design of our Structured stimuli, for participants to "know precisely when in time a word/phrase/sentence boundary is going to occur" they must integrate over several syllables to identify the underlying linguistic structure. This is not trivial since the linguistic structure does not follow directly from the acoustics. Also, since we gradually ramped up the volume of the task-irrelevant speech at the start of each trial, determining where each sentence/phrase starts can only be achieved based on linguistic processing. Therefore, finding a 1Hz peak for the Structured but not for the Non-Structured task-irrelevant speech, which share the same acoustic-rhythm and were constructed from the same syllable units, serves as an indication that the underlying linguistic structure of task irrelevant speech was indeed detected. We have elaborated on this point in the revised discussion (pp. 20).

6. Please discuss how "natural" the manipulated speech stimuli were, and whether this differed across conditions (or is different in important ways compared to previous studies). Do you believe any such differences explain what you observed?

This is an important point, since our ultimate goal is to understand attention to speech under natural, real-life, conditions. We agree that the current study is not fully ‘natural’ for several reasons (e.g. the structured nature of the stimuli; their arbitrary content; the dichotic presentation etc.). The revised discussion now addressed this point more extensively, focusing on the generalization of our findings to more "natural” circumstances, comparison to previous studies, and a call for future studies to continue in this direction and systematically explore these questions under increasingly natural conditions (p. 21-22 and p.25-26; see also specific response to the reviewers below):

“As cognitive neuroscience research increasingly moves towards studying speech processing and attention in real-life circumstances, a critical challenge will be to systematically map out the perceptual and cognitive factors that contribute to, or hinder, the ability to glean meaningful information from stimuli that are outside the primary focus of attention.”

In resubmitting your paper, please also consider the many suggestions and questions that the reviewers raise in their full reviews, below.

Reviewer #1:

[…] 1. Speech manipulation:

In general, it is unclear what predictions to make regarding the frequency tagging of the unattended distractor speech. On the one hand, the imposed artificial rhythmicity (necessary for the frequency tagging approach) may make it easier for listeners to ignore the speech stream, and thus seeing an effect at higher-level frequency tags may be of greater note, although not entirely plausible. On the other hand, having the syllables presented at a consistent rate may make it easier for listeners to parse words and phrasal units because they know precisely when in time a word/phrase/sentence boundary is going to occur, allowing listeners to check on the irrelevant speech stream at predictable times. For both the frequency tagging and TRF electrophysiological results, the task-irrelevant structured speech enhancement could be interpreted as an infiltration of this information in the neural signal (as the authors suggest), but because the behavioral results are not different this latter interpretation is not easily supported. This pattern of results is difficult to interpret.

Although the current results provide an indication for linguistic-parsing of task-irrelevant speech, the reviewer raises an important point regarding the generalizability of our results to natural speech. Specifically, they ask whether the strict rhythmicity of the frequency tagged stimuli used here, might have made it easier or harder to "ignore", relative to natural speech that lacks this precise temporal structure.

We have several responses to this comment:

1. Indeed, as the reviewer points out, one possible interpretation for the current results is that the strict rhythmic/hierarchical structure of task-irrelevant speech-stimuli enabled participants to employ a ‘rhythmic-glimpsing listening strategy’. In this strategy the task irrelevant stream could be sampled (‘glimpsed’) at the most informative points in time, allowing participants to glean sufficient linguistic information to process the task irrelevant speech. We agree (and discuss in the paper; pp. 20) that the phrase-rate peak observed here in the Structured condition could, potentially, reflect this type of ‘glimpsing’ strategy (even though we cannot validate or disprove this possibility in the current study, since we do not have direct insight into participants’ listening strategy).

2. However, even if this is the case, employing a ‘rhythmic glimpsing strategy’ is in-and-of itself an indication that the linguistic structure of the task-irrelevant stream was detected and is parsed correctly. This is because, given the hierarchical design of our Structured stimuli, for participants to "know precisely when in time a word/phrase/sentence boundary is going to occur" they must integrate over several syllables to identify the underlying linguistic structure. This is not trivial, since the linguistic structure does not follow directly from the acoustics. Also, since we gradually ramped up the volume of the task-irrelevant speech at the start of each trial, determining where each sentence/phrase starts can only be achieved based on linguistic processing. Therefore, finding a 1Hz peak for the Structured but not for the Non-Structured task-irrelevant speech, which share the same acoustic-rhythm and were constructed from the same syllable units, serves as an indication that the underlying linguistic structure of task irrelevant speech was indeed detected.

We have elaborated on this point in the revised discussion, which now reads (pp. 20):

“An important question to ask is whether the phrase-level response observed for task irrelevant speech can be explained by attention shifts? […] However, we hope that future studies will gain empirical access into the dynamic of listeners’ internal attentional state and help shed light on this pivotal issue.”

3. Another important point raised by the reviewer is that the artificial-rhythmicity of the current stimuli might actually make them easier to ignore than natural speech that is less rhythmic? Indeed, as the reviewer points out, previous studies using simple tones suggest that when task-irrelevant tones are isochronous, this can make them easier to ignore relative to non-isochronous tones (e.g., Makov et al. 2020). The current study was not designed to address this particular aspect; since we do not compare whether isochronous speech is easier to ignore than non-isochronous speech. However, given the monotonous and artificial nature of the current speech-stimuli we speculate that they are probably easier to ‘tune out’, as compared to natural speech that contain potential attention grabbing events as well as prosodic cues. A recent study by Aubanel and Schwarz (2020) also suggests that isochrony plays a reduced role in speech perception relative to simple tones. Importantly, though, regarding the reviewer’s concern: the isochronous 4Hz nature of the speech-stimuli is not sufficient for explaining the main 1Hz effect reported here, since both the Structured and Non-Structured stimuli were similarly isochronous. Therefore, although we agree that this speech is “unnatural”, it is nonetheless processed and parsed for linguistic content.

4. Taking a broader perspective to the reviewer’s comment regarding the generalization of our findings to more "natural” circumstances:

One of the main take-home-messages of this paper is that we should not think about whether or not task-irrelevant speech is processed linguistically as a binary yes/no question. Rather, that the ability to process task-irrelevant speech likely depends on both the acoustic properties of the stimuli as well as the cognitive demands of the task. Within this framework, our current findings nicely demonstrate one of the circumstances in which task-irrelevant speech has the capacity to process more than one speech stream (be it through glimpsing or parallel processing, as discussed above). This demonstration has important theoretical implications, indicating that we should not assume an inherent “bottleneck” for processing two competing speech-streams, as suggested by some models.

Clearly, additional research is required to fully map-out the factors contributing to this effect (rhythmicity being one of them, perhaps). However, it is highly unlikely that the system is ONLY capable of doing this when stimuli are strictly rhythmic. We look forward to conducting systematic follow-up studies into the specific role of rhythm in attention to speech, as well as other acoustic and cognitive factors. We now elaborate on this point in the discussion (p. 21):

“More broadly, the comparison between these two studies invites re-framing of the question regarding the type / level of linguistic processing applied to task-irrelevant speech, and propels us to think about this issue not as a yes-or-no dichotomy, but perhaps as a more flexible process that depends on the specific context (Brodbeck et al. 2020b). [….] As cognitive neuroscience research increasingly moves towards studying speech processing and attention in real-life circumstances, a critical challenge will be to systematically map out the perceptual and cognitive factors that contribute to, or hinder, the ability to glean meaningful information from stimuli that are outside the primary focus of attention.”

2. Behavioral Results:

Importantly, no behavioral difference in accuracy was observed between the two irrelevant speech conditions (structured vs. non-structured), which makes it difficult to interpret what impact the structured irrelevant speech had on attentive listening. If the structured speech truly "infiltrates" or "competes" for linguistic processing resources, the reader would assume a decrease in task accuracy in the structured condition. This behavioral pattern has been observed in other studies. This calls into questions the face validity of the stimuli and task being used.

In the current study, attentive-listening behavior was probed by asking participants four multiple-choice questions after each narrative (3-possible answers per question; chance level = 0.33). Indeed, we did not find any differences in accuracy on these questions when the natural-narrative was paired with Structured vs. Non-Structured task-irrelevant speech. Moreover, a new analysis aimed at testing whether behavioral performance was modulated by the strength of the 1Hz ITPC response did not reveal any significant effects (see behavioral results, pp. 14). However, we were not surprised by the lack of a behavioral effect, nor do we believe that this null-effect diminishes the significance of the neural effect observed here. This is because the task was not designed with the intent of demonstrating behavioral disturbance-effects by task-irrelevant speech, and indeed does not have sufficient sensitivity to do so for several reasons:

a. Asking only four questions on a ~45-second long narrative is an extremely poor measure for probing a participant’s understanding of the entire narrative.

b. Answering these questions correctly or incorrectly is not necessarily a direct indication of how much attention was devoted to the narrative, or an indication of lapses of attention. Rather, performance is likely influenced by other cognitive processes. For example, questions requiring recollection of specific details (e.g., “what color was her hat?”) rely not only on attention but also on working-memory. Conversely, questions addressing the ‘gist’ of the narrative, (e.g., “why was she sad?”) can be answered correctly based on logical deduction even if there were occasional attention-lapses. In other words, good performance on this task does not necessarily indicate “perfect” attention to the narrative, just as making mistakes on this task does not necessarily reflect “lapses” of attention.

c. Supporting our claim of the coarseness of this task: Prior to this experiment, we conducted a behavioral pilot study, aimed at obtaining a baseline-measure for performance when participants listen to these narratives in a single-speaker context (without additional competing speech). In that study, the average accuracy rate was 83% (n=10), indicating that even without the presence of competing speech, performance on this task is not perfect.

So why did we choose this task?

As we discuss in the paper, and the reviewer correctly points out, there have been numerous behavioral studies demonstrating behavioral ‘intrusions’ of the task-irrelevant stimuli on performance of an attended-task. However, these effects require substantially more sensitive behavioral tasks, where behavior is probed at a finer scale. Some prominent examples are short-term memory-tasks for lists of words (Tun et al. 2002), semantic priming (Dupoux et al. 2003, Aydelott et al. 2015) or target-detection tasks (Rivenez et al. 2006, 2008, Carey et al. 2014). However, these types of tasks are quite artificial and are not suitable for studying attention to continuous natural speech particularly if we do not want to disrupt listening with an ongoing (secondary) task and/or artificial manipulation of the speech. Therefore, many studies similar to ours employ ‘gross’ comprehension metrics, that are by-definition inadequate for capturing the complexity of attentive-listening behavior.

Our main motivation for choosing this task was a) to motivate and guide participants to direct attention towards the to-be-attended narrative and b) verify that indeed they listened to it. This is critical in order to assert that participants indeed attended to the correct stream.

However, given the admitted insensitivity of this measure, we do not believe that the null effects on behavior can be interpreted in any meaningful way. In fact, the lack of good behavioral metrics for studying attention to continuous speech, and the tension of determining the ‘ground truth’ of attention is precisely the motivation for this study. We believe that ongoing neural metrics provide a better indication of how continuous speech is processed than sporadic assessment of comprehension/memory.

We now elaborate on this point in the paper in the methods section (p. 9):

“This task was chosen as a way to motivate and guide participants to direct attention towards the to-be-attended narrative and provide verification that indeed they listened to it. […] At the same time, this task is instrumental in guiding participants' selective attention toward the designated speaker, allowing us to analyze their neural activity during uninterrupted listening to continuous speech, which was the primarily goal of the current study.”

And in the discussion (p. 25):

“Since the neural response to the to-be-attended speech was modulated by the type of competition it faced, then why was this not mirrored in the current behavioral results as well? […] This is a challenge shared by many previous studies similar to ours, and is one of the main motivations for turning directly to the brain and studying neural activity during uninterrupted listening to continuous speech, rather than relying on sparse behavioral indications (Ding et al. 2016; Makov et al. 2017; Broderick et al. 2018, 2019; Donhauser and Baillet 2019; Brodbeck et al. 2020).”

3. Attention:

• In this study activation of posterior parietal cortex was found, that could be indicative of a strong attentional manipulation, and that the task was in fact quite attentionally demanding in order for subjects to perform. This may align with the lack of behavioral difference between structured and non-structured irrelevant stimuli. Perhaps subjects attempted to divide their attention which may have been possible between speech that was natural and speech that was rather artificial. The current results may align with a recent proposal that inferior frontal activity may be distinguished by language selective and domain general patterns.

We agree with the reviewer processing aspects of the task-irrelevant speech, in addition to following the to-be-attended narrative may impose a higher demand on working-memory (a form of ‘divided’ attention), and this might be reflected in the activation of PPC and inferior frontal regions in this condition. We have now expanded on this in our discussion, which reads (Discussion p. 22-23):

“Both the posterior-parietal cortex and inferior frontal gyrus play an important role in verbal working-memory (Todd and Marois 2004; Postle et al. 2006; Linden 2007; McNab and Klingberg 2008; Edin et al. 2009; Østby et al. 2011; Gazzaley and Nobre 2012; Ma et al. 2012; Rottschy et al. 2012; Meyer et al. 2014, 2015; Yue et al. 2019, Fedorenko and Blank 2020). […] Therefore, one possible interpretation for the presence of a phrase-level response to task-irrelevant speech in the left posterior-parietal cortex and inferior frontal regions, is their role in forming and maintaining a representation of task-irrelevant stimuli in working-memory, perhaps as a means for monitoring the environment for potentially important events.”

4. Lack of word level response:

• A major concern is that the results do not seem to replicate from an earlier study with the same structured stimuli, i.e., the effects were seen for sentence and word level frequency tagging. As the authors discuss, it seems difficult to understand how a phrasal level of effect could be obtained without word-level processing, and so a response at the word level is expected.

Indeed, the lack of a response at the word-level was not expected. We too expected that if linguistic-responses were observed for task-irrelevant speech, this would be observed at both the word- and phrase- level (as was observed in previous single-speaker studies using these stimuli; e.g., Makov et al. 2017). All the reviewers point this out and we too try to grapple with this issue in our discussion. As detailed above, we conducted additional analyses of the data to confirm that validity of the 1Hz peak (and the lack of a 2Hz peak), and this result still stands. Since these are the data, which we now share in full on OSF (https://osf.io/e93qa), we offer our thoughts as to why there is only a phrase-level peak but not a word-level peak when frequency-tagged speech is the ‘task-irrelevant’ stimulus in a two-speaker paradigm. See section “why no word-level response” in our revised paper (Discussion, section p. 23):

“Why no word-level response?

Although in the current study we found significant neural response to task-irrelevant speech at the phrasal-rate, we did not see peaks at the word- or at the sentence-rate. […] This matter regarding the depth of lexical processing of task-irrelevant speech, and its interaction with syntactic analysis, remains to be further explored in future research.”

We understand that the lack of the expected 2Hz response can raise doubts regarding the validity of the 1Hz response as well. To address this concern and further verify that the peak observed at 1Hz is “real”, we have now added a new analysis to independently assess the significance of the 1Hz peak relative to the frequency-specific noise-floor. To this end, we compared ITPC at each frequency to the average ITPC in the surrounding frequencies (2 bins from each side) using a t-test. This approach accounts for potential frequency-specific variations in SNR, for example due to the inherent 1/f noise-structure (Mouraux et al., 2011; Retter and Rossion, 2016; Nozaradan et al., 2017, 2018). This analysis confirmed that the only significant ITPC peaks were at 4Hz (in both conditions) and at 1Hz (in the Structured condition only), further validating the robustness of the 1Hz phrase-level response. The new analysis is now described in the methods (pp. 11) and Results sections (pp. 14) which reads:

“Scalp-level spectra of the Inter-trial phase coherence (ITPC) showed a significant peak at the syllabic-rate (4Hz) in response to both Structured and Non-Structured hierarchical frequency tagged speech, with a 4-pole scalp-distribution common to MEG recorded auditory responses (Figure 3a) (p< 10^-9; large effect size, Cohen's d > 1.5 in both). […] Comparison of the 1Hz ITPC between these conditions also confirmed a significant difference between them (p=0.045; moderate effect size, Cohen's d = 0.57).”

5. Familiarization phase:

The study included a phase of familiarization with the stimuli, to get participants to understand the artificial speech. However it would seem that it is much easier for listeners to report back on structured rather than unstructured stimuli. This is relevant to understanding any potential differences between the two conditions. It is unclear if any quantification was made of performance/understanding at this phase. If there is no difference in the familiarization phase, this might explain why there was no difference in behavior during the actual task between the two conditions. Or, if there is a difference at the familiarization phase (i.e. structured sequences are more easily repeated back than non-structured sequences), this might help explain the neural data result at 1 Hz, given that some higher level of processing must have occurred for the structured speech (such as "chunking" into words/phrasal units).

We would like to clarify the need of the familiarization stage. The speech materials used in the current study are not immediately recognizable as Hebrew speech. Therefore, we conducted a familiarization stage prior to the main experiment. Without the familiarization stage, we could not be sure whether participants were aware of higher-level chunking of the Structured stimuli. Moreover, we wanted to avoid any perceptual learning effects during the main experiment. We now elaborate more extensively on the familiarization procedure in the methods section (pp. 9).

Indeed, as the reviewer anticipated, repeating the Structured stimuli during the familiarization stage was easier than repeating the Non-Structured stimuli since the latter did not map only known lexical units. However, we don’t fully understand the reviewers concern regarding the familiarization task and whether it ‘explains’ the neural results. As we see it, the 1Hz neural response reflects the identification of phrasal boundaries, which was only possibly for the Structured stimuli. The fact that participants were (implicitly) made aware of the underlying structure does not trivialize this effect. Rather, our results indicate that the continuous stream of input was correctly parsed and the underlying linguistic structure encoded despite being task-irrelevant.

6. Speech manipulation:

• To assist interpretation of the pattern of results it would be helpful to know something about the listening experience to the stimuli. Was there any check on abnormality of the attended speech that was changed in gender, i.e., how natural did this sound? Why was the gender manipulation imposed, instead of initially recording the stimuli in a male voice?

The natural speech materials were chosen from a pre-existing database of actor-recorded short stories, that have been used in previous studies in the lab. These were originally recorded by both female and male speakers. However, our frequency-tagged stimuli were recorded only in a male voice. Since it is known that selective attention to speech is highly influenced by whether the voices are of the same/different sex, we opted to use only male voices. Therefore, we used the voice-change transformation on narratives that were originally spoken by a female actor. To ensure that the gender change did not affect the natural sounding of the speech and to check for abnormalities of the materials, we conducted a short survey among 10 native Hebrew speakers. They all agreed that the speech sounded natural and normal. Examples of the stimuli are now available at: https://osf.io/e93qa. We have clarified this in the methods section (pp. 6) which reads:

“Natural speech stimuli were narratives from publicly available Hebrew podcasts and short audio stories (duration: 44.53±3.23 seconds). […] They all agreed that the speech sounded natural and normal.”

• Similarly, how natural-sounding was the task-irrelevant structured speech?

The task-irrelevant speech is comprised of individually-recorded syllables, concatenated at a fixed rate. Although the syllabic-rate (4Hz) is akin to that of natural speech, the extreme rhythmicity imposed here is not natural and requires some perceptual adaptation. As mentioned above, the frequency-tagged stimuli are not immediately recognizable as Hebrew speech, which is the main reason for conducting a familiarization stage prior. After a few minutes of familiarization these stimuli still sound unnaturally-rhythmic, but are fully intelligible as Hebrew. Examples of the stimuli (presented separately and dichotically) are now available at: https://osf.io/e93qa.

7. Behavioral Results:

• It is difficult to reconcile why there are no significant differences in response accuracy between non-structured and structured conditions. How do the authors interpret this discrepancy alongside the observed neural differences across these two conditions? Is it possible this is reflective of the stimulus, i.e., that the structured speech is so artificial that it is not intrusive on the attended signal (thus no difference in behavior)? It seems less plausible that the non-structured speech was equally as intrusive as the structured speech, given the cited literature. These issues relate to the speech manipulation.

• Did the authors check on task behavior before running the experiment?

• It would be helpful to understand why no behavioral result occurred, and whether this was related to the speech manipulation specifically by obtaining behavioral results with other versions of the task.

See our extensive answer above regarding the behavioral tasks (including results from behavioral screening of the task) in response to critique #2.

• How does this relate to the irrelevant stimuli were used in the experiment in Makov et al. 2017. Is it possible this is important, can the authors comment?

Yes. The Structured stimuli were identical to those used in our previous study by Makov et al., 2017. However, in that study only a single-speech stimulus was presented and selective attention was not manipulated. We now mention this explicitly in the methods section.

• There is a rather large range in response accuracy across subjects. One analysis that might strengthen the argument that the increase in 1 Hz ITPC truly reflects phrasal level information would be to look for a correlation between response accuracy in the structured condition with 1 Hz ITPC. One might predict that listeners which show lower behavioral accuracy would show greater 1 Hz ITPC (i.e. greater interference from linguistic content of the unattended structured speech).

Thank you for this suggestion. To test whether the 1Hz ITPC peak was stronger in participants who performed poorly we have added a new analysis. We split the participants into two groups according to the median of the 1Hz ITPC value in the Structured condition and tested whether there was a significant difference in the behavioral scores of the two groups. However, this median-split analysis did not reveal any significant effects that would indicate a ‘trade-off’ between linguistic representation of task-irrelevant speech and performance on the attended task. That said, as elaborated in our response to critique #2 above, the task was not sufficiently sensitive for adequately capturing behavioral consequences of task-irrelevant stimuli. Therefore, in our opinion, this null-effect should not be taken as indication that both types of task-irrelevant stimuli were similarly distracting.

We have added this new analysis to the paper, which reads (p. 13-14):

“Additionally, to test for possible interactions between answering questions about the to-be attended speech and linguistic neural representation of task-irrelevant speech, we performed a median-split analysis of the behavioral scores across participants. […] Neither test showed significant differences in performance between participants whose 1Hz ITPC was above vs. below the median [Structured condition: t(27) = -1.07, p=0.29; Structured – Non-Structured: t(27) = -1.04, p=0.15]. Similar null-results were obtained when the median-split was based on the source level data.”

8. Attention:

• An attentional load account is interesting, but load is not directly manipulated in this experiment. And it is difficult to reconcile the claim that the Ding experiment was less natural than the current one, as both were transformations of time.

Thank you for this opportunity to clarify our comparison between the current study and the study by Ding et al.: While both studies used similar frequency-tagged speech as task irrelevant stimuli, the to-be-attended stimuli used by us was natural speech whereas Ding et al. used speech that was compressed by a factor of 2.5 and where all naturally-occurring gaps were artificially removed. It is well known that understanding time-compressed speech is substantially more difficult than natural-paced speech. Hence, in order to perform the task (answer questions about the to-be-attended narrative), participants in the study by Ding et al. needed to invest substantially more listening effort relative to the current one.

We offer the perspective of “Attentional Load theory” as a way to account for the discrepancy in results between these two studies, and also as a way to think more broadly about the discrepancies reported throughout the literature regarding processing of task-irrelevant stimuli. Specifically, we proposed that because of the more-demanding stimuli/task used by Ding et al., insufficient resources were available to also encode task-irrelevant stimuli, which is in line with “Attentional Load Theory” (Lavie et al. 2004). We also agree that additional studies are required in order to fully test this explanation and systematically manipulate “load” in a within-experiment design. We have revised our discussion on this point (pp. 21):

“While in the current experiment to-be-attended speech was presented in its natural form, mimicking the listening effort of real-life speech-processing, in the study by Ding et al. (Ding et al. 2018) to-be-attended speech was time-compressed by a factor of 2.5 and naturally occurring gaps were removed, making the comprehension task substantially more effortful (Nourski et al. 2009; Müller et al. 2019). […] Specifically, if understanding the to-be-attended speech imposes relatively low perceptual and cognitive load, then sufficient resources may be available to additionally process aspects of task-irrelevant speech, but that this might not be the case as the task becomes more difficult and perceptually demanding (Wild et al. 2012; Gagné et al. 2017; Peelle 2018).”

• Federenko and Blank, 2020 propose an account of inferior frontal mechanisms that may relate to the present pattern of results regarding, in particular that there may be a stronger manipulation of attention (domain general) than linguistic processes.

We thank the reviewer for pointing us to this highly-relevant work, and now discuss the potential involvement of IFG in domain-general processes such as working-memory and attention, besides its role in speech processing (pp. 23).

9. Lack of word level response:

• Again it might be relevant with respect to potential stimulus differences to previous versions of the stimuli. If this is the case then it might have important implications for only a 1Hz effect being found.

• If SNR is an issue it calls into question the current results in addition to the possibility that it was an underestimation.

See our extensive answer regarding the lack of a work-level peak in response to critique #4 above, where we address the lack of a word-level response and include a new analysis validating the robustness of the 1Hz ITPC peak.

10. Familiarization phase:

• If they exist, what are the behavioral data / accuracy between conditions (structured v. non-structured) from the familiarization phase? Or did subjects comment on any differences?

See our answer above regarding the familiarization task, in response to critique #5.

11. ROIs:

• A representation or list of the ROIs might be helpful. It is unclear from Figure 1 if the whole cortical mantle is included in the 22 ROIs. In addition these ROI boundaries look considerably larger than the 180 in each hemisphere from Glasser et al. 2016. Please clarify.

We apologize, this was not clear enough in our original submission. Indeed, Glasser et al., 2016, identified 180 ROIs in each hemisphere. However, in the Supplementary Neuroanatomical Results (table1 p180) these are grouped into 22 larger ROIs, which is extremely useful for data-simplification and reduction of multiple-comparisons. This coarser ROI-division is also more suitable for MEG data, given its reduced spatial-resolution (compared to fMRI). The 22 ROIs are delineated in black in Figure 3, and we have now clarified this in the methods section (pp. 12)

Reviewer #2:

[…] The only issue I had with the results is that the possibility (or likelihood, in my estimation) that the subjects are occasionally letting their attention drift to the task-irrelevant speech rather than processing in parallel can't be rejected. To be fair, the authors include a nice discussion of this very issue and are careful with the language around task-relevance and attended/unattended stimuli. It is indeed tough to pull apart. The second paragraph on page 18 states "if attention shifts occur irregularly, the emergence of a phase-rate peak in the neural response would indicate that bits of 'glimpsed' information are integrated over a prolonged period of time." I agree with the math behind this, but I think it would only take occasional lapses lasting 2 or 3 seconds to get the observed results, and I don't consider that "prolonged." It is, however, much longer than a word, so nicely rejects the idea of single-word intrusions.

We fully agree with the reviewer that the current results do not necessarily imply parallel processing of competing speech and could be brought about by occasional (rhythmic or nonrhythmic) shifts of attention between streams (“multiplexed listening”). We now elaborate on our previous discussion of this issue, emphasizing two main points (p. 19-20; also, please see our extensive response to reviewer #1/critique #1):

1. As the reviewer points out, regardless of the underlying mechanism, the current results indicate temporal integration of content and structure-building processing, that go beyond momentary “intrusions” of single words.

2. One of our main take-home messages from the current study is that selective-attention does not mean exclusive-attention, and that individuals are capable of gleaning linguistic components of task-irrelevant speech (be it through parallel processing or through multiplexed-listening). This invites us to re-examine some of the assumptions regarding what individuals are actually doing when we instruct them to pay selective attention.

Reviewer #3:

The use of frequency tagging to analyze continuous processing at phonemic, word, phrasal and sentence-levels offers a unique insight into neural locking at higher-levels. While the approach is novel, there are major concerns regarding the technical details and interpretation of results to support phrase-level responses to structured speech distractors.

– Is the peak at 1Hz real and can it be attributed solely to the structured distractor?

* The study did not comment on the spectral profile of the "attended" speech, and how much low modulation energy is actually attributed to the prosodic structure of attended sentences? To what extent does the interplay of the attended utterance and distractor shapes the modulation dynamics of the stimulus (even dichotically)?

The reviewer suggests that, perhaps, the acoustics of the task-relevant stream could have contributed to the observed 1Hz ITPC peak, and that the peak might not solely be attributed to the Structured stimuli.

There are two reasons why this is not the case.

1. In Author response image 1 we show the modulation spectrum of the narratives used as task-relevant speech. As can be seen, the spectrum does not contain a distinct peak at 1Hz.

2. The narratives used as task-relevant speech were fully randomized between the Structured and Non-Structured conditions and between participants. Therefore, if these stimuli had contributed to the 1Hz peak, this should have been observed in both conditions. We have now clarified this point in the methods (p.6) which reads “For each participant they were randomly paired with task-irrelevant speech (regardless of condition), to avoid material-specific effects.”

Author response image 1

Download asset Open asset

* How is the ITPC normalized? Figure 2 speaks of a normalization but it is not clear how? The peak at 1Hz appears extremely weak and no more significant (visually) than other peaks – say around 3Hz and also 2.5Hz in the case of non-structured speech? Can the authors report on the regions in modulation space that showed any significant deviations? What about effect size of the 1Hz peak relative to these other regions?

* It is hard to understand where the noise floor in this analysis – this floor will rotate with the permutation test analysis performed in the analysis of the ITPC and may not be fully accounted for. This issue depends on what the chosen normalization procedure is. The same interpretation put forth by the author regarding a lack of a 0.5Hz peak due to noise still raises the question of interpreting the observed 1Hz peak?

We understand the reviewer’s concerns about the validity of the 1Hz peak, and have taken several steps to address them:

1. We have added a new analysis to independently assess the significance of the 1Hz peak. In this analysis, we compared ITPC at each frequency to the average ITPC in the surrounding frequencies (2 bins from each side) using a t-test. This approach addresses the concern of frequency-specific noise-floor, for example due to the inherent 1/f noise structure (see similar implementations e.g., in Mouraux et al., 2011; Retter and Rossion, 2016, Nozaradan et al. 2017, 2018). Results of this analysis confirmed that the only significant ITPC peaks were at 4Hz (in both conditions) and at 1Hz (in the Structured condition only), further validating the robustness of the 1Hz phrase-level response. Note that the other peaks that stand-out visually (at 2.5Hz and 3Hz) were not statistically significant in this analysis. The new analysis is now described in the methods (pp. 11) and Results sections (pp. 14) which reads:

“Scalp-level spectra of the Inter-trial phase coherence (ITPC) showed a significant peak at the syllabic-rate (4Hz) in response to both Structured and Non-Structured hierarchical frequency-tagged speech, with a 4-pole scalp-distribution common to MEG recorded auditory responses (Figure 3a) (p< 10^-9; large effect size, Cohen's d > 1.5 in both). […] Comparison of the 1Hz ITPC between these conditions also confirmed a significant difference between them (p=0.045; moderate effect size, Cohen's d = 0.57).”

2. Although, as the reviewer points out, the magnitude of the 1Hz peak is smaller than the 4Hz, this is to be expected since the 4Hz peak is a direct consequence of the acoustic input whereas the 1Hz peak proposedly reflects linguistic representation and/or chunking. Similar ratios between the acoustic and linguistic peaks have been observed in previous studies using this frequency-tagging approach (e.g. Ding et al. 2016, Makov et al. 2017). Therefore, the smaller relative magnitude of the 1Hz peak does not invalidate it. We have now added quantification of all effect sizes to the Results section.

3. The normalization used for the ITPC was a z-score of the resultant phase-locking factor, as implemented in the circ_rtest function in the Matlab circular statistics toolbox (Berens, 2009). We have now clarified this in the methods section (p. 11) and the caption of Figure 3 (p. 14).

2. Control of attention during task performance

* The author present a very elegant analysis of possible alterative accounts of the results, but they acknowledge that possible attention switches, even if irregular, could result in accumulated information that could emerge as a small neurally-locked response at the phrase-level? As indicated by the authors, the entire experimental design to fully control for such switches is a real feat. That being said, additional analyses could shed some light on variations of attentional state and their effect on observed results. For instance, analysis of behavioral data across different trials (wouldn't be conclusive, but could be informative).

Indeed, we agree that occasional ‘attention switches’ can be one explanation for the results observed here. We now elaborate on our previous discussion of this point in the revised paper (discussion, pp. 20; and see also our extensive response to reviewer #1/critique #1 on this point).

To address the reviewer’s suggestion of looking more closely at the behavioral results, and testing whether the emergence of a phrase-level response to task-irrelevant speech came at the ‘expense’ of processing the to-be-attended speech, we now include a new median-split analysis. Rather than conducting a per-trial analysis (which suffers from low SNR), we split the participants into two groups according to the median of the 1Hz ITPC value in the Structured condition and tested whether there was a significant difference in the behavioral scores of the two groups. However, this median-split analysis did not reveal any significant effects that would indicate a ‘tradeoff’ between linguistic representation of task-irrelevant speech and performance on the attended task. We have added this new analysis to the paper, which reads (p. 13-14):

“Additionally, to test for possible interactions between answering questions about the to-be attended speech and linguistic neural representation of task-irrelevant speech, we performed a median-split analysis of the behavioral scores across participants. […] Neither test showed significant differences in performance between participants whose 1Hz ITPC was above vs. below the median [Structured condition: t(27) = -1.07, p=0.29; Structured – Non-Structured: t(27) = -1.04, p=0.15]. Similar null-results were obtained when the median-split was based on the source level data.”

That said, as elaborated in our response to reviewer #1/critique #2 above, and in the revised methods (p. 9) we do not believe the task used here is sufficiently sensitive for capturing behavioral consequences of task-irrelevant stimuli. The lack of a good behavioral measures is, in fact, part of the challenge of studying attention to continuous speech and part of the motivation for turning towards neural metrics rather than relying on behavioral measures, as we now discuss explicitly (p. 25):

“In moving towards studying speech processing and attention under more ecological circumstances, using natural continuous speech, we face an experimental challenge of obtaining sufficiently sensitive behavior measures without disrupting listening with an ongoing task (e.g., target detection) or encroaching too much on working-memory. This is a challenge shared by many previous studies similar to ours, and is one of the main motivations for turning directly to the brain and studying neural activity during uninterrupted listening to continuous speech, rather than relying on sparse behavioral indications (Ding et al. 2016; Makov et al. 2017; Broderick et al. 2018, 2019; Donhauser and Baillet 2019; Brodbeck et al. 2020).”

Therefore, although we wholeheartedly agree with the reviewer’s comment that “the experimental design to fully control for such switches is a real feat”, and we DO hope to be able to better address this question in future (neural) studies, in our opinion the current behavioral data cannot reliably shed light on this matter.

* This issue is further compounded by the fact that a rather similar study (Ding et al.) did not report any phrasal-level processing, though there are design differences. The authors suggest differences in attentional load as a possible explanation and provide a very appealing account or reinterpretation of the literature based on a continuous model of processing based on task demands. While theoretically interesting, it is not clear whether any of the current data supports such account. Again, maybe a correlation between neural responses and behavioral performance in specific trials could shed some light or strengthen this claim.

Here too, we refer the reviewer to our response to reviewer #1/critique #8, regarding the comparison between the current results and the study by Ding et al.

We offer the perspective of “Attentional Load theory” as a way to account for the discrepancy in results between these two studies, given that they differ substantially in the listening effort required for performing the task. We agree with the reviewer that, at the moment, this is mostly a theoretical speculation (particularly given the null-behavioral effects discussed above), even though it does converge with several other lines of empirical testing (e.g. the effects of working-memory capacity on attentional abilities). It also gives rise to specific hypotheses which can (and should) be tested in follow-up studies, which is why we think it is beneficial to include this as a discussion point in our paper (p. 21-22):

“the comparison between these two studies invites re-framing of the question regarding the type / level of linguistic processing applied to task-irrelevant speech, and propels us to think about this issue not as a yes-or-no dichotomy, but perhaps as a more flexible process that depends on the specific context (Brodbeck et al. 2020b). […] As cognitive neuroscience research increasingly moves towards studying speech processing and attention in real-life circumstances, a critical challenge will be to systematically map out the perceptual and cognitive factors that contribute to, or hinder, the ability to glean meaningful information from stimuli that are outside the primary focus of attention.”

– What is the statistic shown for the behavioral results? Is this for the multiple choice question? Then what is the t-test on?

We are happy to clarify. After each narrative, participants were asked 4 multiple-choice questions (with three potential answers; chance level = 0.33). Their answers to question were coded as ‘correct’ or ‘incorrect’ and then the average accuracy-rate (% questions answered correctly) was calculated across all questions and all narratives, for each participant. This was done separately for trials in the Structured and Non-Structured condition.

The t-test presented in Figure 2 tests for differences in average-accuracy rate between conditions. Additionally, we performed a t-test between the accuracy rate averaged across all conditions vs. chance-rate (0.33), to establish that they performed better than chance (guessing).

We have now clarified this in the methods section (p. 9):

“The average accuracy rate of each participant (% questions answered correctly) was calculated across all questions and narratives, separately for trials in the Structured and NonStructured condition.”

– Beyond inter-trial phase coherence, can the authors comment on actual power-locked responses at the same corresponding rates?

Thank you for this comment. Yes, we did look at the evoked power-spectrum in addition to the ITPC (Author response image 2). As is evident, the power spectrum also contained a clearly visible peak at 1Hz in the Structured condition (but not in the Non-Structured condition). However, statistical testing of this peak vs. its surrounding neighbors was not significant. We attribute the discrepancy between the power spectrum and ITPC spectrum to the 1/f power-law noise than primarily affects the former (attributed to non-specific/spontaneous neural activity; e.g. Voytek et al. 2015).

Author response image 2

Download asset Open asset

Similar patterns have also been observed in other studies using frequency-tagged stimuli, and ITPC seems to be a ‘cleaner’ measure for bringing out frequency-specific phase-locked responses in the neural signal (see similar discussion in Makov et al. 2017). For this reason, in the manuscript we only report the ITPC results.

In line with concerns regarding interpretation of experimental findings, some control experiment appears to be critical to establish a causal link between the observed neural processing the 1Hz rhythm and the phrasal processing of the distractor. What do the author expect from a similarly structured distractor but unintelligible, in an unfamiliar language or even reversed?

Multiple previous studies using hierarchical frequency-tagging of speech have clearly shown that this response is specific to contexts in which individuals understand the speech. For example, both Ding et al. 2016 and Makov et al. 2017 showed that the phrase-level response is only produced for speech in a familiar language, but not for unfamiliar language or random concatenation of syllables. This pattern of results has been replicated across several languages so far (e.g., English, Chinese, Hebrew, Dutch) as well as for newly learned pseudo-languages (Henin et al. 2021). Accordingly, the current study builds on these previous findings in attributing the 1Hz peak to encoding the phrase-structure of speech.

Author details

1. Paz Har-shai Yahav

   The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan, Israel

   Contribution

   Data curation, Formal analysis, Investigation, Visualization, Methodology, Writing - original draft, Writing - review and editing

   For correspondence

   pazhs10@gmail.com

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0002-3666-3338

2. Elana Zion Golumbic

   The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan, Israel

   Contribution

   Conceptualization, Resources, Data curation, Formal analysis, Supervision, Funding acquisition, Investigation, Methodology, Writing - original draft, Project administration, Writing - review and editing

   For correspondence

   elana.zion-golumbic@biu.ac.il

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0002-8831-3188

• 2,265

  Page views

• 261

  Downloads

• 21

  Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.