When walking into a busy restaurant or café, our sense of hearing is bombarded with different sounds that our brain has to sort through to make sense of our surroundings. Our brain has to balance the desire to focus our attention on sounds we choose to listen to (such as the friend we are having a conversation with) and sounds that attract our attention (such as the sound of someone else’s phone ringing). Without the ability to be distracted, we might miss a noise that may or may not be crucial to our survival, like the engine roar of an approaching vehicle or a ping notifying us of an incoming email. However, it remains unclear what happens in our brains that enables us to shift our attention to background sounds.

To investigate this further, Huang and Elhilali asked 81 participants to focus their attention on a repeating sound while being exposed to background noises from everyday life, such as sounds from a busy café. The experiment showed that when a more noticeable sound happened in the background, such as a loud voice, the participants were more likely to lose attention on their task and miss changes in the tone of the repeating sound.

Huang and Elhilali then measured the brain activity of 12 participants as they counted the number of altered tones in a sequence of sounds, again with noise in the background. This revealed that brain waves synchronized with tones that the participants were concentrating on. However, once there was a noticeable event in the background, this tone synchronization was reduced and the brain waves aligned with the background noise. Huang and Elhilali found that distracting noises in the background activate the same region of the brain as sounds we choose to listen to. This demonstrates how background sounds are able to re-direct our attention.

These results are consistent with the idea that we have a limited capacity for attention, and that new sensory information can divert brain activity. Having a better understanding of how these processes work could help develop better communication aids for people with impaired hearing, and improve software for interpreting sounds with a noisy background.

Attention is a selection mechanism that deploys our limited neural resources to the most relevant stimuli in the environment. Without such a process, the sights and sounds of everyday life would overwhelm our senses. Filtering out important information from our surroundings puts a constant demand on the cognitive system given the dynamic nature of everyday scenes. On the one hand, we attend to sounds, sights and smells that we choose based on what matches our behavioral goals and contextual expectations. At the same time, we have to balance perception of salient events and objects that we need to be alerted to both for survival as well as awareness of our ever changing surrounds. These various factors guide our attentional resources to dynamically shift in order to shape the representation of sensory information based on its behavioral relevance, and ultimately influence how we perceive the world around us.

How does the brain manage its executive attentional resources faced with these dynamic demands? Studies of voluntary (‘top-down’ or endogenous) attention have shown that cognitive feedback modulates the encoding of sensory cues in order to improve the signal-to-noise ratio of attended targets relative to irrelevant maskers or other objects in the environment (Baluch and Itti, 2011; Desimone and Duncan, 1995; Senkowski et al., 2005). Whether attending to someone’s voice amidst a crowd, or spotting that person in a busy street, or even identifying a particular smell among others, changes to neural encoding due to attention have been reported across all sensory modalities including auditory, visual, olfactory and somatosensory systems and appear to operate across multiple neural scales (Corbetta and Shulman, 2002; Zelano et al., 2005; Bauer et al., 2006; Knudsen, 2007). Response profiles of individual neurons, entire sensory circuits, and cross brain regions are modulated by attentional feedback to produce neural responses that reflect not only the physical properties of the stimulus but also the behavioral state and reward expectations of the system. Some of the hallmarks of selective attention are enhanced neural encoding in sensory cortex of attended features and dynamics (e.g. envelope of an attended speaker; Mazziotta et al., 2001) as well as recruitment of dorsal fronto-parietal circuits mediated by boosted gamma oscillatory activity (Fries, 2009; Baluch and Itti, 2011).

In contrast, our understanding of the effects of involuntary (‘bottom-up’ or exogenous) attention has been mostly led by work in vision. There is a well established link between perceptual attributes of salience and their influence on attention deployment in visual scenes (Borji et al., 2013; Treue, 2003; Wolfe and Horowitz, 2004). Studies of visual salience greatly benefited from natural behaviors such as eye gaze which facilitate tracking subjects’ attentional focus and allow the use of rich and naturalistic stimuli including still pictures and videos (Borji, 2015; Carmi and Itti, 2006; Marius 't Hart et al., 2009). In parallel, exploration of brain networks implicated in visual salience revealed engagement of both subcortical and cortical circuits that balance the sensory conspicuity of a visual scene with more task-related information to shape attentional orienting to salient visual objects (Veale et al., 2016). Bottom-up attention also engages ventral fronto-parietal circuits that orient subjects’ focus to salient stimuli outside the spotlight of voluntary attention (Corbetta and Shulman, 2002; Fox et al., 2006; Asplund et al., 2010).

By comparison, the study of auditory bottom-up attention has proven more challenging owing to the difficulty of properly defining behavioral metrics that determine when attention is captured by a salient sound. Pupilometry has been explored in auditory salience studies with recent evidence suggesting a correlation between stimulus salience and pupil size (Liao et al., 2016; Wang et al., 2014; Zhao et al., 2019). Still, there are various aspects of this correlation that remain ill understood, with some evidence suggesting that a large component of the pupillary response is driven by the sound’s loudness and its local context rather than a full account of its perceptual salience (Liao et al., 2017; Huang and Elhilali, 2017). In parallel, a large body of work has focused on deviance detection in auditory sequences, and has established neural markers associated with deviant or rare events. An example of such a response is mismatch negativity (MMN) which can be elicited pre-attentively, though this response is modulated by attention and associated with behavioral measures of distraction (Ririe et al., 2017; Näätänen et al., 2007). By using sequences with deviant tokens or snippets, studies of novelty processing are able to better control the acoustic parameters of the stimulus and the precise occurrence and nature of salient events. Other studies have extended oddball designs using richer sound structures including musical sequences or noise patterns, but still piecing together sound tokens to control presence of transient salient events in the acoustic signal (Duangudom and Anderson, 2013; Kayser et al., 2005; Kaya and Elhilali, 2014; Tordini et al., 2015). Nonetheless, this structure falls short of the natural intricacies of realistic sounds in everyday environments where salience can take on more nuanced manifestations. Similar to established results in vision, use of natural soundscapes could not only extend results observed with simpler oddball sequences; but also shed light on the privileged processing status of social signals that reflect attentional capture in everyday life (Doherty et al., 2017).

In the current work, we explore dynamic deployment of attention using an unconstrained dataset of natural sounds. The collection includes a variety of contents and compositions, and spans samples from everyday situations taken from public databases such as YouTube and Freesound. It covers various settings such as a busy cafeteria, a ballgame at the stadium, a concert in a symphony hall, a dog park, and a protest in the streets. Concurrent with these everyday sounds, subjects’ attention is directed towards a controlled tone sequence where we examine effects of top-down attention to this rhythmic sequence as well as intermittent switches of attention elicited by salient events in background scenes. This paradigm tackles three key limitations in our understanding of the dynamic deployment of attentional resources in complex auditory scenes. First, the study investigates the relationship between auditory salience and bottom-up attentional capture beyond deviance detection paradigms. The stimulus probes how distracting events in a background scene organically compete for attentional resources already deployed toward a dynamic sound sequence. Unlike clearly defined ‘deviants’ typically used in oddball paradigms, the attention-grabbing nature of salient events in natural soundscapes is more behaviorally and cognitively nuanced and exhibits a wide range of dynamics both in strength and buildup. A salient event in a complex scene can vary from a momentary transient event (e.g. a phone ringing in an auditorium) to a gradually dynamic sound (e.g. a distinct voice steadily emerging from the cacophony in a busy cafeteria). Here, we are interested in probing whether this natural and nuanced capture of attention induces equally profound effects on brain responses as previously reported from top-down, task-related attention. The study leverages the organic nature of competition between bottom-up and top-down attention in natural soundscapes to not only test the hypothesis of limited resources shared between the two modes of attention, but also engagement of distinct but overlapping brain networks (Corbetta and Shulman, 2002; Salmi et al., 2009).

Second, employing dynamic scenes allows us to focus our analysis beyond event-related potentials (ERPs) which require precisely-aligned event onsets, hence often limiting paradigms to oddball designs or intermittent distractors. In the current study, the use of continuous scenes is anchored against a rhythmic attended sequence which provides a reference for temporal alignment of competing attentional states throughout the experiment. Third, while the study sheds lights on neural markers of auditory salience, it does so relative to a competing sequence in a controlled attentional task. As such, it balances the dichotomy often found in studies of auditory salience using either distraction or detection paradigms. A number of studies probe bottom-up attention using irrelevant stimuli presented to the subjects without necessarily competing for their attentional focus; or where subjects are informed or learn their value (see Lavie, 2005). Here, we are interested in characterizing the dynamic effect of salient distractors on the encoding of attended targets. Ultimately, the current study aims to determine how well we can predict the existence of attention-grabbing events while subjects are engaged in a competing task.

Listeners perform an amplitude-modulation (AM) detection task by attending to a tone sequence and indicating presence of intermittent modulated target tones (orange note in Figure 1). Concurrently, a busy acoustic scene is presented in the background and subjects are asked to completely ignore it. Background scenes are taken from the JHU DNSS (Dichotic Natural Salience Soundscapes) database for which behavioral estimates of salience timing and strength have been previously collected (Huang and Elhilali, 2017) (see Materials and methods for details). In a first experiment, easy and hard AM detection tasks are interleaved in experimental blocks by changing the modulation depth of the target note (easy: 0 dB, hard: −5 dB). As expected, subjects report a higher overall detection accuracy for the easy condition (75.4%) compared to the hard condition (48.2%). Moreover, target detection (in both easy and hard conditions) is disrupted by presence of a salient event in the ignored background scenes; and detection accuracy drops significantly over a period up to a second after onset of the salient event [drop in detection accuracy; hard task, t(62) = −5.25, p=1.96*10⁻⁶; easy task, t(62) = −5.62, p=4.92*10⁻⁷]. Salient events attract listeners’ attention away from the task at hand and cause a drop in detection accuracy that is proportional to the salience level of background distractors; especially for high and mid salience events [hard task - high salience event t(62) = −4.97, p=5.57*10⁻⁶; mid salience event t(62) = −3.70, p=4.54*10⁻⁴; low salience event t(62) = −0.75, p=0.46; easy task - high salience event t(62) = −4.20, p=8.54*10⁻⁵; mid salience event t(62) = −2.29, p=0.025; low salience event t(62) = −1.51, p=0.14]. In order to further explore neural underpinnings of changes in the attentional state of listeners, this paradigm is repeated with the easy task while neural activity is measured using Electroencephalography (EEG).

Figure 1

Download asset Open asset

The attended tone sequence is presented at a regular tempo of 2.6 Hz and induces a strong overall phase-locked response around this frequency despite the concurrent presentation of a natural scene in the background. Figure 2A shows the grand average spectral profile of the neural response observed throughout the experiment. The plot clearly displays a strong energy at 2.6 Hz, with a left-lateralized fronto-central response, consistent with activation of Heschl’s gyrus and conforming to prior observations of precise phase-locking to relatively slow rates in core auditory cortex (Lütkenhöner and Steinsträter, 1998; Liégeois-Chauvel et al., 2004; Stropahl et al., 2018). (Figure 2A, inset).

Figure 2

Download asset Open asset

Taking a closer look at this phase-locked activity aligned to the tone sequence, the response appears to change during the course of each trial, particularly when coinciding with task-specific AM tone targets, as well as when concurring with salient events in the background scene. Phase-locking near modulated-tone targets shows an increase in 2.6 Hz power relative to the average level, reflecting an expected increase in neural power induced by top-down attention (Figure 2B-top). The same phase-locked response is notably reduced when tones coincide with salient events in the background (Figure 2B-bottom - blue curve), indicating diversion of resources away from the attended sequence and potential markers of distraction caused by salient events in the ignored background.

We contrast variability of 2.6 Hz phase-locked energy over 3 windows of interest in each trial: (i) near AM tone targets, (ii) near salient events and (iii) near tones chosen randomly ‘away’ from either targets or salient events and used as control baseline responses. We compare activity in each of these windows relative to a preceding window (e.g. Figure 1, post vs. pre-event interval). Figure 2C shows that phase-locking to 2.6 Hz after target tones increases significantly [t(443)=4.65, p=4.43*10⁻⁶], whereas it decreases significantly following salient events [t(443)=−5.89, p < 10⁻⁷], relative to preceding non-target tones. A random sampling of tones away from target tones or salient events does not show any significant variability [t(443)=−0.78, p=0.43, Bayes Factor 0.072] indicating a relatively stable phase-locked power in ‘control’ segments of the experiment away from task-relevant targets or bottom-up background events (2C, middle bar). Compared to each other, the top-down attentional effect due to target tones is significantly different from the inherent variability in phase-locked responses in ‘control’ segments [t(886)=3.81, p=1.48*10⁻⁴]; while distraction due to salient events induces a decrease in phase-locking that is significantly different from inherent variability in ‘control’ segments [t(886)=−3.58, p=3.66*10⁻³].

Interestingly, this salience-induced decrease is modulated in strength by the level of salience of background events. The decrease in phase-locked energy is strongest for events with a higher level of salience [t(443)=−3.78, p=1.8*10⁻⁴]. It is also significant for events with mid-level salience [t(443)=−2.57, p=0.01], but marginally reduced though not significant for events with the lowest salience [t(359)=1.33, p=0.20, Bayes Factor BF 0.14] (Figure 2D). A one-way ANOVA did not show a significant difference between the mean suppression at the three salience levels [F(1329)=1.65, p=0.19].

A potential confound to reduced phase-locking due to distraction could be local acoustic variability associated with salient events instead of actual deployment of bottom-up attention that disrupts phase-locking to the attended sequence. While this possibility is unlikely given the significant effect of salient events on behavioral detection of targets, we further reassess loss of phase-locking to the attended rhythm near events by excluding salient events with the highest loudness which could cause energetic masking effects (Moore, 2013). This analysis confirms that phase-locking to 2.6 Hz is still significantly reduced relative to non-event control moments [t(443)=−3.88, p < 10⁻³]. A complementary measure of loudness is also explored by excluding events with the highest energy in one equivalent rectangular bandwidth (ERB) around the tone frequency at 440 Hz (Moore and Glasberg, 1983). Excluding the loudest 25% events by this measure still yields a significant reduction in tone-locking [t(443)=−4.93, p=1.17*10⁻⁶]. In addition, we analyze acoustic attributes of all salient events in background scenes and compare their acoustic attributes to those of randomly selected intervals in non-salient segments. This comparison assesses whether salient events have unique acoustic attributes that are never observed at other moments in the scene. A Bhattacharyya coefficient -BC- (Kailath, 1967) reveals that salient events share the same global acoustic attributes as non-salient moments in the ambient background across a wide range of features (BC for loudness 0.9655, brightness 0.9851, pitch 0.9867, harmonicity .9775 and scale 0.9868). Morever, the significant drop in phase locking is maintained when events are split by strength of low-level acoustic features such as harmonicity or brightness [High Harmonicity, t(443) = −3.75, p=1.97*10⁻⁴; Low Harmonicity, t(443) = −3.77, p=1.82*10⁻⁴; High Brightness, t(443) = −4.18, p=3.51*10⁻⁵; Low Brightness, t(443) = −3.26, p=1.21*10⁻³], further validating that the effect of salience is not solely due to low-level acoustic features.

The reduction of phase-locking to the attended sequences’ rhythm in presence of salient events raises the question whether these ‘attention-grabbing’ instances result in momentary increased neural entrainment to the background scene. While the ambient scene does not contain a steady rate to examine exact phase-locking, its dynamic nature as a natural soundscape allows us to explore the fidelity of encoding of the stimulus envelope before and after salient events. Generally, synchronization of ignored stimuli tends to be greatly suppressed (Ding and Simon, 2012; Fuglsang et al., 2017). Nonetheless, we note a momentary enhancement in decoding accuracy after high salience events compared to a preceding period [paired t-test, t(102) = 2.18, p=0.03] though no such effects are observed in mid [t(113)=−1.09, p=0.28] and low salience [t(107)=0.24, p=0.81] events (Figure 3).

Figure 3

Download asset Open asset

Next, we probe other markers of attentional shift and focus particularly on the Gamma band energy in the neural response (Ray et al., 2008). We contrast spectral profiles of neural responses after target tones, salient events and during ‘control’ tones. Figure 4A depicts a time-frequency profile of neural energy around modulated target tones (0 on the x-axis denotes the start of the target tone). A strong increase in Gamma activity occurs after the onset of target tones and spans a broad spectral bandwidth from 40 to 120 Hz. Figure 4B shows the same time-frequency profile of neural energy relative to attended tones closest to a salient event. The figure clearly shows a decrease in spectral power post-onset of attended tones nearest salient events which is also spectrally broad, though strongest in a high-Gamma range (∼60–120 Hz).

Figure 4

Download asset Open asset

Figure 4C quantifies the variations of Gamma energy relative to targets, salient events, and control tones as compared to a preceding time window. High-Gamma band energy increases significantly following target tones [t(443)=11.5, p < 10⁻⁷]; while it drops significantly for attended tones near salient events [t(443)=−6.83, p < 10⁻⁷]. Control non-event segments show no significant variations in Gamma energy [t(443)=1.5, p=0.13, Bayes factor 0.16] confirming a relatively stable Gamma energy throughout the experimental trials overall. The increase in spectral energy around the Gamma band is significantly different in a direct comparison between target and control tones [t(886)=10.3, p < 10⁻⁷]. Similarly, the decrease in spectral energy around the Gamma band is significantly different when comparing salient events against control tones [t(886)=6.68, p < 10⁻⁷]. As with the decrease in tone locking, the Gamma band energy drop is more prominent for higher salience events [t(443)=−7.72, p < 10⁻⁷], is lower but still significant for mid-level salience events [t(443)=−3.64, p=3.02*10⁻⁴], but not significant for low salience events [t(443)=0.84, p=0.40, Bayes Factor 0.076] (Figure 4D). A one-way ANOVA shows that the three levels of salience strength have significantly different changes in gamma power [F(1329)=20.79, p=1.29*10⁻⁹], with all levels found to be significantly different from each other based on a post-hoc Tukey test.

Furthermore, the modulation of gamma band energy by both bottom-up and top-down attention is further modulated by subjects’ behavior, quantified using signed error (defined as detected targets minus actual targets - see Materials and methods). Targets in scenes with negative signed error (suggesting that modulated targets were missed due to lower top-down attentional focus) show a smaller increase in gamma power than events in scenes with positive signed error. This difference is significant based on a two-sample t-test [t(886)=−3.96, p=8.06*10⁻⁵]. Conversely, salient events within negative signed error scenes showed significantly higher increase in gamma than those in positive signed error scenes [t(886)=4.32, p=1.74*10⁻⁵], suggesting that lower top-down attention indicated higher bottom-up attention, and vice versa. A qualitatively similar result is obtained by grouping subjects’ behavior by error size (absolute error) rather than signed error.

Given this push-pull competition between bottom-up and top-down attentional responses to tones in the attended rhythmic sequence, we examine similarities between neural loci engaged during these different phases of the neural response. Using the Brainstorm software package (Tadel et al., 2011), electrode activations are mapped onto brain surface sources using standardized low resolution brain electromagnetic tomography (sLORETA, see Materials and methods for details). This analysis of localized Gamma activity across cortical voxels examines brain regions uniquely engaged while attending to target tones or distracted by a salient event (relative to background activity of control tones).

We correlate the topography of these top-down and bottom-up brain voxels using sparse canonical correlation analysis (sCCA) (Roeber et al., 2003; Witten and Tibshirani, 2009; Lin et al., 2013) to estimate multivariate similarity between these brain networks at different time lags (Figure 5A, see Materials and methods for details). Canonical correlation analysis (CCA) is a form of multivariate analysis of correlation where high-dimensional data are compared in order to discover interpretable associations (or correlations) represented as data projections -called canonical vectors- (Uurtio et al., 2018). Imposing sparse constraints on this procedure improves interpretability of these projections by confining these mapping to constrained vectors. We cross-correlate brain activation maps at different time lags, and consider that similar brain networks are engaged if a statistically significant correlation emerges from the canonical analysis. Figure 5B shows that a significant correlation between Gamma activity in brain voxels is observed about 1 s after tone onset, with bottom-up attention to salient events engaging these circuits about 0.5 s earlier relative to activation by top-down attention. The contoured area denotes statistically significant canonical correlations with p < 0.005, and highlights that the overlap in bottom-up and top-down brain networks is slightly offset in time (mostly off the diagonal axis) with an earlier activation by salient events. A closer look at canonical vectors resulting from this correlation analysis reveals the topography of brain networks most contributing to this correlation. Canonical vectors reflect the set of weights applied to each voxel map that results in maximal correlation, and can therefore be represented in voxel space. These canonical vectors show a stable pattern over time lags of significant correlation and reveal a topography with strong contributions of frontal and parietal brain. Figure 5C shows a representative profile of overlapped canonical vectors obtained from SCCA analysis corresponding to the the time lag shown with an asterisk in Figure 5B and reveals the engagement of inferior/middle frontal gyrus (IFG/MFG) as well as the superior parietal lobule (SPL).

Figure 5

Download asset Open asset

Given the profound effects of bottom-up attention on neural responses, we examine the predictive power of changes in tone-locking and Gamma-energy modulations as biomarkers of auditory salience. We train a neural network classifier to infer whether a tone in the attended sequence is aligned with a salient distractor in the background scene or not. Figure 6 shows that classification accuracy for each neural marker, measured by the area under the ROC curve. Both Gamma and tone-locking yield significant predictions above chance [Gamma energy: 68.5% accuracy, t(9) = 4.12, p < 10⁻³; Tone-locking: 73% accuracy, t(9) = 6.03, p < 10⁻⁵]. Interestingly, the best accuracy is achieved when including both features [79% accuracy, t(9) = 7.20, p < 10⁻⁷], alluding to the fact that Gamma-band energy and phase-locking may contribute complementary information regarding the presence of attention-grabbing salient events in the background. Furthermore, an estimate of noise floor for this classification (see Materials and methods) yields a prediction range of 2% which is below the improvement in accuracy observed from combining both features. In addition, interaction information (IF) across these features was assessed. IF is an information theory metric that quantifies whether two features are complementary with respect to a class variable (Yeung, 1991; Matsuda, 2000; Shuai and Elhilali, 2014). This measure results in greater mutual information I(F1,F2;S)=0.65 using both gamma energy and tone-locking than the combination of both measures I(F1;S)+I(F2;S)=0.23+0.27, again suggesting a possible complimentary role of both features as biomarkers of salience.

Figure 6

Download asset Open asset

Selective attention heavily modulates brain activity (Baluch and Itti, 2011; Knudsen, 2007), and bottom-up auditory attention is no exception (Ahveninen et al., 2013; Alho et al., 2014; Salmi et al., 2009). The current study reinforces the view that profound and dynamic changes to neural responses in both sensory and cognitive networks are induced by bottom-up auditory attention. It further demonstrates that these effects compete with top-down attention for neural resources, interrupting behavioral and neural encoding of the attended stimulus by engaging neural circuits that reflect the cognitive salience of ambient distractors. Modulation of both steady-state phase-locked activity in response to the attended stream as well as energy in the high gamma band is so profound that it can accurately identify moments in the neural response coinciding with these salient events with an accuracy of up to 79% relative to control -non salient- moments. The observed changes in both phase-locked activity as well as gamma oscillations dynamically change in opposing directions based on engagement of voluntary or stimulus-driven attention. This dichotomy strongly suggests shared limited resources devoted to tracking a sequence of interest, resulting in either enhancement or suppression of neural encoding of this attended target as a result of occasional competing objects (Lavie, 2005; Scalf et al., 2013). This push-pull action is strongly modulated by the salience of events in the ambient scene which not only reflect the dynamic acoustic profile of natural sounds, but also their higher-level perceptual and semantic representations, hence shedding light on dynamic reorienting mechanisms underlying the brain’s awareness of its surroundings in everyday social environments (Corbetta et al., 2008; Doherty et al., 2017). Further evidence of this push-pull interaction is also observed when accounting for subjects’ behavior, where trials with lower errors (suggesting higher attentional focus on the dynamic scene) result in higher enhancement of gamma power of targets and lower suppression by salient events; while trials with higher error (suggesting lower attentional focus) result in lower enhancement of targets and higher suppression by salient events.

The fidelity of the neural representation of an auditory stimulus can be easily quantified by the power of phase-locked responses to the driving rhythm. Enhancement of this phase-locking is accepted as one of the hallmarks of top-down attention and has been observed using a wide range of stimuli from simple tone sequences (similar to targets employed here) to complex signals (e.g. speech) (Elhilali et al., 2009; Mesgarani and Chang, 2012; Fuglsang et al., 2017). By enhancing neural encoding of voluntarily-attended sensory inputs relative to other objects in the scene, attentional feedback effectively facilitates selection and tracking of objects of interest and suppression of irrelevant sensory information (Knudsen, 2007; Shamma and Fritz, 2014). In the current study, we observe that diverting attention away from the attended stream does in fact suppress the power of phase-locking relative to a baseline level, tapered by the degree of salience of the distracting event (Figure 2C–D). The locus of this modulated phase-locked activity is generally consistent with core auditory cortex, though no precise topography can be localized from scalp activity only. Still, engagement of core sensory cortex in both enhancement and suppression of phase-locked responses to the attended sequence concurs with a role of auditory cortex in auditory scene analysis and auditory object formation (Ding and Simon, 2012; Leaver and Rauschecker, 2010). Moreover, the drop of steady-state following responses due to distractors coincides with a significant increase in the encoding of the background scene near highly-salient events, as reflected in the accuracy of the ambient scene reconstruction (Figure 3). Generally, the ability to decode entrainment to a dynamic envelope is a non-trivial task often yielding rather low reconstruction accuracy values (O'Sullivan et al., 2015; Vanthornhout et al., 2019); and is even more challenging for background sources away from attentional focus (Ding and Simon, 2012; Fuglsang et al., 2017). Still, neural decoding of ignored scenes results in boosted accuracy at specific moments coinciding with salient events. Such enhancement suggests that neural resources are indeed being diverted during those specific moments due to competition for neural representation between the attended target and the salient background object. Such diversion of resources is consistent with prior reports supporting load theory which posits that capacity limitations dictate the degree to which otherwise ignored sensory information can divert processing capability within and across modalities (Lavie, 2010; Salmi et al., 2009; Molloy et al., 2018).

Further analysis of this push-pull modulation of phase-locked activity rules out an interpretation based on acoustic masking which reduces the target-to-noise ration during distracting events resulting in a weaker auditory stimulation. A comparison of acoustic features throughout the background scene shows that there are no global differences between moments deemed attention-grabbing vs. background segments in the JHU DNSS dataset. Specifically, salient events were not confined to simply louder moments in the scene. Rather, some dense scenes contained ongoing raucous activity that would be perceived as continuously loud but not necessarily salient, except for specific conspicuous moments (e.g. emergence of a human voice or occasional discernible background music in an otherwise busy cafeteria scene). As such, what makes certain events salient is not the instantaneous acoustic profile independent of context. Instead, it is often a relative change in the scene statistics reflecting not only acoustic changes but also perceptual and semantic manifestations that normally emerge during everyday social settings. Moreover, excluding the loudest salient events (using both envelope-level and spectral-based measures) still reveals a significant drop of phase-locked activity relative to baseline tones further confirming that this effect cannot be simply attributed to energetic masking of the attended sequence. An additional analysis grouping salient events based on various low-level acoustic attributes (harmonicity, brightness) shows no difference in the degree of suppressed phase-locking induced by different sub-groups of events. Finally, the significant drop in behavioral accuracy in the attended task further confirms the distraction effect likely due to disengagement of attentional focus away from the attended sequence. It should however be noted that the behavioral design of the EEG experiment did not place any target tones in the post-event region in order to avoid any contamination of the neural signal. As such, it was not possible to perform a direct comparison of target tones and salient events and all analyses were compared against preceding time windows to assess the relative modulation of neural phase-locked activity as the stimulus sequence unfolded.

The engagement of executive attention resources in the current paradigm is further observed in enhancements in gamma-band activity, which is also consistent with prior effects linking modulation of gamma-band activity and engagement of cognitive control, particularly with attentional networks. Specifically, enhancement of high-frequency gamma has been reported in conjunction with top-down attention in auditory, visual, and somatosensory tasks (Debener et al., 2003; Tallon-Baudry et al., 2005; Bauer et al., 2006; Senkowski et al., 2005). While enhanced gamma oscillations index effective sensory processing due to voluntary attention, they also interface with mnemonic processes, particularly encoding of sensory information in short-term memory (Sederberg et al., 2003; Jensen et al., 2007). Given the demands of the current paradigm to remember the number of modulated targets in the attended sequence, it is not surprising to observe that the enhancement of gamma energy extends over a period of a few seconds post target onset, in line with previously reported effects of memory consolidation (Tallon-Baudry and Bertrand, 1999). In some instances, gamma band activity have also been reported to increase during attentional capture (Buschman and Miller, 2007); though two distinctions with the current study design are worth noting: First, our analysis is explicitly aligned to the attended target sequence hence probing distraction effects on activity relative to the foreground sound. Second, the modulation of gamma-band activity is very much tied with task demands, the notion of salience, and how it relates to both the perceptual and cognitive load imposed by the task at hand (Lavie, 2005). Importantly, the current paradigm emulates natural listening situations, which reaffirms the privileged status of social distractors previously reported in visual tasks (Doherty et al., 2017).

While effects of enhancement of broadband gamma frequency synchronization reflecting an interface of attentional and memory processing have been widely reported, reduction in gamma-band energy due to distraction effects is not commonly observed. Few studies, encompassing data from animal or human subjects, have shown a potential link between modulation of gamma energy and impaired attention, in line with results observed here. Ririe and colleagues reported reduced Local Field Potential activity (including gamma band energy) during audiovisual distraction in medial prefrontal cortex in freely behaving rats (Ririe et al., 2017). Bonnefond et al. used Magentoencephalography (MEG) in human listeners and reported reduced gamma for distractors during a memory task very much in line with observed effects in the current task (Bonnefond and Jensen, 2013). Moreover, modulation of gamma activity has been ruled out as being associated with novel unexpected stimuli (Debener et al., 2003) and is likely linked to ongoing shifts in attentional focus of listeners throughout the task reflecting the interaction between top-down executive control and sound-driven activity.

Importantly, the analysis of neural networks engaged during this push-pull effect points to overlapping networks spanning frontal and parietal areas involved during both bottom-up and top-down attention with a temporal offset for engagement of these networks (Figure 5). On the one hand, there is strong evidence in the literature dissociating dorsal and ventral networks of bottom-up and top-down attentional engagement, respectively (Corbetta and Shulman, 2002). Such networks have been reported across sensory tasks suggesting a supramodel attentional circuitry that interfaces with sensory networks in guiding selection and tracking of targets of interest while maintaining sensitivity to salient objects in a dynamic scene (Spagna et al., 2015). On the other hand, there are overlapping brain regions that underlie top-down as well as bottom-up attentional control particularly centered in the lateral prefrontal cortex, and interface between the two systems to guide behavioral responses that not only account for task-guided goals, but also environmentally-relevant stimuli (Asplund et al., 2010; Corbetta et al., 2008). Our analysis shows that there is a coordinated interaction between these two networks consistent with other reports of a possible shared circuitry, especially in the auditory modality (Alho et al., 2014). The current study specifically reveals a consistent temporal offset in the activation of the two networks. A possible interpretation of this dynamic interaction could be that signals from bottom-up attentional networks interrupt activity in the top-down network, potentially reorienting the locus of attention (Ahveninen et al., 2013; Corbetta et al., 2008; Salmi et al., 2009). Building on this interpretation, two possible hypotheses emerge from the earlier engagement of this common orienting network by bottom-up attention. One, that engagement of bottom-up attention sends an inhibitory reset signal in order to reorient attention to socially engaging salient events. Two, that earlier engagement of overlapped networks of attention by salient events reflects reduced memory consolidation due to a distraction effect, which is itself tied to diminished sensory encoding of the attended rhythm.

The ability to analyze the circuitry underlying the interaction between bottom-up and top-down networks in the current study was facilitated by a powerful multivariate regression technique named Canonical correlation analysis (CCA). This approach attempts to circumvent the limitations of comparisons across source topographies in electroencephalography (EEG) and leverages multivariate techniques to explore relationships between high-dimensional datasets which have been championed with great success in numerous applications including neuroimaging, pharmacological and genomic studies (Parkhomenko et al., 2009; Wang et al., 2015; Bilenko and Gallant, 2016). While applying CCA directly to very high-dimensional data can be challenging or uninterpretable, the use of kernel-based regularizations with constraints such as sparsity as adopted in the current work allows mappings between high-dimensional brain images (Witten et al., 2009; Gao et al., 2015; Uurtio et al., 2018). Here, we adapted the approach proposed by Rosa et al. (2015) as it not only regularizes the correlation analysis over sparse constraints, but also optimally defines these constraints in a data-driven fashion. The permutation-based approach yields an optimal way to define statistical significance of observed correlation effects as well as constraints on optimization parameters much in line with cross-validation tests performed in statistical analyses, hence reducing bias by the experimenter in defining parameters (Witten and Tibshirani, 2009; Lin et al., 2013). The resulting sCCA coefficients delimit brain regions with statistically significant common effects. Consistent with previous findings, the analysis does reveal that areas with statistically significant activations lie in inferior parietal and frontal cortices, particularly inferior and medial temporal gyri as well as the superior parietal lobule (Alho et al., 2014).

In conclusion, the use of a naturalistic experimental paradigm provides a range of nuanced ambient distractions similar to what one experiences in everyday life and demonstrates the dynamic competition for attentional resources between task and socially-relevant stimulus-driven cues. It not only sheds light on profound effects of both top-down and bottom-up attention in continuously shaping brain responses, but it also reveals a steady push-pull competition between these two systems for limited natural resources and active engagement by listeners.

Analysis from all data generated during this study are included in the manuscript and supporting files.

1. 1. Ahveninen J
   2. Huang S
   3. Belliveau JW
   4. Chang WT
   5. Hämäläinen M

   (2013) Dynamic oscillatory processes governing cued orienting and allocation of auditory attention

   Journal of Cognitive Neuroscience 25:1926–1943.

   https://doi.org/10.1162/jocn_a_00452

   • PubMed
   • Google Scholar
2. 1. Alho K
   2. Salmi J
   3. Koistinen S
   4. Salonen O
   5. Rinne T

   (2014) Top-down controlled and bottom-up triggered orienting of auditory attention to pitch activate overlapping brain networks

   Brain Research 1626:136–145.

   https://doi.org/10.1016/j.brainres.2014.12.050

   • PubMed
   • Google Scholar
3. 1. Asplund CL
   2. Todd JJ
   3. Snyder AP
   4. Marois R

   (2010) A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention

   Nature Neuroscience 13:507–512.

   https://doi.org/10.1038/nn.2509

   • PubMed
   • Google Scholar
4. 1. Baluch F
   2. Itti L

   (2011) Mechanisms of top-down attention

   Trends in Neurosciences 34:210–224.

   https://doi.org/10.1016/j.tins.2011.02.003

   • PubMed
   • Google Scholar
5. 1. Bauer M
   2. Oostenveld R
   3. Peeters M
   4. Fries P

   (2006) Tactile spatial attention enhances gamma-band activity in somatosensory cortex and reduces low-frequency activity in parieto-occipital Areas

   Journal of Neuroscience 26:490–501.

   https://doi.org/10.1523/JNEUROSCI.5228-04.2006

   • PubMed
   • Google Scholar
6. 1. Bilenko NY
   2. Gallant JL

   (2016) Pyrcca: regularized kernel canonical correlation analysis in Python and its applications to neuroimaging

   Frontiers in Neuroinformatics 10:49.

   https://doi.org/10.3389/fninf.2016.00049

   • PubMed
   • Google Scholar
7. 1. Bonnefond M
   2. Jensen O

   (2013) The role of gamma and alpha oscillations for blocking out distraction

   Communicative & Integrative Biology 6:e22702.

   https://doi.org/10.4161/cib.22702

   • PubMed
   • Google Scholar
8. 1. Borji A
   2. Sihite DN
   3. Itti L

   (2013) Quantitative analysis of human-model agreement in visual saliency modeling: a comparative study

   IEEE Transactions on Image Processing 22:55–69.

   https://doi.org/10.1109/TIP.2012.2210727

   • PubMed
   • Google Scholar
9. 1. Borji A

   (2015) What is a salient object? A dataset and a baseline model for salient object detection

   IEEE Transactions on Image Processing 24:742–756.

   https://doi.org/10.1109/TIP.2014.2383320

   • PubMed
   • Google Scholar
10. 1. Buschman TJ
    2. Miller EK

    (2007) Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices

    Science 315:1860–1862.

    https://doi.org/10.1126/science.1138071

    • PubMed
    • Google Scholar
11. 1. Carmi R
    2. Itti L

    (2006) Visual causes versus correlates of attentional selection in dynamic scenes

    Vision Research 46:4333–4345.

    https://doi.org/10.1016/j.visres.2006.08.019

    • PubMed
    • Google Scholar
12. 1. Corbetta M
    2. Patel G
    3. Shulman GL

    (2008) The reorienting system of the human brain: from environment to theory of mind

    Neuron 58:306–324.

    https://doi.org/10.1016/j.neuron.2008.04.017

    • Google Scholar
13. 1. Corbetta M
    2. Shulman GL

    (2002) Control of goal-directed and stimulus-driven attention in the brain

    Nature Reviews Neuroscience 3:201–215.

    https://doi.org/10.1038/nrn755

    • PubMed
    • Google Scholar
14. 1. de Leeuw JR

    (2015) jsPsych: a JavaScript library for creating behavioral experiments in a web browser

    Behavior Research Methods 47:1–12.

    https://doi.org/10.3758/s13428-014-0458-y

    • PubMed
    • Google Scholar
15. 1. Debener S
    2. Herrmann CS
    3. Kranczioch C
    4. Gembris D
    5. Engel AK

    (2003) Top-down attentional processing enhances auditory evoked gamma band activity

    NeuroReport 14:683–686.

    https://doi.org/10.1097/00001756-200304150-00005

    • PubMed
    • Google Scholar
16. 1. Delorme A
    2. Makeig S

    (2004) EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis

    Journal of Neuroscience Methods 134:9–21.

    https://doi.org/10.1016/j.jneumeth.2003.10.009

    • Google Scholar
17. 1. Deng L

    (2013) Deep learning: methods and applications

    Foundations and Trends in Signal Processing 7:197–387.

    https://doi.org/10.1561/2000000039

    • Google Scholar
18. 1. Desimone R
    2. Duncan J

    (1995) Neural mechanisms of selective visual attention

    Annual Review of Neuroscience 18:193–222.

    https://doi.org/10.1146/annurev.ne.18.030195.001205

    • PubMed
    • Google Scholar
19. 1. Dienes Z

    (2014) Using Bayes to get the most out of non-significant results

    Frontiers in Psychology 5:781.

    https://doi.org/10.3389/fpsyg.2014.00781

    • PubMed
    • Google Scholar
20. 1. Ding N
    2. Simon JZ

    (2012) Emergence of neural encoding of auditory objects while listening to competing speakers

    PNAS 109:11854–11859.

    https://doi.org/10.1073/pnas.1205381109

    • PubMed
    • Google Scholar
21. 1. Doherty BR
    2. Patai EZ
    3. Duta M
    4. Nobre AC
    5. Scerif G

    (2017) The functional consequences of social distraction: Attention and memory for complex scenes

    Cognition 158:215–223.

    https://doi.org/10.1016/j.cognition.2016.10.015

    • Google Scholar
22. Conference

    1. Duangudom V
    2. Anderson D

    (2013) Identifying salient sounds using dual-task experiments

    IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA). pp. 1–4.

    https://doi.org/10.1109/WASPAA.2013.6701865

    • Google Scholar
23. Book

    1. Efron B

    (2010) Large Scale Inference

    Cambridge University Press.

    https://doi.org/10.1017/CBO9780511761362

    • Google Scholar
24. 1. Elhilali M
    2. Xiang J
    3. Shamma SA
    4. Simon JZ

    (2009) Interaction between attention and bottom-up saliency mediates the representation of foreground and background in an auditory scene

    PLOS Biology 7:e1000129.

    https://doi.org/10.1371/journal.pbio.1000129

    • PubMed
    • Google Scholar
25. 1. Fox MD
    2. Corbetta M
    3. Snyder AZ
    4. Vincent JL
    5. Raichle ME

    (2006) Spontaneous neuronal activity distinguishes human dorsal and ventral attention systems

    PNAS 103:10046–10051.

    https://doi.org/10.1073/pnas.0604187103

    • Google Scholar
26. 1. Fries P

    (2009) Neuronal Gamma-Band synchronization as a fundamental process in cortical computation

    Annual Review of Neuroscience 32:209–224.

    https://doi.org/10.1146/annurev.neuro.051508.135603

    • Google Scholar
27. 1. Fuglsang SA
    2. Dau T
    3. Hjortkjær J

    (2017) Noise-robust cortical tracking of attended speech in real-world acoustic scenes

    NeuroImage 156:435–444.

    https://doi.org/10.1016/j.neuroimage.2017.04.026

    • PubMed
    • Google Scholar
28. 1. Gao C
    2. Ma Z
    3. Ren Z
    4. Zhou HH

    (2015) Minimax estimation in sparse canonical correlation analysis

    The Annals of Statistics 43:2168–2197.

    https://doi.org/10.1214/15-AOS1332

    • Google Scholar
29. Book

    1. Goodfellow I
    2. Bengio Y
    3. Courville A

    (2016)

    Deep Learning

    MIT press.

    • Google Scholar
30. 1. Gureckis TM
    2. Martin J
    3. McDonnell J
    4. Rich AS
    5. Markant D
    6. Coenen A
    7. Halpern D
    8. Hamrick JB
    9. Chan P

    (2016) psiTurk: an open-source framework for conducting replicable behavioral experiments online

    Behavior Research Methods 48:829–842.

    https://doi.org/10.3758/s13428-015-0642-8

    • PubMed
    • Google Scholar
31. Book

    1. Hsu J

    (1996) Multiple Comparisons: Theory and Methods

    Chapman & Hall/CRC.

    https://doi.org/10.1002/1097-0258(20000730)19:14<1951::AID-SIM471>3.0.CO;2-W

    • Google Scholar
32. 1. Huang N
    2. Elhilali M

    (2017) Auditory salience using natural soundscapes

    The Journal of the Acoustical Society of America 141:2163–2176.

    https://doi.org/10.1121/1.4979055

    • PubMed
    • Google Scholar
33. 1. Jensen O
    2. Kaiser J
    3. Lachaux JP

    (2007) Human gamma-frequency oscillations associated with attention and memory

    Trends in Neurosciences 30:317–324.

    https://doi.org/10.1016/j.tins.2007.05.001

    • PubMed
    • Google Scholar
34. 1. Kailath T

    (1967) The divergence and Bhattacharyya distance measures in signal selection

    IEEE Transactions on Communications 15:52–60.

    https://doi.org/10.1109/TCOM.1967.1089532

    • Google Scholar
35. 1. Kaya EM
    2. Elhilali M

    (2014) Investigating bottom-up auditory attention

    Frontiers in Human Neuroscience 8:327.

    https://doi.org/10.3389/fnhum.2014.00327

    • PubMed
    • Google Scholar
36. 1. Kayser C
    2. Petkov CI
    3. Lippert M
    4. Logothetis NK

    (2005) Mechanisms for allocating auditory attention: an auditory saliency map

    Current Biology 15:1943–1947.

    https://doi.org/10.1016/j.cub.2005.09.040

    • PubMed
    • Google Scholar
37. 1. Knudsen EI

    (2007) Fundamental components of attention

    Annual Review of Neuroscience 30:57–78.

    https://doi.org/10.1146/annurev.neuro.30.051606.094256

    • PubMed
    • Google Scholar
38. 1. Lavie N

    (2005) Distracted and confused?: selective attention under load

    Trends in Cognitive Sciences 9:75–82.

    https://doi.org/10.1016/j.tics.2004.12.004

    • PubMed
    • Google Scholar
39. 1. Lavie N

    (2010) Attention, distraction, and cognitive control under load

    Current Directions in Psychological Science 19:143–148.

    https://doi.org/10.1177/0963721410370295

    • Google Scholar
40. 1. Leaver AM
    2. Rauschecker JP

    (2010) Cortical representation of natural complex sounds: effects of acoustic features and auditory object category

    Journal of Neuroscience 30:7604–7612.

    https://doi.org/10.1523/JNEUROSCI.0296-10.2010

    • PubMed
    • Google Scholar
41. 1. Liao HI
    2. Kidani S
    3. Yoneya M
    4. Kashino M
    5. Furukawa S

    (2016) Correspondences among pupillary dilation response, subjective salience of sounds, and loudness

    Psychonomic Bulletin & Review 23:412–425.

    https://doi.org/10.3758/s13423-015-0898-0

    • PubMed
    • Google Scholar
42. Conference

    1. Liao HI
    2. Zhao S
    3. Chait M
    4. Kashino M
    5. Furukawa S

    (2017)

    How the eyes detect acoustic transitions: a study of pupillary responses to transitions between regular and random frequency patterns

    Association for Research in Otolaryngology.

    • Google Scholar
43. 1. Liégeois-Chauvel C
    2. Lorenzi C
    3. Trébuchon A
    4. Régis J
    5. Chauvel P

    (2004) Temporal envelope processing in the human left and right auditory cortices

    Cerebral Cortex 14:731–740.

    https://doi.org/10.1093/cercor/bhh033

    • PubMed
    • Google Scholar
44. 1. Lin D
    2. Zhang J
    3. Li J
    4. Calhoun VD
    5. Deng HW
    6. Wang YP

    (2013) Group sparse canonical correlation analysis for genomic data integration

    BMC Bioinformatics 14:245.

    https://doi.org/10.1186/1471-2105-14-245

    • PubMed
    • Google Scholar
45. 1. Lindquist MA
    2. Mejia A

    (2015) Zen and the art of multiple comparisons

    Psychosomatic Medicine 77:114–125.

    https://doi.org/10.1097/PSY.0000000000000148

    • PubMed
    • Google Scholar
46. 1. Lütkenhöner B
    2. Steinsträter O

    (1998) High-precision neuromagnetic study of the functional organization of the human auditory cortex

    Audiology and Neurotology 3:191–213.

    https://doi.org/10.1159/000013790

    • PubMed
    • Google Scholar
47. 1. Marius 't Hart B
    2. Vockeroth J
    3. Schumann F
    4. Bartl K
    5. Schneider E
    6. König P
    7. Einhäuser W

    (2009) Gaze allocation in natural stimuli: comparing free exploration to head-fixed viewing conditions

    Visual Cognition 17:1132–1158.

    https://doi.org/10.1080/13506280902812304

    • Google Scholar
48. 1. Matsuda H

    (2000) Physical nature of higher-order mutual information: intrinsic correlations and frustration

    Physical Review E 62:3096–3102.

    https://doi.org/10.1103/PhysRevE.62.3096

    • Google Scholar
49. 1. Mazziotta J
    2. Toga A
    3. Evans A
    4. Fox P
    5. Lancaster J
    6. Zilles K
    7. Woods R
    8. Paus T
    9. Simpson G
    10. Pike B
    11. Holmes C
    12. Collins L
    13. Thompson P
    14. MacDonald D
    15. Iacoboni M
    16. Schormann T
    17. Amunts K
    18. Palomero-Gallagher N
    19. Geyer S
    20. Parsons L
    21. Narr K
    22. Kabani N
    23. Goualher GL
    24. Boomsma D
    25. Cannon T
    26. Kawashima R
    27. Mazoyer B

    (2001) A probabilistic atlas and reference system for the human brain: international consortium for brain mapping (ICBM)

    Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences 356:1293–1322.

    https://doi.org/10.1098/rstb.2001.0915

    • Google Scholar
50. 1. Mesgarani N
    2. Chang EF

    (2012) Selective cortical representation of attended speaker in multi-talker speech perception

    Nature 485:233–236.

    https://doi.org/10.1038/nature11020

    • PubMed
    • Google Scholar
51. 1. Molloy K
    2. Lavie N
    3. Chait M

    (2018) Auditory figure-ground segregation is impaired by high visual load

    The Journal of Neuroscience 18:2518-18.

    https://doi.org/10.1523/JNEUROSCI.2518-18.2018

    • Google Scholar
52. Book

    1. Moore BCJ

    (2013)

    An Introduction to the Psychology of Hearing (Sixth ed)

    Brill.

    • Google Scholar
53. 1. Moore BCJ
    2. Glasberg BR

    (1983) Suggested formulae for calculating auditory‐filter bandwidths and excitation patterns

    The Journal of the Acoustical Society of America 74:750–753.

    https://doi.org/10.1121/1.389861

    • Google Scholar
54. Conference

    1. Mullen T

    (2012)

    CleanLine EEGLAB plugin

    Neuroimaging Informatics Tools and Resources Clearinghouse (NITRC).

    • Google Scholar
55. 1. Näätänen R
    2. Paavilainen P
    3. Rinne T
    4. Alho K

    (2007) The mismatch negativity (MMN) in basic research of central auditory processing A review

    Clinical Neurophysiology 12:2544–2590.

    https://doi.org/10.1016/j.clinph.2007.04.026

    • Google Scholar
56. 1. O'Sullivan JA
    2. Shamma SA
    3. Lalor EC

    (2015) Evidence for neural computations of temporal coherence in an auditory scene and their enhancement during active listening

    Journal of Neuroscience 35:7256–7263.

    https://doi.org/10.1523/JNEUROSCI.4973-14.2015

    • Google Scholar
57. 1. Oostenveld R
    2. Fries P
    3. Maris E
    4. Schoffelen J-M

    (2011) FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data

    Computational Intelligence and Neuroscience 2011:1–9.

    https://doi.org/10.1155/2011/156869

    • Google Scholar
58. 1. Parkhomenko E
    2. Tritchler D
    3. Beyene J

    (2009) Sparse canonical correlation analysis with application to genomic data integration

    Statistical Applications in Genetics and Molecular Biology 8:1–34.

    https://doi.org/10.2202/1544-6115.1406

    • Google Scholar
59. 1. Pascual-Marqui RD

    (2002)

    Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details

    Methods and Findings in Experimental and Clinical Pharmacology 24 Suppl D:5–12.

    • PubMed
    • Google Scholar
60. 1. Ray S
    2. Niebur E
    3. Hsiao SS
    4. Sinai A
    5. Crone NE

    (2008) High-frequency gamma activity (80-150Hz) is increased in human cortex during selective attention

    Clinical Neurophysiology 119:116–133.

    https://doi.org/10.1016/j.clinph.2007.09.136

    • PubMed
    • Google Scholar
61. 1. Ririe DG
    2. Boada MD
    3. Schmidt BS
    4. Martin SJ
    5. Kim SA
    6. Martin TJ

    (2017) Audiovisual distraction increases prefrontal cortical neuronal activity and impairs attentional performance in the rat

    Journal of Experimental Neuroscience 11:117906951770308.

    https://doi.org/10.1177/1179069517703080

    • Google Scholar
62. 1. Roeber U
    2. Widmann A
    3. Schröger E

    (2003) Auditory distraction by duration and location deviants: a behavioral and event-related potential study

    Cognitive Brain Research 17:347–357.

    https://doi.org/10.1016/S0926-6410(03)00136-8

    • PubMed
    • Google Scholar
63. 1. Rosa MJ
    2. Mehta MA
    3. Pich EM
    4. Risterucci C
    5. Zelaya F
    6. Reinders AA
    7. Williams SC
    8. Dazzan P
    9. Doyle OM
    10. Marquand AF

    (2015) Estimating multivariate similarity between neuroimaging datasets with sparse canonical correlation analysis: an application to perfusion imaging

    Frontiers in Neuroscience 9:366.

    https://doi.org/10.3389/fnins.2015.00366

    • PubMed
    • Google Scholar
64. 1. Salmi J
    2. Rinne T
    3. Koistinen S
    4. Salonen O
    5. Alho K

    (2009) Brain networks of bottom-up triggered and top-down controlled shifting of auditory attention

    Brain Research 1286:155–164.

    https://doi.org/10.1016/j.brainres.2009.06.083

    • PubMed
    • Google Scholar
65. 1. Scalf PE
    2. Torralbo A
    3. Tapia E
    4. Beck DM

    (2013) Competition explains limited attention and perceptual resources: implications for perceptual load and dilution theories

    Frontiers in Psychology 4:243.

    https://doi.org/10.3389/fpsyg.2013.00243

    • PubMed
    • Google Scholar
66. 1. Sederberg PB
    2. Kahana MJ
    3. Howard MW
    4. Donner EJ
    5. Madsen JR

    (2003) Theta and gamma oscillations during encoding predict subsequent recall

    The Journal of Neuroscience 23:10809–10814.

    https://doi.org/10.1523/JNEUROSCI.23-34-10809.2003

    • PubMed
    • Google Scholar
67. 1. Senkowski D
    2. Talsma D
    3. Herrmann CS
    4. Woldorff MG

    (2005) Multisensory processing and oscillatory gamma responses: effects of spatial selective attention

    Experimental Brain Research 166:411–426.

    https://doi.org/10.1007/s00221-005-2381-z

    • PubMed
    • Google Scholar
68. 1. Shamma S
    2. Fritz J

    (2014) Adaptive auditory computations

    Current Opinion in Neurobiology 25:164–168.

    https://doi.org/10.1016/j.conb.2014.01.011

    • Google Scholar
69. 1. Shuai L
    2. Elhilali M

    (2014) Task-dependent neural representations of salient events in dynamic auditory scenes

    Frontiers in Neuroscience 8:203.

    https://doi.org/10.3389/fnins.2014.00203

    • PubMed
    • Google Scholar
70. 1. Singha S
    2. Shenoy PP

    (2018) An adaptive heuristic for feature selection based on complementarity

    Machine Learning 107:2027–2071.

    https://doi.org/10.1007/s10994-018-5728-y

    • Google Scholar
71. Book

    1. Snedecor G
    2. Cochran W

    (1989)

    Statistical Methods

    Ames: Iowa State University Press.

    • Google Scholar
72. 1. Spagna A
    2. Mackie MA
    3. Fan J

    (2015) Supramodal executive control of attention

    Frontiers in Psychology 6:35.

    https://doi.org/10.3389/fpsyg.2015.00065

    • PubMed
    • Google Scholar
73. 1. Stropahl M
    2. Bauer AR
    3. Debener S
    4. Bleichner MG

    (2018) Source-Modeling auditory processes of EEG data using EEGLAB and brainstorm

    Frontiers in Neuroscience 12:309.

    https://doi.org/10.3389/fnins.2018.00309

    • PubMed
    • Google Scholar
74. 1. Tadel F
    2. Baillet S
    3. Mosher JC
    4. Pantazis D
    5. Leahy RM

    (2011) Brainstorm: a User-Friendly application for MEG/EEG analysis

    Computational Intelligence and Neuroscience 2011:1–13.

    https://doi.org/10.1155/2011/879716

    • Google Scholar
75. 1. Tallon-Baudry C
    2. Bertrand O
    3. Hénaff MA
    4. Isnard J
    5. Fischer C

    (2005) Attention modulates gamma-band oscillations differently in the human lateral occipital cortex and fusiform gyrus

    Cerebral Cortex 15:654–662.

    https://doi.org/10.1093/cercor/bhh167

    • PubMed
    • Google Scholar
76. 1. Tallon-Baudry C
    2. Bertrand O

    (1999) Oscillatory gamma activity in humans and its role in object representation

    Trends in Cognitive Sciences 3:151–162.

    https://doi.org/10.1016/S1364-6613(99)01299-1

    • PubMed
    • Google Scholar
77. Conference

    1. Tordini F
    2. Bregman AS
    3. Cooperstock JR

    (2015)

    The loud bird doesn’t (always) get the worm: Why computational salience also needs brightness and tempo

    Proceedings of the 21st International Conference on Auditory Display (ICAD 2015). pp. 236–243.

    • Google Scholar
78. 1. Treue S

    (2003) Visual attention: the where, what, how and why of saliency

    Current Opinion in Neurobiology 13:428–432.

    https://doi.org/10.1016/S0959-4388(03)00105-3

    • PubMed
    • Google Scholar
79. 1. Uurtio V
    2. Monteiro JM
    3. Kandola J
    4. Shawe-Taylor J
    5. Fernandez-Reyes D
    6. Rousu J

    (2018) A tutorial on canonical correlation methods

    ACM Computing Surveys 50:1–33.

    https://doi.org/10.1145/3136624

    • Google Scholar
80. 1. Vanthornhout J
    2. Decruy L
    3. Francart T

    (2019) Effect of task and attention on neural tracking of speech

    Frontiers in Neuroscience 13:977.

    https://doi.org/10.3389/fnins.2019.00977

    • PubMed
    • Google Scholar
81. 1. Veale R
    2. Hafed ZM
    3. Yoshida M

    (2016) How is visual salience computed in the brain? insights from behaviour, neurobiology and modelling

    Philosophical Transactions of the Royal Society B: Biological Sciences 372:20160113.

    https://doi.org/10.1098/rstb.2016.0113

    • Google Scholar
82. 1. Wang CA
    2. Boehnke SE
    3. Itti L
    4. Munoz DP

    (2014) Transient pupil response is modulated by contrast-based saliency

    Journal of Neuroscience 34:408–417.

    https://doi.org/10.1523/JNEUROSCI.3550-13.2014

    • PubMed
    • Google Scholar
83. 1. Wang YXR
    2. Jiang K
    3. Feldman LJ
    4. Bickel PJ
    5. Huang H

    (2015) Inferring gene–gene interactions and functional modules using sparse canonical correlation analysis

    The Annals of Applied Statistics 9:300–323.

    https://doi.org/10.1214/14-AOAS792

    • Google Scholar
84. 1. Witten DM
    2. Tibshirani R
    3. Hastie T

    (2009) A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis

    Biostatistics 10:515–534.

    https://doi.org/10.1093/biostatistics/kxp008

    • PubMed
    • Google Scholar
85. 1. Witten DM
    2. Tibshirani RJ

    (2009) Extensions of sparse canonical correlation analysis with applications to genomic data

    Statistical Applications in Genetics and Molecular Biology 8:1–27.

    https://doi.org/10.2202/1544-6115.1470

    • Google Scholar
86. 1. Wolfe JM
    2. Horowitz TS

    (2004) What attributes guide the deployment of visual attention and how do they do it?

    Nature Reviews Neuroscience 5:495–501.

    https://doi.org/10.1038/nrn1411

    • PubMed
    • Google Scholar
87. 1. Wong DDE
    2. Fuglsang SA
    3. Hjortkjær J
    4. Ceolini E
    5. Slaney M
    6. de Cheveigné A

    (2018) A comparison of regularization methods in forward and backward models for auditory attention decoding

    Frontiers in Neuroscience 12:531.

    https://doi.org/10.3389/fnins.2018.00531

    • PubMed
    • Google Scholar
88. 1. Yeung RW

    (1991) A new outlook on Shannon's information measures

    IEEE Transactions on Information Theory 37:466–474.

    https://doi.org/10.1109/18.79902

    • Google Scholar
89. 1. Zelano C
    2. Bensafi M
    3. Porter J
    4. Mainland J
    5. Johnson B
    6. Bremner E
    7. Telles C
    8. Khan R
    9. Sobel N

    (2005) Attentional modulation in human primary olfactory cortex

    Nature Neuroscience 8:114–120.

    https://doi.org/10.1038/nn1368

    • PubMed
    • Google Scholar
90. 1. Zhao S
    2. Chait M
    3. Dick F
    4. Dayan P
    5. Furukawa S
    6. Liao HI

    (2019) Pupil-linked phasic arousal evoked by violation but not emergence of regularity within rapid sound sequences

    Nature Communications 10:4030.

    https://doi.org/10.1038/s41467-019-12048-1

    • PubMed
    • Google Scholar

Author details

1. Nicholas Huang

   Laboratory for Computational Audio Perception, Department of Electrical Engineering, Johns Hopkins University, Baltimore, United States

   Contribution

   Conceptualization, Resources, Data curation, Software, Formal analysis, Funding acquisition, Validation, Investigation, Visualization, Methodology, Project administration

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0001-5993-8325

2. Mounya Elhilali

   Laboratory for Computational Audio Perception, Department of Electrical Engineering, Johns Hopkins University, Baltimore, United States

   Contribution

   Conceptualization, Resources, Data curation, Software, Formal analysis, Funding acquisition, Validation, Investigation, Visualization, Methodology, Project administration

   For correspondence

   mounya@jhu.edu

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0003-2597-738X

• 2,674

  views

• 332

  downloads

• 34

  citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.