Stochastic resonance mediates the state-dependent effect of periodic stimulation on cortical alpha oscillations
Abstract
Brain stimulation can be used to engage and modulate rhythmic activity in brain networks. However, the outcomes of brain stimulation are shaped by behavioral states and endogenous fluctuations in brain activity. To better understand how this intrinsic oscillatory activity controls the susceptibility of the brain to stimulation, we analyzed a computational model of the thalamo-cortical system in two distinct states (rest and task-engaged) to identify the mechanisms by which endogenous alpha oscillations (8Hz–12Hz) are modulated by periodic stimulation. Our analysis shows that the different responses to stimulation observed experimentally in these brain states can be explained by a passage through a bifurcation combined with stochastic resonance — a mechanism by which irregular fluctuations amplify the response of a nonlinear system to weak periodic signals. Indeed, our findings suggest that modulation of brain oscillations is best achieved in states of low endogenous rhythmic activity, and that irregular state-dependent fluctuations in thalamic inputs shape the susceptibility of cortical population to periodic stimulation.
https://doi.org/10.7554/eLife.32054.001Introduction
Periodic brain stimulation, such as repetitive transcranial magnetic stimulation (rTMS) and transcranial alternating current stimulation (tACS), can be used to engage cortical rhythms (Fröhlich, 2015). Such findings have raised the fascinating prospect of manipulating rhythmic brain activity in a controlled manner, thereby engaging neural circuits at a functional level to manipulate cognition and to treat disorders of the central nervous system (Cecere et al., 2015; Fröhlich, 2015; Romei et al., 2016; Ezzyat et al., 2017). Yet, the brain is not a passive receiver. Invasive and non-invasive brain stimulation differ in their effect on neuronal dynamics as a function of the state of the targeted network, a robust observation across a variety of stimulation modalities (Neuling et al., 2013; Ruhnau et al., 2016; Alagapan et al., 2016). Indeed, previous studies have reported the seemingly counterintuitive fact that the susceptibility of neural tissue to exogenous control (during stimulation for instance) is increased during task-engaged states (Neuling et al., 2013; Ruhnau et al., 2016; Alagapan et al., 2016). Task-engaged states are generally characterized by higher neuronal firing rates and by population responses that are predominantly asynchronous, and by a suppression of low-frequency electrical brain activity compared to what is seen in the rest condition (Churchland et al., 2010; Rosenbaum et al., 2017). By contrast, the rest state is characterized by strong endogenous oscillations, such as alpha oscillations (8 Hz–12 Hz), which reflect internally driven brain processes (Pfurtscheller et al., 1996; Klimesch, 2012). To compensate for these state-dependent differences in population activity, it has been suggested that stimulation parameters should be calibrated in a closed loop (Boyle and Frohlich, 2013; Lustenberger et al., 2016) in order for stimulation to be optimally effective. But the lack of understanding about the cause of these state-dependent changes and how they interfere with brain stimulation remains one of the main limitations for the development of new paradigms that are based on the selective control of brain rhythms.
We formulated the hypothesis that the dominance of asynchronous activity in the task state — in the form of irregular fluctuations in neural activity — may enhance the susceptibility of cortical neurons to periodic stimulation. Specifically, we asked whether stochastic resonance (SR) was involved. SR is a phenomenon by which the presence of uncorrelated random fluctuations, or so-called ‘noise’, amplifies the salience of a weak periodic signal driving a non-linear system (McDonnell and Abbott, 2009). In absence of noise, a subthreshold signal is too weak to generate an output that reflects the input. For intermediate levels of noise, however, the superposition of the signal and the random fluctuations results in super-threshold — and thus detectable — dynamics. Further increase in noise typically causes the saliency of the signal to decrease. Such a link between SR and state-dependent effects of brain stimulation have been reported experimentally across various modalities (Schwarzkopf et al., 2011; Silvanto and Cattaneo, 2017), in which irregular waveforms have further been shown to improve the effect of rhythmic stimuli (Wuehr et al., 2017). However, it remains unclear how the task-related decrease in alpha oscillations is involved in enhancing the susceptibility of cortical neurons to entrainment by exogenous electric fields.
Computational approaches and modeling are poised to answer many of these fundamental questions, but have received little attention, especially with respect to the clinical applications of brain stimulation. By identifying the network mechanisms involved, modeling can be used to catalyze the development of more efficient stimulation protocols and customized clinical interventions. Using simulations, we have previously used a cortical network model to better understand how periodic stimulation interacts with resting-state alpha (8 Hz–12 Hz) activity, and found that multiple mechanisms where involved (Herrmann et al., 2016). Echoing the theory of non-linear oscillators in physics, stimulations with increasing amplitudes and/or frequencies were found to shape networks responses through different mechanisms: resonance, in which intrinsic oscillations are enhanced by stimuli with frequencies close to the network natural frequency; and entrainment, where the systems’ dynamics become phase locked to the stimulation and thus adopt the same frequency. Entrainment occurs only for specific sets of stimulation amplitudes and frequencies (regions in stimulation parameters space called Arnold tongues). But what happens in the presence of state-induced changes in baseline activity?
To address these questions and to provide predictions about optimal entrainment conditions, we harnessed computational and mathematical techniques to analyze state-dependent effects on a network model of the thalamo-cortical system in the presence of periodic stimulation. We found that increased thalamic drive suppressed endogenous oscillations throughout the thalamo-cortical loop, leading to an asynchronous state characterized by intense spiking activity that was weakly synchronized. We defined regimes of low (with respect to high) thalamic drive and resting (with respect to task-engaged) brain state to represent two externally imposed experimental conditions. In presence of periodic stimulation, the transition from the rest to the task-engaged state was accompanied by an increased susceptibility to entrainment, as demonstrated by amplified power at stimulation frequency and phase alignment between cortical responses and stimulation. Specifically, we found that the oscillatory response of the system switched from alpha oscillations to stimulus-induced activity as thalamic drive was increased, i.e. during a transition from the resting state to the task state. Taken together, these results show that the thalamo-cortical loop implements a gain control mechanism that regulates the robustness of alpha oscillatory activity and, by doing so, modulates cortical susceptibility to rhythmic entrainment by stimulation.
Results
To understand how the effect of periodic stimulation depends on brain state (Alagapan et al., 2016), we examined the hypothesis that cortical susceptibility to entrainment is controlled by sub-cortical (i.e. thalamic) populations that are reciprocally connected with the cortical networks targeted by stimulation. Given the important role of the thalamus in controlling cortical state (Poulet et al., 2012) and resting-state alpha activity (Hughes et al., 2004; Hughes and Crunelli, 2005; Lorincz et al., 2009), we investigated how increased thalamic inputs regulated cortical excitability and the power of endogenous alpha oscillations. By brain state, we here refer to the state of the thalamo-cortical network, which is determined by the afferent sensory drive to thalamus in the model and parallels two different experimental conditions (i.e. rest and task-engaged). We developed a model of the thalamo-cortical network composed of cortical, thalamic relay and reticular populations that exhibit synchronous activity within the alpha band (see Materials and methods). In this model, cortical populations of excitatory and inhibitory cells share both feedforward and feedback connections with the thalamus. Sensory inputs (e.g. visual) are sent through the lateral geniculate nucleus (LGN) to cortical areas for further processing (Poulet et al., 2012), impacting the pattern of activity of cortical neurons. The model structure is illustrated in Figure 1, along with the steady-state responses generated by the different groups of neurons present.
To quantify the impact of thalamic drive on cortical activity and alpha oscillations — first without stimulation — we calculated both cortical and sub-cortical firing rates, and the power of endogenous oscillations as the input to the thalamus was increased (Figure 2). We did this to define quantitatively different brain states, i.e. resting state vs task-engaged state. For low input to the thalamus, all populations across the network were maintained in a highly synchronous state, where recurrent interactions generate strong firing-rate oscillations with an envelope of about 8 Hz. As can be seen in Figure 1B, the activity of the different populations is synchronized, and the phase difference is due to the presence of propagation delays from the thalamus to and back from the cortex.
Increases in thalamic inputs have a destabilizing effect on endogenous oscillations. While increasing thalamic drive also increased firing rates throughout the system, a gradual suppression of synchronous alpha activity could also be observed: the power of endogenous alpha oscillations decreased substantially. This increased thalamic drive also changed the spiking patterns of cortical neurons: spiking activity became irregular and asynchronous, in line with studies showing a transition towards decorrelated cortical dynamics at task-onset (Pfurtscheller et al., 1996; Poulet et al., 2012; Churchland et al., 2010). This negative correlation between alpha power and spike rate is further in line with other experimental findings (Haegens et al., 2011; van Kerkoerle et al., 2014). Taken together, these results demonstrate that changes in thalamic state are sufficient to destabilize alpha oscillations throughout the thalamo-cortical loop, as well as to shape spike correlations. We thus defined rest and task states as limit cases of low (i.e. rest) and high (i.e. task-engaged) thalamic drive, respectively (see Materials and methods), as indicated in Figure 2C. We note that aside from the thalamic input, the network parameters were kept constant. Such a smooth and gradual destabilization of alpha oscillations is suggestive of a noise-induced supercritical Hopf bifurcation (See Materials and methods). According to this well-known mechanism (Horsthemke and Lefever, 1982), noise acts as a gain control parameter by which non-linear oscillations sustained by delayed and recurrent inhibition (as in our model) can be altered and/or suppressed by a change in noise variance (Lefebvre et al., 2015; Hutt et al., 2016). In the process, noise also linearizes the dynamics by smoothing the non-linear response function of threshold systems (Gammaitoni, 1995; McDonnell and Abbott, 2009; Lefebvre et al., 2015). In the context of our model, rest and task-engaged states would then correspond to opposite points above and below the transition point, respectively, where the ‘noise’ is here mediated by increasingly irregular input from thalamus to cortex.
Having defined rest and task-engaged states in our network model and having characterized the influence of thalamic activity on alpha oscillations, we next asked how state-dependent changes in resting state oscillations (the destabilization of alpha oscillations) were impacted by cortical periodic stimulation. To disambiguate the contribution of resonance (the amplification of endogenous oscillations) and entrainment (the phase locking to an externally applied frequency) and to test network responses, we first considered a cortical stimulation with moderate amplitude and frequency of 11 Hz (), which does not share any low order harmonic relationship with the endogenous frequency (i.e. 8 Hz). This was done to align our simulation to a previous experimental setting (Alagapan et al., 2016), in order to determine whether we could reproduce the previously observed state-dependent effects. Then, we investigated how spiking activity and cortical oscillations properties changed as thalamic drive was gradually increased in the presence of periodic stimulation (Figure 3). We first computed the correlations in the spiking response amongst excitatory cells in the cortical network, either with 11 Hz stimulation or with no stimulation (sham), see Figure 3A. Without stimulation, thalamic drive suppresses correlated spiking and synchronous activity decreases. By contrast, when stimulation is applied in regimes of weak thalamic drive, correlations are lower than in the sham condition, indicating that stimulation itself interferes with endogenous activity. By increasing thalamic drive, spike-rate correlations gradually increase, indicating that cells are becoming entrained by the stimulation. Taken together, these observations elucidate a gradual transition from recurrent to externally driven dynamics as thalamic input is increased. To explore this further, we plotted, in Figure 3B, the peak power found both at alpha frequency (8 Hz) and at stimulation frequency (here 11 Hz). The power at stimulation frequency did indeed increase during the transition from the rest to the task state and that a shift in oscillatory regime can be observed. Indeed, one can clearly observe a jump in the dominant frequency from 8 Hz (endogenous alpha frequency) to 11 Hz (stimulation frequency) as resting state alpha oscillations are gradually suppressed.
We hypothesized that this enhanced spectral power at the stimulation frequency might occur through SR. SR has been implicated in the enhancement of sub-threshold signals in which random fluctuations — of either external or internal origin — act like a pedestal increasing the sensitivity of stimulated neurons to a given set of low-intensity inputs (Miniussi et al., 2013). Initially formulated in bistable systems with an implicit time-scale (a ‘resonance’), SR is also present in systems with threshold nonlinearities, which we note are present in our model.
To verify whether SR was indeed involved —and to disambiguate the contribution of SR and dithering (McDonnell and Abbott, 2009) — we chose a weak amplitude stimulation and computed the mutual information between stimulation signal and firing-rate response at the stimulation frequency across successive and independent trials, while noise variance was gradually increased across all populations in the network. As shown in Figure 3D, the mutual information was found to be optimized at an intermediate value, indicating that SR — in its most strict definition (McDonnell and Abbott, 2009) — was indeed involved. In contrast to SR, dithering — a similar phenomenon by which the saliency of weak signals is improved by noise — would cause the mutual information to increase monotonically, that is, it would not exhibit a peak at some intermediate value of noise. To confirm the presence of entrainment (to the stimulation and not to another internal oscillation), we performed a phase analysis comparing the phase of the cortical firing rates with the phase of the stimulation across independent trials. The results are shown in Figure 3E and F. There, one can see that weak phase alignment was found in the rest state (Figure 3E), whereas clear phase locking can be seen in the task state (Figure 3F). Our simulations show that cortical spiking responses are phase locked to the stimulation waveform only for intermediate values of thalamic drive. Below this drive, endogenous network activity suppresses cortical entrainment, and beyond this value, irregular noisy fluctuations originating from the thalamic population decreases the saliency of the temporal structure of the stimulation waveform. Taken together, the results above indicate that state-dependent inputs simultaneously amplify stimulation-induced activity while suppressing endogenous rhythmic activity through SR, enabling the stimulation to entrain cortical neurons.
Figure 4 summarizes these findings in the rest and task-engaged states. In the rest state (Figure 4A), the dynamics of the cortical neurons were predominantly governed by internal, recurrent fluctuations. When stimulation is applied in this state (Figure 4B), ongoing alpha oscillations are slightly perturbed but no cortical entrainment occurs. Stimulation has a minimal impact on the activity of cortical neurons: the phasic alternation of network-wide coincident firing and inhibitory recovery greatly reduces susceptibility to entrainment. This absence of phase locking of neuronal activity to the stimulation signal can be most clearly seen from the firing activity of cortical excitatory and inhibitory neurons. The firing activity of these cells occurs by successive bursts at 8 Hz, with little effect from stimulation-induced membrane fluctuations, which remain sub-threshold. The poor susceptibility is also apparent from the relatively small contribution of stimulation power to the overall spectral density distribution of the simulated cortical EEG (Figure 3C). These indicate that the rest state is characterized by highly stable attractor dynamics. By contrast, robust entrainment was observed in the task-engaged state (Figure 4C), as seen from a dominant spectral peak located precisely at the stimulation frequency (Figure 3C). Despite the fact that stimulation amplitude and frequency remained the same, cortical neurons were here fully entrained by the 11 Hz stimulation. The irregular activity that characterizes the task state was here replaced by stimulus-induced fluctuations while neural firing was tightly phased locked to the stimulus dynamics. Spectral power at the stimulation frequency is significantly amplified when compared to that in the rest state, whereas negligible power can be found at the endogenous alpha frequency. This forms yet another indication that the resting state attractor has been destabilized under the action of thalamic drive and the resulting increase in neural noise (Lefebvre et al., 2015; Hutt et al., 2016), also in line with requirements of SR (McDonnell and Abbott, 2009).
But how does this state-dependent susceptibility depend on stimulation parameters? To answer this question, we first fixed stimulation amplitude and varied its frequency between 0 and 50 Hz, while computing the power spectral density in each case (Figure 5). A peak at the stimulation frequency can be seen along the diagonal, but the rest state power spectral density is characterized by a dominant horizontal peak at 8 Hz. According to this analysis, the spectral contribution of stimulation is negligible unless the stimulation frequency is close to the endogenous frequency and/or its harmonics (horizontal lines in Figure 5A), as expected via resonance (Ali et al., 2013; Herrmann et al., 2016). In the task-engaged state, the opposite occurs: reduced power at the endogenous frequency promotes entrainment, and stimulation power increases significantly across the range of stimulation frequency considered.
As a next step, we computed the power-spectral density of the simulated EEG activity of cortical excitatory and inhibitory cells, and systematically measured the peak frequency and power for all combinations of stimulation frequency and amplitudes within a given range. We then identified regions for which the dominant (i.e. peak) frequency was defined either by endogenous oscillations or by the stimulation — thus identifying regimes of entrainment. In Figure 6A, one can see the peak frequency of the simulated cortical EEG activity in the rest state. For most combinations of stimulation amplitudes and frequencies, the peak frequency remains stable and equal to the endogenous alpha frequency (i.e. 8 Hz). However, for higher amplitudes and for stimulation frequencies near 8 Hz, cortical neurons were gradually entrained by the stimulation (1:1 entrainment). A narrow triangular entrainment region (the so-called Arnold tongue, delimited by white dashed lines) (Glass and Belair, 1980; Hunter and Milton, 2003) emerges and gets larger as stimulation amplitude increases. Note that the asymmetrical shape of the Arnold tongue is here due to a stimulation-induced shift of the endogenous frequency (Hutt et al., 2016). The equivalent calculations were made in Figure 6B but for the task-engaged state. Multiple differences compared to the rest state can be observed. The Arnold tongue spans a much larger portion of the stimulus-parameter space, indicating robust entrainment for much weaker stimulation amplitudes. In Figure 6C and D, the power at peak response frequency is plotted. The power found at the endogenous frequency in the rest state outside the Arnold tongue (here also delimited by a white dashed line) is high, and is gradually suppressed as stimulation parameters are changed towards the entrainment region. There, peak power, associated with the stimulation frequency is much smaller (Figure 6C). Under the action of thalamic input in the task state, endogenous alpha oscillations are suppressed compared to those in the rest state, leading to weak power outside the Arnold tongue (Figure 6D). In contrast to the rest state, stimulation at the endogenous frequency enhances the peak power. In sum, the effect of stimulation on peak power when the frequency is close to the resonant frequency (vertical black dashed lines in Figure 6C and D) also depends on the state, that is, the thalamic drive.
What mechanism is responsible for this state-dependence? Mathematical insights can play a key role here in helping us to understand how periodic stimulation interacts with intrinsic limit cycles (i.e. alpha oscillations) and how changes in stability can promote entrainment. In Alagapan et al., 2016), the authors modelled state-dependent entrainment using a population-scale network of cortical neurons interacting through both local and feedback projections in the presence of robust resting state oscillations. To learn more about the mechanism involved, we considered a simplified neural oscillator with delayed feedback (Lefebvre and Hutt, 2013; Lefebvre et al., 2015; Hutt et al., 2016) as a simplified model for the thalamo-cortical network. Networks of neurons that are exposed to delayed feedback and recurrent inhibition commonly display rhythmic activity whose features are tightly linked to input statistics (Dhamala et al. 2001; Doiron et al., 2003; Lefebvre and Hutt, 2013). To better understand the mechanism underlying the state-dependent changes in the amplitude of resting state oscillations, we investigated the dynamics of this simplified oscillator (see Materials and methods) in the presence of periodic forcing (i.e. stimulation) and various levels of noise. In can be shown that as input noise increases during the task state, limit cycle solutions are destabilized through a supercritical Hopf bifurcation. Analyzing the response of this simplified model both above and below the bifurcation threshold, that is, in the vicinity of the point where self-sustained (i.e. intrinsic) oscillations become unstable, we found that limit cycle solutions of this system are entrained by periodic forcing, although their amplitudes are highly sensitive to noise intensity. To see this, we computed resonance curves (Figure 7B) for this oscillator and compared the results for both high and low values of input noise variance. This simple qualitative analysis shows that the linearization induced by noise decreases the amplitude of the resonant solutions and increases the amplitude of all other forcing frequencies by transitioning through a critical state. Spectral clustering, in which the power and/or amplitude of forced solutions are concentrated near the intrinsic resonance, is a state of weak susceptibility to entrainment. The consequences of input-induced linearization in the simple conceptual model above are two-fold: (1) it causes a suppression of resonant oscillations, and (2) it augments the amplitude of non-resonant solutions. This was found to be in agreement with the state-dependency observed in our full spiking model as depicted in Figure 7C.
Discussion
Alpha activity has been implicated in a wide variety of physiological and cognitive functions (Başar and Basar, 2012; Mierau et al., 2017). Numerous recent studies have demonstrated that periodically modulated electric fields can interfere with alpha oscillations to trigger a measurable effect on stimulus perception (Chanes et al., 2013; Cecere et al., 2015) and task performance by entraining these rhythms (Henry et al., 2014; Samaha and Postle, 2015). However, the efficacy of these approaches has been shown to depend heavily on brain states and to fluctuate according to internally governed dynamics (Zaehle et al., 2010; Miniussi et al., 2013; Ruhnau et al., 2016; Alagapan et al., 2016).
To better understand this phenomenon and to elucidate previous experimental findings (Alagapan et al., 2016), we here combined computational and mathematical approaches and analyzed a computational model of the thalamo-cortical system exhibiting resting state alpha oscillations. The dynamics of our network model were analyzed in two conditions: the rest state, which we have defined as a regime of weak afferent input to the thalamus, and the task-engaged state, where thalamic drive is high to reflect experimentally imposed conditions. We found that a destabilization of alpha oscillations occurred during the transition between rest and task-engaged states, in which both cortical and sub-cortical spiking patterns switched from correlated and synchronous to irregular and asynchronous. Then, applying periodic stimulation to cortical neurons, we found that the susceptibility of the system to external perturbations was strongly controlled by the presence (or absence) of an oscillatory attractor (i.e. the alpha oscillation) and as such depended heavily on state. By comparing the stimulation waveform with the cortical firing-rate responses for weak stimulation amplitudes, we found that SR was involved in improving cortical susceptibility to entrainment. While in the rest state, applied stimulation had a weak impact on the activity of cortical neurons whose dynamics remained locked to internal recurrent oscillations. Arnold tongues (i.e. regions in the stimulation parameter space where network activity is phase locked to the stimulation) were found to be very narrow. By contrast, in the task-engaged state, excitatory and inhibitory cortical neurons were freed from the intrinsic attractor and found to be more susceptible to entrainment, as shown by significantly larger Arnold tongues. Using a simplified neural oscillator model, our mathematical analysis revealed that thalamic input to the cortex, playing a similar role as noise, could control the stability of intrinsic oscillations by provoking a bifurcation, and by doing so, could amplify the response to non-resonant stimuli. Aside from the state-dependent input and/or noise, only stimulation parameters, such as amplitude and frequency, were changed in our study. Taken together, our results show that internal control over attractor states shapes the susceptibility of cortical populations to stimulation and entrainment. Our modelling results further suggest that the thalamo-cortical system behaves like a non-linear oscillator whose susceptibility to periodic forcing is gated by noise through SR and a passage through a bifurcation.
SR is widely appreciated as a mechanism that regulates cortical excitability (Miniussi et al., 2013) and has measurable effects on cognitive performance and perception (van der Groen and Wenderoth, 2016). Our computational results demonstrate the important role of SR, and thus of asynchronous and irregular neural dynamics, in regulating the responses of cortical neurons to stimulation. Using a simplified neural oscillator model, we have shown that noise — playing the role of uncorrelated inputs from the thalamus — can suppress oscillation through a Hopf bifurcation. Practically speaking, this is accomplished by a noise-induced linearization of the response function of the system, a generic effect observed in systems with threshold non-linearities (see McDonnell and Abbott, 2009) and references therein), which can further be shown to impact the frequency and amplitude of oscillatory solutions in non-linear systems (Lefebvre et al., 2015; Hutt et al., 2016). Such linearization also plays a fundamental role in dithering, a mechanism by which noise is added to a signal, prior to its digitalization, to increase its integrity (McDonnell and Abbott, 2009). Formulated in the context of neural systems, irregular and/or uncorrelated fluctuations can thus be used to increase the saliency or fidelity of neural responses. Interestingly, this ‘correlation-induced blockade’ has been previously discussed with respect to alpha oscillations (Klimesch et al., 2007), where large-scale synchrony has been hypothesized to implement a functional inhibition gate through which increased synchronized fluctuations shut down the mutual coding capacity of neural networks (Zohary et al., 1994; Greenberg et al., 2008). In this perspective, we hypothesize that alpha oscillations — as well as other intrinsic attractors — block perturbations of neural activity, triggered either by endogenous (e.g. inter-area signaling) or exogenous (e.g. stimulation) manipulations. Future work will show whether endogenous correlated neural activity, which goes beyond the purely rhythmic activity observed here, could also play a role in regulating susceptibility to entrainment, and more generally in control.
We here note that, in line with previous theoretical (Hutt et al., 2016) and experimental (Mierau et al., 2017) findings, the peak alpha frequency was found to change as a function of thalamic drive between 8 and 8.5 Hz. This can be seen for instance in Figure 3C (top), Figure 5A,B and Figure 6A,B, where the peak frequency is slightly higher in the task-engaged state than in the rest state. This is because inputs from the thalamus to the cortex, whose variance changes as a function of thalamic drive, correspond to a stream of irregular fluctuations (i.e. Poisson noise) that are known to alter the oscillatory properties of non-linear networks (Lefebvre et al., 2015). As here these fluctuations possess stationary statistics (i.e. mean and variance that did not fluctuate in time), no temporal variability was observed in the peak frequency of endogenous oscillations. As such, this non-linear phenomenon, which is well understood mathematically, does not impact our conclusions.
Our results are conceptually connected to experimental findings in studies of tACS. In the task-engaged state, successful entrainment was reflected in a shift of the oscillation frequency to the stimulation frequency. This agrees with the findings of multiple studies of tACS that point towards a successful shift in the alpha peak frequency to the stimulation frequency during stimulation (e.g. Helfrich et al., 2014). Several studies using tACS (see Thut et al., 2017 and references therein) and a recent study (Minami and Amano, 2017) that uses amplitude-modulated tACS (AM-tACS) have employed some type of visual task, ranging from a simple vigilance task to prevent participants from falling asleep all the way to sophisticated visual psychophysics paradigms.
As for any modeling work, a key aspect to discuss is the level of abstraction. The electrical field applied by tACS is the strongest in the cortex due to its closest proximity to the stimulation electrodes. However, any modulation of cortical network dynamics by stimulation must, almost by definition, also alter activity in the regions interconnected with the targeted cortical circuits, including the thalamus. However, dissecting the effects of stimulation on an interconnected network remains a challenge because of the feedback nature of the network dynamics. Here, we have chosen to study a reduced, relatively abstract model of the thalamo-cortical system. By contrast, in a recent study in which we focused on the cellular and synaptic biophysics and their role in shaping the response to stimulation, we examined the response to stimulation of thalamus in isolation (Li et al., 2017). Qualitatively, the findings from the two studies agree as the detailed thalamic model suggested that faster oscillations, typically associated with the task-engaged state, are more responsive to stimulation than the task-negative alpha oscillations.
Our results further raise interesting questions regarding sensory entrainment paradigms (Keitel et al., 2017). In the presence of periodic sensory stimulation, or sensory inputs possessing a rhythmic structure, thalamic drive would also possess a rhythmic structure. It would prove interesting to see how these fluctuations in thalamo-cortical inputs would interact with endogenous oscillations, and whether brain state fluctuations could gate their propagation towards cortical networks. Given the central role of thalamus in sensory gating (e.g. Sherman, 2007; Poulet et al., 2012), sensory rhythmic inputs that reach the thalamus first may have a different effect on thalamo-cortical oscillations than does cortical stimulation. Yet another fundamental difference is the magnitude of the input. Sensory input to the thalamus (e.g., retinal input to the LGN) is strong enough to cause spiking in the thalamus, which is time-locked to the temporal structure of the visual input (Hirsch et al., 2015). Thus such input is super-threshold in comparison to the subthreshold stimulation examined here.
In summary, our results demonstrate that target engagement by stimulation is state-dependent. The fact that the presence of a pronounced endogenous oscillation limits the impact of stimulation in terms of entrainment points towards important questions for the use of such stimulation paradigms in research, and ultimately in the clinic. First, the overall state of the network needs to be measured and documented in studies that investigate brain stimulation for the modulation of brain rhythms. Second, it remains mostly unclear how adjusting the frequency of the alpha oscillation affects cognition and behavior (Romei et al., 2016; Mierau et al., 2017). Yet, a reduced alpha peak frequency is a hallmark of a range of neurological and psychiatric illnesses (e.g. Rossini et al., 2007) and probably an overall marker of brain health (Klimesch, 1999, 2012). In such work, our findings suggest that states of low alpha power represent the ideal state for the application of stimulation, and that modulation of brain oscillations is best achieved in states of low endogenous alpha rhythmic activity. This finding may be important for the next generation of brain stimulation paradigms developed using rational design.
Materials and methods
Model
Request a detailed protocolWe have developed and analyzed a model of the thalamo-cortical system in which recurrent interactions between the different neural populations generate strong synchronous activity within the alpha band (8 Hz–12 Hz). An illustration of the model structure and connections is presented in Figure 1A. The cortical population is composed of recurrently connected excitatory pyramidal neurons and inhibitory interneurons, and both interact with thalamic and reticular populations via delayed connections. The spiking activity of all neurons is modeled by a non-homogenous Poisson process,
where is the spike train of the neuron in the population . The activation function represents a saturating firing-rate function that relates monotonically to the cellular membrane potential , with gain , maximal rate and threshold . The mean somatic membrane potentials of all neurons in the network obey the set of dynamic equations
where we have spike frequency adaptation
and where recurrent inputs are
The rates and define the time scale of the somatic membranes and adaptation, respectively. The post-synaptic potentials are computed by convolving spike trains with exponential synapses with time constant that is,
All populations, including the sub-cortical neurons (relay, reticular), are mutually coupled with sparse and spatially topographic projections (Hellwig, 2000). The synaptic connectivity kernels between neurons of index and , respectively from population and are given by Gaussians
with connection probability and as the spatial spread of the inter-neuronal connections. The network is also subjected to propagation delays due to finite axonal conduction velocity =0.35 m/s (Hutt et al., 2003). Furthermore, a delay of 45 ms was included between thalamus (RTN, LGN) and cortex (), and a delay of =10 ms between reticular (RTN) and relay (LGN) populations.
Thalamic drive and brain states
Request a detailed protocolIn addition to fixed bias inputs, , neurons in the network are subjected to Gaussian white noise, , of intensity, . To represent an increase in sensory afference to the thalamus in two distinct conditions, the intensity of the noise driving the lateral geniculate nucleus (LGN) neurons is increased. To mimic externally imposed experimental states, we analyzed the dynamics of this network model in two conditions:
rest state: regime of low thalamic drive (i.e. );
task-engaged state: regime of high thalamic drive (i.e. ).
Specifically, a transition between the rest and task-engaged states occurs whenever noise intensity at the LGN increases. Aside from this input, which was changed to set the system in the rest and/or task-engaged state, only the periodic stimulation parameters, such as amplitude and frequency, were changed. We chose not to define the thalamic drive intensity for the task state as the optimal value found through SR (i.e. Figure 3D), because this value was found to be sensitive to the stimulation amplitude and frequency, which will vary in the subsequent analysis. To represent the effect of periodic stimulation, all excitatory and inhibitory cortical neurons were equally driven by a periodic input with waveform , where is defined as the stimulation amplitude and is the stimulation frequency. No stimulation is present for sub-cortical populations as non-invasive brain stimulation predominantly targets cortex.
For minimal thalamic drive (i.e. ), the network engages intense resting state alpha activity at a frequency of about 8 Hz due to the combined action of slow spike-frequency-dependent adaptation and finite conduction velocity — resulting in propagation delays that enhance the prevalence of correlated rhythmic states (Lefebvre et al., 2011; Deco et al., 2009). The stability of the resulting oscillatory solutions is maintained and amplified due to thalamo-cortical feedback, leading to phase-locked dynamics across all neural populations involved, both cortical and sub-cortical. The activity of each population in the resting state is depicted in Figure 1B. The parameter values that were chosen were aligned within the physiological range in the literature and are summarized in Table 1. The response of the sub-cortical populations (i.e. LGN, RTN) can be seen to adopt a stable phase offset with respect to cortical activity. Such phase differences have been observed experimentally and shown to be sensitive to ongoing oscillatory state (Slézia et al., 2011). In our model, this phase lag occurs because of the propagation delay in the transition to and back from the cortex. When thalamic drive is increased (i.e. ), global oscillations are suppressed through a noise-induced Hopf bifurcation (see below). Through this transition, noise triggers a gradual change in effective gain between populations, suppressing global oscillations and replacing them by asynchronous activity.
In addition, we mention that the unit of the model voltage and the model firing threshold is arbitrary, which reflects an invariance with respective to unknown physiological parameters. Consequently, it is difficult to compare experimental stimulation parameters, such as stimulus amplitude, to model parameters. One typical distinction in the literature is the differentiation between ‘sub-threshold’ and ‘super-threshold’ stimulation (in terms of generating an action potential), which conveys the notion of ‘weak’ versus ‘strong’ input. However, the stimulation amplitude alone does not determine in isolation whether an action potential is generated. Rather the electrical state of the neuron (in particular, its level of depolarization) plays an equally important role. Thus such classification makes most sense when applied to stimulation occurring when the neuron is quiescent and thus at the resting membrane voltage. In our work here, we do not directly model the membrane voltage but rather how spiking activity depends on input, which implies an underlying subthreshold depolarization. However, as a reference for discussion of our results in the context of different human non-invasive brain stimulation paradigms, the shape of the transfer function of input to spiking output in our model supports the conclusion that the range of amplitudes considered here would mostly fall into the ‘weak’ (subthreshold) category.
Simulated EEG
Request a detailed protocolIn our model, encephalographic (EEG) dynamics are modelled by a weighted sum over somatic excitatory and inhibitory potentials, that is
where are real positive coefficients. Here we assume that the network's fine-scale structure is unknown, and thus consider random weights = [0,1]. However, we note that specific choices of the distributions can be made to increase the similarity of the network activity to physiological signals, such as LFPs and EEG (Linden et al., 2010, Mazzoni et al., 2015).
Spectral analysis and phase distributions
Request a detailed protocolSpectral analysis was performed using a fast Fourier transform (FFT) routine using freely available C++ scripts (Press et al., 2007). To quantify entrainment, we used a windowed discrete Fourier transform to compute the phase of the firing-rate activity for cortical excitatory cells across independent trials, and to this phase with the phase of the stimulation applied. As such, we computed the response of the network in rest and task conditions to stimulation delivered with a random phase for 200 independent trials of 2 s. In each trial, we randomly selected a time window of 500 ms and computed the phase difference, at the stimulation frequency of 11 Hz, between firing-rate response and input stimuli. We did this to ensure no phase consistency in the endogenous network response between successive trials on which we computed phase differences. We then evaluated the distribution of these phase differences across all trials in both conditions. Results are shown in Figure 3E and F. In each trial, cortical neurons were driven with a 11 Hz stimulus applied at a random phase. To ensure statistical significance, we successively shuffled and separated trials into two groups and computed the distribution of phase differences in each case. We then computed the circular variance of these distributions as a measure of phase clustering (i.e. small circular variance indicating more clustered phases around the mean). We then computed the probability of observing the variance in the unshuffled data.
Mutual information
Request a detailed protocolWe computed mutual information between the stimulation signal and the mean firing-rate response to measure how well the stimulation waveform was reflected in the spiking patterns of cortical neurons across independent trials. We assumed that for sufficiently high firing rates, the random fluctuations impacting the network responses can be approximated by Gaussian white noise, and computed,
where is the signal to noise ratio and is the crossspectral correlation defined by
The convolutions measure the covariance between the Fourier transforms and of two time series and . We computed the mutual information between input signal and responses for increasing noise variance across all populations of the network. We did this to confirm the presence of stochastic resonance, where irregular fluctuations first improve and then hinder the detection of weak signals, and also to compensate for firing-rate saturation (which bounds the variance of input- and noise-induced fluctuations).
Noise-induced transition and resonance curves for a simplified delayed neural oscillator
Request a detailed protocolThe thalamo-cortical system has been thoroughly studied, both in experiments and in models, and its low frequency dynamics have been shown to be largely determined by the presence of a delayed feedback loop between cortex and thalamus (e.g. Roberts and Robinson, 2008). A thorough derivation of the reduced dynamics for the detailed spiking model that we used in the simulations is far beyond the scope of this paper, and is highly challenging due to the combined presence of sparse and topographic synaptic projections, multiple cell types and spiking activity. To better understand the mechanism involved in shaping resting-state cortical oscillations, we built a simplified conceptual neural oscillator model,whose limit cycle solutions emerge due to the combined presence of delayed feedback and slow spike-frequency adaptation,
with feedback response function for some gain g<0 and time delay . The membrane potential proxy here denotes the mean somatic membrane potential of cortical neurons, subjected to re-entrant inputs back from the thalamus. The response function also depends on the state-dependent noise variance . This results from non-linear interactions between noise and a sigmoidal non-linearity, which is revealed by performing a mean-field reduction (Lefebvre et al., 2015; Hutt et al., 2016). Note that a similar model has been used before to study state-dependent entrainment and outlasting effects observed in experimental data in humans (Alagapan et al., 2016).
Assuming slow adaptation ( large) and the temporal evolution close to the systems fixed point, the smoothing of the neurons’ response functions (Lefebvre et al., 2015) leads to the effective linear dynamics with periodic forcing,
with and fixed point . It has been shown that the value of the gain is inversely proportional to the intensity of noise in the system. Indeed, for low values of (i.e. in the rest state), remains high due to the steepness of the neuron response function. By contrast, as increases (i.e. in the task state), decreases (Hutt et al. 2016). The impact of state-dependent noise on oscillatory solutions can thus be quantified by analyzing how the stability of the system depends on the parameter . It can be shown that increasing the noise variance in the system above causes a destabilization of limit cycle solutions through a supercritical Hopf bifurcation. Setting and using the ansatz with , where in the linearized system above, one obtains after separating real and imaginary parts,
Setting 90 ms (i.e. twice the thalamo-cortical delay), one then obtains −1.05.
The derivation of the resonance curve for a linear delayed system with periodic forcing is easily accomplished by finding the amplitudes of its solution, which can be computed explicitly via substitution. Let us assume an entrained oscillatory solution of the form
Substituting this ansatz in Equation (1) above and solving for the and , one can then compute the amplitude of the solution as
where
and
References
-
A review of alpha activity in integrative brain function: fundamental physiology, sensory coding, cognition and pathologyInternational Journal of Psychophysiology 86:1–24.https://doi.org/10.1016/j.ijpsycho.2012.07.002
-
EEG feedback-controlled transcranial alternating current stimulationInternational IEEE EMBS Conference on Neural Engineering pp. 140–143.https://doi.org/10.1109/NER.2013.6695891
-
Stimulus onset quenches neural variability: a widespread cortical phenomenonNature Neuroscience 13:369–378.https://doi.org/10.1038/nn.2501
-
Key role of coupling, delay, and noise in resting brain fluctuationsProceedings of the National Academy of Sciences 106:10302–10307.https://doi.org/10.1073/pnas.0901831106
-
Enhancement of neural synchrony by time delayPhysical Review Letters 92:074104.https://doi.org/10.1103/PhysRevLett.92.074104
-
Experiments and models of cortical oscillations as a target for noninvasive brain stimulationProgress in Brain Research 222:41–73.https://doi.org/10.1016/bs.pbr.2015.07.025
-
Stochastic resonance and the dithering effect in threshold physical systemsPhysical Review E 52:4691–4698.https://doi.org/10.1103/PhysRevE.52.4691
-
BookContinuation of Arnold tongues in mathematical models of periodically forced biological oscillatorsIn: Othmer H. G, editors. Nonlinear Oscillations in Biology and Chemistry. Springer-Verlag. pp. 232–243.
-
Population imaging of ongoing neuronal activity in the visual cortex of awake ratsNature Neuroscience 11:749–751.https://doi.org/10.1038/nn.2140
-
Shaping intrinsic oscillatory neural activity with periodic stimulationJournal of Neuroscience 36:5328–5337.https://doi.org/10.1523/JNEUROSCI.0236-16.2016
-
How inhibitory circuits in the thalamus serve visionAnnual Review of Neuroscience 38:309–329.https://doi.org/10.1146/annurev-neuro-071013-014229
-
BookNoise-Induced Tran-sitions: Theory and Applications in Physics, Chemistry and BiologyBerlin: Springer.
-
Thalamic mechanisms of EEG alpha rhythms and their pathological implicationsThe Neuroscientist 11:357–372.https://doi.org/10.1177/1073858405277450
-
Epilepsy as a Dynamic Disease. Biological and Medical Physics SeriesControlling neural synchrony with periodic and aperiodic stimuli, Epilepsy as a Dynamic Disease. Biological and Medical Physics Series, Heidelberg, Springer.
-
Pattern formation in intracortical neuronal fieldsNetwork: Computation in Neural Systems 14:351–368.https://doi.org/10.1088/0954-898X_14_2_310
-
EEG alpha oscillations: the inhibition-timing hypothesisBrain Research Reviews 53:63–88.https://doi.org/10.1016/j.brainresrev.2006.06.003
-
α-band oscillations, attention, and controlled access to stored informationTrends in Cognitive Sciences 16:606–617.https://doi.org/10.1016/j.tics.2012.10.007
-
Stimulus statistics shape oscillations in nonlinear recurrent neural networksJournal of Neuroscience 35:2895–2903.https://doi.org/10.1523/JNEUROSCI.3609-14.2015
-
Neural adaptation facilitates oscillatory responses to static inputs in a recurrent network of ON and OFF cellsJournal of Computational Neuroscience 31:73–86.https://doi.org/10.1007/s10827-010-0298-4
-
Intrinsic dendritic filtering gives low-pass power spectra of local field potentialsJournal of Computational Neuroscience 29:423–444.https://doi.org/10.1007/s10827-010-0245-4
-
Computing the Local Field Potential (LFP) from Integrate-and-Fire Network ModelsPLOS Computational Biology 11:e1004584.https://doi.org/10.1371/journal.pcbi.1004584
-
What is stochastic resonance? Definitions, misconceptions, debates, and its relevance to biologyPLoS Computational Biology 5:e1000348.https://doi.org/10.1371/journal.pcbi.1000348
-
Illusory jitter perceived at the frequency of alpha oscillationsCurrent Biology 27:2344–2351.https://doi.org/10.1016/j.cub.2017.06.033
-
Modelling non-invasive brain stimulation in cognitive neuroscienceNeuroscience & Biobehavioral Reviews 37:1702–1712.https://doi.org/10.1016/j.neubiorev.2013.06.014
-
Event-related synchronization (ERS) in the alpha band--an electrophysiological correlate of cortical idling: a reviewInternational Journal of Psychophysiology 24:39–46.https://doi.org/10.1016/S0167-8760(96)00066-9
-
BookNumericalrecipes: The Art of Scientific Computing (3)Cambridge: Cambridge University.
-
Information-based approaches of noninvasive transcranial brain stimulationTrends in Neurosciences 39:782–795.https://doi.org/10.1016/j.tins.2016.09.001
-
The spatial structure of correlated neuronal variabilityNature Neuroscience 20:107–114.https://doi.org/10.1038/nn.4433
-
Clinical neurophysiology of aging brain: from normal aging to neurodegenerationProgress in Neurobiology 83:375–400.https://doi.org/10.1016/j.pneurobio.2007.07.010
-
Stochastic resonance effects reveal the neural mechanisms of transcranial magnetic stimulationJournal of Neuroscience 31:3143–3147.https://doi.org/10.1523/JNEUROSCI.4863-10.2011
-
The thalamus is more than just a relayCurrent Opinion in Neurobiology 17:417–422.https://doi.org/10.1016/j.conb.2007.07.003
-
The functional importance of rhythmic activity in the brainCurrent Biology 22:R658–R663.https://doi.org/10.1016/j.cub.2012.06.061
Article and author information
Author details
Funding
Natural Sciences and Engineering Research Council of Canada (RGPIN-2017-06662)
- Jérémie Lefebvre
National Institute of Mental Health (R01MH111889)
- Flavio Frohlich
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
This work has been supported by the Natural Sciences and Engineering Research Council of Canada (JL). Research reported in this publication was supported in part (FF) by the National Institute of Mental Health of the National Institutes of Health under Award Number R01MH111889. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Copyright
© 2017, Lefebvre et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,034
- views
-
- 381
- downloads
-
- 42
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Computational and Systems Biology
- Neuroscience
The basolateral amygdala (BLA) is a key site where fear learning takes place through synaptic plasticity. Rodent research shows prominent low theta (~3–6 Hz), high theta (~6–12 Hz), and gamma (>30 Hz) rhythms in the BLA local field potential recordings. However, it is not understood what role these rhythms play in supporting the plasticity. Here, we create a biophysically detailed model of the BLA circuit to show that several classes of interneurons (PV, SOM, and VIP) in the BLA can be critically involved in producing the rhythms; these rhythms promote the formation of a dedicated fear circuit shaped through spike-timing-dependent plasticity. Each class of interneurons is necessary for the plasticity. We find that the low theta rhythm is a biomarker of successful fear conditioning. The model makes use of interneurons commonly found in the cortex and, hence, may apply to a wide variety of associative learning situations.
-
- Cancer Biology
- Computational and Systems Biology
Effects from aging in single cells are heterogenous, whereas at the organ- and tissue-levels aging phenotypes tend to appear as stereotypical changes. The mammary epithelium is a bilayer of two major phenotypically and functionally distinct cell lineages: luminal epithelial and myoepithelial cells. Mammary luminal epithelia exhibit substantial stereotypical changes with age that merit attention because these cells are the putative cells-of-origin for breast cancers. We hypothesize that effects from aging that impinge upon maintenance of lineage fidelity increase susceptibility to cancer initiation. We generated and analyzed transcriptomes from primary luminal epithelial and myoepithelial cells from younger <30 (y)ears old and older >55y women. In addition to age-dependent directional changes in gene expression, we observed increased transcriptional variance with age that contributed to genome-wide loss of lineage fidelity. Age-dependent variant responses were common to both lineages, whereas directional changes were almost exclusively detected in luminal epithelia and involved altered regulation of chromatin and genome organizers such as SATB1. Epithelial expression of gap junction protein GJB6 increased with age, and modulation of GJB6 expression in heterochronous co-cultures revealed that it provided a communication conduit from myoepithelial cells that drove directional change in luminal cells. Age-dependent luminal transcriptomes comprised a prominent signal that could be detected in bulk tissue during aging and transition into cancers. A machine learning classifier based on luminal-specific aging distinguished normal from cancer tissue and was highly predictive of breast cancer subtype. We speculate that luminal epithelia are the ultimate site of integration of the variant responses to aging in their surrounding tissue, and that their emergent phenotype both endows cells with the ability to become cancer-cells-of-origin and represents a biosensor that presages cancer susceptibility.