Pre-stimulus phase and amplitude regulation of phase-locked responses are maximized in the critical state
Abstract
Understanding why identical stimuli give differing neuronal responses and percepts is a central challenge in research on attention and consciousness. Ongoing oscillations reflect functional states that bias processing of incoming signals through amplitude and phase. It is not known, however, whether the effect of phase or amplitude on stimulus processing depends on the long-term global dynamics of the networks generating the oscillations. Here, we show, using a computational model, that the ability of networks to regulate stimulus response based on pre-stimulus activity requires near-critical dynamics—a dynamical state that emerges from networks with balanced excitation and inhibition, and that is characterized by scale-free fluctuations. We also find that networks exhibiting critical oscillations produce differing responses to the largest range of stimulus intensities. Thus, the brain may bring its dynamics close to the critical state whenever such network versatility is required.
Introduction
Understanding how neurons coordinate their activity to produce emergent dynamics and behaviors is crucial to understanding how the brain gives rise to conscious perception. An influential approach for elucidating neural correlates of consciousness (Dehaene and Changeux, 2011; Engel and Singer, 2001; Tononi and Koch, 2008) has been that of threshold-stimulus detection (Li et al., 2014; Linkenkaer-Hansen et al., 2004; Wyart and Tallon-Baudry, 2009). In these tasks, subjects are given a stimulus that is set at the edge of perception, meaning that on 50% of trials subjects perceive it, and on 50% of trials they do not. In trials where the stimulus is perceived, primary sensory regions exhibit larger event-related potentials (Pins and Ffytche, 2003), larger event-related desynchronization (Vidal et al., 2015), and stronger phase-locking to the stimulus (Palva et al., 2005). However, what causes some trials to evoke stronger ERPs, event-related desynchronization, or phase-locking than other trials—with dramatic consequences for perception—cannot be explained by differences in the stimuli, which are held identical throughout the threshold-stimulus detection experiments. The alternative is that awareness of stimuli depends on brain processes that unravel around the time of the stimulation, for example that pre-stimulus neuronal activity biases stimulus processing and conscious perception (Aru et al., 2012).
One candidate mechanism for gating stimulus processing is alpha oscillations (Jensen and Mazaheri, 2010), which inhibit unwanted stimuli from reaching consciousness (Capilla et al., 2014; Händel et al., 2011; Jensen et al., 2012; Jensen and Mazaheri, 2010; Thut et al., 2006). Fluctuations in alpha oscillations, possibly modulated by attention (Macdonald et al., 2011), may determine whether a stimulus is perceived or not. This was confirmed in threshold-stimulus experiments relating higher pre-stimulus alpha activity to decreased stimulus detection (Ergenoglu et al., 2004; Hanslmayr et al., 2005; Linkenkaer-Hansen et al., 2004). In addition to amplitude, the pre-stimulus alpha phase also predicts stimulus awareness (Busch et al., 2009; Mathewson et al., 2009; VanRullen, 2016).
Regardless of the attentional state, neuronal oscillations in the alpha band exhibit spontaneous amplitude fluctuations. However, these fluctuations are not random, but exhibit a specific temporal structure: autocorrelations with scale-free decay that extends up to time scales of hundreds of seconds (Linkenkaer-Hansen et al., 2001), also called long-range temporal correlations (LRTC). This scale-free character of the oscillations emerges in neuronal networks with balanced excitatory and inhibitory forces (Poil et al., 2012) and is considered a sign of critical-state dynamics (Bak et al., 1987; Chialvo, 2010). Thus, oscillations exhibiting LRTC are referred to as ‘critical oscillations’. Criticality in the brain has also been associated with scale-free neuronal avalanches, and different computational models have used this link to indicate that critical dynamics are beneficial for processing information (Beggs and Plenz, 2003), for example evoked responses show the largest dynamic range (Gautam et al., 2015; Kinouchi and Copelli, 2006; Larremore et al., 2011) and this has subsequently been confirmed experimentally (Gautam et al., 2015; Shew et al., 2009). However, it is not known whether critical-state dynamics of alpha oscillations is beneficial for stimulus processing. Importantly, it remains entirely unknown whether pre-stimulus bias of post-stimulus processing depends on brain dynamics being close to the critical point.
To answer this question, we consider the network response in terms of phase-locking to the stimulus, which is thought to play a role in reorganizing neuronal networks for efficient stimulus processing (Hanslmayr et al., 2005; Min et al., 2007; Sauseng et al., 2007; Voloh and Womelsdorf, 2016). We rely on an extension of a model of critical oscillations (CROS) (Poil et al., 2012), which exhibits dynamics comparable to human M/EEG (Dalla Porta and Copelli, 2019). We use the model to investigate the network phase-locking response as a function of network connectivity, stimulus size, and pre-stimulus alpha amplitude and phase. We then related short-term fluctuations in information processing in these networks, with a long-term characteristic of the oscillatory dynamics: their level of criticality. To evaluate the criticality of alpha oscillations, we used detrended fluctuation analysis (DFA, see Materials and methods), which can discriminate between random fluctuations in the amplitude of oscillations and critical oscillations with long-range temporal correlations. In addition, DFA has the advantage, over other measures of criticality such as neuronal avalanches, that it can be estimated noninvasively at electrode level. This will allow future experiments with EEG/MEG recordings to test whether for example the criticality of sensory cortices biases stimulus processing. We show that pre-stimulus amplitude and phase regulation occurs for critical, but not for subcritical or supercritical networks. Thus, critical-state dynamics in a neuronal network is associated with versatile functions, allowing it to flow between low- and high-responsivity states on sub-second time scales. In addition, we show that a critical network can differentiate the widest range of stimulus sizes. Together, our results suggest that understanding how close neuronal networks are to criticality is essential for understanding their function.
Results
Unstimulated network produces multi-level criticality
To test the effect of critical oscillations on neuronal network functionality, we adapted a model of ongoing neuronal activity (CROS) (Poil et al., 2012) (see Materials and methods). CROS consists of 75% excitatory and 25% inhibitory integrate-and-fire neurons arranged in a 50 × 50 grid (Figure 1—figure supplement 1A). The two parameters that need to be set when creating a network are the percentage of neurons within a local range (circular radius four neurons) that each excitatory and each inhibitory neuron connects to (Figure 1—figure supplement 1A). The firing rate grew monotonously for both excitatory and inhibitory neurons, as we increased excitatory connectivity (Figure 1—figure supplement 1B,C). Networks oscillated in the 8–16 Hz range (Figure 1—figure supplement 1D), with the power of the oscillation increasing as we move towards an excitation-dominated regime (Figure 1—figure supplement 1E). Importantly, the model exhibits multi-level criticality, with spatial and temporal power-law scaling behavior in network activity, which arises through a common mechanism of balanced E/I connectivity (Figure 1—figure supplement 1F–J). To illustrate the importance of the level of criticality on network function, we will show detailed data from three networks throughout the paper: a subcritical (45% excitatory/90% inhibitory connectivity - blue), a critical (60%/75% - green), and a supercritical one (75%/60% - red)(e.g., Figure 1E).
Dynamic range of phase-locking response is strongest for critical networks
Previously, it was shown that criticality maximizes the dynamic range of evoked firing-rate responses (Gautam et al., 2015; Kinouchi and Copelli, 2006; Larremore et al., 2011). However, event-related responses in large oscillatory networks also reflect a reset in the oscillatory phase following stimulation, leading to the phase-locking of the oscillation to the stimulus (Makeig et al., 2002; Min et al., 2007; Palva et al., 2005). As such, the firing rate and phase-locking responses reflect fundamentally different aspects of network activity, for example evoked firing-rate responses may increase the overall network activity without affecting the phase of oscillatory activity in a particular frequency band. In fact, evoked firing-rate responses are not an appropriate measure of network response in networks with strong oscillations: they fluctuate continuously with the phase of the ongoing oscillation, making it difficult to judge the firing-rate response in absolute values, that is without relating it to the ongoing oscillation. In that respect, the phase-locking response is a more appropriate way to detect changes in network activity occurring due to external stimulation.
To test whether criticality maximizes the dynamic range also for phase-locked oscillatory responses, we attached a stimulus to n excitatory neurons distributed randomly on the grid (Figure 1A). The stimulus had the same weight as any of the excitatory to excitatory synapses in the network (winput = wEE = 0.0085), and lasted for one time step (1 ms). We found that the stimulus response in our networks is indeed oscillatory, which may result in stimulus phase-locking (Figure 1B). We then investigated how changing the stimulus size, n, altered the phase-locking response of a network to the stimulus. In Figure 1C, we can see that a critical network increases the level of post-stimulus phase-locking as stimulus size is increased. This shows that the CROS model is capable of showing oscillatory responses to a stimulus, as has been seen in human subjects (Palva et al., 2005). We calculated the dynamic range, which gives an indication of how well a network can give differing responses to stimuli of different sizes (see Materials and methods). Critical networks show a wider dynamic range than their sub-/super-critical counterparts (Figure 1D–F), and this effect is robust over a wide range of post-stimulus latencies (Figure 1—figure supplement 2). Interestingly, in the case of supercritical networks, the strong, ongoing oscillatory activity prevents the phase-locking response from saturating (PLF ~1), even at the largest stimulus sizes (Figure 1D, Figure 2—figure supplement 1). Another factor that can shape stimulus response, other than stimulus size, is the strength of the external stimulus. We found that an 8-fold increase in the external input strength was sufficient to bring the PLF of supercritical networks to saturation, for the largest stimulus size (Figure 1—figure supplement 3B). However, such a large increase in the input strength also leads to a stronger PLF for the smaller stimulus sizes in the case of subcritical and critical networks, which means they no longer show weak PLF responses reducing their dynamic range. Of all tested strengths and networks, the maximal dynamic range occurs for critical networks at a multiplier ~1 (Figure 1—figure supplement 3C). Overall, our results show that critical networks discriminate the widest range of stimulus sizes through their post-stimulus phase-locking response.
Pre-stimulation amplitude influence on phase-locking requires critical dynamics
The ongoing oscillations showed a phase-locking response in the post-stimulus period (~65–250 ms) to the stimulus, which depended on the criticality of the network (Figure 2A,B), as well as on the stimulus size (Figure 2—figure supplement 1). Considering the complex variation of activity in a critical network, we wondered whether critical networks function differently depending on their instantaneous state. For this purpose, we assessed the network phase-locking response to a stimulus of 5 neurons, and related it to the pre-stimulus amplitude averaged over the −150 to −50 ms time range, in the 8–16 Hz frequency band. We found that critical networks exhibit strong negative pre-stimulus amplitude regulation (Figure 2C–E), whereas sub-critical or super-critical networks show no pre-stimulus amplitude regulation (Figure 2D,E). We confirmed this result statistically by showing that pre-stimulus amplitude regulation was more prominent for networks with stronger LRTC (Figure 2F, Figure 2—figure supplement 2).
To test whether this function is generic to criticality and not specific to the chosen stimulus size, we investigated the three combinations of excitatory/inhibitory connectivity and found that the critical network—unlike the sub-/super-critical networks—showed significant pre-stimulus amplitude modulation for a wide range of stimulus intensities (Figure 2G). Changing the weight of the external input also affects the range of stimuli over which networks show pre-stimulus amplitude regulation (Figure 2—figure supplement 3B). Nonetheless, the range of stimuli over which the critical networks show pre-stimulus amplitude regulation is superior to that of the subcritical and supercritical networks, regardless of the strength of the input weight (Figure 2—figure supplement 3C).
Pre-stimulation phase influence on phase-locking requires critical dynamics
Having identified a strong interaction between criticality of oscillations and pre-stimulus amplitude on stimulus-evoked phase-locking, we asked whether a similar effect is present for the phase of the pre-stimulus oscillation. For the sub- and super-critical networks there was no pre-stimulus phase regulation of response at a stimulus size of 5 neurons (Figure 3A). In contrast, the critical network showed large differences in post-stimulus phase-locking for different pre-stimulus phase bins (Figure 3A). These networks showed the weakest response on the descending side of the alpha cycle, when the network is inhibited, and the strongest response on the rising side of the alpha cycle, when the network is in an excitable state (Figure 3—figure supplement 1). Looking across the connectivity parameter space, we found that pre-stimulus phase dependence of post-stimulus phase-locking requires a balance in E/I connectivity (Figure 3B), and is significantly correlated with criticality as reflected in LRTC (Figure 3C, Figure 3—figure supplement 2). The pre-stimulus phase influence on phase-locking also generalized to other stimulus sizes. Given the three combinations of excitatory/inhibitory connectivity indicated in Figure 3D, we found that the critical networks show pre-stimulus regulation over the widest range of stimulus sizes. We found that changing the weight of the external input also affects the range of stimuli over which pre-stimulus phase regulation is significant (Figure 3—figure supplement 3B). Nonetheless, pre-stimulus phase-regulation occurs for a wider range of stimuli in critical networks than in their subcritical or supercritical counterparts, regardless of the strength of the input weight (Figure 3—figure supplement 3C).
The relationship between criticality and network versatility is robust to changes in model parameters
Model parameters were selected through an optimization process which aimed at getting power-law avalanche distributions and robust LRTC (as described in more detail in Materials and methods), but did not include any criteria to maximize the dynamic range of phase-locking response, or pre-stimulus amplitude or phase regulation. Therefore, we expect that the functional consequences of criticality on stimulus processing that emerged out of the model, are generic to criticality, and not specific to the actual parameters. To verify this, we repeated our analysis for two versions of the model where the synaptic weight of excitatory to excitatory connections (wEE) was multiplied by a factor of 0.75, or by a factor of 1.25. Multiplication of wEE by a factor of 0.75 reduced the overall activity in the network, which means that stronger connectivity is required to achieve the same dynamics, leading to a shift up of the critical line through the phase space (Figure 4). Increasing wEE had the opposite effect on the critical line. Importantly, the functional consequences of criticality—maximized dynamic range, pre-stimulus amplitude and phase regulation—followed this shift in the critical line. This suggests that the relationship between criticality and versatility in stimulus processing is not coincidental on the specific choice of parameters, but generic to criticality.
Discussion
In this study, we establish for the first time a link between critical-state dynamics of oscillations and the ability of a network to respond differently depending on the amplitude of ongoing alpha oscillations. This functionality has been investigated in many human studies (Ergenoglu et al., 2004; Hanslmayr et al., 2005; Linkenkaer-Hansen et al., 2004), where a low oscillation power in relevant sensory areas in the pre-stimulus period has been seen as a pre-requisite of conscious perception. In non-relevant areas, on the other hand, it has been suggested that a high oscillation power serves to functionally inhibit that region (Smith et al., 2012). Our findings are also consistent with the notion that alpha oscillations create periodic fluctuations in excitability (Klimesch et al., 2007), which are indexed by the phase of the oscillations. Pre-stimulus phase has been shown to bias perception (Busch et al., 2009; Mathewson et al., 2009; VanRullen, 2016) and we found that this function is also likely to be modulated by the criticality of the network. In addition, we show that oscillatory spiking neuronal networks have an optimal dynamic range when they are critical, which is in agreement with previous work on non-oscillatory networks (Gautam et al., 2015; Kinouchi and Copelli, 2006; Larremore et al., 2011; Shew et al., 2009), and suggests that optimal dynamic range is a generic property of critical systems. Thus, since the level of criticality affects network response in terms of stimulus phase-locking, and phase-locking plays a role in the generation of event-related responses (ERPs) (Makeig et al., 2002; Min et al., 2007), we predict that criticality will also affect the different time components of ERPs.
There is much debate as to the cause of amplitude fluctuations during threshold stimulus detection tasks, with top-down mechanisms such as attention and expectation being suggested (Jensen et al., 2012; Melloni et al., 2011). Here, we show that a network with balanced excitatory and inhibitory connectivity produces spontaneous amplitude fluctuations that have a functional role, meaning that the network goes through periods of high and low sensitivity to external stimuli. In the unbalanced state, the network loses this function and either reliably reacts (in the sub-critical case), or ignores the stimulus (super-critical case). Thus, top-down mechanisms are not required for fluctuations in alpha power; however, it is plausible that attentional mechanisms can actively regulate the level of fluctuations to shift the network’s operating point relative to the critical state, allowing the network to react in the required manner (Wyart and Tallon-Baudry, 2009). How do these findings relate to task performance? Pre-stimulus activity regulation of post-stimulus response has been found beneficial, by enhancing detection of stimuli that are attended to (Capilla et al., 2014) or expected (Mayer et al., 2016), and reducing detection of irrelevant stimuli. The spontaneous fluctuations in amplitude observed at criticality, with impact on conscious perception, may serve to flexibly switch between the different stimuli competing for attention. To this is added another advantage of being in the critical state: it requires minimal attentional modulations to reach the sub- or super-critical states, and thus to enhance aspects of stimuli, for example in the case of stimulus discrimination (Tomen et al., 2014).
However, is this network ability to regulate perception based on pre-stimulus amplitude always optimal for performing a task? In tasks where continuous detection ability is required, fluctuations in pre-stimulus activity will actually decrease task performance in those periods of amplitude that produce smaller post-stimulus response. In addition, the broadening of attention to external stimuli in the critical state, is accompanied by increased susceptibility to task-unrelated mentation, or mind-wandering (Hellyer et al., 2014). When people experience periods of mind-wandering during task-performance, this results in reduced phase-locking to a stimulus (Baird et al., 2014). In these cases a more sub-critical network would actually perform better in terms of constant attention (Irrmischer et al., 2018; Tomen et al., 2014) and a super-critical network would perform better in terms of constant functional inhibition. Our results are in line with the predictions of Cramer et al. (2019), which suggest that the critical state is not optimal for all information processing requirements: complex tasks benefit from criticality, whereas in simple tasks, the high susceptibility to stimuli, memory capacity and entropy of a critical regime might impair performance.
We have shown that critical networks have overall the widest dynamic range of phase-locking response, and pre-stimulus amplitude and phase regulation. However, we also found that supercritical networks can show differential PLF and pre-stimulus regulation for the large stimulus sizes where the PLF response of critical networks saturates. One way in which the brain can take advantage of the information processing benefits of different states is to regulate its dynamics with respect to the critical point in a task-dependent manner (Pfeffer et al., 2018). Zierenberg et al. (2020) show that the brain could also combine networks with different distances to the critical point, such that the resulting ensemble has a dynamic range of stimulus response wider than any of the ensemble networks. This strategy could plausibly be employed to extend the range of stimulus sizes over which pre-stimulus amplitude and phase regulation occur.
Although our computational model abstracts many biophysiological neuronal mechanisms, it captures essential features of neuronal dynamics: alpha oscillations, long-range temporal correlations, and scale-free avalanches, which emerge at a specific balance of excitatory and inhibitory connectivity. We showed that the relationship between criticality and the maximal versatility of network function is not specific to the selection of model parameters, which suggests that it is generic to criticality. Future studies should test whether our results also hold for more physiologically realistic models, for example where excitatory and inhibitory currents balance each other (Haider et al., 2006; Rudolph and Destexhe, 2003).
Previously, non-oscillatory neuronal models have shown maximized dynamic range at criticality (Gautam et al., 2015; Kinouchi and Copelli, 2006; Larremore et al., 2011; Shew et al., 2009). While it is plausible that non-oscillatory models could also show a pre-stimulus ‘amplitude’ regulation effect based on the level of pre-stimulus firing—and that this effect is likely to be maximal at criticality—it is unclear how a phase regulation effect could occur without an ongoing oscillation. Future studies could investigate whether the presence of oscillations is important for pre-stimulus phase and amplitude regulation to occur, in models with a different type of critical phase transition (such as absorbing/sustained) (Del Papa et al., 2017; Levina et al., 2007).
Overall our study highlights the importance of critical-state dynamics (Chialvo, 2010) for understanding neuronal network function, and shows that it is possible to integrate oscillatory mechanisms into this framework. Importantly, while the quantitative hallmarks of criticality require long-time monitoring of spatial and temporal dynamics that are statistically stable, our results show that the concept of critical brain dynamics is compatible with time-varying functions—an important notion in contemporary theories of neuronal oscillations and their role in neuronal communication and in attention.
Materials and methods
CRitical OScillations (CROS) model
Request a detailed protocolWe used an adapted version of the model described in Poil et al. (2012), with synaptic weights optimized for power-law avalanches and long-range temporal correlations. The model was implemented using the Brian2 simulator for spiking neural networks (Stimberg et al., 2014; RRID:SCR_002998). Specifically, we modeled networks of 75% excitatory and 25% inhibitory integrate-and-fire neurons arranged on a 50x50 open grid. Placing neurons on the grid using uniform sampling may result, by chance, in clusters of excitatory or inhibitory neurons. To avoid this, we first positioned inhibitory neurons on the grid according to Mitchell’s best candidate algorithm (Mitchell, 1991), which results in a more even spatial distribution. The remaining spaces were filled with excitatory neurons. Networks differ in their two connectivity parameters, and , which are the percentage of other neurons within a local range (a circle with radius = 4 neurons centered on the presynaptic neuron) that each excitatory and each inhibitory neuron connects to, respectively. Connectivity parameters were set between 25 and 100% at 5% intervals, and 10 different networks were created for each combination of and . Border neurons had fewer connections because these neurons had a lower number of neurons in their local range. Within local range, connection probability decreases exponentially with distance. More specifically, the probability, P, of a connection at a distance r was given by:
where is optimized separately for excitatory and inhibitory neurons such that the overall connectivity probability within a neuron’s local range is equal to or , depending on whether the neuron is excitatory or inhibitory. For example in the case of an excitatory neuron i, with connectivity probability , where the set of neighboring neurons within the local range is , and is the number of neighbors, will have to satisfy the following equation:
As such, we used the Nelder-Mead optimization algorithm to determine the value of which minimizes the following function:
Neuron model
Request a detailed protocolNeurons were modeled using a synaptic model integrating received spikes, and a probabilistic spiking model. Each time step (dt) of 1 ms starts with each neuron, i, updating the input with spikes received from the presynaptic neurons , together with an exponential synaptic decay:
The weights are fixed, and depend on the type of the pre- and post-synaptic neuron. the decay constant of inputs, and S is a is a binary vector, with =1 if the pre-synaptic neuron j fired in the previous time step, and =0 otherwise.
The activation of a neuron , is then updated with these excitatory and inhibitory inputs, together with an exponential decay, , and a baseline activation level :
The spiking probability is calculated as a function of the neuron activation A at the current timestep, as follows:
We determine whether the neuron spikes with the probability PS. If a neuron spikes, the neuron activation A is reset to the reset value, . At the next time step, all neurons that it connects to will have their input updated again according to Equation 4.
Model parameters
Request a detailed protocolAll model parameters were the same as in the original paper (Poil et al., 2012) apart from the synaptic weights. Neuron model: (= 9 ms), Synaptic model: Excitatory neurons ( = 6 ms, A0 = 0.000001, Ar = -2), Inhibitory neurons ( = 12 ms, A0 =0, Ar = -20). To improve the range and stability of the long-range temporal correlations from the original model, an evolutionary algorithm (Smit and Eiben, 2011) was applied to the synaptic weights. The parameters that could vary were the 2 connectivity parameters (taking values between 0 and 100%), and the natural logarithm of the magnitude of the 4 synaptic weights, WEE, WIE, WEI and WII (taking values between -5 and 1). For each run, a fitness value was calculated based on the avalanches size and duration distributions (see Materials and methods - Neuronal Avalanches), and the LRTCs (see Materials and methods - Detrended fluctuation analysis of long-range temporal correlations).
The optimum weights (Wij, connecting the presynaptic neuron j to the postsynaptic neuron i) found by the algorithm were (WEE = 0.0085,WIE = 0.0085,WEI = −0.569,WII = −2).
Network activity analysis
Request a detailed protocolA network signal was created by summing the total number of neurons spiking at each time-step with a Gaussian white noise signal of the same length with mean = 0 and σ = 3. This level of white noise was set to allow all networks to achieve a time-varying phase, which is not the case without adding the noise, when there are silent periods in the network. Detrended fluctuation analysis, oscillation power, and phase-locking factor, which are described below, were calculated on this pre-processed signal, with Gaussian noise added. The analysis of neuronal avalanches was performed on the raw signal, consisting of the total number of neurons spiking at each time step.
Oscillation power
Request a detailed protocolThe power spectrum was computed using the Welch method with a Hamming window with 211 FFT points.
Neuronal avalanches
Request a detailed protocolA neuronal avalanche is defined as a period where neurons are spiking above a certain threshold—in our case set to half median of activity. The size of the avalanche is the number of spikes during this period. We then computed the κ index (Poil et al., 2012; Shew et al., 2009), which determines the difference between the distribution of our data and a power-law, by calculating the average difference of the cumulative distribution of a power-law function, P, (with exponent −1.5 for size and −2.0 for duration) and that of our experimental data, A, at 10 equally spaced points on a logarithmic axis (β) and adding 1.
A subcritical distribution is characterized by κ <1, and a supercritical distribution by κ >1, whereas κ = 1 indicates a critical network.
Detrended fluctuation analysis of long-range temporal correlations
Request a detailed protocolDetrended fluctuation analysis (DFA) was used to analyze the scale-free decay of temporal (auto)correlations, also known as long-range temporal correlations (LRTC). The DFA was introduced as a method to quantify correlations in complex data with less strict assumptions about the stationarity of the signal than the classical autocorrelation function or power spectral density (Hardstone et al., 2012; Linkenkaer-Hansen et al., 2001). In addition, DFA facilitates a reliable analysis of LRTC up to time scales of at least 10% of the duration of the signal (Chen et al., 2002; Gao et al., 2006). DFA exponents in the interval of 0.5 to 1.0 indicate scale-free temporal correlations (autocorrelations), whereas an exponent of 0.5 characterizes an uncorrelated signal. The main steps from the broadband signal to the quantification of LRTC using DFA have been explained in detail previously (Hardstone et al., 2012; Linkenkaer-Hansen et al., 2001). In brief, the DFA measures the power-law scaling of the root-mean-square fluctuation of the integrated and linearly detrended signals, F(t), as a function of time-window size, t (with an overlap of 50% between windows). The DFA exponent is the slope of the fluctuation function F(t), and can be interpreted as the strength of the autocorrelations in signals. For our analyses we computed DFA on the amplitude envelope of the signal filtered in the 8–16 Hz range, and the exponent was fit between 2 and 50 s.
Unstimulated networks
Request a detailed protocolTo assess the dynamics of unstimulated networks we allowed connectivity to take values between 25 and 100% at 5% intervals. For all 256 possible parameter combinations of excitatory and inhibitory connectivity, we created 10 different networks and ran each network for 2 × 106 time-steps (2000 s).
Stimulation networks
Request a detailed protocolTo test network response to a stimulus we took one sample network for each combination of excitatory and inhibitory connectivity parameters, and for each run of the network we stimulated n excitatory neurons where n ε {1, 2, 3, 5, 9, 15, 25, 43, 74, 126, 216, 369, 632, 1081, 1800}. The stimulated neurons were randomly distributed across the grid. For all 256 possible parameter combinations of excitatory and inhibitory connectivity, and stimulus size, we used the same 10 different networks as in the unstimulated case, and ran each network for 2 × 106 time-steps (2000 s). During the stimulation runs all neurons in the receptive field simultaneously received a stimulus once in every 500–1500 ms. The stimulus had the same weight as any of the excitatory-excitatory connections in the network (winput = wEE = 0.0085), and was applied simultaneously, for one timestep = 1 ms, to all the n excitatory neurons which the stimulus connected to. Additionally, we investigated the effect of the stimulus strength on network dynamics by modulating winput by a factor of 1/64 to 64 times the original value, on a log2 scale.
Phase-locking factor
Request a detailed protocolStimulus response was calculated in the network in terms of the phase-locking factor (Palva et al., 2005). Data were filtered using a one-way causal FIR filter (order 250) between 8 and 16 Hz. The use of a causal FIR filter ensured that pre-stimulus phase and amplitude were not contaminated by the stimulus responses, at the cost of delaying the peak response to the stimulus by 125 ms. The phase at any point in time was obtained by taking the angle of the Hilbert transform. Phase-locking factor (PLF) measures the uniformity of phases across trials at a time-point post-stimulus and was calculated as the mean vector length of all phases (Berens, 2009; RRID:SCR_016651):
where T is the set of trials, of size N, and is the unit vector whose angle corresponds to the momentary phase in trial i, at the time point for which PLF is calculated.
Dynamic range
Request a detailed protocolWe fit a sigmoid to the PLF response at 150 ms post-stimulus, as a function of the number of neurons stimulated. The dynamic range is calculated as the orders of magnitude of neurons stimulated between the 10% and 90% of the sigmoid we fit (Kinouchi and Copelli, 2006).
Pre-stimulus amplitude regulation of PLF
Request a detailed protocolTo calculate the PLF response corresponding to different levels of pre-stimulus amplitude, we separated trials into 10 percentile bins, based on the average amplitude in the −150 to −50 ms time-range, calculated for the 8–16 Hz frequency band. The percentile binning procedure ensured an equal number of trials across bins, which is important because the PLF value reflects the distribution of phases, but is also determined by the number of trials (e.g., the PLF value for uniformly randomly distributed phases is dependent on the number of trials). PLF at 150 ms post-stimulus was calculated separately for each of the 10 bins. The regulation measure Regamp was calculated as the Spearman correlation between the index of the bin and the PLF for that bin.
Pre-stimulus phase regulation of PLF
Request a detailed protocolTo calculate the pre-stimulus phase regulation of PLF, trials were split into 32 overlapping bins of width π/8 based on the pre-stimulus phase in the 8–16 Hz frequency range at time −5 ms. To get an equal number of trials in each bin, x randomly selected trials from each bin were picked where x was the smallest number of trials in a bin. PLF at 150 ms post-stimulus was calculated separately for each bin. If no phase regulation takes place, a uniform distribution of post-stimulus PLF is expected. The calculation of phase regulation uses the phase-locking factor of each of 32 phase bins as the weight for the unit vector of that phase. The sum of the 32 vectors is then normalized by the sum of all PLFs. For this calculation, we used the circ_r function from the circ_stats package (Berens, 2009; RRID:SCR_016651):
where P is the set of 32 bins, is the unit vector whose angle corresponds to the phase at the center of each bin i, and is the phase-locking factor across all trials belonging to bin i. This measure gives a value of Regphase between 0 (PLF is same for all bins) and 1 (PLF is non-zero in one bin, and zero in all others).
Association between criticality and network function
Request a detailed protocolCriticality was measured by the LRTC (DFA) of alpha oscillations in the non-stimulated networks. Network function was measured by pre-stimulus amplitude and phase modulation, as well as dynamic range, of the stimulated networks. To get robust estimators for criticality as well as our 3 indicators of network function, we averaged the values across all 10 network initializations, for each excitatory/inhibitory connectivity parameter combination (n=256). Before correlating criticality to network function, we had to address another aspect: a disproportionate amount of networks had low DFA. To this end, we binned the n=256 datapoints corresponding to each aspect of network function (pre-stimulus amplitude and phase modulation, dynamic range), by DFA, in bins of size 0.02, covering a DFA range of 0.5 to 0.9. The association between criticality and pre-stimulus amplitude regulation, for example, was computed as the Spearman correlation between the mean values of the 20 DFA bins, and the mean Regamp for the networks belonging to that bin. The same type of pre-processing was performed for pre-stimulus phase regulation and dynamic range. To identify the time ranges where criticality predicts network function, we calculated the Spearman correlation mentioned earlier, for all timepoints between 0 and 500 ms post-stimulus. To correct for multiple comparisons, we used the cluster-based correction with permutation (Nichols and Holmes, 2002), with a significance threshold . We will exemplify again the process by looking at the association between criticality and pre-stimulus amplitude regulation, but the steps are the same for the other indicators of network function. First, we calculated the cluster significance threshold, to determine which clusters could have arisen by chance. While keeping the ordering of the DFA bins the same, we permuted the corresponding Regamp values, separately for each timepoint between 0 and 500 ms post-stimulus. We then computed the Spearman correlation coefficients between DFA and the permuted Regamp, for each timepoint, and identified all clusters – sets of contiguous timepoints with a p-value for the Spearman correlation . We defined cluster size , where is a timepoint belonging to the set of contiguous timepoints in cluster , and is the absolute value of the Spearman correlation coefficient at time . We then calculated the maximum cluster size for the permuted dataset to be , where is the set of all clusters . We repeated this process 10000 times, which gave us a distribution of over different permutations of the data. We set the cluster significance threshold to correspond to the percentile of . We then identified all clusters from the actual (non-permuted data), consisting of contiguous timepoints with with a p-value for the Spearman correlation , and kept only those clusters, whose cluster size >
Baseline level of pre-stimulus regulation
Request a detailed protocolFor this, we generated 10 synthetic runs (equal to the number of simulations of the CROS model for each excitatory/inhibitory connectivity combination)—each consisting of 2000 pairs of pre/post stimulus phase (equal to the number of times that the CROS model was stimulated throughout a run) drawn from a uniform distribution, and calculated pre-stimulus phase regulation for each of the 10 synthetic runs. Then we computed the average phase regulation across all 10 runs. We repeated this process 10000 times to get the 95% percentile of phase regulation. We used this as a significance threshold to determine whether 10 individual subcritical, critical, or supercritical networks, at a certain stimulus size, showed pre-stimulus phase regulation above what is expected from a random distribution of pre/post-stimulus phases. As seen in Figure 3D, sub-critical networks at strong stimuli show phase regulation well below this threshold. That is because these networks respond reliably to the strong stimuli regardless of the pre-stimulus phase, thus the distribution of responses across phases is more uniform than expected from a random distribution. Some supercritical networks show phase regulation below threshold for the weaker stimuli, because they have strong alpha oscillations which maintain the phase of oscillations similar for a long time after they have been binned uniform.
Robustness of relationship between network versatility and criticality
Request a detailed protocolTo verify that our results are not dependent on the specific model parameters, we used two variants of the model, where the weight of excitatory to excitatory connections (wEE) was multiplied by a factor of 0.75 and 1.25, respectively. For each combination of excitatory and inhibitory connectivity, we created five different networks. We then ran each network for 2 × 106 time-steps (2000 s), for all combinations of stimulus size and weight of excitatory to excitatory connections (wEE).
Data availability
Source code required to run all simulations, as well as datasets and scripts required to generate all figures presented here, are available at https://doi.org/10.6084/m9.figshare.12167943.v2.
-
figsharePre-stimulus phase and amplitude regulation of phase-locked responses is maximized in the critical state.https://doi.org/10.6084/m9.figshare.12167943.v2
References
-
Distilling the neural correlates of consciousnessNeuroscience & Biobehavioral Reviews 36:737–746.https://doi.org/10.1016/j.neubiorev.2011.12.003
-
The decoupled mind: mind-wandering disrupts cortical phase-locking to perceptual eventsJournal of Cognitive Neuroscience 26:2596–2607.https://doi.org/10.1162/jocn_a_00656
-
Self-organized criticality: an explanation of the 1/f noisePhysical Review Letters 59:381–384.https://doi.org/10.1103/PhysRevLett.59.381
-
Neuronal avalanches in neocortical circuitsThe Journal of Neuroscience 23:11167–11177.https://doi.org/10.1523/JNEUROSCI.23-35-11167.2003
-
CircStat : a MATLAB toolbox for circular statisticsJournal of Statistical Software 31:1–21.https://doi.org/10.18637/jss.v031.i10
-
The phase of ongoing EEG oscillations predicts visual perceptionJournal of Neuroscience 29:7869–7876.https://doi.org/10.1523/JNEUROSCI.0113-09.2009
-
Effect of nonstationarities on detrended fluctuation analysisPhysical Review E 65:41107.https://doi.org/10.1103/PhysRevE.65.041107
-
Temporal binding and the neural correlates of sensory awarenessTrends in Cognitive Sciences 5:16–25.https://doi.org/10.1016/S1364-6613(00)01568-0
-
Alpha rhythm of the EEG modulates visual detection performance in humansCognitive Brain Research 20:376–383.https://doi.org/10.1016/j.cogbrainres.2004.03.009
-
Maximizing sensory dynamic range by tuning the cortical state to criticalityPLOS Computational Biology 11:e1004576.https://doi.org/10.1371/journal.pcbi.1004576
-
Alpha oscillations correlate with the successful inhibition of unattended stimuliJournal of Cognitive Neuroscience 23:2494–2502.https://doi.org/10.1162/jocn.2010.21557
-
Detrended fluctuation analysis: a scale-free view on neuronal oscillationsFrontiers in Physiology 3:450.https://doi.org/10.3389/fphys.2012.00450
-
Strong long-range temporal correlations of beta/gamma oscillations are associated with poor sustained visual attention performanceEuropean Journal of Neuroscience 48:2674–2683.https://doi.org/10.1111/ejn.13672
-
An oscillatory mechanism for prioritizing salient unattended stimuliTrends in Cognitive Sciences 16:200–206.https://doi.org/10.1016/j.tics.2012.03.002
-
Shaping functional architecture by oscillatory alpha activity: gating by inhibitionFrontiers in Human Neuroscience 4:186.https://doi.org/10.3389/fnhum.2010.00186
-
Optimal dynamical range of excitable networks at criticalityNature Physics 2:348–351.https://doi.org/10.1038/nphys289
-
EEG alpha oscillations: The inhibition–timing hypothesisBrain Research Reviews 53:63–88.https://doi.org/10.1016/j.brainresrev.2006.06.003
-
Long-range temporal correlations and scaling behavior in human brain oscillationsThe Journal of Neuroscience 21:1370–1377.https://doi.org/10.1523/JNEUROSCI.21-04-01370.2001
-
Prestimulus oscillations enhance psychophysical performance in humansJournal of Neuroscience 24:10186–10190.https://doi.org/10.1523/JNEUROSCI.2584-04.2004
-
To see or not to see: prestimulus alpha phase predicts visual awarenessJournal of Neuroscience 29:2725–2732.https://doi.org/10.1523/JNEUROSCI.3963-08.2009
-
The best of both worlds: phase-reset of human EEG alpha activity and additive power contribute to ERP generationInternational Journal of Psychophysiology 65:58–68.https://doi.org/10.1016/j.ijpsycho.2007.03.002
-
BookSpectrally Optimal Sampling for Distribution Ray TracingACM Siggraph Computer Graphics.
-
Early neural correlates of conscious somatosensory perceptionJournal of Neuroscience 25:5248–5258.https://doi.org/10.1523/JNEUROSCI.0141-05.2005
-
The neural correlates of conscious visionCerebral Cortex 13:461–474.https://doi.org/10.1093/cercor/13.5.461
-
A fast-conducting, stochastic integrative mode for neocortical neurons in vivoThe Journal of Neuroscience 23:2466–2476.https://doi.org/10.1523/JNEUROSCI.23-06-02466.2003
-
Neuronal avalanches imply maximum dynamic range in cortical networks at criticalityJournal of Neuroscience 29:15595–15600.https://doi.org/10.1523/JNEUROSCI.3864-09.2009
-
ConferenceMulti-Problem parameter tuning using bonesaArtificial Evolution. pp. 222–233.
-
Equation-oriented specification of neural models for simulationsFrontiers in Neuroinformatics 8:6.https://doi.org/10.3389/fninf.2014.00006
-
Marginally subcritical dynamics explain enhanced stimulus discriminability under attentionFrontiers in Systems Neuroscience 8:1–15.https://doi.org/10.3389/fnsys.2014.00151
-
The neural correlates of consciousness: an updateAnnals of the New York Academy of Sciences 1124:239–261.https://doi.org/10.1196/annals.1440.004
-
Perceptual cyclesTrends in Cognitive Sciences 20:723–735.https://doi.org/10.1016/j.tics.2016.07.006
-
A role of Phase-Resetting in coordinating large scale neural networks during attention and Goal-Directed behaviorFrontiers in Systems Neuroscience 10:18.https://doi.org/10.3389/fnsys.2016.00018
-
Tailored ensembles of neural networks optimize sensitivity to stimulus statisticsPhysical Review Research 2:13115.https://doi.org/10.1103/PhysRevResearch.2.013115
Article and author information
Author details
Funding
Nederlandse Organisatie voor Wetenschappelijk Onderzoek (612.001.123)
- Richard Hardstone
- Klaus Linkenkaer-Hansen
Nederlandse Organisatie voor Wetenschappelijk Onderzoek (406.15.256)
- Arthur-Ervin Avramiea
- Klaus Linkenkaer-Hansen
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
This work was funded by Netherlands Organization for Scientific Research (NWO) Physical Sciences Grant 612.001.123 (to KL-H and RH) and NWO Social Sciences grant 406.15.256 (to KL-H and A-EA). We thank Simon-Shlomo Poil for discussions on the manuscript.
Copyright
© 2020, Avramiea et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,180
- views
-
- 258
- downloads
-
- 20
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Computational and Systems Biology
- Neuroscience
Hypothalamic kisspeptin (Kiss1) neurons are vital for pubertal development and reproduction. Arcuate nucleus Kiss1 (Kiss1ARH) neurons are responsible for the pulsatile release of gonadotropin-releasing hormone (GnRH). In females, the behavior of Kiss1ARH neurons, expressing Kiss1, neurokinin B (NKB), and dynorphin (Dyn), varies throughout the ovarian cycle. Studies indicate that 17β-estradiol (E2) reduces peptide expression but increases Slc17a6 (Vglut2) mRNA and glutamate neurotransmission in these neurons, suggesting a shift from peptidergic to glutamatergic signaling. To investigate this shift, we combined transcriptomics, electrophysiology, and mathematical modeling. Our results demonstrate that E2 treatment upregulates the mRNA expression of voltage-activated calcium channels, elevating the whole-cell calcium current that contributes to high-frequency burst firing. Additionally, E2 treatment decreased the mRNA levels of canonical transient receptor potential (TPRC) 5 and G protein-coupled K+ (GIRK) channels. When Trpc5 channels in Kiss1ARH neurons were deleted using CRISPR/SaCas9, the slow excitatory postsynaptic potential was eliminated. Our data enabled us to formulate a biophysically realistic mathematical model of Kiss1ARH neurons, suggesting that E2 modifies ionic conductances in these neurons, enabling the transition from high-frequency synchronous firing through NKB-driven activation of TRPC5 channels to a short bursting mode facilitating glutamate release. In a low E2 milieu, synchronous firing of Kiss1ARH neurons drives pulsatile release of GnRH, while the transition to burst firing with high, preovulatory levels of E2 would facilitate the GnRH surge through its glutamatergic synaptic connection to preoptic Kiss1 neurons.
-
- Cell Biology
- Neuroscience
The assembly and maintenance of neural circuits is crucial for proper brain function. Although the assembly of brain circuits has been extensively studied, much less is understood about the mechanisms controlling their maintenance as animals mature. In the olfactory system, the axons of olfactory sensory neurons (OSNs) expressing the same odor receptor converge into discrete synaptic structures of the olfactory bulb (OB) called glomeruli, forming a stereotypic odor map. The OB projection neurons, called mitral and tufted cells (M/Ts), have a single dendrite that branches into a single glomerulus, where they make synapses with OSNs. We used a genetic method to progressively eliminate the vast majority of M/T cells in early postnatal mice, and observed that the assembly of the OB bulb circuits proceeded normally. However, as the animals became adults the apical dendrite of remaining M/Ts grew multiple branches that innervated several glomeruli, and OSNs expressing single odor receptors projected their axons into multiple glomeruli, disrupting the olfactory sensory map. Moreover, ablating the M/Ts in adult animals also resulted in similar structural changes in the projections of remaining M/Ts and axons from OSNs. Interestingly, the ability of these mice to detect odors was relatively preserved despite only having 1–5% of projection neurons transmitting odorant information to the brain, and having highly disrupted circuits in the OB. These results indicate that a reduced number of projection neurons does not affect the normal assembly of the olfactory circuit, but induces structural instability of the olfactory circuitry of adult animals.