Subthalamic beta-targeted neurofeedback speeds up movement initiation but increases tremor in Parkinsonian patients
Abstract
Previous studies have explored neurofeedback training for Parkinsonian patients to suppress beta oscillations in the subthalamic nucleus (STN). However, its impacts on movements and Parkinsonian tremor are unclear. We developed a neurofeedback paradigm targeting STN beta bursts and investigated whether neurofeedback training could improve motor initiation in Parkinson’s disease compared to passive observation. Our task additionally allowed us to test which endogenous changes in oscillatory STN activities are associated with trial-to-trial motor performance. Neurofeedback training reduced beta synchrony and increased gamma activity within the STN, and reduced beta band coupling between the STN and motor cortex. These changes were accompanied by reduced reaction times in subsequently cued movements. However, in Parkinsonian patients with pre-existing symptoms of tremor, successful volitional beta suppression was associated with an amplification of tremor which correlated with theta band activity in STN local field potentials, suggesting an additional cross-frequency interaction between STN beta and theta activities.
Introduction
Enhanced synchronization of neural activity in the beta band (13–30 Hz) has been consistently observed in the subthalamic nucleus (STN) in patients with Parkinson’s disease (Kühn et al., 2009; Neumann et al., 2016). Synchrony in this frequency band takes the form of short-lived bursts of different durations and amplitudes (Tinkhauser et al., 2017a; Tinkhauser et al., 2017b). The occurrence rate of longer beta bursts with large amplitude positively correlates with motor impairment (Tinkhauser et al., 2017a; Tinkhauser et al., 2020; Torrecillos et al., 2018). Closed-loop deep brain stimulation (DBS), which selectively truncates long duration beta bursts, can achieve clinical improvement that is at least as good as that with conventional continuous DBS in acute trials (Little et al., 2013; Little et al., 2016). These studies highlight the importance of modulating the temporal dynamics of beta activity in the STN for the treatment of Parkinson’s disease.
A better understanding of the electrophysiological biomarkers underlying symptoms of bradykinesia and rigidity in Parkinson’s disease has motivated the use of neurofeedback as a therapeutic technique for the disease (Esmail and Linden, 2014; Fukuma et al., 2018; Carney, 2019). In neurofeedback training, neural activities were recorded and quantified in real-time and provided to the participant for the purpose of self-regulation (Sitaram et al., 2017). Parkinsonian patients have been shown to be capable of voluntarily regulating STN beta-band power measured from electrodes implanted for DBS (Carney, 2019; He et al., 2019). However, it is still not clear whether modulating beta oscillations in STN through neurofeedback training can lead to changes in motor performance in patients with Parkinson’s disease (Subramanian et al., 2011; Erickson-Davis et al., 2012). Additionally, previous studies have not specifically targeted bursts of prolonged beta activity, nor considered any additional effects of beta-targeted neurofeedback training on tremor.
Tremor is another cardinal symptom of Parkinson’s disease. Its pathophysiology remains poorly understood, but some recent studies indicate that the pattern of neural activities related to Parkinsonian tremor can be very different from those related to bradykinesia and rigidity. For example, reduced activities in the beta band and increases in power in the tremor frequency band, corresponding to the theta band (3–7 Hz), in the STN, as well as reduced basal ganglia-cortical coherence in the beta frequency band have been observed during the presence of resting tremor in Parkinson’s disease (Hirschmann et al., 2013; Qasim et al., 2016; Asch et al., 2020). Moreover, one in five patients shows resurgence of tremor if DBS is only switched on when STN beta activity is high (Little and Brown, 2020). These observations raise the possibility that neurofeedback training that suppresses beta oscillations in the STN may not improve, even worsen, resting tremor in Parkinsonian patients.
In this study, we adopted a sequential neurofeedback-behavior task to test whether modulating beta oscillations in the STN through neurofeedback training can lead to changes in motor initiation and whether the endogenous suppression of STN beta band activities increases resting tremor in Parkinson’s disease. Similar experimental designs have helped to shed light on the relationship between neural activity and behavior (McFarland et al., 2015; Khanna and Carmena, 2017). In a recent study, we showed that healthy young participants can indeed suppress cortical beta measured using electroencephalogram (EEG) with veritable neurofeedback better than sham feedback (He et al., 2020). In the paradigm of the current study, a cued finger pinch movement followed a neurofeedback phase during which the position of a visual cue was controlled by suppressing high amplitude beta bursts in activities measured by DBS electrodes implanted in the STN. The endogenous changes in subthalamic activities induced by neurofeedback training also allow us to investigate the relationship between subthalamic activities and motor performance, as well as the severity of tremor on a trial-to-trial basis in patients with Parkinson’s disease.
Results
Neurofeedback control was achieved within 1 day of training
Twelve Parkinsonian patients, who underwent bilateral implantation of DBS electrodes targeting the motor area of the STN, participated in this study during the time when the DBS leads were temporarily externalized. The position of a basketball displayed on a monitor was used as the visual feedback about the incidence of beta bursts detected in STN local field potentials (LFPs) (Figure 1A). The bipolar LFP channel and the peak frequency bands (5 Hz width) with the largest movement-related changes between 13 and 30 Hz were selected to drive the visual feedback for each hemisphere (Figure 2). Specifically, the average power in the selected beta frequency band over each 500 ms time window was used as a neurofeedback signal to control the vertical position of the basketball. In real-time, we assumed that a beta burst was detected when the average beta power within the past 500 ms time window exceeded a predefined threshold, which would result in a drop of the basketball. The patient details and patient-specific beta frequency bands are presented in Table 1. Each patient completed at least four sessions of the task with 10 trials in the ‘Training’ condition and 10 trials in the ‘No Training’ condition in each session with two hands separately (Figure 1B). The participants were asked to keep the position of the basketball high (corresponding to reduced beta bursts) during the neurofeedback phase in the ‘Training’ condition. In the ‘No Training’ control condition, they were asked to pay attention to the position of the basketball without trying to control it, though the ball was also moving toward the right as in the ‘Training’ condition, and the vertical position was controlled by the natural ongoing variations in beta activity. The average final basketball position in the vertical axis, which reflected the performance of neurofeedback control, was calculated for each tested hemisphere in each experimental condition. Paired t-test showed that the final basketball position was higher in the ‘Training’ condition compared to the ‘No Training’ condition (t20 = 4.6054, p = 0.0002, Figure 3A), and this was not consequent on physical movement that was monitored by EMGs attached to both forearms of the participants (Figure 3B).
Neurofeedback training reduced beta oscillations in STN LFPs and reduced beta band synchrony between the conditioned STN and ipsilateral motor cortex compared to a passive observation task
Compared to the ‘ready’ period, activity in STN was reduced over a broad frequency band (7–30 Hz) during the neurofeedback phase in the ‘Training’ condition (shown in Figure 3C), similar to the actual movement related modulation shown in Figure 2B. A paired t-test confirmed a significant effect of neurofeedback in facilitating beta suppression in terms of the average normalized power in the selected beta bands (t20 = −3.6975, p = 0.0014, Figure 4A). The difference in the normalized beta power between the ‘Training’ and ‘No Training’ conditions correlated positively with the percentage change in the beta power during real movement (r = 0.5896, p = 0.0057, Pearson’s correlation, Figure 3D). The neurofeedback training also led to reduced accumulated beta burst duration in the STN LFPs determined as percentage of time with beta amplitude being over the predefined threshold (t20 = −4.7415, p = 0.0001, 17.40 ± 1.44% compared to 22.43 ± 1.85%, mean ± SEM, Figure 4B), a reduced average burst duration (t20 = −3.9428, p = 0.0008, 319.6 ± 19.3 ms compared to 377.2 ± 21.5 ms, Figure 4C), and a reduced number of bursts per second (t20 = −4.8536, p = 0.0001, 0.446 ± 0.030 compared to 0.531 ± 0.033, Figure 4D). The bursts with durations longer than 400 ms were reduced more consistently compared with the shorter bursts (Figure 4—figure supplement 1). In addition, we observed an increase in the broad gamma frequency band (55–95 Hz) in the STN LFPs (t20 = 3.4899, p = 0.0023, Figure 5A).
There was no significant change in the ‘Beta−8Hz’ (centered between 9.4 and 13.4 Hz, Figure 5B) or higher frequency band (‘Beta+8’ [centered between 25.4 and 29.4 Hz], Figure 5C).
Although there was a trend of reduction in the average normalized beta power and beta burst characteristics in the EEG recorded over the ipsilateral motor cortex, the changes were not significant or did not survive multiple comparison correction (Figure 4D–H). There was no significant change in the gamma activities in the EEG measured over the motor cortex (z = 0.7821, p = 0.4342).
The phase synchrony index (t20 = −2.5462, p = 0.0192, Figure 4I) and spectral coherence (z = −3.1803, p = 0.0015, Figure 4J) between the conditioned STN and ipsilateral motor cortex were significantly reduced in the beta band in the ‘Training’ condition compared with the ‘No Training’ condition, and this change did not happen in other frequency bands (‘Beta−8’ or ‘Beta+8’).
Carry-over effect of neurofeedback training
There was a sustained carry-over effect of neurofeedback training over the short time window (~2 s) after the neurofeedback phase when a black screen was presented before the Go cue. The average normalized beta power (k = 0.6050 ± 0.0241, p < 0.0001), accumulated beta burst duration (k = 0.0892 ± 0.0144, p < 0.0001), and normalized gamma power (k = 0.9617 ± 0.0073, p < 0.0001) during the 2 s pre-Go cue were positively correlated with the average normalized beta power, beta burst duration, and normalized gamma power during the 4 s feedback phase, respectively, as identified by the generalized linear mixed effects (GLME) modeling using the measurements during the 2 s pre-Cue and 4 s feedback phase as the dependent variables and predictors, respectively. If we replaced the predictor by the experimental condition (‘Training’ or ‘No Training’) in the models, the results revealed that the average beta power (k = −0.2523 ± 0.0769, p = 0.0011) and accumulated beta burst duration (k = −0.0601 ± 0.0172, p = 0.0005) during the 2 s pre-Go cue were significantly reduced in the ‘Training’ condition compared to the ‘No Training’ condition. In contrast, the average gamma power during the 2 s pre-Go cue were significantly increased (k = 0.0781 ± 0.0296, p = 0.0083) in the ‘Training’ condition compared to the ‘No Training’ condition.
Neurofeedback training improved reaction time in subsequently cued movements
The reaction time in response to the Go cue was significantly reduced in the ‘Training’ condition compared with the ‘No Training’ condition (487.4 ± 29.7 ms compared to 510.9 ± 32.3 ms, t20 = −2.7518, p = 0.0123, paired t-test, Figure 6A). Figure 6B shows an example of the recorded left-hand pinch force in the ‘Training’ and ‘No Training’ conditions from Patient 12.
GLME modeling was used to investigate the relationship between the reaction time and the STN LFP activities in the beta () and gamma (γ) frequency bands considering all valid trials for both the ‘Training’ and ‘No Training’ conditions across all tested hemispheres. We focused on the neural activities during the 2 s window before the Go-cue when the visual neurofeedback was no longer presented. When STN average beta power or beta burst characteristics (average burst duration, accumulated burst duration) during the 2s before the Go-cue were used as the only predictor in separate models, all of them significantly contributed to the prediction of reaction time (Models 1–5, Table 2). We then used the model of (Model 6) to evaluate if activities in broad band gamma (γ) and alpha (α) frequency bands also contributed to the prediction of reaction time. In the latter model, only average beta power () was used so as to keep the unit of beta similar to that of the other frequency bands used. This model confirmed the significant effect of beta-targeted neurofeedback training (i.e., whether patients were in the ‘Training’ or ‘No Training’ condition) in reducing reaction time ( = −0.0154 ± 0. 0071, p = 0.0297), and of a significant positive effect of the beta band power ( = 0.0061 ± 0.0020, p = 0.0017) and negative effect of gamma band power ( = −0.0085 ± 0.0026, p = 0.0014) in the STN LFPs over the 2 s before the Go-cue. There was no significant effect of alpha band activity on reaction time ( = 0.0029 ± 0.0022, p = 0.1948). Overall, around 20% of the variance in the reaction time was being explained by the model (Model 6, R2 = 0.2072, Table 2). The significant negative showed that there was an effect of ‘Training’ in reducing the reaction time, which cannot be explained by changes in the beta or gamma band power. The positive sign of and negative sign of indicate that reduced STN beta band power and increased gamma band power over the 2 s before the Go-cue predicted faster reaction time. In addition, we selected a subgroup (75%) of trials from the ‘Training’ and ‘No Training’ conditions that have similar normalized beta power (Figure 6—figure supplement 1A), and tested the differences in reaction time and normalized gamma power. The results showed no significant difference in the RT (t20 = −0.4374, p = 0.6665, Figure 6—figure supplement 1B) nor in the normalized gamma power (z = −0.8168, p = 0.4140, Figure 6—figure supplement 1C) between the selected trials from the ‘Training’ and ‘No Training’ conditions but with matched normalized beta power. Overall these analyses suggest that beta modulation during neurofeedback training does contribute to the changes in RT, even though other condition factors (e.g., cognitive requirement) may also contribute to the observed difference in the RT between the ‘Training’ and ‘No Training’ conditions.
When the EEG beta band and alpha band activities, and the experimental condition were considered as the only predictors in the model, the EEG beta band activity also contributed to the prediction of reaction time (k = 0.0067 ± 0.0024, p = 0.0058, Model 8, Table 2), consistent with previous findings in young healthy participants (He et al., 2020). However, when EEG beta, STN beta, and STN gamma were considered together in one model, only STN beta and STN gamma significantly contributed to the prediction of reaction time (Model 9, Table 2).
Neurofeedback training targeting STN beta activity increased tremor
Five out of the twelve participants (nine STN hemispheres) in the study displayed resting tremor during the recording, which enabled us to investigate how volitional suppression of STN beta oscillations affected tremor in Parkinson’s disease. The tremor severity, quantified based on the measurements from the tri-axial accelerometer attached to the contralateral hand, increased during the ‘Training’ condition compared to the ‘No Training’ condition contralateral to seven out of the tested nine hemispheres (Figure 6C, t8 = 3.2589, p = 0.0115). GLME modeling () confirmed the significant effect of neurofeedback training ( = 3.9415 ± 0.4925, p < 0.0001) on increasing tremor. It also indicated that increased tremor band activity ( = 0.6341 ± 0.0499, p < 0.0001) and reduced beta band activity ( = −0.5971 ± 0.1990, p = 0.0028) in the STN LFPs predicted increased tremor. Overall, the model explained 58.39% of the variance in the tremor power ( = 0.5839). When the theta power in the EEG was included in the model, the prediction was not improved (k = −0.1526, p = 0.1103). In addition, a significantly positive correlation was observed between the tremor power and the theta band power in the STN LFP across hemispheres (R = 0.5003, p = 0.034, Pearson’s, Figure 6—figure supplement 2). There was no significant difference in the tremor severity between ‘Training’ and ‘No Training’ conditions when 75% of trials with matched normalized beta power from the two conditions were considered (t8 = −1.1152, p = 0.2971, Figure 6—figure supplement 1D). These results suggested that the difference in the experimental condition by itself did not lead to significant difference in the tremor severity between the ‘Training’ and ‘No Training’ conditions if the beta power was the same.
Overnight learning effect of the neurofeedback training
In most EEG-based neurofeedback studies, training sessions are repeated over several separate days (Engelbregt et al., 2016; Schabus et al., 2017). In this study, four participants (eight hemispheres) repeated the task on two separate, consecutive days. Comparing against Day 1, six out of the eight tested hemispheres showed increased neurofeedback control (indicated by the increased difference in the ‘Training’ and ‘No Training’ conditions) on Day 2 (Figure 7A). The other two tested hemispheres that had already achieved good neurofeedback control on Day 1 did not further improve on Day 2 (H7 and H8 in Figure 7A).
GLME modeling using the difference in the basketball's final position, average beta power, or accumulated beta burst duration between ‘Training’ and ‘No Training’ conditions as dependent variable, experimental day (Day 1 or Day 2) as fixed predictor, and a random intercept for each hemisphere confirmed a significant interaction between experimental condition and recording days on the basketball's final position (k = 0.1497 ± 0.0372, p = 0.0001), average beta power (k = −12.56 ± 3.8987, p = 0.0017), and accumulated beta burst duration (k = −0.1803 ± 0.0632, p = 0.0051), suggesting the neurofeedback training on Day 2 was associated with better neurofeedback control and more reduction in the average beta power and accumulated beta burst duration compared to Day 1 (Figure 7A–C). There was no significant change in the baseline beta power during rest between Day 1 and Day 2 (Figure 7D).
To investigate whether the baseline beta power changes overnight, GLME modeling using the average beta power as dependent variable, experimental condition (‘Training’ or ‘No Training’) and experimental day (Day 1 or Day 2) as fixed predictor, and a random intercept for each hemisphere was applied. Apart from the significant interaction between experimental condition and the average beta power (k = −0.5835, p < 0.0001), the results also confirmed a significant interaction between experimental day and average beta power (k = −0.1949, p = 0.0108), which could not be explained by the different experimental conditions, suggesting a baseline reduction of the beta power over the two consecutive training days. There was no significant baseline change if we replaced average beta power by accumulated beta burst duration in the model (k = 0.0041, p = 0.8996).
For the two patients (four hemispheres) who had tremor and repeated the task over two consecutive days, tremor during the ‘Training’ condition was increased more on Day 2 than Day 1 in all four hemispheres (Figure 7E). Considering all the individual trials across the two recording days for these hemispheres, GLME modeling using the average tremor power as dependent variable, experimental condition (T or N: ‘Training’ or ‘No Training’), experimental day (Day: 1 or 2), average beta power (), and theta power (θ) in the STN LFP as fixed predictors, and a random intercept for each hemisphere confirmed significant effects for all predictors (T or N: = 4.1901 ± 0.5696, p < 0.0001; Day: k = 3.2611 ± 0.5477, p < 0.0001; : k = −0.6253 ± 0.2073, p = 0.0027; : k = 0.7016 ± 0.0487, p < 0.0001), suggesting the reduced beta and increased theta power in the STN during neurofeedback training on Day 2 associated with the increased tremor.
Discussion
This is the first study to show that volitional suppression of beta bursts in the STN LFP facilitated by neurofeedback training is able to speed up movement initiation in subsequent cued movement in Parkinsonian patients. This is consistent with previous studies that demonstrate a positive correlation between purposely induced beta-power and reaction time (Khanna and Carmena, 2017; Peles et al., 2020). We also showed that the suppression of beta was accompanied by an increase in the broad gamma band activity in the STN. Both the reduced beta and increased gamma in the STN LFP before the Go-cue predicted faster reaction time.
Neurofeedback training for Parkinson’s disease
Neurofeedback training aiming to train subjects to self-regulate their neural activity has been proposed to be a promising technique to tune pathological brain activities underlying different diseases (Ros et al., 2014).
In the current study, online visual feedback reflected the activity that has been previously related to motor impairment in Parkinson’s disease (Kühn et al., 2006) – the beta band oscillations in the STN LFPs recorded from the electrode implanted for DBS. We selected a patient-specific beta frequency band that was modulated by voluntary movements and was also enhanced relative to other frequency bands during rest. Our paradigm took into account the temporal dynamics of the signal of interest and reduced the variance and noise in the visual feedback that are not behaviorally relevant, thus allowing Parkinsonian patients to learn to suppress beta bursts within 30 min of training even when off medication. This was accompanied by reduced reaction time in cued movements, which strengthens the link between STN beta, particularly beta bursts, and motor impairment and also suggests that neurofeedback training may help patients develop a strategy to speed up movement initiation.
It should be acknowledged that proper sham control would be required to determine whether observed behavioral and electrophysiological alterations were due to veritable neurofeedback or mediated by other mental strategies (Thibault et al., 2015; Thibault et al., 2016). Our recent study (He et al., 2020) with double-blinded sham control in a similar paradigm targeting the EEG sensorimotor beta activity in young healthy participants showed that veritable neurofeedback had extra effect compared to mental strategies. Thus, considering that externalized patients provide a rare opportunity to understand the response of STN activity to interventions, we did not include a sham condition but only used veritable neurofeedback. Here we argue that veritable neurofeedback may help patients to develop an efficient mental strategy to modulate targeted pathological activities in a short period of time. Our recent study (He et al., 2020) suggested that suppression of sensorimotor cortex beta bursts facilitated by neurofeedback training could help improve movement initiation in healthy subjects. The current study suggests that suppression of STN beta bursts facilitated by neurofeedback training also led to a trend of reduced beta over the motor cortex, and reduced beta band coherence between the STN and ipsilateral motor cortex. In addition, it helped improve movement initiation in Parkinson’s disease. Even though STN beta is shown to be a more consistent biomarker for bradykinesia in Parkinson’s disease, cortical beta oscillation can be measured noninvasively and using cortical beta as neurofeedback signal may make the method more feasible in patients. However, it remains to be tested whether EEG-based neurofeedback training could be used to suppress STN beta bursts and improve movement initiation in Parkinson’s disease.
Broad band gamma activities in STN LFP for Parkinson’s disease
In this study, we observed significant increase in the broad band gamma activity accompanied with reduced beta in the STN LFPs during the neurofeedback phase and during the short period of time after the neurofeedback disappeared. In addition, both the reduced beta and increased gamma in the STN LFPs before the Go-cue contributed to the prediction of shorter reaction times. The increase of gamma and reduction of beta band activity in STN have been reported during voluntary movements (Androulidakis et al., 2007; Kempf et al., 2009; Brücke et al., 2012; Brücke et al., 2013). The level of gamma increase and beta reduction during the onset of voluntary gripping movements also helps predict gripping force and movement speed (Tan et al., 2016; Lofredi et al., 2018). In the dopamine-depleted state, movement-related subcortical gamma power significantly decreased (Kempf et al., 2009; Litvak et al., 2012), particularly during the trials when peak velocity was slower than ON medication (Lofredi et al., 2018). These studies suggest that in addition to increased synchrony in the beta band, reduced subcortical gamma signaling in the dopamine-depleted state may also contribute to bradykinesia. The present study shows that Parkinsonian patients were able to purposely increase subcortical gamma band activities. The observed effect in the gamma frequency band may have been mediated by the mental strategy or arousal, since a previous study has shown that STN gamma activity increased during motor imagery and scaled with imagined gripping force (Fischer et al., 2017). We also showed that increases in gamma oscillations before the Go-cue predict faster reaction time, over and above the prediction afforded by reduced beta band activities. These results suggest that gamma oscillations may be another important treatment target for Parkinson’s disease. Treatments increasing subcortical gamma oscillations, such as medication with levodopa (Androulidakis et al., 2007), may also help improve motor initiation.
Different pathophysiology underlying akinesia-rigidity and tremor in Parkinson’s disease
Another important observation in this study is that neurofeedback training targeting beta oscillations may increase tremor, as well as tremor band activities in the STN LFP in tremulous patients. This was not just due to increased cognitive load during the neurofeedback phase since the tremor got worse on Day 2 even though neurofeedback control was improved. Our results are consistent with previous studies showing that, in the presence of tremor, neuronal oscillations at tremor frequency (3–7 Hz) tend to increase in the cortical-basal ganglia-thalamic circuit (Hirschmann et al., 2013), whereas beta power (13–30 Hz) and beta band coupling in the motor network are reduced (Qasim et al., 2016). Therefore, neurofeedback training targeting beta activity might not help patients with tremor. Such patients might be better served by neurofeedback training focusing on tremor-related oscillations.
Over-night training sessions
We showed that the patients’ ability to modulate their STN beta activity during the neurofeedback phase increased in Day 2 compared to Day 1, even though the baseline beta activities during rest were similar during Day 1 and Day 2. In particular, those patients who did not achieve good neurofeedback control carried on learning and showed significant improvement on Day 2 compared with Day 1. These results suggest that spaced training may facilitate further learning. However, it also remains to be tested if spaced training across multiple sessions would attenuate the connections in the targeted neural network that give rise to synchronization through Hebbian plasticity (Legenstein et al., 2008; Ros et al., 2014) and whether spaced training can lead to reduced beta synchrony even during rest outside of the neurofeedback task. It would also be interesting to test the effect of neurofeedback training spread out over longer periods as chronic sensing with bidirectional devices becomes more widely available (Herron et al., 2017; Khanna et al., 2017; Haddock et al., 2018; Houston et al., 2019).
Limitations
A within-participant design comparing the ‘Training’ against the ‘No Training’ conditions was used in this study to evaluate the effect of neurofeedback training. In a separate study with young healthy participants, we showed that ‘veritable feedback’ is better than ‘sham feedback’ in training participants to modulate neural activities even when using similar self-reported mental strategies (He et al., 2020). We did not use ‘sham feedback’ in the current study because intermixing ‘sham feedback’ and ‘veritable feedback’ might have had a negative impact on motivation and might have interfered with learning given the time constraints we had in the patients with externalized electrodes. Therefore, with the current study, we cannot disambiguate whether the observed effects are due to the neurofeedback training or mediated by mental strategy (motor imagery). However, the main results remain valid: Parkinsonian patients can purposely modulate pathological subcortical brain activities, and this modulation led to improved movement initialization. In addition, the more beta band reduction and increase in gamma band activities before the Go-cue predicted faster reaction time.
In summary, we designed a neurofeedback paradigm targeting the neural signal that has previously been shown to be related to bradykinesia and rigidity in Parkinson’s disease – beta bursts in the STN. By tailoring the paradigm to the patient-specific beta frequency band and taking into account the temporal dynamics of the signal of interest, the paradigm allowed patients to purposely suppress pathological beta oscillations in the STN within a short training session. The training also led to reduced coupling between the STN and EEG over the motor cortex in the targeted frequency band, as well as to an increase in broad band gamma activity in the STN LFP. Importantly, these changes were accompanied by a reduction in cued reaction time. The results strengthen the link between STN beta oscillations, beta bursts in particular, and motor impairment. Although gamma activity also changed with neurofeedback, multilevel modeling showed that gamma and beta effects independently help predict reaction times. Thus, the results also identify STN gamma activities as an important target for treating motor impairment in Parkinson’s disease. The effects of neurofeedback on motor initiation were encouraging, and there was also some indication that the behavioral effects of neurofeedback training might increase over consecutive days. It remains to be seen whether this can translate into a prolonged effect on voluntary motor control, and whether this correlates with clinically meaningful symptom amelioration. It should also be noted that when proposing neurofeedback as a potential therapy, symptom-specific biomarker should be used, and its temporal dynamics need to be taken into account.
Materials and methods
Subjects
Twelve Parkinsonian patients (four females), who underwent bilateral implantation of DBS electrodes targeting the motor area of the STN, participated in this study. The DBS leads were temporarily externalized (3–6 days) prior to a second surgery to connect the leads to a pulse generator. The placements of the leads were confirmed by fusion of preoperative MRI and postoperative CT scans. All patients had normal or corrected-to-normal vision and an average age of 62 ± 8.8 (range 48–75) years and disease duration of 11 ± 5.1 (range 5–20) years. Patients showed good response to dopaminergic medication with mean scores of the Unified Parkinson’s Disease Rating Scale (UPDRS) of 45 ± 13.1 and 22.9 ± 9.1 for medication OFF and ON, respectively. All experiments were conducted with the patients off their dopaminergic medication overnight. The study was approved by the local ethics committees and all patients provided their informed written consent according to the Declaration of Helsinki before the experiments. The clinical details of the patients are summarized in Table 1.
Experimental protocol
Request a detailed protocolThe neurofeedback training protocol comprised multiple short trials, similar to what was used in a previous study with healthy young participants (He et al., 2020). Each trial consisted of a 2–3 s period during which the patients were instructed to get ready, and a neurofeedback phase lasting 4–8 s followed by a cued motor task 2–3 s after the neurofeedback phase (see Figure A). During the neurofeedback phase, an image of a basketball was presented on a monitor with the vertical position of the basketball indicating the incidence of high amplitude beta bursts quantified in real-time based on the STN LFP measurements. The vertical movement of the basketball was sensitive to the STN beta power calculated within 500 ms long moving windows in real-time. For each update, which occurred every 250 ms (so that windows overlapped), if the calculated beta power was larger than a predefined threshold T, the basketball dropped downwards by a fixed distance. The distance of each drop of the basketball was set so that if the patient was in a resting state, the basketball would drop down to the bottom of the screen within 4–8 s due to spontaneous variations in the power of beta oscillations. If the threshold was not crossed, the ball only moved horizontally on the screen. Thus, the position of the basketball was independent from other variations in beta power that were lower than the threshold used to define beta bursts. This design reduced noise in the visual feedback, and thereby helped participants to gain a sense of agency within a short time period. In the ‘Training’ condition trials, participants were instructed to try to keep the ball floating at the top of the monitor screen during the neurofeedback phase. The patients were explicitly told that imagining moving their contralateral hand may help to improve the performance but were also encouraged to try different strategies without any real movements. In order to control for effects caused by attending to the moving visual stimulus, participants also performed the task in a ‘No Training’ condition, in which they were instructed to pay attention to the ball movement and get ready for the Go-cue without having to voluntarily control the position of the ball, though the ball was also moving toward the right as in the ‘Training’ condition, and the vertical position was controlled by the natural ongoing variations in beta activity.
A Go-cue appeared 2–3 s after the neurofeedback phase to prompt the participants to perform a finger pinch movement. All participants were reminded to avoid any voluntary movements until the Go-cue was presented, and then to pinch a small force meter as fast as possible using their thumbs in response to the Go-cue. The force meter was held on a table by the participant throughout the whole experiment.
Each experimental session consisted of 30 s of rest, a block of 10 trials in the ‘Training’ condition, and a block of 10 trials in the ‘No Training’ condition (Figure 1B). The instruction for each block was presented for 10 s before the block started. The order of training and no training blocks was randomized in each session. During the 30 s rest period, the power of the selected beta frequency was calculated every 250 ms, and the 75th percentile of the beta power calculated during this 30 s period was then used as the threshold T for triggering the vertical movement of the basketball in the following session.
Nine out of the twelve participants completed four sessions of the task separately with both hemispheres and contralateral arms, and the other three participants only completed the task with the dominant hand for the motor task and the contralateral STN. All trials were visually inspected and those with obvious movement artifact during the neurofeedback phase were excluded. Short breaks were provided between sessions, and the recording for each STN lasted for around 30 min. Four patients repeated the same task over two consecutive days with both hemispheres, which allowed us to investigate overnight learning effects.
Data recording
Request a detailed protocolAll recordings in this study were undertaken 3–6 days after the first surgery for bilateral DBS electrodes (Quadripolar Macroelectrode, Model 3389, Medtronic or Vercise Cartesia Directional Lead, Boston Scientific) implantation and prior to the second surgery for connecting the electrodes to the subcutaneous pulse generator. For directional DBS leads, the segmented contacts of levels 2 and 3 were ganged together to make one monopolar channel for the recording. Eight monopolar channels of bilateral STN LFPs and eight monopolar channels of EEG signals covering ‘Fz’, ‘FCz’, ‘Cz’, ‘Oz’, ‘C3’, ‘C4’, ‘CP3’, and ‘CP4’ according to the standard 10–20 system were recorded using a TMSi Porti amplifier (TMS International, The Netherlands) at a sampling rate of 2048 Hz. A common average reference was applied automatically to all recorded monopolar signals by the amplifier. The ground electrode was placed on the left forearm. Electromyography (EMG) was simultaneously recorded using the same amplifier from Flexor Carpi Radialis of both arms and the masseter muscle. One tri-axial accelerometer was taped to the back of each hand in order to monitor kinematic movements and any tremor. Generated force in the cued pinch movements was recorded using a pinch meter (P200, Biometrics Ltd). In addition, the real-time positions (X, Y) of the basketball in each trial, which allowed evaluation of the performance of neurofeedback training during the online experiment, and the trigger signals of the paradigm were recorded through an open-source toolkit named Lab Streaming Layer (LSL) (Kothe, 2014). The synchronization between different data streams was achieved through LSL and another open-source toolkit named Openvibe (Renard et al., 2010). The paradigm used in this study was developed in C++ (Visual Studio 2017, Microsoft) and the online/offline data processing was achieved in Matlab (R2018a, MathWorks, US).
Selecting the STN LFP channel and the target frequency band
Request a detailed protocolPrior to each experiment, monopolar STN LFPs and EEG data were first recorded during 60 s at rest and during 15 trials of cued finger pinch movements with each hand (Tan et al., 2015). The recorded monopolar STN LFPs were re-montaged to bipolar LFPs (through subtraction of adjacent annular or pseudo-annular contacts) prior to analysis. The movement-related power reduction for each bipolar LFP channel contralateral to the performing hand in the beta frequency band (13–30 Hz) was calculated and the bipolar LFP channel with the maximal reduction during movement was selected as the target LFP channel. A 5 Hz frequency band around the frequency showing maximal movement-related modulation ([f-2, f+2]) was determined as the individual-specific beta frequency band. The selected bipolar STN LFP channels and the selected frequency band for each STN are listed in Table 1. The frequency showing maximal movement-related modulation ranged from 17.4 Hz to 21.4 Hz across all tested STNs and coincided with the peak in the average power spectral density of the selected bipolar channel during rest (Figure 2A).
Estimating beta power in real-time to determine the position of visual feedback online
Request a detailed protocolDuring the online experiment, the beta power of the selected frequency band was calculated in real-time every 250 ms using a segment of 500 ms data (with 50% overlapping) recorded from the selected bipolar LFP channel. For each segment of 500 ms data, we first applied a mean subtraction followed by a 5–85 Hz band pass filter on the raw data. Next, FFT was applied to calculate the power spectrum of the filtered data and the average power of the selected frequency band was quantified as the beta band power of the current update. At the beginning of each session, data were recorded with the participant resting for 30 s, during which time the beta band power was also updated every 250 ms (119 times). From these values, we selected the 75th percentile as the threshold T for that recording session, which means that when the patient was at rest, their beta power would exceed the threshold 25% of the time (Tinkhauser et al., 2017a; Tinkhauser et al., 2017b). The threshold was recalculated at the beginning of each session in order to correct for any drift in the average beta power with time spent in the task.
In this paradigm, the position of the basketball was updated every 250 ms, which corresponded to 16–32 updates during the 4–8 s of neurofeedback in each trial. For each update, the displacement of the basketball on the horizontal axis was constant, so the basketball moved from left to right at constant speed. The displacement of the basketball on the vertical axis was related to the beta band power calculated in real-time. When the updated beta power was larger than the threshold T, the basketball displayed on the screen dropped downwards by one step. The distance of each step was calibrated, so that the basketball would drop to the bottom of the screen if beta was over the threshold for 25% of the update time points during the feedback phase (4–8 s). Thus, the final vertical position of the basketball in each trial was directly associated with the number of incidences when beta power exceeded the threshold within that time window.
Offline data analysis
Visual feedback
Request a detailed protocolThe trajectory of the basketball and the final vertical position of the basketball in each individual trial were recorded. The difference between the final vertical positions of the basketball between the ‘Training’ and ‘No Training’ conditions indicated the effect of the neurofeedback training. The variations across training days in the differences in the ball’s final vertical positions between these two conditions indicated the learning effect induced by neurofeedback training.
Motor performance
Request a detailed protocolWe quantified the reaction time in response to the Go-cue for each trial based on the recorded pinch force. Specifically, the measured force was first low-pass filtered with a 20 Hz cut-off frequency using a fourth order zero-phase digital filter and segmented into 4 s epochs extending between 1 s prior to and 3 s after the Go-cue. We then calculated a threshold to define pinch onset by taking the mean plus three times the standard deviation (SD) of a segment of 500 ms force data before the cue of the pinch task. The time delay between the Go-cue and the time point when the force crossed the determined threshold and sustained for at least 100 ms was taken as the RT of that trial. Force measurements from individual trials were visually inspected; those trials with obvious artifacts failed to pinch within 2 s after the Go-cue, or with a reaction time smaller than 0.2 s were excluded. Thus, for each of the 21 STN hemispheres we analyzed 44.38 ± 3.88 (mean ± SEM) and 44.57 ± 3.84 trials in the ‘Training’ and ‘No Training’ conditions, respectively, resulting in 1868 trials in total across all tested hemispheres.
Hand tremor was monitored by a tri-axial accelerometer attached to the back of each hand. The power in the tremor frequency band (3–7 Hz) was quantified for each axis separately and then averaged across all axes.
Offline analysis of STN LFP and EEG
Request a detailed protocolThe LFPs from the selected STN bipolar channel and EEGs recorded over motor cortex (C3 or C4) were further analyzed off-line with Matlab (v2018a, MathWorks, US). The signals were first band-pass filtered between 0.5 and 100 Hz and notch filtered at 50 Hz using a fourth order zero-phase digital filter. Time-frequency decomposition was obtained by continuous complex Morlet wavelet transformation with a linear frequency scale ranging from 1 to 95 Hz with 1 Hz resolution, and a linearly spaced number (4–8) of cycles across all calculated frequencies. The calculated power of each time point and each frequency was first normalized against the average value quantified across all the time periods when the participants were at rest throughout the whole experiment for that frequency, in order to derive the percentage change. The time courses of beta power percentage changes were separately averaged across trials in the ‘Training’ and ‘No Training’ conditions. The average normalized power in the frequency band and time window of interest were calculated for each individual trial for further analysis. In the offline analysis, different beta burst characteristics (accumulated duration, average duration, and number of bursts) during the first 4 s of the neurofeedback phase were recalculated as in Tinkhauser et al., 2017a. In order to investigate whether there would be a similar impact of neurofeedback training on the power and bursts in other non-targeted frequency bands, for each hemisphere, we repeated the power and burst characteristics calculation and analyses in two other frequency bands which were not overlapping with the selected 5 Hz beta band by shifting the center frequency band by 8 Hz down and up, to give ‘Beta−8 Hz’ and ‘Beta+8 Hz’ frequency bands.
The connectivity between the STN LFP and ipsilateral motor cortex EEG was evaluated using the phase synchrony index (PSI, Equation 1; Lachaux et al., 2000) and spectral coherence (Coh, Equation 2; Lachaux et al., 1999) calculated based on the time-frequency decomposition results after complex Morlet transformation, and compared between experimental conditions (‘Training’ or ‘No Training’).
where n indicates the total time points in each trial (4 s), and indicate the phase values of the selected LFP and EEG signals at time point t, and and indicate the amplitude values of the selected LFP and EEG signals at time point t, respectively.
Generalized linear mixed effects modeling
Request a detailed protocolGLME modeling (Matlab function fitglme) was used to assess the trial-to-trial within-subject relationship between different measurements, and how they were changed by neurofeedback training. Apart from transforming the dependent variable to eliminate the deviation from normality distribution, GLME also allows researchers to select a theoretical distribution that matches the properties of the dependent variable (Lo and Andrews, 2015). For example, the measured RT is skewed and closer to an Inverse Gaussian distribution instead of a normal Gaussian distribution, thus an Inverse Gaussian distribution was selected in the models using RT as dependent variable. When applying GLME modeling, data from all valid individual trials from all tested hemispheres were considered, and the average power (10log10 transferred to dB) was used when applicable. The slope(s) between the predictor(s) and the dependent variable were set to be fixed across all hemispheres; a random intercept was set to vary by hemisphere. The details of the models were described together with the results.
Statistical analysis
Request a detailed protocolPaired t-tests (Matlab function t-test) or nonparametric Wilcoxon signed-rank test (Matlab function signrank), depending on whether the normal distribution assumption was satisfied, was used to evaluate the effect of the experimental condition (‘Training’ and ‘No Training’) on neurofeedback task performance, the motor task reaction time, tremor severity, and neural activities measured in STN LFPs and EEGs. The normal distribution assumption was tested using Anderson–Darling test (Matlab function adtest) (Anderson and Darling, 1952). Multiple comparisons applied to different measurements were corrected using Bonferroni correction.
When GLME modeling was used, the estimated fixed effect coefficient (k), which indicates the potential positive or negative correlation between the predictor and the dependent variable, the corresponding t-statistic p-value, and R2 were reported.
Data availability
Source data and codes for generating Figures 2-7, all supplement figures, and Table 2 have been provided.
References
-
Asymptotic theory of certain "Goodness of Fit" Criteria Based on Stochastic ProcessesThe Annals of Mathematical Statistics 23:193–212.https://doi.org/10.1214/aoms/1177729437
-
Anticipatory changes in beta synchrony in the human corticospinal system and associated improvements in task performanceEuropean Journal of Neuroscience 25:3758–3765.https://doi.org/10.1111/j.1460-9568.2007.05620.x
-
Scaling of movement is related to pallidal γ oscillations in patients with dystoniaJournal of Neuroscience 32:1008–1019.https://doi.org/10.1523/JNEUROSCI.3860-11.2012
-
Short and long-term effects of sham-controlled prefrontal EEG-neurofeedback training in healthy subjectsClinical Neurophysiology 127:1931–1937.https://doi.org/10.1016/j.clinph.2016.01.004
-
Neural networks and neurofeedback in Parkinson’s DiseaseNeuroRegulation 1:240–272.https://doi.org/10.15540/nr.1.3-4.240
-
Automated deep brain stimulation programming for tremorIEEE Transactions on Neural Systems and Rehabilitation Engineering 26:1618–1625.https://doi.org/10.1109/TNSRE.2018.2852222
-
ConferenceBeta oscillation-targeted neurofeedback training based on subthalamic LFPs in Parkinsonian patients2019 9th International IEEE/EMBS Conference on Neural Engineering (NER). pp. 81–84.https://doi.org/10.1109/NER.2019.8717176
-
A machine-learning approach to volitional control of a closed-loop deep brain stimulation systemJournal of Neural Engineering 16:016004.https://doi.org/10.1088/1741-2552/aae67f
-
Gamma activity and reactivity in human thalamic local field potentialsEuropean Journal of Neuroscience 29:943–953.https://doi.org/10.1111/j.1460-9568.2009.06655.x
-
Neurofeedback control in Parkinsonian patients using electrocorticography signals accessed wirelessly with a chronic, fully implanted deviceIEEE Transactions on Neural Systems and Rehabilitation Engineering 25:1715–1724.https://doi.org/10.1109/TNSRE.2016.2597243
-
Reduction in subthalamic 8-35 hz oscillatory activity correlates with clinical improvement in Parkinson's diseaseEuropean Journal of Neuroscience 23:1956–1960.https://doi.org/10.1111/j.1460-9568.2006.04717.x
-
Measuring phase synchrony in brain signalsHuman Brain Mapping 8:194–208.https://doi.org/10.1002/(SICI)1097-0193(1999)8:4<194::AID-HBM4>3.0.CO;2-C
-
Studying single-trials of phase synchronous activity in the brainInternational Journal of Bifurcation and Chaos 10:2429–2439.https://doi.org/10.1142/S0218127400001560
-
A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedbackPLOS Computational Biology 4:e1000180.https://doi.org/10.1371/journal.pcbi.1000180
-
Adaptive deep brain stimulation in advanced Parkinson diseaseAnnals of Neurology 74:449–457.https://doi.org/10.1002/ana.23951
-
Bilateral adaptive deep brain stimulation is effective in Parkinson's diseaseJournal of Neurology, Neurosurgery & Psychiatry 87:717–721.https://doi.org/10.1136/jnnp-2015-310972
-
Debugging adaptive deep brain stimulation for Parkinson's DiseaseMovement Disorders 35:555–561.https://doi.org/10.1002/mds.27996
-
Effects of training pre-movement sensorimotor rhythms on behavioral performanceJournal of Neural Engineering 12:066021.https://doi.org/10.1088/1741-2560/12/6/066021
-
OpenViBE: an Open-Source software platform to design, test, and use Brain–Computer Interfaces in Real and Virtual EnvironmentsPresence: Teleoperators and Virtual Environments 19:35–53.https://doi.org/10.1162/pres.19.1.35
-
Tuning pathological brain oscillations with neurofeedback: a systems neuroscience frameworkFrontiers in Human Neuroscience 8:1008.https://doi.org/10.3389/fnhum.2014.01008
-
Closed-loop brain training: the science of neurofeedbackNature Reviews Neuroscience 18:86–100.https://doi.org/10.1038/nrn.2016.164
-
Real-time functional magnetic resonance imaging neurofeedback for treatment of Parkinson's diseaseJournal of Neuroscience 31:16309–16317.https://doi.org/10.1523/JNEUROSCI.3498-11.2011
-
Subthalamic nucleus local field potential activity helps encode motor effort rather than force in parkinsonismThe Journal of Neuroscience 35:5941–5949.https://doi.org/10.1523/JNEUROSCI.4609-14.2015
-
Post-Movement beta activity in sensorimotor cortex indexes confidence in the estimations from internal modelsThe Journal of Neuroscience 36:1516–1528.https://doi.org/10.1523/JNEUROSCI.3204-15.2016
-
Neurofeedback, Self-Regulation, and brain imaging: clinical science and fad in the service of mental disordersPsychotherapy and Psychosomatics 84:193–207.https://doi.org/10.1159/000371714
-
The modulatory effect of adaptive deep brain stimulation on beta bursts in Parkinson’s diseaseBrain : A Journal of Neurology 140:1053–1067.https://doi.org/10.1093/brain/awx010
-
The cumulative effect of transient synchrony states on motor performance in Parkinson's DiseaseThe Journal of Neuroscience 40:1571–1580.https://doi.org/10.1523/JNEUROSCI.1975-19.2019
-
Modulation of beta bursts in the subthalamic nucleus predicts motor performanceThe Journal of Neuroscience 38:8905–8917.https://doi.org/10.1523/JNEUROSCI.1314-18.2018
Article and author information
Author details
Funding
Medical Research Council (MR/P012272/1)
- Shenghong He
- Huiling Tan
Medical Research Council (MC_UU_12024/1)
- Flavie Torrecillos
- Gerd Tinkhauser
- Petra Fischer
- Alek Pogosyan
- Peter Brown
National Institute for Health Research (Oxford Biomedical Research Centre)
- Shenghong He
- Abteen Mostofi
- Emilie Syed
- Flavie Torrecillos
- Gerd Tinkhauser
- Petra Fischer
- Alek Pogosyan
- Peter Brown
- Huiling Tan
Rosetrees Trust
- Shenghong He
- Huiling Tan
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank the patients who participated for making this study possible.
Ethics
Human subjects: Informed consent and consent to publish was obtained from patients before they took part in the study, which was approved by Oxfordshire Research Ethics Committee, reference number 18/SC/0006.
Copyright
© 2020, He et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,984
- views
-
- 301
- downloads
-
- 24
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Granule cells of the cerebellum make up to 175,000 excitatory synapses on a single Purkinje cell, encoding the wide variety of information from the mossy fibre inputs into the cerebellar cortex. The granule cell axon is made of an ascending portion and a long parallel fibre extending at right angles, an architecture suggesting that synapses formed by the two segments of the axon could encode different information. There are controversial indications that ascending axon (AA) and parallel fibre (PF) synapse properties and modalities of plasticity are different. We tested the hypothesis that AA and PF synapses encode different information, and that the association of these distinct inputs to Purkinje cells might be relevant to the circuit and trigger plasticity, similar to the coincident activation of PF and climbing fibre inputs. Here, by recording synaptic currents in Purkinje cells from either proximal or distal granule cells (mostly AA and PF synapses, respectively), we describe a new form of associative plasticity between these two distinct granule cell inputs. We show for the first time that synchronous AA and PF repetitive train stimulation, with inhibition intact, triggers long-term potentiation (LTP) at AA synapses specifically. Furthermore, the timing of the presentation of the two inputs controls the outcome of plasticity and induction requires NMDAR and mGluR1 activation. The long length of the PFs allows us to preferentially activate the two inputs independently, and despite a lack of morphological reconstruction of the connections, these observations reinforce the suggestion that AA and PF synapses have different coding capabilities and plasticity that is associative, enabling effective association of information transmitted via granule cells.
-
- Neuroscience
Sour taste, which is elicited by low pH, may serve to help animals distinguish appetitive from potentially harmful food sources. In all species studied to date, the attractiveness of oral acids is contingent on concentration. Many carboxylic acids are attractive at ecologically relevant concentrations but become aversive beyond some maximal concentration. Recent work found that Drosophila ionotropic receptors IR25a and IR76b expressed by sweet-responsive gustatory receptor neurons (GRNs) in the labellum, a peripheral gustatory organ, mediate appetitive feeding behaviors toward dilute carboxylic acids. Here, we disclose the existence of pharyngeal sensors in Drosophila melanogaster that detect ingested carboxylic acids and are also involved in the appetitive responses to carboxylic acids. These pharyngeal sensors rely on IR51b, IR94a, and IR94h, together with IR25a and IR76b, to drive responses to carboxylic acids. We then demonstrate that optogenetic activation of either Ir94a+ or Ir94h+ GRNs promotes an appetitive feeding response, confirming their contributions to appetitive feeding behavior. Our discovery of internal pharyngeal sour taste receptors opens up new avenues for investigating the internal sensation of tastants in insects.