Entrainment and maintenance of an internal metronome in supplementary motor area
Abstract
To prepare timely motor actions, we constantly predict future events. Regularly repeating events are often perceived as a rhythm to which we can readily synchronize our movements, just as in dancing to music. However, the neuronal mechanisms underlying the capacity to encode and maintain rhythms are not understood. We trained nonhuman primates to maintain the rhythm of a visual metronome of diverse tempos and recorded neural activity in the supplementary motor area (SMA). SMA exhibited rhythmic bursts of gamma band (30–40 Hz) reflecting an internal tempo that matched the extinguished visual metronome. Moreover, gamma amplitude increased throughout the trial, providing an estimate of total elapsed time. Notably, the timing of gamma bursts and firing rate modulations allowed predicting whether monkeys were ahead or behind the correct tempo. Our results indicate that SMA uses dynamic motor plans to encode a metronome for rhythms and a stopwatch for total elapsed time.
https://doi.org/10.7554/eLife.38983.001eLife digest
A catchy tune on the radio, and suddenly we are tapping our foot and moving our bodies to the rhythm of the music. We can follow a beat because our motor neurons, the nerve cells that control movements, work together in circuits. During actions that require precise timing – such as dancing to a rhythm – the motor neurons within these circuits increase and decrease their activity in complex patterns.
But recent evidence shows that these motor neuron circuits also ‘switch on’ simply when we perceive a rhythm, even if we do not move to it. In fact, just imagining a rhythm triggers the same symphony of electrical activity in the brain. How do motor neurons generate coordinated patterns of activity without movement or even an external stimulus?
Cadena-Valencia et al. set out to answer this question by training monkeys to follow a rhythm. The animals learned to track a dot that appeared alternately on the left and right sides of a touchscreen with a regular tempo. After a few repeats, the dot disappeared. The monkeys then had to continue mentally tracking where the dot would have been. A group of neurons in a brain region called the supplementary motor area synchronized their activity with the dot. Whenever the dot was due to appear, the neurons in the area showed a burst of rapid firing. These spikes of activity, called gamma bursts, helped the motor neurons to communicate with one another within their circuits.
The gamma bursts thus acted as an internal metronome, making it easier for the monkeys to follow the rhythm. These results should be a starting point for other studies to pinpoint exactly where and how this rhythmic activity arises, and how the brain uses gamma bursts to synchronize our movements to a tempo.
https://doi.org/10.7554/eLife.38983.002Introduction
Adaptive behavior benefits from the ability to discern temporal regularities in the environment. To exploit these regularities, the brain must be able to measure time intervals between repetitive events (Buhusi and Meck, 2005; de Lafuente et al., 2015; Confais et al., 2012; Leon and Shadlen, 2003; Grahn and Brett, 2007; Merchant and Lafuente, 2014; Merchant et al., 2015), and use this timing information to anticipate future events (Goel and Buonomano, 2014; Jazayeri and Shadlen, 2010; Uematsu et al., 2017). This behavior is evident when we dance to music, which requires perceiving rhythms and generating movements in sync with them (Levitin et al., 2018). Nonhuman primates and other vertebrates are capable synchronizing their movements to periodic rhythms (Merchant et al., 2013; Takeya et al., 2017; Gámez et al., 2018), and we recently showed that monkeys can internally maintain rhythms of different tempos in the absence of overt motor actions (García-Garibay et al., 2016). Ample evidence indicates that cortical and subcortical motor circuits participate in behavioral tasks that require time perception and temporally precise behavioral responses (Mita et al., 2009; Crowe et al., 2014; Bartolo et al., 2014; Merchant and Averbeck, 2017; Grahn and Brett, 2007; Ivry and Spencer, 2004; Murray et al., 2014). Nonetheless, the neuronal mechanisms that allow motor structures to encode rhythms of different tempos, in the absence of motor commands, are not yet completely understood.
We developed a novel visual metronome task in which nonhuman primates had to observe, and then internally maintain, a temporal rhythm defined by a left-right alternating visual stimulus. Crucially, subjects had to track the rhythm in the absence of overt movements (García-Garibay et al., 2016). By uncoupling rhythm encoding and maintenance from motor actions, we aimed to identify the mechanism that allows the brain to internally maintain rhythms of different tempos. While monkeys performed the task, we recorded the local field potentials (LFPs) and spiking activity of single neurons in the supplementary motor area (SMA) that has been implicated in timing and rhythm perception (Buzsáki et al., 2012; Pesaran et al., 2002). Our results show that bursts of lower gamma band activity (30–40 Hz) reflect the internally maintained tempos by a simple mechanism: the intervals defining the rhythm are encoded by the periodic onset of gamma bursts. Moreover, increasing amplitudes of gamma bursts reflected an estimate of total elapsed time (i.e. the total time since the rhythm began). Importantly, gamma bursts encoded both rhythm and the total elapsed time in the absence of sensory stimulation and overt motor activity.
Results
Monkeys can perceive rhythms and maintain them internally
We trained two rhesus monkeys (M. mulatta) to perform a visual metronome task (Figure 1A). While maintaining eye and hand fixation over the screen, monkeys saw a visual stimulus that appeared on one side, switched to the other, and the back to the initial location. This alternating stimulus defined three entrainment intervals of an isochronous rhythm. On each trial, the interval duration was pseudo-randomly chosen to be 500, 750, or 1000 ms. In this manner, animals were presented with a visual metronome whose tempo was changed on a trial-by-trial basis (Figure 1A).
-
Figure 1—source data 1
- https://doi.org/10.7554/eLife.38983.008
After the third entrainment interval, the visual stimulus disappeared, and subjects had to maintain the rhythm internally by keeping track of the virtual position (left or right) of the stimulus as a function of elapsed time. To test the ability of subjects to maintain the rhythms, a go-cue at the middle of any one of up to four maintenance intervals instructed the subjects to reach towards the stimulus location (the go-cue consisted of removing the hand fixation point; the number of maintenance intervals was pseudo-randomly chosen; Figure 1A). Thus, the key parameters in the visual metronome task were (1) interval duration (500, 750, or 1000 ms), and (2) the number of maintenance intervals that subjects had to wait after the visual stimulus was gone.
We characterized monkeys’ ability to maintain the rhythms by plotting the proportion of correct responses as a function of the elapsed time since the initiation of the first maintenance interval (Figure 1B). The behavioral results show that monkeys satisfactorily performed the task and were able to correctly estimate the location of the stimulus in more than 80% of trials (94 ± 0.2% monkey 1; 86 ± 0.3% monkey 2; mean ± s.e. over sessions, n = 131 sessions).
Importantly, performance as a function of time displays the hallmark of a timing task: the proportion of correct responses declines as a function of the number of maintenance intervals (or equivalently, elapsed time). The proportion of correct responses started close to 100% and declined to approximately 75% for the last maintenance intervals (last two data points for each curve). This behavior is consistent with the internal rhythm gradually drifting away from the true tempo of the stimulus (Gibbon et al., 1997; Grondin, 2001). As we described in previous work (García-Garibay et al., 2016), this pattern is well captured by a model in which the subject’s time estimates arise from increasingly noisy (wider) distributions, described by Weber’s Law of time (also called the scalar property of timing) (Laje et al., 2011). The increase in timing variability causes the subjects to eventually fall out of synchrony with the true stimulus position (getting ahead, or behind the true tempo), thus explaining the decrease in correct responses as a function of elapsed time (Figure 1B, the colored curves are fits of this model to the data; pooled data across monkeys; see also Figure 1—figure supplement 1). Behavioral performance for the 4th maintenance interval of the 750 and 1000 ms tempos is higher than would be expected, that is it is higher than the performance on the previous 3rd interval. This is likely due to the fact that our experiment only included up to four maintenance intervals. We speculate that monkeys exploited this information and halted the maintenance at the 4th interval, so that they could avoid errors due to moving onto the 5th interval. In the future, we plan to mitigate this bias by choosing the number of entrainment and maintenance intervals from an exponential distribution with a flat hazard rate.
Reaction times to the go-cue increases significantly in proportion to elapsed time within a narrow window ranging between 350 ms after the first maintenance interval of the fastest tempo (500 ms intervals), to 400 ms after the last interval of the slowest tempo (1000 ms intervals) (Figure 1C; R2 = 0.72, slope = 11 ms/s, p<0.001; monkey 1 = 10.2 ms/s±0.8; monkey 2 = 11.3 ms/s ± 0.5). This increase in reaction times could be a result of the increasing difficulty in estimating the true stimulus position. As expected by scalar variability, the subject’s estimate of the stimulus position becomes noisier with time, thus increasing uncertainty and the reaction time necessary to make a decision. In Figure 1—figure supplement 2, we provide the LFP spectrogram aligned to movement onset, demonstrating that gamma band activity decreases, and it is replaced by low-frequency oscillations at movement onset. We also demonstrate that larger gamma band amplitudes are correlated with increased reaction times. Overall, behavioral results show that monkeys were able to entrain to a rhythm, and maintain it in the absence of sensory stimuli, and importantly, in the absence of overt motor commands.
Gamma oscillations reveal the internally maintained rhythms
While the monkeys performed the visual metronome task, we recorded neural activity in 131 experimental sessions (84 and 47 for monkeys 1 and 2, respectively; Figure 1E), and analyzed the local field potentials (LFPs) within 5–80 Hz band. As a first step, we calculated the mean spectrogram for both monkeys, across all recording sessions (Figure 1D; 500 ms interval shown; combined data across monkeys). Modulations of LFP amplitude were especially salient in the 30–40 Hz frequencies, which we will refer to as gamma band. In this band, LFP power was up to two-fold larger than the baseline activity recorded 500 ms before trial initiation (p<0.001; permutation test of the time-frequency bins, 1000 permutations).
The LFP amplitude in the gamma band had a rhythmic structure. It increased markedly with the presentation of the last visible stimulus (3rd entrainment interval, Figure 1D), as well as near the time when the non-visible stimulus would be switching its position from one side of the screen to the other during maintenance intervals (Figure 1D; broken red lines). To test this observation quantitatively, we verified that the average gamma amplitude at the time of switches was significantly higher than halfway between them (t-test, p<0.01 for the three tempos; window sizes 1/4th of interval length; see Materials and methods). In addition to the rhythmic modulation, gamma oscillations increased in amplitude as a function of total elapsed time (Figures 1D and 3C; note that the last maintenance interval displays the largest amplitude).
-
Figure 2—source data 1
- https://doi.org/10.7554/eLife.38983.010
The analyses so far focused on mean LFP activity across sessions. To gain further insight into the LFP dynamics supporting the maintenance of internal rhythms, we analyzed LFP amplitude modulations within single trials. The LFP recordings from single trials (band-passed at 30–40 Hz) revealed short-duration bursts during which the oscillations transiently increase in amplitude (Figure 2B), consistent with recent findings in the putamen (Bartolo et al., 2014) and the prefrontal cortex (Lundqvist et al., 2016). Importantly, we observed that during the maintenance epoch, these bursts tended to coincide with the times at which the stimulus would have changed position, as is shown by the peaks in the spectrogram of the example single trials (Figure 2A).
This trend is readily visualized by color-coding the amplitude of gamma oscillations and plotting all recorded trials on a single panel (Figure 2C). It is readily apparent that gamma bursts during maintenance tend to appear around the times at which the stimulus should be switching from one side of the screen to the other. This pattern is captured by the mean gamma amplitude, across trials, as a function of elapsed time (Figure 2D; p<0.01, t-test that compared amplitudes at the times of switch [0.5 and 1 s] versus amplitudes at the middle of the interval [0.75 and 1.25 s]; 125 ms windows).
These salient temporal features of the gamma LFP were consistent across the three interval durations (Figure 3A; 500, 750, and 1000 ms intervals). To better illustrate the time distribution of gamma bursts, trials were sorted according to burst-onset time in each maintenance interval.
-
Figure 3—source data 1
- https://doi.org/10.7554/eLife.38983.012
It is important to emphasize that there are no motor actions during the maintenance intervals, and no periodic stimuli is shown on the screen. The only difference between the three groups of trials (500, 750, 1000 ms) is the tempo of the internal rhythm that subjects are maintaining. In other words, the rapid succession of the gamma bursts in the 500 ms intervals, and the more temporally distant bursts in the 1000 ms intervals, are a reflection of the subject’s internal maintenance of a visuo-spatial rhythm for the fast and slow tempos, respectively. This finding reveals a neural signature of rhythms, of different tempos, that are maintained internally.
Alignment of the gamma bursts to their onset time revealed that bursts have a similar temporal profile across tempos and elapsed intervals (Figure 3B). Importantly, we found that the amplitude of these bursts increased in proportion to the time elapsed since the initiation of the internal rhythm (Figure 3C; R2 = 0.86, exponential model). The results presented so far indicate that (1) the LFPs in SMA encode internal rhythms by means of gamma bursts that occur in sync with the beats (i.e. location switch) of a visual metronome presented earlier; and that (2) these bursts increase in amplitude, providing a neural correlate for total elapsed time.
Errors due to deviations of the internal rhythm from the objective tempo
In a previous study, we demonstrated that human subjects tend to lag behind fast tempos and get ahead of slow ones (García-Garibay et al., 2016). This predicts that animals might systematically overestimate the 500 ms rhythms, and underestimate the 1000 ms rhythms. However, since animals only had two response options (left or right), it was not possible to use behavioral responses to disambiguate errors in which the animals were ahead or behind the true tempo. Nonetheless, we hypothesized that systematic over- and under-estimations of the intervals should be reflected in the patters of gamma activity in SMA. We therefore compared the profile of gamma activity on correct and error trials (Figure 4A). The results showed that, on fast tempo trials (500 ms interval), the dynamics of gamma on error trials was right-shifted with respect to correct trials. That is, error trials displayed slower dynamics compared to correct trials (Figure 4A, upper panel). This trend was captured by the power spectrums of error and correct trials, which showed that error trials indeed oscillated at lower frequencies (Figure 4A, inset on upper panel). Conversely, the dynamics of errors on slow tempo trials (1000 ms) resemble a left-shifted version of the correct trials, that is errors displayed faster dynamics as compared to the correct trials (Figure 4A; bottom panel). This pattern is captured by the power spectrums of correct and error trials, which show that error trials oscillated at higher frequencies compared to correct trials (Figure 4A, inset on the bottom panel). These results suggest that monkeys were lagging behind fast tempos and getting ahead of slow ones.
-
Figure 4—source data 1
- https://doi.org/10.7554/eLife.38983.015
The internal rhythm increasingly getting out of synchrony was also demonstrated by the ability of a logistic classifier to differentiate between correct and error trials (Figure 4B; see Materials and methods). This analysis shows that correct and error trials are increasingly easier to classify as a function of elapsed time, just as it would be expected from a rhythm that increasingly falls out of sync with the correct tempo. This pattern holds true for a classifier that cumulatively uses gamma amplitude information as the trial develops, and also for a classifier using the information from a sliding window of constant length (Figure 4B). On average, monkeys tend lag behind fast rhythms and get ahead of slow ones. However, we must note that mean error activity comes from a mixture of lagging and leading tempos (see Figure 4—figure supplement 1). Thus, mean error activity does not necessarily reflect the half a cycle de-synchronization that must underlie incorrect responses on single trials.
Gamma band activity in a delayed-reach task
Since SMA participates in the preparation of impending motor actions, it is possible that the rhythmic gamma bursts that we observed arise because this premotor area rhythmically prepare reach movements alternatively to the left and right locations of the screen. To test this possibility, we recorded the LFPs in a delayed-reach control task (Hwang and Andersen, 2011) in which subjects were required to reach to the left or the right after being cued by a briefly presented visual stimulus (Figure 5A). In this task, monkeys waited a pseudo-randomly chosen time (1100 to 3000 ms, exponential distribution) before a go-cue prompted a reach towards the location specified by the cue (Figure 5B).
-
Figure 5—source data 1
- https://doi.org/10.7554/eLife.38983.017
The results of this control task show that, as monkeys prepare an impending reach movement, the LFPs in SMA generate bursts of gamma band activity that occur more frequently, and with increasing amplitude, as a function of total elapsed time (Figure 5C, delay period). These findings are consistent with the idea that gamma bursts in SMA encode impending motor commands. Moreover, the results of this control task are consistent with the idea that the SMA circuits reflect internal rhythms by means of rhythmically alternating motor plans to make a reach movement to the left and right locations of the screen.
Gamma oscillations during entrainment of the visual metronome
According to the previous delayed-reach experiment, gamma bursts might be reflecting an internal rhythm by periodically alternating ‘reach-left’ and ‘reach-right’ motor plans. However, our task is designed such that a motor response was never required during the three entrainment intervals. For this reason, we next analyzed the gamma band activity during the entrainment intervals in which the presentation of the alternating visuo-spatial stimuli defined the different tempos of the visual metronome task (500, 750, and 1000 ms intervals; Figure 6A–B).
-
Figure 6—source data 1
- https://doi.org/10.7554/eLife.38983.019
The results showed that even during entrainment intervals, which did not involve any motor planning, bursts of gamma oscillations were present in each interval, and their amplitude progressively increased after the presentation of each visual stimulus (Figure 6A–C). It is important to note that gamma activity in entrainment intervals peaked after each stimulus presentation. This is in contrast to what was observed during maintenance intervals, in which the peaks of gamma occurred when the stimulus switched sides. We speculate that this phase offset could be related to the process of estimating interval duration, a process that necessarily happens during entrainment intervals.
A potential concern is that the gamma bursts in entrainment intervals are merely sensory responses to visual stimuli. However, a pure sensory response should produce similar gamma dynamics after each stimulus presentation, both across consecutive entrainment intervals (1st, 2nd, 3rd), and also similar across tempos (500, 750, 1000 ms), which was clearly not the case in our results (Figure 6A). In particular, two observations suggest that gamma bursts during entrainment cannot be explained solely in terms of a sensory response. First, gamma bursts increased in amplitude as a function of elapsed time, but the amplitude dropped sharply 500 ms after the onset of the third entrainment interval (Figures 6A, 750 and 1000 ms panels). Therefore, gamma bursts carry information about the animals’ knowledge that the third entrainment interval was the last visible interval, that is the last interval that could be used for estimating the tempo. Thus, gamma dynamics likely incorporate aspects of higher cognitive processing. Second, the times of burst onset do not have a fixed temporal profile with respect to stimulus presentation (Figure 6B). To demonstrate this, we measured the distribution of burst onset time across each consecutive interval (1st, 2nd, and 3rd entrainment intervals) and across metronome tempos (500, 750, and 1000 ms), and then performed Chi-squared tests between these distributions (by using burst onset time we removed the effect of burst amplitude). The tests demonstrated that the temporal profiles of gamma onset times significantly differ, both across consecutive intervals and across metronome tempos (p<0.01; corrected for multiple comparisons). In fact, gamma responses to stimulus onset are similar only during the first 500 ms of the first entrainment interval, which is the only epoch in which monkeys have no information about the metronome tempo (Figure 6C). These results indicate that gamma bursts reflect cognitive processes related to estimating the rhythm of the visual metronome.
To quantify the extent to which gamma burst amplitude encodes total elapsed time, we measured burst amplitudes in each of the three entrainment intervals (Figure 6D). We found that burst amplitude increased linearly in proportion to total elapsed time (R2 = 0.94). In this manner, in addition to periodically generating bursts in each entrainment interval, the SMA circuit reflected the total elapsed time since the beginning of the entrainment epoch.
The metronome is encoded in the firing patterns of SMA neurons
Simultaneously with LFPs, we recorded the extracellular spike potentials of 113 neurons (78 monkey 1; 35 monkey 2). The temporal profile of the mean firing rates largely resembled the modulations of gamma-band activity in the LFP in the sense that firing rates (1) display oscillatory amplitude modulations, both during entrainment and maintenance intervals (Figure 7A,B); (2) firing rates increase as a function of total elapsed time; and (3) the activity of neurons in the delayed-reach task increase during the period preceding reach movements to a target signaled by a brief visual cue (Figure 7C).
We found that SMA neurons had a preferred spatial location, that is they were more active when the stimulus was presented (entrainment intervals), or was estimated to be (maintenance intervals), on one side of the screen. Of the 113 recorded neurons, 74 preferred the right side of the screen, and 39 preferred the left side (Materials and methods). This side preference allowed us to detrend the firing rates by subtracting the mean firing rate across sides (mean between preferred and non-preferred sides of the screen; Figure 7D). The detrended firing rates demonstrated the cyclic oscillations in the activity and, importantly, allowed to calculate the cross-correlation function between correct and incorrect trials.
The cross-correlation analysis between firing rates provided an independent corroboration of the hypothesis that that errors are mostly due to the internal metronome lagging behind fast rhythms, and getting ahead of slow ones (Figure 7E). The cross-correlogram for the 500 and 750 ms intervals peak at negative lags, demonstrating that incorrect trials lag behind the correct tempo. The opposite pattern was observed for the slow tempo (1000 ms tempo).
Neuronal spikes are associated with gamma band activity
To explore the relationship between single-neuron spiking and the simultaneously recorded LFP, we calculated the spike-triggered average (STA) LFP, and its spectral density, within a window of −100 to 100 ms surrounding each spike (Figure 8A–B, see Materials and methods) (Denker et al., 2011; Fries et al., 2001). We found that the LFP activity simultaneously recorded with each spike has a power peak at 30 Hz, and this peak is especially salient during maintenance intervals (Figure 8A, bottom panel; factorial ANOVA: interaction band/condition F = 12.11 p<0.05, Bonferroni tests of Gamma power in maintenance and entrainment vs baseline: p<0.05). Moreover, the association between spikes and the 25–40 Hz frequency band is stronger at the times of stimulus transitions, that is. around the times at which the stimulus switches from one side of the screen to the other (Figure 8C; window length around switch: half an interval, t-test p<0.005). To demonstrate that gamma is closely associated with the timing of spikes we performed a control analysis in which we jittered the spike times by ±15 ms with the resulting loss of the observed peak at the gamma band (random uniform distribution; grey traces Figure 8c; t test between jittered data in switch and non-switch conditions p=0.21).
-
Figure 8—source data 1
- https://doi.org/10.7554/eLife.38983.024
These analyses demonstrate that the performance of the metronome task is accompanied by a tighter temporal relationship between the gamma bursts and the firing of single neurons, and this association is more prominent at the times of stimulus switching during the maintenance intervals. These results are consistent with previous investigations proposing that LFP oscillations near the gamma frequencies could help single neurons synchronize their firing, and thus have a larger and more temporally precise influence on downstream target structures (Siegle et al., 2014; Veit et al., 2017; Fries, 2015).
Finally, we demonstrate that the LFP signals we recorded reflect local interaction and were not the result of signals being volume-conducted from other brain regions. We measured the coherence between LFPs of simultaneously recorded electrodes and plotted this measure as a function of the distance between them. The results show that coherence decayed as a function of electrode distance (Figure 8D, R2 = 0.72), as expected by an LFP signal that is generated in the neuronal circuits within the vicinity of the recording electrode.
Discussion
Our results show that (1) monkeys can maintain rhythms in the absence of sensory stimuli and in the absence of overt motor commands. (2) Those internal rhythms are encoded by bursts of low gamma-band LFP oscillations in SMA whose timing and amplitude indicate rhythm intervals and total elapsed time, respectively. (3) The spikes of single neurons are associated with the low gamma band frequency of the LFP, which is consistent with the idea that gamma oscillations might help to synchronize populations of neurons whose temporally coincident firing would have a larger impact on its postsynaptic targets (Buzsáki and Schomburg, 2015; Cardin et al., 2009; Fries, 2015; Siegle et al., 2014; Veit et al., 2017; Womelsdorf et al., 2007; Wong et al., 2016).
In our metronome task, the go-cue can arrive at the middle of any of the four maintenance intervals. So, there is a rhythmic modulation in the likelihood of motor response initiation. This could be related the periodic modulation of the gamma bursts and the firing rates of SMA neurons. However, we must emphasize that the rhythmicity in the gamma bursts and firing rates is also observed in entrainment intervals, where no movement is ever required. In addition to rhythmic modulations, the probability of the go-cue appearing, given that it has not appeared yet, increases as a function of total elapsed time (hazard rate). Thus, the increase in gamma amplitude and in the firing rates that is observed as total time elapses, could be related to the increasing likelihood of a motor response. We must note, however, that in the delayed-reach task we used an exponential distribution of delay times, resulting in a flat hazard rate. Even with a flat hazard rate, we observed increases in gamma amplitude, and in the firing rates, that are related to total elapsed time. Overall, we favor the interpretation that SMA participates in the metronome task by generating a motor plan that dynamically matches the spatio-temporal tempo defined by the rhythmic visual stimulus.
SMA plays a central role in learning, imaging, planning and executing complex motor actions (Nachev et al., 2008; Romo and Schultz, 1992; Kurata and Wise, 1988; Shima and Tanji, 2000; Murakami et al., 2014). It is densely and reciprocally connected to M1 and to the parietal and frontal lobes, and has direct projections to motor nuclei in the brain stem (Jürgens, 1984). Thanks to this diverse input and output relationships its activity been found to correlate not only with motor actions but also with cognitive, emotional, and perceptual functions (Narayana et al., 2012; Vergara et al., 2016; de Lafuente and Romo, 2005). SMA is active before the actual movement begins, participating in action selection, and importantly, determining the time at which actions are performed (Merchant and Averbeck, 2017; Mita et al., 2009; Chen et al., 2010; Ohara et al., 2001; Yokoyama et al., 2016; Shima and Tanji, 2000). Preparatory activity can be observed even when monkeys are required to rapidly produce a movement in response to a sensory cue (Lara et al., 2018), and it has been proposed that this preparatory activity constitutes the initial step of the temporal evolution of a dynamical system for the control of movement (Churchland et al., 2010; Remington et al., 2018). Consistent with this view, our results show that LFP and single neuron activity in SMA starts during the entrainment epoch of the metronome task, seconds before an actual movement will be required. Thus, the internal metronome is encoded as a dynamic motor plan that is initiated by the presentation of entrainment intervals.
That behavioral performance decreases as a function of time while gamma amplitude increases with elapsed time might seem counterintuitive. However, we must note that the tempo of the internal metronome is encoded by the timing, not the amplitude of the gamma bursts. On Figure 4—figure supplement 1 we show a six-choice variation of the metronome task that allowed determining that error trials are not explained by random behavioral responses. Instead, the behavioral responses on the six-choice version of the task demonstrate that error trials are due to the internal metronome lagging or getting ahead of the true tempo. Even on error trials, gamma activity, and the firing pattern of neurons, show rhythmic dynamics and a mean amplitude that increases with total elapsed time. Thus, there are three independent lines of evidence supporting the notion that error trials arise from the internal metronome falling out of sync with the intended tempo. First, the periodograms of gamma activity indicate that errors on fast trials (500 ms interval) oscillate at slower frequencies as compared to correct trials. Conversely, errors on slow tempos (1000 ms) oscillate faster than correct responses. Second, these same patterns were demonstrated by the cross-correlograms of the firing rates in correct and incorrect trials (Figure 7E). Finally, the behavioral results on the six-choice version of the metronome task showed that errors are not uniformly distributed across choices (as would be expected from lapses of attention), but distribute around the correct stimulus position, with increasing variability for longer elapsed times, as would be expected from the scalar property of timing (Figure 4—figure supplement 1). Moreover, the distributions show that errors tend to be behind the true stimulus position on fast trials, and ahead on slow trials.
It has been debated whether subjects performing a rhythmic task measure individual intervals separately, or instead rely on an estimate of total elapsed time (Laje et al., 2011). Our results now reveal that rhythms of different tempos are supported by the presence of rhythmic neuronal activity outlining each individual interval. In addition to this, the increases in gamma burst amplitude, and mean firing rates, provide information about total elapsed time.
Gamma synchronization might be useful to the formation of local ensembles of neurons that increase the temporal coordination of presynaptic spikes on postsynaptic targets, allowing brief windows of effective communication (Wong et al., 2016; Womelsdorf et al., 2007; Buzsáki and Schomburg, 2015). Previous results show that gamma oscillations increase before the execution of a motor action, and then shut down at the time of movement onset (Yokoyama et al., 2016) a result replicated by our data. Previous work by Merchant and colleagues found that LFP gamma band activity in the basal ganglia was associated with the presentation of sensory stimuli defining the intervals within a hand tapping task (Bartolo et al., 2014). They found that bursts of gamma were selective for intervals of different durations, and thus different cell populations were selective for different time intervals. We found no such duration selectivity in the SMA cortex, instead observing that gamma bursts encoded intervals of different durations.
Signals associated with timing tasks can be found across multiple brain areas, including parietal, motor, and premotor cortices, as well as dopaminergic midbrain neuron in the primate (Ghose and Maunsell, 2002; Genovesio et al., 2006; Lebedev and Wise, 2000; Mita et al., 2009; Harrington et al., 2010). For example, Jazayeri and Shadlen, 2015 have shown that activity of single neurons in the lateral intraparietal area encodes the time elapsed from a previous sensory stimuli, as well as the time remaining to initiate a saccadic eye movement (Jazayeri and Shadlen, 2015). Importantly, they showed that these signals calibrate themselves according to the underlying probability to make an eye movement within a given temporal window. A recent important result by Jazayeri and colleagues demonstrated that encoding intervals of different lengths is achieved by means of speeding up or slowing down the temporal dynamics of populations of neurons that, individually, display widely different firing patterns (Wang et al., 2018). Our results extend this finding to the dynamics of the LFP oscillations by demonstrating that they also show temporal scaling (Figures 3A and 6C). A coherent picture is thus emerging, indicating that time-estimation and time-production signals are present as dynamic motor plans that are distributed across the motor structures that participate in executing timely motor actions.
Materials and methods
Subjects
Two adult male Rhesus monkeys (Macaca mulatta) participated in the study (weight: 5–7 kg, age: 5, 7 years). Experimental procedures were approved by the Ethics in Research Committee of the Institute of Neurobiology and were in agreement with the principles outlined in the Guide for Care and Use of Laboratory Animals (National Institutes of Health). Each monkey was surgically implanted with titanium head bolts and a titanium recording chamber over the left supplementary motor area (SMA). Placement of the chambers over the SMA was guided by structural MRI for both monkeys (Figure 1E).
Behavioral task
Request a detailed protocolMonkeys were trained in a visual metronome task described in detail in a previous report (García-Garibay et al., 2016). Briefly, while maintain eye and hand fixation over a touch screen (ELO Touch Solutions, model 1939L; ASL Eye-Track 6), subjects observed a visual stimulus (gray circle, 10° diameter, 25° eccentricity) that periodically changed position from one side of the screen to the other, at regular intervals (entrainment epoch; 500, 750, or 1000 ms interval; pseudo-randomly selected on each trial; Figure 1A). After three entrainment intervals the visual stimulus disappeared, and subjects had to continue estimating its position (left or right) as a function of elapsed time (maintenance intervals; Figure 1A). This visuo-spatial rhythm task is similar to a visual metronome that paces a rhythm which subjects have to keep internally during the maintenance epoch. To quantify the ability of the subjects to maintain rhythms of different tempos a go-cue (disappearance of the hand fixation area) was presented at the middle of any of the four maintenance intervals (randomly selected, uniform distribution; Figure 1A). This go-cue instructed the subjects to make a reach movement towards the estimated target position (left or right). It is important to note that this was not an interception task, that is once the go-cue was presented the non-visible stimulus no longer changed position. Performance was measured as the proportion of correct responses plotted as a function of the elapsed time since the initiation of the maintenance epoch (Figure 1B). Visual stimuli and task control was achieved with the Expo software (designed by Peter Lennie, maintained by Robert Dotson; available at https://sites.google.com/a/nyu.edu/expo/).
Delayed-reach control task
Request a detailed protocolIn this task, monkeys were required wait a variable delay period before making a reach movement to one side of the screen signaled by a brief visual stimulus (Figure 5). The stimulus appeared for 500 ms on either the left or side of the screen (randomly selected), and the delay period was randomly selected from a truncated exponential distribution with a minimum delay duration of 1.1 s and a maximum of 3 s. For analyzing the activity during the delay period (Figures 5 and 7), we used every trial up to the time before the go-cue. This ‘attrition’ method allows to use all available information up a given point in time (without the go-cue, or movement related- activity). In this manner, before 1.1 s all trials contribute to the mean activity. Then, there is a progressive attrition of trials so that for the 3 s time point ~300 trials contribute to the mean. Figure 5B shows every trial in which the visual cue appeared on the left.
Neural recordings
Request a detailed protocolNeural recordings were performed with seven independent movable microelectrodes (2–3 MΩ, Thomas Recordings, Giessen, Germany). Electrodes were advanced in the coronal plane into the supplementary motor area until single unit activity was obtained in at least one of the electrodes. At each recording site, spikes were isolated online (Cerebus acquisition system, Blackrock Microsystems, Salt Lake City, UT) and sampled at 30 KHz. The local field potentials (LFPs) were obtained by filtering the electrode signal at 0.5 to 500 Hz, at a 2 KHz rate. Offline, the signal was down sampled to 1 KHz, and band-pass filtered to the 2–50 Hz band.
Data analysis
Request a detailed protocolAnalyses were performed with MATLAB 2013b (The Mathworks, Natick, MA), making use of the Chronux Toolbox for the time- frequency maps (Mitra and Bokil, 2007).
Time-frequency decomposition
Request a detailed protocolSpectral estimation was performed using multitaper methods (Pesaran et al., 2002; Mitra and Pesaran, 1999; Cohen, 2014). A 200 ms windows sliding at 5 ms steps was used for the time-frequency maps (one taper was used, 5 Hz bandwidth). Spectrogram power was normalized by dividing each frequency and time bin by the average power in a 500 ms baseline window before trial initiation.
Oscillations of gamma amplitude
Request a detailed protocolFor the entrainment intervals, we compared the mean gamma amplitude (across the trials of one session) at the time of switches (dotted lines in Figure 1D), with the gamma amplitude in between switches (at the middle of each interval). We used window lengths of 25% the interval duration. For each tempo, each recording session contributed three pairs of switch/non-switch windows. Thus, the degrees of freedom of the t-test were (131 sessions) x (3 pairs per session) = 393–1 degrees of freedom. We performed three such tests, one for each metronome tempo (500, 750, 1000 ms). The three tests had p<0.01.
Single-trial analysis
Request a detailed protocolTo characterize how the amplitude of the gamma oscillations is modulated over time, we averaged the normalized spectrograms over the low gamma band frequencies (30–40 Hz). Narrow-band filtering with analytic envelopes and complex Morlet wavelet convolution yielded similar results. Gamma bursts were defined as the period of time in which gamma amplitude exceeded the 90th percentile of overall activity for at least 100 ms (i.e. for at least four cycles of the gamma oscillations). On panel 2C trials were sorted by the burst-onset time on the last maintenance interval, thus, the previous gamma bursts are not aligned. On panel 3A gamma bursts were aligned independently on each interval,that is the bursts were aligned for the first transition, then re-aligned for the second transition and so on. This was done for display purposes only; the mean gamma activity is not affected by how trials are sorted.
Classification of correct and error trials
Request a detailed protocolA logistic function was used to identify correct and error trials:
where t1 correspond to the gamma amplitude in the first time-bin, t2 to the amplitude on second time bin, and so on (10 time bins per interval, 35 time-bins for each trial). Thus, the predicted behavior arises from a linear combination of the gamma activity used to fit the logistic function. The classifier accuracy was measured on 100 trials (50 correct and 50 error trials; randomly selected) not used in fitting the logistic function. Fitting and testing was repeated 100 times, randomly selecting the test trials. For the cumulative window classifier (Figure 4B, green line), we used the gamma amplitude on the first time-bin and then tested the accuracy of decoding, then we added the data of the second time-bin and recalculated accuracy, and so on until the last time-bin. In a second approach that we called ‘sliding window’, a window of 5 time-bins were used to fit the classifier and calculate accuracy. This window moved across the trial to calculate accuracy as a function of elapsed time (Figure 4B, blue line).
Neuron’s spatial preference
Request a detailed protocolTo estimate each neuron’s spatial preference, we computed the cross-correlation between the stimulus position (left and right) and the mean firing rate. For this analysis, we concatenated the mean firing rate of trials starting on the left with those starting the right, and generated the stimulus position signal accordingly. The sign at the peak of the cross-correlogram tells us if increasing firing rates are significantly correlated, or anti-correlated, with the stimulus position being on the left. With each neuron’s spatial preference, we were able to generate the mean firing rate of trials starting on the neuron’s preferred location, and the mean firing rate of trials starting in the opposite location (Figure 7B). The detrended firing rates were obtained by subtracting the mean activity across all trials, from the mean firing rates of each trial type (starting on the preferred and non-preferred location; Figure 7D).
Spike-triggered average (STA)
Request a detailed protocolTo estimate the synchronization between the spikes and the simultaneously recorded LFP, 200 ms windows centered on each spike were analyzed (Fries et al., 2001; Denker et al., 2011). The average LFP in these windows were computed and normalized peak-to-valley to values between 0 and 1. This procedure was applied before spectral decomposition of the STA (Figure 8A, power spectrum), allowing the comparison of spectral density maintaining the same maximum amplitude across conditions (baseline, entrainment and maintenance epochs). To assess statistical significance, we performed a factorial ANOVA with the factors condition (baseline, entrainment, maintenance), and frequency (alpha, beta, gamma), where the dependent variable was the average amplitude between 6 and 10 Hz for alpha, 15 to 24 Hz for beta and 30 to 40 Hz for gamma. This analysis demonstrated that the average power of the STA over the gamma band was significantly larger during entrainment and maintenance, as compared to the baseline period (p<0.01; Figure 8B). We normalized the amplitude of the LFP traces surrounding each spike to account for the increase in gamma amplitude with total elapsed time.
Coherence between simultaneously recorded electrodes
Request a detailed protocolTo assess the locality of the observed LFP oscillations we estimated the phase clustering between the LFPs in pairs of simultaneously recorded electrodes. We used the time series of all trials recorded while the monkeys performed the task. For each electrode pair, we band-pass filtered the signal (30–40 Hz) and estimated the analytic envelope to obtain the instantaneous phase. Then, for each time point we estimated the difference angles between signals in the complex plane. The coherence was defined as the length of the average vector of all difference angles, a procedure that results in magnitudes between 1 (all difference angles are aligned to the same direction) and zero (random distribution) (Cohen, 2014). To quantify how coherence decreased as a function of electrode separation we grouped the distance variable into 50 bins containing the same number of observations per bin. A linear regression was then applied to these data (Figure 8D).
Data availability
MAT files with summary data for Figures 1-8, Figure 1—figure supplements 1 and 2, and Figure 7—figure supplement 1 have been provided. The full raw dataset is available on request to the corresponding author.
References
-
What makes Us tick? functional and neural mechanisms of interval timingNature Reviews Neuroscience 6:755–765.https://doi.org/10.1038/nrn1764
-
The origin of extracellular fields and currents--EEG, ECoG, LFP and spikesNature Reviews Neuroscience 13:407–420.https://doi.org/10.1038/nrn3241
-
What does gamma coherence tell Us about inter-regional neural communication?Nature Neuroscience 18:484–489.https://doi.org/10.1038/nn.3952
-
Supplementary motor area exerts proactive and reactive control of arm movementsJournal of Neuroscience 30:14657–14675.https://doi.org/10.1523/JNEUROSCI.2669-10.2010
-
On the anticipatory precue activity in motor cortexJournal of Neuroscience 32:15359–15368.https://doi.org/10.1523/JNEUROSCI.1768-12.2012
-
Representation of accumulating evidence for a decision in two parietal AreasJournal of Neuroscience 35:4306–4318.https://doi.org/10.1523/JNEUROSCI.2451-14.2015
-
Neuronal correlates of subjective sensory experienceNature Neuroscience 8:1698–1703.https://doi.org/10.1038/nn1587
-
The local field potential reflects surplus spike synchronyCerebral Cortex 21:2681–2695.https://doi.org/10.1093/cercor/bhr040
-
Predictive rhythmic tapping to isochronous and tempo changing metronomes in the nonhuman primateAnnals of the New York Academy of Sciences pp. 396–414.https://doi.org/10.1111/nyas.13671
-
Monkeys share the human ability to internally maintain a temporal rhythmFrontiers in Psychology 7:1–12.https://doi.org/10.3389/fpsyg.2016.01971
-
Toward a neurobiology of temporal cognition: advances and challengesCurrent Opinion in Neurobiology 7:170–184.https://doi.org/10.1016/S0959-4388(97)80005-0
-
Timing as an intrinsic property of neural networks: evidence from in vivo and in vitro experimentsPhilosophical Transactions of the Royal Society B: Biological Sciences 369:20120460.https://doi.org/10.1098/rstb.2012.0460
-
Rhythm and beat perception in motor areas of the brainJournal of Cognitive Neuroscience 19:893–906.https://doi.org/10.1162/jocn.2007.19.5.893
-
From physical time to the first and second moments of psychological timePsychological Bulletin 127:22–44.https://doi.org/10.1037/0033-2909.127.1.22
-
Neural modulation of temporal encoding, maintenance, and decision processesCerebral Cortex 20:1274–1285.https://doi.org/10.1093/cercor/bhp194
-
Effects of visual stimulation on LFPs, spikes, and LFP-spike relations in PRRJournal of Neurophysiology 105:1850–1860.https://doi.org/10.1152/jn.00802.2010
-
The neural representation of timeCurrent Opinion in Neurobiology 14:225–232.https://doi.org/10.1016/j.conb.2004.03.013
-
Temporal context calibrates interval timingNature Neuroscience 13:1020–1026.https://doi.org/10.1038/nn.2590
-
A neural mechanism for sensing and reproducing a time intervalCurrent Biology 25:2599–2609.https://doi.org/10.1016/j.cub.2015.08.038
-
Learning of temporal motor patterns: an analysis of continuous versus reset timingFrontiers in Integrative Neuroscience 5:1–11.https://doi.org/10.3389/fnint.2011.00061
-
Oscillations in the premotor cortex: single-unit activity from awake, behaving monkeysExperimental Brain Research 130:195–215.https://doi.org/10.1007/s002210050022
-
The psychology of music: rhythm and movementAnnual Review of Psychology 69:51–75.https://doi.org/10.1146/annurev-psych-122216-011740
-
Interval tuning in the primate medial premotor cortex as a general timing mechanismJournal of Neuroscience 33:9082–9096.https://doi.org/10.1523/JNEUROSCI.5513-12.2013
-
Neurobiology of Interval Timing1–13, Introduction to the neurobiology of interval timing, Neurobiology of Interval Timing, New York, Springer.
-
Finding the beat: a neural perspective across humans and non-human primatesPhilosophical Transactions of the Royal Society B: Biological Sciences 370:20140093.https://doi.org/10.1098/rstb.2014.0093
-
The computational and neural basis of rhythmic timing in medial premotor cortexThe Journal of Neuroscience 37:4552–4564.https://doi.org/10.1523/JNEUROSCI.0367-17.2017
-
Interval time coding by neurons in the presupplementary and supplementary motor AreasNature Neuroscience 12:502–507.https://doi.org/10.1038/nn.2272
-
Analysis of dynamic brain imaging dataBiophysical Journal 76:691–708.https://doi.org/10.1016/S0006-3495(99)77236-X
-
Neural antecedents of self-initiated actions in secondary motor cortexNature Neuroscience 17:1574–1582.https://doi.org/10.1038/nn.3826
-
A hierarchy of intrinsic timescales across primate cortexNature Neuroscience 17:1661–1663.https://doi.org/10.1038/nn.3862
-
Functional role of the supplementary and pre-supplementary motor AreasNature Reviews Neuroscience 9:856–869.https://doi.org/10.1038/nrn2478
-
Role of primate basal ganglia and frontal cortex in the internal generation of movementsIII. Neuronal Activity in the Supplementary Motor Area. Experimental Brain Research 91:396–407.
-
Gamma-range synchronization of fast-spiking interneurons can enhance detection of tactile stimuliNature Neuroscience 17:1371–1379.https://doi.org/10.1038/nn.3797
-
Cortical gamma band synchronization through somatostatin interneuronsNature Neuroscience 20:951–959.https://doi.org/10.1038/nn.4562
-
Flexible timing by temporal scaling of cortical responsesNature Neuroscience 21:102–110.https://doi.org/10.1038/s41593-017-0028-6
-
Coherent neuronal ensembles are rapidly recruited when making a look-reach decisionNature Neuroscience 19:327–334.https://doi.org/10.1038/nn.4210
Article and author information
Author details
Funding
Consejo Nacional de Ciencia y Tecnología (Fellowship 486768)
- Jaime Cadena-Valencia
Consejo Nacional de Ciencia y Tecnología (Fronteras de la Ciencia 196)
- Hugo Merchant
Consejo Nacional de Ciencia y Tecnología (Ciencia Básica 236836)
- Hugo Merchant
Universidad Nacional Autónoma de México (PAPIIT IN202317)
- Hugo Merchant
Universidad Nacional Autónoma de México (PAPIIT IN207818)
- Victor de Lafuente
Consejo Nacional de Ciencia y Tecnología (Ciencia Básica 254313)
- Victor de Lafuente
Consejo Nacional de Ciencia y Tecnología (Fronteras de la Ciencia 245)
- Victor de Lafuente
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Edgar Bolaños for technical assistance and Juan Ortiz for obtaining the MRI images. Ana María Malagón helped with single neuron analysis. Ranufo Romo provided helpful comments on the manuscript. This work was supported by grants to from CONACYT Ciencia Básica 254313 (VdL), 236836 (HM); Fronteras de la Ciencia 245 (VdL), 196 (HM); and PAPIIT IN207818 (VdL), IN202317 (HM). JCV is a doctoral student from Programa de Doctorado en Ciencias Biomédicas, Universidad Nacional Autónoma de México (UNAM) and received fellowship number 486768 from Consejo Nacional de Ciencia y Tecnología (CONACYT).
Ethics
Animal experimentation: Experimental procedures were approved by the Ethics in Research Committee of the Institute of Neurobiology (protocol number 046) and were in agreement with the principles outlined in the Guide for Care and Use of Laboratory Animals (National Institutes of Health).
Copyright
© 2018, Cadena-Valencia et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,574
- views
-
- 431
- downloads
-
- 47
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey–Osterrieth complex figure (ROCF) is the state-of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF drawing and quantifies deviations from the original figure. This manual procedure is time-consuming, slow and scores vary depending on the clinician’s experience, motivation, and tiredness. Here, we leverage novel deep learning architectures to automatize the rating of memory deficits. For this, we collected more than 20k hand-drawn ROCF drawings from patients with various neurological and psychiatric disorders as well as healthy participants. Unbiased ground truth ROCF scores were obtained from crowdsourced human intelligence. This dataset was used to train and evaluate a multihead convolutional neural network. The model performs highly unbiased as it yielded predictions very close to the ground truth and the error was similarly distributed around zero. The neural network outperforms both online raters and clinicians. The scoring system can reliably identify and accurately score individual figure elements in previously unseen ROCF drawings, which facilitates explainability of the AI-scoring system. To ensure generalizability and clinical utility, the model performance was successfully replicated in a large independent prospective validation study that was pre-registered prior to data collection. Our AI-powered scoring system provides healthcare institutions worldwide with a digital tool to assess objectively, reliably, and time-efficiently the performance in the ROCF test from hand-drawn images.
-
- Neuroscience
Combining electrophysiological, anatomical and functional brain maps reveals networks of beta neural activity that align with dopamine uptake.