Entrained neuronal activity to periodic visual stimuli in the primate striatum compared with the cerebellum
Abstract
Rhythmic events recruit neuronal activity in the basal ganglia and cerebellum, but their roles remain elusive. In monkeys attempting to detect a single omission of isochronous visual stimulus, we found that neurons in the caudate nucleus showed increased activity for each stimulus in sequence, while those in the cerebellar dentate nucleus showed decreased activity. Firing modulation in the majority of caudate neurons and all cerebellar neurons was proportional to the stimulus interval, but a quarter of caudate neurons displayed a clear duration tuning. Furthermore, the time course of population activity in the cerebellum well predicted stimulus timing, whereas that in the caudate reflected stochastic variation of response latency. Electrical stimulation to the respective recording sites confirmed a causal role in the detection of stimulus omission. These results suggest that striatal neurons might represent periodic response preparation while cerebellar nuclear neurons may play a role in temporal prediction of periodic events.
https://doi.org/10.7554/eLife.48702.001Introduction
When listening to music, we often feel rhythms and sometimes dance to them. It has been suggested that temporal information processing for periodic events differs from that for a single interval, such as pressing a stopwatch at a specific time (Grahn and Brett, 2007; Grube et al., 2010; Patel and Iversen, 2014; Ross et al., 2018; Teki et al., 2011a; Teki et al., 2011b). Previous studies of functional imaging (Aso et al., 2010; Grahn and Brett, 2007; Hove et al., 2013; Konoike et al., 2012; Teki and Griffiths, 2016) and clinical cases (Allman and Meck, 2012; Cope et al., 2014; Schlerf et al., 2007) have elucidated brain regions relevant to rhythm processing in the frontoparietal cortices as well as in the basal ganglia and the cerebellum. However, as the number of physiological studies in experimental animals are limited (Cadena-Valencia et al., 2018; Lakatos et al., 2008; Renoult et al., 2006), how individual neurons in these regions represent periodic timing remains largely unknown. Furthermore, most of the previous studies used timing tasks that required rhythmic movements, making it difficult to dissociate sensory from motor components in neuronal activity (Bartolo et al., 2014; Merchant et al., 2011; Schneider and Ghose, 2012).
With the aim of clarifying the neuronal mechanism of rhythm processing, we have developed the oddball detection paradigm that requires temporal prediction of periodic events (Ohmae et al., 2013). In this task, subjects are asked to detect the unexpected omission or the change in color of isochronous repetitive visual stimuli in the range of several hundreds of milliseconds. Importantly, to detect the stimulus omission, the subjects need to predict the timing of each stimulus in the sequence but are not allowed to make any movements until the omission. When tested in humans, the subjects indeed relied on temporal prediction to detect the stimulus omission for sequences slower than 4 Hz, whereas they detected a slight stumbling of stimulus stream for faster sequences (Ohmae and Tanaka, 2016). We also demonstrated in monkeys that neurons in the cerebellar dentate nucleus during the task exhibited entrainment of activity, and that neuronal modulation for each stimulus was proportional to the inter-stimulus interval (ISI) (Ohmae et al., 2013). Because local inactivation and electrical stimulation applied to the recording sites delayed and promoted the detection of the stimulus omission, respectively, the periodic neuronal signals in the cerebellar nucleus likely contributed to the prediction of stimulus timing during the task (Ohmae and Tanaka, 2016; Ohmae et al., 2013; Uematsu et al., 2017).
Nevertheless, the cerebellum is not the only subcortical structure involved in rhythm perception. As above, evidence shows that the basal ganglia are also essential for temporal information processing for both periodic and single event timing (Buhusi and Meck, 2006; Coull et al., 2011; Merchant et al., 2013; Paton and Buonomano, 2018). In particular, dopamine signaling in the striatum appears to play a crucial role in regulating the signal flow in the cortico-basal ganglia pathways during timing tasks (De Corte et al., 2019; Emmons et al., 2016; Kim and Narayanan, 2019; Kunimatsu and Tanaka, 2016; Soares et al., 2016). In this study, we examined neuronal activity in the caudate nucleus during the oddball detection task in monkeys, and then compared the results with those obtained previously from the cerebellar dentate nucleus (Ohmae et al., 2013). We show that neurons in the caudate nucleus also exhibit periodic activity for isochronous repetitive visual stimuli, whereas the time courses of neuronal activity were clearly different from those in the cerebellum. Further quantitative analyses suggest that the caudate nucleus might be responsible for periodic motor preparation, while the cerebellar dentate nucleus may be involved in temporal prediction of periodic sensory event which is necessary to detect the stimulus omission.
Results
Periodic neuronal activity in the caudate nucleus
A total of 129 task-related neurons were recorded from the head of the caudate nucleus (1–5 mm anterior to the anterior commissure, Figure 1C) in three monkeys. Of these, 109 neurons (52, 33 and 24 neurons from monkeys G, H and L, respectively) showed firing modulation for each repetitive visual stimulus, while the remaining neurons only exhibited a phasic activity associated with saccades (n = 15) or reward delivery (n = 3), or showed sustained activity in the middle of the stimulus sequence (n = 2).
Figure 2A illustrates the activity of a representative neuron in trials with a 400 ms ISI. This neuron showed virtually no response or slight suppression for the first few stimuli in the sequence, and exhibited a strong firing modulation as the repetition progressed in trials with the stimulus omission (missing condition, red trace and rasters). The firing rate started to increase just before the stimulus presentation (vertical dashed lines) and peaked approximately 130 ms following the stimulus onset. The firing modulation was much lower when the animal prepared for detecting the changes in stimulus color (deviant condition, blue trace and rasters). Like this example, the majority of caudate neurons responding to the repetitive stimuli (74%, 83/109) exhibited a gradual rise in firing modulation for each stimulus during the trial, while only one neuron responded roughly equally to each stimulus in the sequence. On average, the neuronal activity of these increase-type neurons peaked at 160 ± 75 ms (SD, n = 84) from the stimulus onset in trials with a 400 ms ISI. Most of them (88%, 74/84) also exhibited a transient activity around the time of saccades following the omission of regular stimulus (Figure 2A, right panel, red trace). However, when we tested formally in the conventional visual saccade trials, the increase-type neurons (n = 3) did not exhibit a strong saccade-related activity, if any.
-
Figure 2—source data 1
- https://doi.org/10.7554/eLife.48702.004
As with another example shown in Figure 2B, a minority of neurons (23%, 25/109) responded vigorously to the initial few stimuli in the sequence and exhibited a gradual decrease of activity that eventually disappeared at the time of oddball (i.e. stimulus omission or deviation). For all these decrease-type neurons, the response to the repetitive stimulus was greatest for the first stimulus, exhibiting a peak at 566 ± 358 ms (SD, n = 25) from the stimulus onset. All but four of these neurons showed no transient activity around the time of saccades, just like the example shown in Figure 2B (right panel). As we were interested in the underlying neuronal mechanism of oddball detection in this study, we only considered the increase-type neurons further (Figure 2A).
Basic response properties in different conditions
The magnitude of neuronal activity for the repetitive stimuli depended on the location of the saccade target only in a minority of individual neurons (17%, 14/84, Wilcoxon’s rank sum test, p<0.05, 12 and 2 showed a preference for contralateral and ipsilateral targets, respectively, Figure 3C, filled circles), while there was a significant contralateral bias in the population (paired t-test, t83 = 3.40, p=0.005). When the magnitude of directional bias was quantified by computing a regression slope in Figure 3C, neuronal activity in the missing oddball condition with the contralateral saccade target was approximately 5% greater than that with the ipsilateral saccade target (slope = 1.08). Given the relatively weak directional modulation, we combined the data for both saccade directions for the subsequence analyses.
-
Figure 3—source data 1
- https://doi.org/10.7554/eLife.48702.006
Each neuron was tested for two oddball conditions presented randomly: the missing condition required temporal prediction while the deviant condition did not. The two conditions were indicated by color of the fixation point at the beginning of each trial (Materials and methods). As seen in Figure 2, neurons in the caudate nucleus exhibited greater firing modulation during the missing than the deviant oddball conditions. Figure 3A compares the time courses of population activity between the oddball conditions aligned with either the occurrence of stimulus omission (Miss) or color deviation (Dev). In the neuronal population, the activity in the missing condition was again strongly enhanced compared with the deviant condition. When the magnitude of neuronal activity was assessed by measuring the peak (100 ms bin) during 400 ms before the oddball (Figure 3A, black bar), 50 out of 84 neurons showed differential activity between the conditions (Wilcoxon’s rank sum test, p<0.05, Figure 3B, filled circles). In the population as a whole, the activity in the missing condition was approximately 1.7-fold greater than that in the deviant condition (paired t-test, t83 = 11.7, p<10−19). Thus, the periodic activity in the caudate nucleus was much greater when the prediction of stimulus timing was needed. Figure 3D plots the time courses of firing modulation for each repetitive stimulus, showing that the peak activity (data connected with solid lines) gradually increased during stimulus repetition while the minimal value during each ISI (100 ms bin, open symbols connected with dashed lines) remained almost unchanged throughout the trial in both oddball conditions.
We previously demonstrated that the periodic neuronal modulation in the cerebellar dentate nucleus depended on the stimulus interval, showing a greater firing modulation for longer ISIs (Ohmae et al., 2013; Uematsu et al., 2017). In this study, we also found that the magnitude of periodic activity in the caudate nucleus altered as the ISI was systematically varied from 100 to 600 ms. Like neurons in the cerebellum, a representative caudate neuron shown in Figure 4A exhibited greater firing modulation for longer ISIs. Among 49 increase-type neurons tested formally, the majority (76%, 37/49) were classified into long-tuned neurons. Figure 4C summarizes the normalized firing modulation for these neurons. On average, the normalized activities for the 100, 200, 300 and 400 ms ISIs were 9, 18, 43% and 64% of the response to the 600 ms ISI, respectively.
-
Figure 4—source data 1
- https://doi.org/10.7554/eLife.48702.009
We also found a subset of caudate neurons (24%, 12/49) exhibiting a preference for the medium ISIs like the one shown in Figure 4B. This short-tuned neuron showed the greatest firing modulation for the 300 ms ISI during fixation, as well as a transient activity associated with saccades for short intervals. Figure 4D summarizes the normalized firing modulation for different ISIs for this and the other short-tuned neurons. Almost all neurons (92%, 11/12) exhibited maximal firing modulation for either 300 or 400 ms ISIs, and none showed a preference for the 100 ms ISI. In the population, the magnitude of firing modulation was 15, 46, 88, 94% and 59% of the maximal value for the ISIs of 100, 200, 300, 400 and 600 ms, respectively. The absence of neurons showing a preference for the 100 ms ISI was not attributed to the use of a Gaussian kernel with a relatively large σ value (30 ms, Materials and methods) to obtain spike density. When we used a narrower kernel of 15 ms, the traces of neuronal activity became somewhat noisy and the magnitude of firing modulation became slightly greater, but the time courses of neuronal activity were very similar to those using the 30 ms kernel (Figure 4—figure supplement 1A and B). Furthermore, the duration preference remained almost unchanged for Gaussians with a σ of 15 ms (only two long-tuned neurons altered their preference from 600 to 400 or 300 ms, and one short-tuned neuron altered its preference from 400 to 300 ms) (Figure 4—figure supplement 1C and D). In this case, the normalized activity for the long-tuned neurons averaged 18, 26, 51, 68% and 99.7% and the short-tuned neurons averaged 23, 58, 88, 91% and 60% of the maximal value for the ISIs of 100, 200, 300, 400 and 600 ms, respectively.
Comparison of time course of neuronal activity with the deep cerebellar nuclei
Although neurons in both the caudate nucleus and the deep cerebellar nucleus exhibited periodic firing modulation for the isochronous visual stimuli, the time courses of neuronal activity were quite different. Figure 5A plots the population activity for the increase-type neurons in the caudate nucleus for different ISIs. In this figure, the data are aligned with the stimulus just before the stimulus omission, and the dashed traces indicate neuronal activity during 100 ms following the stimulus omission. The neuronal firing in the caudate nucleus peaked approximately 160 ms after the stimulus onset and terminated at ~ 300 ms in trials with longer ISIs (300–600 ms). In contrast, neurons in the cerebellar dentate nucleus reported previously (Ohmae et al., 2013; Figure 5C) exhibited a transient decrement of activity that was lowest approximately 200 ms following the stimulus onset, and gradually resumed the firing rate until the time of the next stimulus. Thus, neurons in the caudate nucleus and the cerebellar dentate nucleus exhibited firing modulation for the repetitive visual stimuli in opposite directions, and the time courses of recovery from the transient activity for each stimulus clearly differed between the recording sites.
-
Figure 5—source data 1
- https://doi.org/10.7554/eLife.48702.012
During recording from caudate neurons in the present study, color of the fixation point indicated the oddball condition so that the animals expected either stimulus omission or deviation during the stimulus repetition (Figure 1A). However, during recording from the deep cerebellar nucleus in the previous study, animals were not informed in advance of oddball conditions so that they were required to predict stimulus timing in all of the trials. To test the effect of prior instruction of oddball condition, we recorded from additional 18 neurons in the cerebellar dentate nucleus in monkey H in separate sessions. We found that the time course of neuronal activity was similar to that in Figure 5C, and the times of peak and trough of neuronal activity were not significantly altered by the instruction, although the magnitude of firing modulation differed between these populations of neurons (Figure 5—figure supplement 1).
We next examined how precisely neuronal activity in these subcortical structures signaled the timing of each next stimulus. We assumed that the downstream structure might decode the elapsed time when the firing rate reached a certain threshold that was proportional to the size of firing modulation. First, we measured the maximal firing modulation as the difference between the peak and trough of population activity during the period from the last stimulus to the time of stimulus omission (i.e. the expected time of stimulus appearance) for each ISI. Then, we defined the predicted timing as the time when the firing modulation reached a certain level of the maximal value. We searched for the optimal %threshold (1% steps) across all the ISIs of 300, 400 and 600 ms that minimized the sum of the squared difference between the predicted and actual timing of the next stimulus (temporal prediction error, Δt, Figure 5B). Figure 5D plots the prediction errors in different interval conditions, showing that the stimulus timing was better predicted by neuronal activity in the cerebellum than the caudate nucleus (mean Δt = 63 versus 28 ms; bootstrap 95% CI [46, 81] and [14 44], respectively). These results suggest that the cerebellum may carry more accurate temporal information than the striatum when predicting timing of periodic events.
The previous study using the oddball detection task demonstrated that neuronal activity in the cerebellar nucleus at the time of stimulus omission correlated with saccade latency (Ohmae et al., 2013). The other study in our laboratory using the self-timing task showed that the stochastic variation of saccade latency differently affected neuronal activity in the caudate and the cerebellar dentate nucleus (Kunimatsu et al., 2018). Therefore, we next asked whether the timing of neuronal correlates of trial-by-trial latency during the oddball task differed between these subcortical structures. To examine this, data for each neuron were divided into six groups according to saccade latency and were aligned with either stimulus omission or saccades (Materials and methods). Then, we measured the timing of stochastic neuronal variation across different groups by performing ANOVA for every millisecond. Specifically, when we aligned the data with stimulus omission, the traces of population activity for the six latency groups were initially comparable but gradually varied as time passage (Figure 6A and C, left panels). We searched for the start of the diverging point back in time, and the time when p-value consistently (>100 ms) surpassed 0.05 was taken as the start of neuronal variation. Similarly, when we aligned the data with saccade initiation, the neuronal activity initially varied between the groups but become indistinguishable around the time of saccades (right panels). We searched for the end of neuronal variation in order of time and detected the time when p-value consistently became > 0.05. In the caudate nucleus, the population activities for different latency groups varied until just before saccade onsets (–161 ms, Figure 6A, vertical dashed line), while neuronal activity around the time of saccades (±50 ms) were comparable between the groups (one-way ANOVA, p=0.90). In contrast, the stochastic neuronal variation in the cerebellar nucleus disappeared well before saccade initiation (–428 ms, Figure 6C). We evaluated the difference in timing of neuronal variation using the bootstrap procedure and found that when the data were aligned with saccade initiation the trial-by-trial variation disappeared earlier in the cerebellum than the caudate nucleus (Figure 6D). When the same sets of data were aligned with the stimulus omission, the stochastic variation tended to emerge earlier in the cerebellum than the caudate nucleus (Figure 6B). Thus, neurons in the cerebellar nucleus exhibited trial-by-trial variation around the time of stimulus omission, while those in the caudate nucleus showed stochastic variation just before saccade initiation.
-
Figure 6—source data 1
- https://doi.org/10.7554/eLife.48702.014
Causal role of striatal activity in the detection of stimulus omission
To examine the causal role of the caudate neuronal activity in the oddball detection, we delivered electrical microstimulation to the recording sites. Figure 7A illustrates eye position traces for contralateral saccades in trials with and without electrical stimulation (100 Hz, 50 μA, color shade). Although electrical stimulation delivered 200 ms before the oddball did not evoke immediate saccades, the detection of stimulus omission was clearly promoted (Figure 7A, red traces). The same stimulation pulses did not alter the detection of stimulus deviation (blue traces) in this and most of the other stimulation experiments (see below).
-
Figure 7—source data 1
- https://doi.org/10.7554/eLife.48702.016
Figure 7B plots the medians of contraversive saccade latencies for the stimulus omission in individual experiments. In 14 out of 29 sessions (48%), electrical stimulation significantly altered saccade latency (Wilcoxon’s rank sum test, p<0.05 with Bonferroni correction), and the means of median latencies were significantly different in the population (paired t-test, t28 = 10.2, p<10−11). Furthermore, electrical stimulation also reduced the variation of saccade latency for the stimulus omission in the population (SDs averaged 58.0 ± 16.4 ms and 47.1 ± 13.1 ms, paired t-test, t57 = 3.45, p<0.005), while this effect was not observed in individual experiments (F-test, p>0.05, corrected). In contrast, in trials with stimulus deviation, electrical stimulation failed to alter saccade latency in most of individual experiments (2/29, 7%, Wilcoxon’s rank sum test, p<0.05, corrected) as well as in the population (paired t-test, t28 = 1.50, p=0.14, Figure 7D). The variation of contraversive saccade latency in the deviant oddball condition was also reduced during electrical stimulation (paired t-test, t28 = −2.24, p<0.05).
Figure 7C summarizes the changes in the medians of reaction time in all experimental conditions. Electrical stimulation facilitated ipsiversive saccades in the missing condition (5 out of 29 sessions, Wilcoxon’s rank sum test, p<0.05, corrected; in the population, paired t-test, t28 = 7.76, p<10−8), and also in the deviant condition to a lesser extent (1 out of 29, Wilcoxon’s rank sum test, p<0.05, corrected; in the population, paired t-test, t28 = 6.50, p<10−7). Two-way ANOVA revealed significant main effects (oddball condition, F1,84 = 118.28, p<0.05; saccade direction, F1,84 = 5.59, p<0.05) and interaction (F1,84 = 10.96, p<0.05). Post hoc paired t-tests detected a significant difference between saccade directions in the missing but not in the deviant conditions (t28 = 3.23 and −1.51, p=0.005 and 0.14, respectively). These results indicate that the neuronal signals in the caudate nucleus were involved in making decision in response to a single omission of a regular beat.
Discussion
We found that neurons in the caudate nucleus exhibited periodic firing modulation when monkeys attempted to detect a single omission of repetitive visual stimulus. Most neurons showed phasic activity that increased gradually as the repetition progressed and peaked around 160 ms following the visual stimulus. The firing modulation for the repetitive stimulus did not develop as great as missing condition when monkeys attempted to detect the change in stimulus color (deviant condition), although the animals were equally required to make a saccade to the visible target. We also found that electrical stimulation delivered to the recording sites promoted the detection of stimulus omission but not the detection of stimulus change. These results suggest that neuronal activity in the caudate nucleus might be relevant to periodic motor preparation with strong enhancement by temporal prediction and may be causally linked with the detection of stimulus omission.
Entrained neuronal activity in the caudate nucleus
Most (88%) caudate neurons with periodic activity exhibited a strong burst of activity around the time of saccades, suggesting that they could somehow play a role in eye movement generation. In support of this, the magnitude of periodic activity in one fifth of individual neurons as well as in the population of neurons altered depending on saccade direction (Figure 3C). It has been widely accepted that an increase of neuronal firing in the caudate nucleus results in a reduction of activity in the substantia nigra, leading to disinhibition of neurons in the superior colliculus which facilitates saccade generation (Hikosaka et al., 2000; Shires et al., 2010). In fact, electrical stimulation delivered to the caudate nucleus has been shown to evoke contraversive saccades with short latency (typically < 150 ms) (Kitama et al., 1991; Yamamoto et al., 2012). In this study, however, electrical microstimulation applied to the recording sites failed to elicit immediate saccades but instead reduced the latency of targeting saccades in both directions. Given that the stimulation parameters in our study was comparable or even stronger than those in the previous studies, the differential stimulation effects might be due to the difference in stimulation sites within the caudate nucleus (i.e. more anterior sites in this study) or the difference in behavioral context (Watanabe and Munoz, 2013). Furthermore, the effects of electrical stimulation in many sites were evident only when the animals prepared for saccades in response to the stimulus omission (Figure 7B–D). These results suggest that neurons with periodic activity may not directly participate in the triggering of saccades, although they could be related to saccade preparation. Previous studies demonstrated that neuronal firing in the primary motor cortex (Renoult et al., 2006) as well as the power of gamma-band oscillation in the supplementary motor area (Cadena-Valencia et al., 2018) exhibited periodic modulation in anticipation of the trigger signal for reaching movements. Considering these results together, the temporal prediction of repetitive events might be represented by periodic motor preparation in the cortico-basal ganglia circuitry.
We also found that the periodic activity was much less when monkeys prepared for saccades in response to the changes in stimulus color. Because the repetitive visual stimuli and required movements were identical between the oddball conditions, the different firing modulation was likely attributed to the need for temporal prediction in the missing but not in the deviant conditions. Alternatively, the difference in neuronal activity might come from the fact that there was an explicit cue for the timing of the targeting saccade in the deviant condition, while the animals needed to internally determine movement timing for stimulus absence in the missing condition. In relation to this, previous studies have shown that neuronal firing and stimulation effects in several brain areas are different between self-initiated and triggered movements (Kunimatsu et al., 2018; Kunimatsu and Tanaka, 2012; Maimon and Assad, 2006; Ohmae et al., 2017; Turner and Anderson, 2005; van Donkelaar et al., 1999; Zimnik et al., 2019), while significant preparatory activity can be observed when the timing of the trigger signal is certainly predictable (Romo and Schultz, 1992; Tanaka, 2007).
It is also well documented that neurons in the caudate nucleus modulate firing in association with reward (Kawagoe et al., 1998; Lau and Glimcher, 2007; Lauwereyns et al., 2002; Schultz, 2016). However, in this study, monkeys obtained an equal amount of reward for every successful trial. These results indicate that the differential modulation of periodic activity between the conditions unlikely reflected reward information. Nevertheless, the activity of these neurons as well as behavioral parameters could be altered by systematic changes in the reward schedule. For example, the gradual rise of neuronal activity during stimulus repetition (Figure 3D), which likely reflected temporal expectation of the stimulus omission in each trial (Uematsu et al., 2017), might be scaled by the amount of reward. This possibility is to be tested in future studies.
Comparison of periodic activity between caudate and cerebellum
Several lines of evidence suggest that different time intervals might be processed by different groups of neurons (Hayashi et al., 2015; Heron et al., 2012). In support of this hypothesis, neurons in several areas in the cerebral cortex have been shown to exhibit tuned representation of specific intervals during rhythmic movements (Bartolo et al., 2014; Hayashi et al., 2015; Heron et al., 2012; Merchant et al., 2011). We also found in this study that a minority of neurons in the caudate nucleus showed a tuned representation for specific time intervals (200–400 ms, Figure 4B,D), while the majority of neurons exhibited monotonical increase of firing modulation as a function of ISI. In contrast, tuned representation for short ISIs was not found in the cerebellar dentate nucleus in the previous study (Ohmae et al., 2013). These results suggest that the duration tuning might only be common in the cortico-basal ganglia pathways but not in the cortico-cerebellar pathways, although alternative possibilities still remain. For example, we could find tuned representation in the cerebellum if we tested for a wider range of intervals than in the previous study (100–600 ms), or if we exhaustively searched for relevant neurons in the other cerebellar nuclei.
Another line of evidence suggests a scalable neuronal representation of interval timing. When monitoring a single interval, the time courses of neuronal activity in the cerebral cortex and the striatum are temporally scaled according to the duration of the measured interval (Kunimatsu et al., 2018; Mello et al., 2015; Wang et al., 2018; Xu et al., 2014). Alteration in the speed of neuronal processing in the population of neurons could be achieved by changing the initial state or the overall level of excitatory input to the recurrent network (Murray and Escola, 2017; Suzuki and Tanaka, 2019; Wang et al., 2018). However, the caudate neurons found in the present study significantly altered the magnitude of firing modulation for different ISIs (Figure 4), suggesting that the temporal information processing for periodic events might differ from the scaling representation for single-event timing. Similar to neuronal firing in the caudate and the cerebellar nucleus, temporally specific gain modulation has also been reported in the beta power in the sensorimotor cortices and the neural coherence through the cerebello-cortical pathways during passive listening to isochronous auditory rhythms (Fujioka et al., 2012). The temporally specific gain modulation for periodic timing may be an essential framework to understand neural mechanisms of rhythm perception.
Another interesting feature was the different time courses of neuronal activity between the caudate and the cerebellum. Neurons in the caudate nucleus elevated activity for each repetitive stimulus, while those in the cerebellar dentate nucleus reduced activity that gradually resumed and peaked around the time of the next stimulus. When we attempted to decode the timing of each next stimulus from the time course of population activity, the temporal prediction was better for the cerebellum than the caudate nucleus (Figure 5D). This was because the duration of transient decrements of activity in the cerebellar nucleus was highly dependent on the ISI, while that of transient increases of activity in the caudate nucleus was not (Figure 5A,C).
We also found that neuronal correlates of trial-by-trial variation of saccade latency emerged at different timings in these subcortical structures. When the data were aligned with saccades, the trial-by-trial variation disappeared early in the cerebellum but persisted late in the caudate (Figure 6D). When the same sets of data were aligned with stimulus omission, the stochastic variation in the cerebellum started well before but that in the caudate followed the stimulus omission (Figure 6B). Given that the reaction time in our behavioral paradigm depends both on the latencies of omission detection and saccade generation, the different timing of stochastic variation may indicate distinct roles of these subcortical structures; the cerebellum might be responsible for the detection of stimulus omission, while the caudate nucleus might contribute to periodic saccade preparation. Because our behavioral paradigm requires both sensory and motor processing, it is difficult to dissociate these components in neuronal activity. However, close comparisons of directionality and time course of neuronal activity suggest that temporal prediction in the caudate nucleus might be represented in motor rather than sensory domain. Similarly, a recent study has shown that the temporal prediction of alternating imaginary targets recruits gamma-bursts in the supplementary motor area, which appears to reflect periodic motor preparation for reaching (Cadena-Valencia et al., 2018).
In the present study, we explored signals in the caudate nucleus because our behavioral paradigm required eye movements and because the striatum has been shown to play a role in timing. However, the signals in two other nuclei in the basal ganglia may be also worth exploring during the task. For comparison with the deep cerebellar nucleus, neuronal signals in the output node of the basal ganglia, such as the substantia nigra, need to be clarified in future study. Exploring neuronal signals in the putamen is also important because previous studies suggest its role in timing, especially when somatic movements are involved (Bartolo et al., 2014; Rao et al., 1997).
In summary, we found that neurons in the caudate nucleus exhibited periodic increases of activity in response to isochronous repetitive visual stimulus. The magnitude of activity depended both on the number of repetitions and the ISI, similar to the activity in the cerebellar dentate nucleus reported previously (Ohmae et al., 2013; Uematsu et al., 2017). However, unlike neurons in the cerebellum, the duration of firing modulation for each stimulus was almost constant in the caudate nucleus, making it difficult to decode the timing of each next stimulus from the population activity of striatal neurons. In addition, the neuronal correlates of stochastic variations of saccade timing started earlier in the cerebellum than the striatum, suggesting that they might be involved in the temporal prediction of stimulus occurrence and periodic motor preparation, respectively. In future studies, dissociation of sensory from motor components of periodic activity is needed to elucidate different contributions of these subcortical structures.
Materials and methods
Animal preparation
Request a detailed protocolThree Japanese monkeys (Macaca fuscata; one female and two males, monkeys G, H and L; 6.0–7.6 kg) were used. All experimental protocols were evaluated and approved by the Hokkaido University Animal Care and Use Committee. The basic surgical procedures of animal preparation were identical to those described previously (Tanaka, 2007). Briefly, the animals were implanted with a pair of head holders and an eye coil under general isoflurane anesthesia in separate surgeries. Analgesics were administered during and a few days following each surgery. After full recovery from the surgery, the animals were trained in the oddball detection task (see below) for several months. Then, a recording cylinder was implanted over a trephined hole for electrode penetration targeting the striatum under the same surgical condition. The location of the cylinder was determined based on stereotaxic coordinates and the magnetic resonance (MR) images taken before the surgery. For monkeys G and L, the cylinder was tilted in the coronal plane to allow for electrode penetration roughly perpendicular to the internal capsule (40° off-vertical, centered at AC+3). For monkey H, the cylinder was installed vertically over both hemispheres (AC+3). Antibiotics were administered during the course of the experiments as necessary.
Visual stimuli and behavioral tasks
Request a detailed protocolAnimals were placed in a darkened booth during the experiments. Visual stimuli were presented on either a 24-inch cathode ray tube monitor (GDM-FW900, Sony; 64 × 44° of visual angle; 60 Hz) or a 27-inch liquid crystal display monitor (XL2720-B, BenQ; 73 × 46°; 144 Hz). Stimulus presentation and data acquisition were controlled by the TEMPO system (Reflective Computing). Five different visual stimuli were presented during the experiments. Red and green filled squares (0.5°) served as the fixation point. A gray-filled square (1.0°) was used as a saccade target. A large (4.0°) white unfilled square surrounding the fixation point was presented repeatedly in each trial, and the color of the square suddenly altered (red filled) in the deviant oddball trials (see below).
We used two versions of the oddball detection task, in which animals were required to detect the unexpected omission (missing condition) or the change in color and filling (deviant condition) of the repetitive visual stimuli. Each trial started with central fixation, and the color of the fixation point indicated the trial type (red and green for the missing and deviant conditions, respectively). As the animals maintained fixation for 2000 ms, a saccade target appeared either 16° left or right of the fixation point. After a random 100–400 ms, a brief (35 ms) visual stimulus was repeatedly presented around the fixation point at a fixed inter-stimulus interval (ISI) of 100, 200, 300, 400 or 600 ms (only 400 ms for the deviant condition). The stimulus sequence lasted for a random 2000–4800 ms (3000–4800 ms for trials with a 600 ms ISI) before the occurrence of stimulus omission or color deviation (we refer to these events as ‘oddball’). The central fixation point remained visible until the end of each trial. Animals were trained to detect the oddball and make a saccade to the target within 600 ms. It should be noted that the animals needed to predict the timing of every upcoming stimulus to detect the stimulus omission but not for the detection of stimulus deviation, at least for ISIs longer than several hundreds of milliseconds (Ohmae and Tanaka, 2016). Because the trial type was explicitly denoted by the color of the fixation point, the animals were likely to attend either to the stimulus omission or deviation during the stimulus repetition. Correct response was reinforced by a liquid reward delivered at the end of each trial.
Physiological procedures
Request a detailed protocolA single tungsten microelectrode (Alfa Omega Engineering) was lowered into the anterior part of the caudate nucleus through the 23-gauge stainless steel tube that was guided by the grid system (Crist Instrument Co.) attached to the cylinder. The electrode was advanced using a micromanipulator (MO-972A; Narishige) in 10 μm steps. Neuronal signals were amplified (Model 1800; A-M Systems), filtered (Model 3625; NF Co.), and monitored online using oscilloscopes and an audio device. We could easily locate neurons in the caudate nucleus based on the depth of electrodes, relatively wide action potentials, and their low baseline firing rate. Once we encountered task-related neurons, we attempted to isolate the waveform of single neurons online, using software with real-time template-matching algorithms (ASD; Alpha Omega Engineering). In this study, we did not include data from putative tonically active cholinergic interneurons which are known to exhibit characteristic firing pattern and wider action potentials (Aosaki et al., 1995). Neurons included for the analysis had relatively low baseline firing rate and were considered as medium-spiny projection neuron and some GABAergic interneurons. The spike timing data were saved in files along with the data of eye position and visual stimuli during experiments. We collected the data for the trials when monkeys remained fixation > 1500 ms from the first stimulus. Eye position data were directly obtained from the eye coil device (MEL-25; Enzaishi Kogyo) and were sampled at 1 kHz with 16-bit resolution. The data were later analyzed off-line using MATLAB (Mathworks). During recording sessions (n = 84), animals sometimes made an early erroneous targeting saccade (11.3 ± 9.3% and 2.7 ± 3.6% for the missing and deviant conditions, respectively) and rarely failed to detect the oddball (2.2 ± 3.5% and 0.9 ± 2.4%). We considered only correct trials for the quantitative analysis.
After the termination of the recording experiments, we examined the effects of electrical microstimulation applied to the recording sites in two monkeys (G and L). Stimulation pulses (50 μA, 200 μs biphasic) were generated by using a stimulator connected with an isolator unit (SEN-3401 and SS-203J; Nihon Kohden). Electrical stimulation was delivered as a train of 100 Hz pulses during 200 ms just before the oddball. Current intensity was monitored by measuring the voltage across the 1 kΩ resistor placed in series with the electrode.
Data analysis
Request a detailed protocolWhen we examined the effects of saccade direction and task condition (Figure 3), the magnitude of neuronal activity was assessed by direct spike count during the ISI just before the oddball. The maximal neuronal activity was defined as the mean firing rate for 100 ms during the period. For the analyses in Figure 4, quantification of neuronal activity was made based on the modulation of spike density, which was obtained by convolving the millisecond-to-millisecond probability of spike occurrence with Gaussians (σ = 30 ms). We also used a smaller σ (15 ms) to verify the absence of high-frequency neuronal oscillation for short ISIs (see the text associated with Figure 4). The magnitude of firing modulation for different ISIs was defined as the difference between the maximum and minimum values of spike density during a specific period in the trial.
We compared the time courses of neuronal activity between neurons in the caudate nucleus and the cerebellar dentate nucleus (Figures 5 and 6). When we estimated how accurately neuronal activities could predict the next stimulus timing (Figure 5A and D), we searched for the %threshold that minimized the prediction error of stimulus timing in trials with longer ISIs (300–600 ms). When we measured the timing of neuronal correlates of trial-by-trial latency variation (Figure 6), we divided the data for each neuron into six groups according to saccade latency and performed one-way ANOVA for every millisecond to detect the diverging point of spike density profiles. Saccade latency was defined as the time from oddball (either omission or color change) to saccade initiation, which was detected when angular eye velocity exceeded 60°/s immediately after the oddball occurrence. The time when the traces of population activities for the six latency groups consistently differed for > 100 ms was taken as the start and end of the stochastic variation. For both analyses on the population activity, statistical significance was evaluated using the bootstrap procedures (1000 resampling of individual neurons).
For comparison between conditions, Wilcoxon’s rank-sum test and paired t-test were used, respectively, for individual neuronal activity and the population activity. Effects of electrical microstimulation were also evaluated using two-way ANOVA (Figure 7C). Further details of statistical tests are reported in the relevant text.
Data availability
Source data files (in Matlab's MAT format) containing numerical data sufficient to reconstruct each main figure have been provided.
References
-
Temporal and spatial characteristics of tonically active neurons of the primate's striatumJournal of Neurophysiology 73:1234–1252.https://doi.org/10.1152/jn.1995.73.3.1234
-
Cerebro-cerebellar interactions underlying temporal information processingJournal of Cognitive Neuroscience 22:2913–2925.https://doi.org/10.1162/jocn.2010.21429
-
Time sharing in rats: a peak-interval procedure with gaps and distractersBehavioural Processes 71:107–115.https://doi.org/10.1016/j.beproc.2005.11.017
-
Neuroanatomical and neurochemical substrates of timingNeuropsychopharmacology 36:3–25.https://doi.org/10.1038/npp.2010.113
-
Striatal dopamine and the temporal control of behaviorBehavioural Brain Research 356:375–379.https://doi.org/10.1016/j.bbr.2018.08.030
-
Internalized timing of isochronous sounds is represented in neuromagnetic β oscillationsJournal of Neuroscience 32:1791–1802.https://doi.org/10.1523/JNEUROSCI.4107-11.2012
-
Rhythm and beat perception in motor Areas of the brainJournal of Cognitive Neuroscience 19:893–906.https://doi.org/10.1162/jocn.2007.19.5.893
-
Duration channels mediate human time perceptionProceedings of the Royal Society B: Biological Sciences 279:690–698.https://doi.org/10.1098/rspb.2011.1131
-
Role of the basal ganglia in the control of purposive saccadic eye movementsPhysiological Reviews 80:953–978.https://doi.org/10.1152/physrev.2000.80.3.953
-
Expectation of reward modulates cognitive signals in the basal gangliaNature Neuroscience 1:411–416.https://doi.org/10.1038/1625
-
Alteration of the timing of self-initiated but not reactive saccades by electrical stimulation in the supplementary eye fieldEuropean Journal of Neuroscience 36:3258–3268.https://doi.org/10.1111/j.1460-9568.2012.08242.x
-
Action and outcome encoding in the primate caudate nucleusJournal of Neuroscience 27:14502–14514.https://doi.org/10.1523/JNEUROSCI.3060-07.2007
-
A cognitive signal for the proactive timing of action in macaque LIPNature Neuroscience 9:948–955.https://doi.org/10.1038/nn1716
-
A scalable population code for time in the striatumCurrent Biology 25:1113–1122.https://doi.org/10.1016/j.cub.2015.02.036
-
Neural basis of the perception and estimation of timeAnnual Review of Neuroscience 36:313–336.https://doi.org/10.1146/annurev-neuro-062012-170349
-
Temporally specific sensory signals for the detection of stimulus omission in the primate deep cerebellar nucleiThe Journal of Neuroscience 33:15432–15441.https://doi.org/10.1523/JNEUROSCI.1698-13.2013
-
Cerebellar roles in Self-Timing for sub- and Supra-Second intervalsThe Journal of Neuroscience 37:3511–3522.https://doi.org/10.1523/JNEUROSCI.2221-16.2017
-
Two different mechanisms for the detection of stimulus omissionScientific Reports 6:20615.https://doi.org/10.1038/srep20615
-
Distributed neural systems underlying the timing of movementsThe Journal of Neuroscience 17:5528–5535.https://doi.org/10.1523/JNEUROSCI.17-14-05528.1997
-
Time is a rubberband: neuronal activity in monkey motor cortex in relation to time estimationEuropean Journal of Neuroscience 23:3098–3108.https://doi.org/10.1111/j.1460-9568.2006.04824.x
-
The Role of Posterior Parietal Cortex in Beat-based Timing Perception: A Continuous Theta Burst Stimulation StudyJournal of Cognitive Neuroscience 30:634–643.https://doi.org/10.1162/jocn_a_01237
-
Temporal production signals in parietal cortexPLOS Biology 10:e1001413.https://doi.org/10.1371/journal.pbio.1001413
-
Reward functions of the basal gangliaJournal of Neural Transmission 123:679–693.https://doi.org/10.1007/s00702-016-1510-0
-
Shedding new light on the role of the basal ganglia-superior colliculus pathway in eye movementsCurrent Opinion in Neurobiology 20:717–725.https://doi.org/10.1016/j.conb.2010.08.008
-
Cognitive signals in the primate motor thalamus predict saccade timingJournal of Neuroscience 27:12109–12118.https://doi.org/10.1523/JNEUROSCI.1873-07.2007
-
A unified model of time perception accounts for duration-based and beat-based timing mechanismsFrontiers in Integrative Neuroscience 5:90.https://doi.org/10.3389/fnint.2011.00090
-
Distinct neural substrates of duration-based and beat-based auditory timingJournal of Neuroscience 31:3805–3812.https://doi.org/10.1523/JNEUROSCI.5561-10.2011
-
Brain Bases of Working Memory for Time Intervals in Rhythmic SequencesFrontiers in Neuroscience 10:239.https://doi.org/10.3389/fnins.2016.00239
-
Context-dependent modulation of movement-related discharge in the primate globus pallidusJournal of Neuroscience 25:2965–2976.https://doi.org/10.1523/JNEUROSCI.4036-04.2005
-
Flexible timing by temporal scaling of cortical responsesNature Neuroscience 21:102–110.https://doi.org/10.1038/s41593-017-0028-6
-
Effects of caudate microstimulation on spontaneous and purposive saccadesJournal of Neurophysiology 110:334–343.https://doi.org/10.1152/jn.00046.2013
-
What and where information in the caudate tail guides saccades to visual objectsJournal of Neuroscience 32:11005–11016.https://doi.org/10.1523/JNEUROSCI.0828-12.2012
Article and author information
Author details
Funding
Ministry of Education, Culture, Sports, Science, and Technology (17H03539)
- Masaki Tanaka
Takeda Science Foundation
- Masaki Tanaka
Japan Society for the Promotion of Science
- Masashi Kameda
Ministry of Education, Culture, Sports, Science, and Technology (18H04928)
- Masaki Tanaka
Ministry of Education, Culture, Sports, Science, and Technology (18H05523)
- Masaki Tanaka
Ministry of Education, Culture, Sports, Science, and Technology (18J20197)
- Masaki Tanaka
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
The authors thank T Mori, A Hironaka, and H Miyaguchi for their assistance with animal care and surgery; M Suzuki and M Saito for administrative help; M Takei and M Kusuzaki at the Research Institute for Electronic Science for manufacturing some equipment; and all lab members for comments and discussions. This work was supported partly by grants from the Ministry of Education, Culture, Sports, Science and Technology of Japan (17H03539, 18H04928, 18H05523, 18J20197) and the Takeda Science Foundation. MK received a fellowship from the Japan Society for the Promotion of Science. Animals were provided by the National Bio-Resource Project.
Ethics
Animal experimentation: All experimental protocols were evaluated and approved by the Hokkaido University Animal Care and Use Committee (#18-0003).
Copyright
© 2019, Kameda et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,725
- views
-
- 261
- downloads
-
- 23
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Computational and Systems Biology
- Neuroscience
Diffusional kurtosis imaging (DKI) is a methodology for measuring the extent of non-Gaussian diffusion in biological tissue, which has shown great promise in clinical diagnosis, treatment planning, and monitoring of many neurological diseases and disorders. However, robust, fast, and accurate estimation of kurtosis from clinically feasible data acquisitions remains a challenge. In this study, we first outline a new accurate approach of estimating mean kurtosis via the sub-diffusion mathematical framework. Crucially, this extension of the conventional DKI overcomes the limitation on the maximum b-value of the latter. Kurtosis and diffusivity can now be simply computed as functions of the sub-diffusion model parameters. Second, we propose a new fast and robust fitting procedure to estimate the sub-diffusion model parameters using two diffusion times without increasing acquisition time as for the conventional DKI. Third, our sub-diffusion-based kurtosis mapping method is evaluated using both simulations and the Connectome 1.0 human brain data. Exquisite tissue contrast is achieved even when the diffusion encoded data is collected in only minutes. In summary, our findings suggest robust, fast, and accurate estimation of mean kurtosis can be realised within a clinically feasible diffusion-weighted magnetic resonance imaging data acquisition time.
-
- Neuroscience
The retina transforms patterns of light into visual feature representations supporting behaviour. These representations are distributed across various types of retinal ganglion cells (RGCs), whose spatial and temporal tuning properties have been studied extensively in many model organisms, including the mouse. However, it has been difficult to link the potentially nonlinear retinal transformations of natural visual inputs to specific ethological purposes. Here, we discover a nonlinear selectivity to chromatic contrast in an RGC type that allows the detection of changes in visual context. We trained a convolutional neural network (CNN) model on large-scale functional recordings of RGC responses to natural mouse movies, and then used this model to search in silico for stimuli that maximally excite distinct types of RGCs. This procedure predicted centre colour opponency in transient suppressed-by-contrast (tSbC) RGCs, a cell type whose function is being debated. We confirmed experimentally that these cells indeed responded very selectively to Green-OFF, UV-ON contrasts. This type of chromatic contrast was characteristic of transitions from ground to sky in the visual scene, as might be elicited by head or eye movements across the horizon. Because tSbC cells performed best among all RGC types at reliably detecting these transitions, we suggest a role for this RGC type in providing contextual information (i.e. sky or ground) necessary for the selection of appropriate behavioural responses to other stimuli, such as looming objects. Our work showcases how a combination of experiments with natural stimuli and computational modelling allows discovering novel types of stimulus selectivity and identifying their potential ethological relevance.