Neuronal sequences during theta rely on behaviordependent spatial maps
Abstract
Navigation through space involves learning and representing relationships between past, current, and future locations. In mammals, this might rely on the hippocampal theta phase code, where in each cycle of the theta oscillation, spatial representations provided by neuronal sequences start behind the animal’s true location and then sweep forward. However, the exact relationship between theta phase, represented position and true location remains unclear and even paradoxical. Here, we formalize previous notions of ‘spatial’ or ‘temporal’ theta sweeps that have appeared in the literature. We analyze singlecell and population variables in unit recordings from rat CA1 place cells and compare them to model simulations based on each of these schemes. We show that neither spatial nor temporal sweeps quantitatively accounts for how all relevant variables change with running speed. To reconcile these schemes with our observations, we introduce ‘behaviordependent’ sweeps, in which theta sweep length and place field properties, such as size and phase precession, vary across the environment depending on the running speed characteristic of each location. These behaviordependent spatial maps provide a structured heterogeneity that is essential for understanding the hippocampal code.
Introduction
Hippocampal place cells elevate their firing rates within circumscribed regions in the environment (‘place fields’) (O'Keefe and Dostrovsky, 1971). In addition to this firing rate code, place cells display phase coding relative to the ∼8 Hz theta oscillations of the hippocampal local field potential (LFP) (Vanderwolf, 1969). As animals cross a cell’s place field, the cell fires at progressively earlier phases of the oscillation, a phenomenon known as theta phase precession (O'Keefe and Recce, 1993). At the population level, phase precession yields distinct neuronal sequences that traverse multiple positions within each cycle of the theta oscillation. The first cells to fire typically have place fields centered behind the current position of the animal, followed by cells with place fields centered progressively ahead, generating socalled ‘theta sequences’ (Figure 1—figure supplement 1; Skaggs et al., 1996; Dragoi and Buzsáki, 2006; Foster and Wilson, 2007). Formally, the position $r(t)$ represented by the hippocampal population at time $t$ appears to deviate from the physical location $x(t)$ of the animal, sweeping from past to future positions during each theta cycle (Maurer et al., 2012; Gupta et al., 2012; Muessig et al., 2019; Kay et al., 2020; Zheng et al., 2021). This phenomenon suggests that beyond the representation of the current spatial location of an animal, the hippocampal theta code more generally encompasses representations of past, present, and future events (Dragoi and Buzsáki, 2006; Cei et al., 2014; Terada et al., 2017). In support of this, theta phase precession and theta sequences have been reported to respond to elapsed time (Pastalkova et al., 2008; Shimbo et al., 2021), particular events and behaviors including jumping (LenckSantini et al., 2008), pulling a lever, and sampling an object (Terada et al., 2017; Aronov et al., 2017; Robinson et al., 2017). Phaseprecession and theta sequences have also been observed in brain regions other than the hippocampus (Kim et al., 2012; Hafting et al., 2008; Jones and Wilson, 2005; van der Meer and Redish, 2011; Tingley et al., 2018; Tang et al., 2021). These studies indicate that the theta phase code plays a supporting role in a wide array of cognitive functions, such as sequential learning (Lisman and Idiart, 1995; Skaggs et al., 1996; Reifenstein et al., 2021), prediction (Lisman and Redish, 2009; Kay et al., 2020), and planning (Johnson and Redish, 2007; Erdem and Hasselmo, 2012; Bolding et al., 2020; Bush et al., 2015).
However, for the hippocampal theta phase code to be useful, there must be a consistent relationship between theta phase, represented position $r(t)$, and the animal’s true location $x(t)$. Surprisingly, this relationship has not previously been made explicit. It is often stated interchangeably that activity at certain phases of theta reflect positions ‘behind’ or ‘ahead’ of the animal, or, alternatively, in its ‘past’ or ‘future’, but these statements hint at two fundamentally different coding schemes. The first notion is that different theta phases encode positions at certain distances behind or ahead of the animal’s current location. For example, within each theta cycle, the represented position $r(t)$ could sweep from the position two meters behind the current location to the position two meters ahead. The hippocampus would thus represent positions shifted in space: we therefore refer to this coding scheme as the ‘spatial sweep’ model. The second notion is that the hippocampus represents positions that were or will be reached at some time intervals into the past or future, respectively. For example, $r(t)$ might start in the position that was reached 5 s ago and extend to the position projected 5 s into the future. We call this the ‘temporal sweep’ scheme. Notably, the temporal sweep predicts different distances depending on speed of movement. In such a sweep, walking down a hallway, the prospective position reached in 5 s might be a couple of meters ahead, whereas when driving on the highway that position could be more than a hundred meters away. Thus, in temporal sweeps, the lookbehind and lookahead distances adapt to the speed of travel, which could make for a more efficient code.
In the following, we set out to develop a quantitative description of the hippocampal theta phase code by formalizing the spatial and temporal sweep models and comparing them to experimental results. Intriguingly, different experimental results appear to support different models. One the one hand, the length of theta sweeps has been shown to increase proportionally with running speed (Maurer et al., 2012; Gupta et al., 2012), a result which is consistent with temporal sweeps. On the other hand, place field parameters, such as place field size or the slope of the spikes’ phase vs. position relationship (phase precession slope), do not change with speed (Huxter et al., 2003; Maurer et al., 2012; Schmidt et al., 2009; Geisler et al., 2007), which is consistent with spatial sweeps. To reconcile these apparently contradictory observations, we propose an additional coding scheme: the ‘behaviordependent sweep' based on a behaviordependent spatial map that varies according to the animal’s characteristic running speed at each location. We analyze recordings from rat CA1 place cells and in the same dataset reproduce the paradoxical results from different studies. Notably, we find that place fields are larger and have shallower phase precession slopes at locations where animals typically run faster, in support of the behaviordependent sweep model. Finally, we compare simulated data generated from the three models based on experimentally measured trajectories and theta oscillations, and confirm that the behaviordependent sweep uniquely accounts for the combination of experimental findings at the population and singlecell levels.
Results
Formalizing the theta phase code
We first put forward a mathematical framework for quantitatively describing the relationship between the current location of the animal, $x(t)$, and the position represented in the hippocampus at each moment in time, $r(t)$. While this framework considers the population representation, i.e. neuronal sequences during theta, the primary variable to be explained, it is linked to the activity of single place cells as follows. Each cell is considered to posses a ‘true place field’ (Sanders et al., 2015; Lisman and Grace, 2005), which corresponds to the positions represented by the cell, that is, a cell becomes active when the position represented by the population, $r(t)$, falls within the cell’s true place field. Note that due to the prospective and retrospective aspects of the theta phase code, $r(t)$ reaches behind and ahead of $x(t)$, so a place cell will also fire when the animal is located ahead or behind its true place field. This results in a measured place field that is larger than the underlying true place field. To stay consistent with the literature on place cells, in the following, when we refer to ‘place field’, we mean the measured place field.
First, we consider the spatial sweep scheme where the theta phase of a place cell’s spike reflects the distance traveled through the place field (Huxter et al., 2003; Geisler et al., 2007; Cei et al., 2014) or equivalently, some measure of the distance to the field’s preferred position (Jeewajee et al., 2014; Huxter et al., 2008; Drieu and Zugaro, 2019). In a uniform population of such phase coding neurons, the represented position, $r(t)$, sweeps forward within each theta cycle, starting at some distance behind the current location of the animal, $x(t)$, and ending at some distance ahead. We formalize these spatial sweeps by the equation:
where ${d}_{\theta}$, which we call the theta distance, is a parameter that determines the extent of the spatial sweep, $\theta (t)$ is the instantaneous theta phase in degrees, and ${\theta}_{0}$ is the theta phase at which the population represents the actual position of the animal. The value of ${\theta}_{0}$ effectively determines the proportion of the theta cycle that lies behind vs ahead of the animal. We note that none of our results or analyses depends on the particular value of this variable.
At the singlecell level, the spatial sweep model predicts that the phases of a cell’s spikes will advance over a spatial range of ${d}_{\theta}$. Assuming that the phase advances over the whole theta cycle, the slope of spatial phase precession will be given by $m={360}^{\circ}/{d}_{\theta}$ (Equation 13 in Materials and methods). Place field sizes will be given by $s={s}_{0}+{d}_{\theta}$, where s_{0} is the size of the true place field (Equation 14 in Materials and methods). Both phase precession slopes and place field sizes are independent of running speed (Figure 1B), consistent with experimental observations (Huxter et al., 2003; Schmidt et al., 2009; Geisler et al., 2007; Sup. Fig. 1 in Maurer et al., 2012). At the population level, we can define the theta trajectory length as the difference between the maximum and minimum positions that $r(t)$ represents within a theta cycle. To a firstorder approximation, that is, assuming that effects from acceleration and higher order derivatives are negligible, the theta trajectory length is given by $L=vT+{d}_{\theta}$, where $v$ is the running speed, and $T$ is the duration of a theta cycle (Equation 11 in Materials and methods). While the spatial sweep predicts that theta trajectory length increases with running speed, the increase is small since the term $vT$, which represents the change in $x(t)$ due to the animal’s motion during the theta cycle (Figure 1A, see also Figure 1 in Maurer et al., 2012) is smaller than ${d}_{\theta}$ for usual running speeds. Contrary to this prediction, experimental results show that the theta trajectory length is roughly proportional to running speed (Figure 2 in Maurer et al., 2012; Figure 1C in Gupta et al., 2012 for speeds above 5 cm/s).
An alternative to the above is the temporal sweep model, where different phases of theta represent the positions that the animals have reached or will reach at some time interval in the past and future, respectively (see Itskov et al., 2008 for a similar model). More formally,
where ${\tau}_{\theta}$ stands for the extent of the temporal sweep. To a firstorder approximation, we derived for the theta trajectory length $L=({\tau}_{\theta}+T)v$, which is proportional to running speed (Equation 18 in Materials and methods) (Figure 1C). This is almost exactly the result reported by Maurer et al., 2012; Gupta et al., 2012. However, at the singlecell level, the temporal sweep model predicts that place field sizes increase and phase precession slopes become shallower with running speed (Figure 1D) – in clear conflict with the experimental results mentioned above. In particular, to a firstorder approximation, theta phase precesses over the spatial range of $v{\tau}_{\theta}$. Thus, the slope of phase precession is given by $m={360}^{\circ}/(v{\tau}_{\theta})$, which increases hyperbolically with running speed (Equation 19 in Materials and methods). Place field sizes would in turn increase linearly with speed, determined by $s={s}_{0}+v{\tau}_{\theta}$ (Equation 20 in Materials and methods).
These conflicting results could potentially arise from differences in analytical methods (e.g. definition of key parameters, comparisons within versus across cells) or experimental procedures (e.g. task difficulty due to the use of linear vs. circular or complex mazes). If this was the case, spatial or temporal sweeps could adequately describe the theta phase code, perhaps switching dynamically depending on the circumstances. Therefore, in the subsequent section, we attempt to reproduce and reexamine these different observations in the same dataset.
However, we also propose an additional scheme that, as it turns out, can potentially reconcile these findings. This third option combines the spatial sweep’s constant place field sizes and phase precession slopes with the temporal sweep’s increase in theta trajectory length with running speed. The former property requires that sweeps are independent of running speed whereas the latter requires that they depend on it. While at first this appears to be a plain contradiction, a resolution is offered if sweeps are made independent of the animal’s instantaneous running speed $v(t)$, but dependent on their ‘characteristic running speed’ at each position $\overline{v}(x(t))$. This characteristic speed could be calculated as as a moving average (e.g. cumulative, exponentially weighted, etc.) as long as it evolves sufficiently slowly, so that it can filter out variation in $v(t)$ from run to run. We refer to this model as the behaviordependent sweep:
According to this model, at different phases of theta, the place cell population represents the positions that would have been or would be reached at certain time intervals in the past or future, like in the temporal sweep, but under the assumption that the animal runs at the characteristic speed through each location, rather than at the instantaneous running speed (Figure 2A,B). To avoid confusion in the following, when we use the terms ‘speed’ or ‘running speed’ without further qualifiers, we always refer to the instantaneous running speed. In the behavioraldependent scheme, to a firstorder approximation the length of a theta trajectory is given by $L=vT+\overline{v}(x(t)){\tau}_{\theta}$ (Equation 22 in Materials and methods). Thus, the more stereotyped the behavior of the animal is (i.e. $v(t)\approx \overline{v}(x(t))$), the more the behaviordependent sweep model would share the temporal sweep model’s feature that theta trajectory length increases proportionally with running speed. At the same time, the behaviordependent sweep model is formally equivalent to the spatial sweep model (Equation 1) with a theta distance that depends on the characteristic running speed at each position:
Therefore, place fields, being fixed in space, remain unaltered by the instantaneous running speed, similar to in the spatial sweep model (Figure 2B). However, in regions of higher characteristic running speed, place fields are characterized by larger sizes and shallower phase precession slopes. Specifically, the slope of phase precession is given by $m={360}^{\circ}/(\overline{v}(x(t)){\tau}_{\theta})$ (Equation 23 in Materials and methods); and the place field size would be $s={s}_{0}+\overline{v}(x(t)){\tau}_{\theta}$ (Equation 24 in Materials and methods).
Theta trajectory lengths increase proportionally with running speed
To better evaluate the conflicting observations across the aforementioned studies, we next sought to reproduce their separate observations on the effect of running speed on populationlevel theta trajectories and singleneuron place field parameters within the same dataset and compare these against predictions from the three theta phase coding models.
To this end, we reanalyzed publicly available simultaneous single unit recordings from CA1 of 6 rats running on linear tracks for water rewards at both ends. Three of the sessions (Mizuseki et al., 2013) were from tracks that were familiar to the animal while the remaining three Grosmark et al., 2016 were from novel tracks. To ensure that spatial representations and theta phase precession were stable for the entirety of the periods under examination, we discarded the first 5 min of the recording on the novel track, allowing sufficient time for hippocampal place fields and phase precession to have stabilized (Frank et al., 2004; Cheng and Frank, 2008).
First, we examined the effect of running speed on theta trajectory length. We performed a Bayesian decoding of positions from the ensemble neuronal firing (Zhang et al., 1998; Davidson et al., 2009) within each theta cycle in overlapping 90° bins with a step size of 30°. Figure 3A shows examples of individual decoded theta trajectories belonging to periods of slow (below 20 cm/s) and fast (above 40 cm/s) running in a sample experimental session. The lengths of the trajectories were measured from bestfit lines. Despite the high level of variability, it was clear in the individual rats’ averages and in the grand average across animals that the trajectory lengths increased roughly proportionately to running speed (Figure 3B). We saw the same effect when we averaged the decoded position probabilities over all cycles belonging to the same speed bin before fitting a line and calculating the theta trajectory length (Figure 3C,D). For this analysis, we defined seven 20 cm/s wide overlapping speed bins starting at 2 cm/s in increments of 10 cm/s. Thus, our results on the dependence of theta trajectory lengths on running speed were consistent with those of Maurer et al., 2012 and Gupta et al., 2012, and appear to be supportive of the temporal sweep model. Alternatively, the results could be accounted for by the behaviordependent sweep model, if running behavior was sufficiently stereotyped across the track, a question to which we return below.
Individual place field sizes are independent of running speed
We next analyzed the effect of running speed on place field size. First, we calculated firing rates separately for periods with different running speeds using the same speed bins as before. As the number of trials in each spatial bin at a given running speeds were limited, we calculated place field sizes only when a field was sufficiently well sampled at a given speed (see Materials and methods). Visual inspection revealed that individual fields tended to maintain similar sizes regardless of running speed (Figure 4A). To quantify the relationship more systematically, we performed linear regression on place field size vs. speed for each field and examined the slopes of the best fitting lines (Figure 4A, bottom row). Figure 4B shows that for each rat, slopes variably took on both negative and positive values, with no clear bias towards either ($p>0.3$, Wilcoxon signedrank test). Thus, we found no evidence for a systematic increase in place field size with running speed.
Intriguingly, however, when we combined all place field sizes corresponding to each speed bin, we uncovered a linear relationship between placefield size and speed (Figure 4C; $p<0.02$ for the association between place field sizes combined across fields and speed bin for five of the six animals, Kendall’s $\tau $ test). This increase in place field sizes is consistent with the temporal sweep model, whereas the lack of withinfield changes mentioned above supports spatial sweeps. Both findings, however, can be consistent with the behaviordependent sweep model provided that place fields are larger in track areas characterized by faster running (Figure 2). We examine this question below.
Phase precession slopes of individual place fields are independent of running speed
Similarly conflicting results were obtained when analyzing phase precession. We calculated phase precession slopes at each running speed bin for each field separately by pooling spikes across different field traversals according to the instantaneous running speed of the animal when the spikes were emitted. Figure 5A shows the results of this analysis for three example place fields. To ensure that we capture and adequately describe steep phase precession in small place fields (e.g. Figure 1D), we devised a method using orthogonal regression (see Materials and methods). An analysis of all place fields (Figure 5B) revealed that phase precession slopes of individual fields did not change systematically with running speed for any of the six animals ($p>0.05$, Wilcoxon signedrank test). Remarkably, however, when we combined phase precession slopes across different fields for each speed bin, the combined slopes at slower speeds tended to be steeper than at faster speeds (Figure 5C; $p<0.006$ for the association between phase precession slopes combined across fields and speed for five of the six animals, Kendall’s $\tau $ test).
In this analysis, when rats accelerate or decelerate through a field, different parts of the field’s phase precession cloud are sampled at different running speeds. This can be seen in the first field (no. 4) in Figure 5A. Since the rat was accelerating through the field, spikes emitted at lower and higher speeds appeared more frequently at the beginning and end of the field, respectively. Phase precession clouds have some curvature (Souza and Tort, 2017; Yamaguchi et al., 2002), so sampling different parts of the field under acceleration or deceleration could lead to a spurious relationship between speed and phase precession slope. To avoid this confound, we further analyzed phase precession slopes in single passes through a field (Schmidt et al., 2009). We only included passes that occurred at approximately constant speed, that is, passes with a coefficient of variation in speed lower than 0.3. Figure 5D shows examples of individual passes through two fields, sorted by running speed. Note how, notwithstanding variability in the slopes, there is no systematic change with running speed, even though the speeds nearly double. There was no significant relationship between phase precession slope and speed for individual fields in any of the three animals with sufficient data for this analysis, that is, more than 10 fields (Figure 5E). Yet again, when we combined phase precession slopes across place fields, we saw that they become shallower with speed ($p<0.04$ for five of the six animals, Kendall’s $\tau $ test; Figure 5F). Hence, the results from single pass phase precession analysis confirm those obtained from the sessionwide analysis.
Theta trajectories and place field parameters vary according to characteristic running speed across the track
We have shown that theta trajectory lengths and place field sizes increase with running speed, and phase precession slopes become shallower, when combining datapoints from different positions along the track or place fields (Figure 3B,D; Figure 4C and Figure 5C,F), but not when fields are analyzed individually (Figure 4B and Figure 5B,E). While these combined findings appear counterintuitive, the behaviordependent sweep model offers a simple explanation: short theta trajectories and small place field sizes could occur at locations where animals tend to run slowly, contributing to the lowspeed averages, while long theta trajectories and large place field sizes could occur where animals tend to run fast, contributing to the fastspeed averages (Figure 6A). For this explanation to be valid, the following prerequisites must hold: (1) running speeds should differ systematically along the track such that (2) place fields in different positions contribute differently to the low and highspeed analyses; and (3) theta trajectory lengths, place field sizes and the inverse of phase precession slopes depend linearly on the characteristic speed across different locations (Equation 2224).
To test the first prerequisite, we calculated the characteristic speed for each spatial bin along the track. This was defined as the mean speed after discarding trials where the animal stopped running on the track (speeds < 10 cm/s), to prevent atypical pauses from distorting the mean values. The upper panel in Figure 6A shows the characteristic speed for rightward runs in one sample experimental session and Figure 6B shows averages across running directions and sessions. All animals showed similar asymmetric inverted Ushape relationships between characteristic speed and position along the track. Next, as required by the second prerequisite, we confirmed that running speeds at each position were clustered around the characteristic running speed (Figure 6C). We also observed inverted Ushape relationships between position along the track, and theta trajectory lengths and place field sizes (Figure 6D,E). Because theta trajectory lengths and place field sizes should be linearly related to the inverse of phase precession slopes (Equation 2224), we plotted this variable along the track and found the corresponding Ushape distribution (Figure 6F). Finally, in support of the third prerequisite, we found that theta trajectory lengths and place field sizes increased, and inverse phase precession slopes decreased, roughly in proportion to characteristic speed for up to at least 60 cm/s, which encompassed most of the data (Figure 6G–I). Some flattening of the curves appeared after 60 cm/s, but this was less apparent when considering each animal individually (Figure 6—figure supplement 1 and Figure 6—figure supplement 2), suggesting that the flattening is at least partly caused by combining points from clouds with different slopes and speed ranges.
Since theta trajectory lengths, place field sizes and inverse phase precession slopes all displayed matching distributions, we tested their mutual relationships. We found that the three of them displayed strikingly linear relationships to one another (Figure 6—figure supplement 3), underscoring the intimate relationships that hold between these systematically interrelated measures of place cell activity. It is also worth noting that theta trajectory length correlates slightly better with characteristic running speed than with either mean place field size or mean inverse phase precession slope at the locations where the trajectories occurred (R = 0.35 vs 0.29 for the latter two; Figure 6—figure supplement 3B,C).
Since speed and location on the track are correlated, we also tested whether place field parameters could be best explained by distance to the nearest end of the track, rather than by characteristic running speed. We performed a likelihood ratio test that indicated that both variables contributed significantly to the prediction of place field sizes and inverse phase precession slopes ($p<{10}^{6}$). However, the fraction of the total variance accounted for differed substantially between the two variables. A model combining both variables could account for 29% and 28% of the variance in place field sizes and inverse phase precession slopes, respectively. Out of this, characteristic running speed uniquely accounted for 13% and 11% of the variance, whereas distance to the border uniquely accounted for 3% and 7%, respectively. Therefore we conclude that although both variables are related and contribute to determining place field parameters, characteristic running speed plays a more prominent role.
Taken together, these findings account for and reconcile the speeddependence of average theta trajectory lengths, place field sizes and phase precession slopes with the speedindependence of individual fields, and satisfy the prerequisites of the behaviordependent sweep model.
The behaviordependent sweep model accounts best for all of these experimental results
Our analyses so far suggest that neither the spatial nor the temporal sweep models can account for all of the experimental observations, whereas the behaviordependent sweep appears consistent with all of them. However, these analyses might involve too many simplifying assumptions about how running speeds, theta coupling and place field parameters are codistributed. To address this issue, we developed generative models based on the experimental LFP and animal tracking data to generate spikes according to each of the different theta phase coding schemes. The parameters in each model were adjusted to account for as many features in the experimental data as possible. We analyzed the effect of instantaneous running speed on theta trajectory lengths, place field sizes and phase precession slopes in each of the simulated datasets alongside the experimental data (Figure 7). This approach further allowed us to examine whether any of the models could provide a simple unified account of the data, using a single set of parameters.
The temporal sweep model roughly captures the observed increase in theta trajectory lengths, place field sizes and phase precession slopes combined across different positions and fields based on instantaneous running speed. However, it did so for the wrong reasons, since it incorrectly predicts changes in individual fields with speed (Figure 7B). By contrast, the spatial sweep model accounts for the speedindependence of individual fields, but severely undershoots the increase in theta trajectory length with running speed and fails to capture the increases in place field sizes and phase precession slopes (Figure 7C). Only the behaviordependent sweep model is able to replicate the correct combination of qualitative effects (Figure 7D). Furthermore, the behaviordependent sweep produced values with the lowest mean squared deviation to the experimental data for four of the five variables considered (Figure 7; numbers in corners).
Further proof for the validity of the behaviordependent sweep model comes from the fact that we fitted one of its crucial parameters based on a different subset of the data as the one used to evaluate the models. In particular, we estimated ${\tau}_{\theta}$ based on Equation 23 from the experimentally observed relationship between phase precession slopes and characteristic running speed (Figure 6I), yielding τ_{θ} = 0.57 s. With this value, the model provided a good fit to the relationship between instantaneous running speed and theta trajectory lengths, place field sizes and phase precession slopes (Figure 7D). This highlights the ability of the model to account for the relationships and internal consistency of multiple measurements of place cell activity.
Finally, a subtle prediction of the behaviordependent sweep model is that fields will skew differently depending on whether the animal is typically accelerating or decelerating through the field–that is when the characteristic running speed changes within the field. We therefore analyzed the relationship between mean acceleration and place field skew in the experimental data and found a good qualitative fit with the predictions from the model (Figure 7—figure supplement 1). Negatively skewed fields Mehta et al., 2000 were observed at all acceleration values, but positively skewed fields occurred mainly at positive accelerations, resulting overall in a significant correlation between mean acceleration and skew ($p=4\times {10}^{8}$, Kendall’s $\tau $ test). A similar observation was made by Diba and Buzsáki, 2008, who reported positive skews at the beginning of the track, where rats are usually accelerating, and negative skews towards the end, where rats decelerate.
In summary, we found that the behaviordependent sweep model provided the best overall fit to the experimental data with a single set of model parameters.
Discussion
While research over the past four decades has shed light on numerous aspects of the hippocampal code, the exact relationship between represented position, theta phase, and the animal’s physical location has remained ambiguous. The expression of this relationship in theta sequence trajectories at the population level and in theta phase precession at the singlecell level are two sides of the same coin, but the two levels have seldom been explored side by side. Here, we illustrated that established findings in the field at these different levels are in apparent contradiction with one another. We reconciled these findings by demonstrating that even though individual place fields do not change with instantaneous running speed, their size and phase precession slopes vary according to the animal’s characteristic running speed through these place fields. In particular, regions of slow running are tiled with smaller place fields with steeper phase precession, corresponding to shorter theta trajectories at the population level, whereas regions of fast running are covered by larger place fields with shallower phase precession, corresponding to longer theta trajectories. Based on these observations, we proposed a novel theta phase coding scheme, the behaviordependent sweep. In this model, the spatial extent of the theta oscillation sweep varies across the environment in proportion to the characteristic running speed at each location. As a result, the sweeps can be seen as going through the positions that were or will be reached at certain time intervals in the past or future, assuming the animal runs at the speed characteristic of each place, as opposed to at its actual instantaneous speed. This coding scheme thus integrates aspects of both the spatial and temporal sweeps.
Relationship to previous studies on the speeddependence of the hippocampal code
Why were the relationships between characteristic speed, hippocampal sweeps and place field parameters not evident in previous studies? Two previous studies (Maurer et al., 2012; Gupta et al., 2012) pooled theta trajectories across different positions when showing the effect of speed on theta trajectory length, therefore masking the role of position in mediating the relationship between the two variables. In other studies, the dependence of place field parameters on the characteristic running speed through the field did not emerge because analyses focused on relative measures between pairs of cells (Geisler et al., 2007; Diba and Buzsáki, 2008) or individual fields (Schmidt et al., 2009; Huxter et al., 2003; Maurer et al., 2012) that remain unaffected.
We note that one other study (Chadwick et al., 2015) previously proposed a model to account for the increase in theta trajectory length with running speed despite stable place field sizes and phaseprecession. The model achieved this by increasing the precision of the theta phase versus position relationships of cells with running speed. This feature, however, results in unusually noisy phaseprecession at low speeds (see Neuronal sequences during theta rely on behaviordependent spatial maps for results on a model that operates based on the same principle and comparisons to experimental data). Furthermore, this kind of model cannot account for the dependence of average place field size on characteristic running speed.
On the other hand, two models which are consistent with the increase in place field sizes with characteristic speed did not address theta phase coding. Slow feature analysis attempts to extract slowly varying signals from the sensory input, and has been found to account for different properties of place, head direction and view cells (Franzius et al., 2007). Extracting placespecific features that vary on the order of several seconds, for instance, would lead to larger place fields at locations of higher speeds, as we have observed. This observation is also consistent with the successor representation model of placefields (Stachenfeld et al., 2017). In this model, the activity of a cell is determined by the expected discounted future occupancy of the cell’s preferred location, which proves useful for planning. Thus, a cell with a preferred location where average running speed is higher would begin firing relatively further away from that place. The behaviordependent theta sweep model shares this prediction with these two models, and further accounts for thetaphase and trajectory relationships.
Behaviordependent sweeps are advantageous for prediction and planning
Given the purported role of theta phase coding in prediction and planning, we can compare our three coding schemes in terms of their benefit for these functions. Representing future positions based on the distance to them, as in the spatial sweep, could allow an animal to calculate the speed necessary to reach those positions in a given amount of time. This representation might also be convenient because our bodies and sensory organs limit the spatial range at which we can interact with the world. In contrast, looking forward based on an interval of time rather than space, as in the temporal sweep model, could increase the code’s efficiency by matching the extent of the lookahead to the speed of progression through the environment. For instance, while driving a car on a highway, we might have to look ahead by several hundred meters, since those positions are just seconds away, while such a distance is not useful when strolling in a park. Plans made too far in advance are very likely to be discarded upon unexpected changes or as new information comes to light, which is conceivably related to the use of a discount factor in reinforcement learning models (Sutton and Barto, 1998). Temporal sweeps also seem more plausible for phasecoding in nonspatial domains (Pastalkova et al., 2008; LenckSantini et al., 2008; Robinson et al., 2017; Terada et al., 2017; Aronov et al., 2017). However, temporal sweeps require a fine control by the instantaneous running speed, and there are indications that the hippocampal network lacks the the flexibility required to modify the time lags between pairs of cells at the theta timescale (Diba and Buzsáki, 2008; Shimbo et al., 2021).
The behaviordependent sweep might thus represent the best solution compatible with network constraints by taking advantage of the relative simplicity of spatial sweeps while still enjoying the benefits of temporal sweeps in situations in which behavior is stereotyped. Thus, the look ahead on a highway remains a few hundred meters even if on occasion we are stuck in a traffic jam. Finally, behaviordependent sweeps could make predictions of future positions more robust through the averaging of past experience.
Despite the potential benefits of behaviordependent sweeps mentioned here, these sweeps are probably best construed as a default or baseline mode of operation, which could be further modulated by ongoing cognitive demands and task contingencies (Wikenheiser and Redish, 2015; Shimbo et al., 2021; Zheng et al., 2021).
Lookahead times can help explain place field sizes
All theta sweep models and concepts of prospective and retrospective coding, and extrafield spikes in general, imply that place cells also fire outside their true place fields. In other words, an experimentally measured place field encompasses the extent of the true place field, as well as lookahead and lookbehind activity. This link between place fields and prospective/restrospective representations at the theta timescale provides a lower bound on place field sizes for a given task based on its characteristic running speed. For sweeps that are centered around the current position, a ${\tau}_{\theta}$ of $\sim 0.6$ s means that theta sweeps on average end in positions arrived at in $\sim 300$ ms. Representing those future positions would be of use only if there was enough time for the animal to modify its behavior in response to them. Reaction times for rats performing simple and choice tasks range between 150 ms and 500 ms (Baunez et al., 2001; Brown and Robbins, 1991), and stop signal reaction times stand at around 360 ms (Eagle et al., 2009). Therefore, place field sizes associated with a lookahead time of 300 ms probably stand towards the lower end of what can be used to control behavior through rapid decisionmaking. However, place fields (Kjelstrup et al., 2008) increase in size along the dorsoventral axis of the hippocampus. The largest place fields recorded in rats stand at about 10 m, which would correspond to representing a time window of > 10 s. Thus, we can conceive of a hierarchy of subregions corresponding to predictions at different temporal scales.
Potential mechanisms of behaviordependent sweeps
The dependence of place field parameters and theta trajectories on characteristic speed raises the question of how and when this speed might be computed in the brain, and how it is used to control hippocampal sweeps. One intriguing possibility is that the animal can estimate the speed at which it will typically traverse some region of an environment based on general knowledge of similar environments (e.g. knowing that speed will tend to be lower around boundaries). Another possibility is that the characteristic speed is taken to be the speed of the firsts traversals through the environment, in which theta sequences are reportedly lacking or reduced (Feng et al., 2015; Tang et al., 2021), and then updated incrementally.
The latter suggestion fits naturally with network connectivity models of phase precession (Jensen and Lisman, 1996; Tsodyks et al., 1996; Drieu and Zugaro, 2019). In these models, theta sequences are produced by the propagation of activity through the population, perhaps owing to the recurrent connectivity in area CA3 (Cheng, 2013; Azizi et al., 2013). The network is cued with the current position and recalls upcoming positions. As the animal moves forward, positions will activate at earlier phases of the theta cycle, producing phase precession. In this family of models, it is easy to imagine sweeps varying based on average speed. Place cells could be connected with a higher synaptic strength the closer in time they become activated, leading to stronger and further reaching connectivity in areas through which the animals run faster on average. If the speed of propagation in the network is then made dependent on synaptic strength, activity would propagate further in the network within each theta cycle where speed had been higher, producing longer theta trajectories in those areas. Alternatively, based on the view that theta sequences arise from independently phaseprecessing cells (Chadwick et al., 2015), behaviordependent sweeps could simply result from a behaviordependent spatial map that yields larger place fields in areas of faster running.
Predictions and outlook
In the dataset analyzed, changes in running speed arose naturally from animals running on a finite track, but were not controlled by the experimenter. Further confirmation for the behaviordependent sweep model could come from experiments in more complex environments that can produce variable running speeds at different specific locations (Kropff et al., 2021), such as slowing down in previously fast segments and speeding up in slow ones. This would allow for the comparison between behaviordependent sweeps, and alternative models for which the lookbehind and lookahead distances vary depending on other variables. In particular, it would be interesting to dissociate the effect of characteristic running speed from that of distance to the environmental boundaries, since the boundary vector cell (Barry et al., 2006) and Laplace transform (Sheehan et al., 2021) models suggest that it could be some nonlinear function of distance to the border or trial start, rather than characteristic running speed, that determines place field parameters. Other factors that could play a role are the distance to reward locations (Hollup et al., 2001), the distance to the goal (Wikenheiser and Redish, 2015), the density of sensory cues, the spatial rate of change of visual input (Tanni et al., 2021), the complexity of the maze, or the amount of retrospection and prospection required for the task.
Although we have focused primarily on the effect of speed, it is reasonable to also expect acceleration to have an effect on theta phase coding. We discuss three specific mechanisms. First, acceleration could introduce a secondorder term in the equation for $r(t)$ such that theta trajectories curve in areas through which the animal typically accelerates or decelerates. This might cause trajectories in areas of positive acceleration to reach further ahead than behind, and trajectories in areas of negative acceleration to reach further behind than ahead, consistent with the findings of Gupta et al., 2012 and Bieri et al., 2014. This effect would also be modulated by the phase at which the current position is represented (${\theta}_{0}$ in our equations), since this controls the ratio of lookahead to lookbehind. For instance, the more lookahead there is, the longer the theta trajectories would become in areas of positive acceleration. Second, acceleration leads to different characteristic running speeds in different parts of a place field. Our model predicts that this would cause place fields to skew differently in areas of positive and negative acceleration, a prediction for which we have found some preliminary experimental support (Figure 7—figure supplement 1). Additionally, the model indicates that changes in characteristic speeds through fields cause corresponding changes in theta phase precession. If characteristic speed increases across a field, the slope of phase precession would become increasingly shallow, resulting in concave phase precession clouds, whereas if characteristic speed decreases across the field, the slope of phase precession would be increasingly steep, producing convex ‘banana shaped’ phase precession clouds (Souza and Tort, 2017; Yamaguchi et al., 2002). Future studies are required to test these two predictions, since the range of accelerations in the current dataset was relatively small, especially for positive values, and strong acceleration and deceleration were concentrated over small regions at the start and end of the track, respectively. Third, theta frequency has recently been shown to increase with positive acceleration, but not deceleration or speed (Kropff et al., 2021). One might wonder whether shorter theta cycles due to positive acceleration, rather than the lower running speed, could explain the shorter theta trajectories we observed at the beginning of the track. However, we also observe shorter theta trajectories at the end of the track, where running speeds are also lower, but acceleration is negative and theta cycles are longest (Figure 6B,C). Furthermore, as shown by Kropff et al., 2021, the increase in theta frequency is accompanied by an increase in the intrinsic firing frequency of cells which would provide a compensatory effect on theta trajectories. Even without such compensation, the reduction in theta trajectory length due to shortened theta cycle is small and insufficient to account for the observed effect.
Lastly, our behaviordependent sweep model could be applied to describing the activity of place cells in twodimensional environments, and potentially also that of grid cells, since theta phase coding has been demonstrated in both of these cases (Huxter et al., 2008; Jeewajee et al., 2014; Hafting et al., 2008). For grid cells, our model predicts that sizes of individual firing fields within the grid will vary according to running speeds characteristic of the corresponding maze regions. By contrast, the distance between firing field peaks would remain constant, since the locations of the underlying true fields remain fixed in the model.
In conclusion, our analyses have highlighted the heretofore unresolved tension lurking in the field between experimental results and interpretations explicitly or implicitly supporting spatial and temporal sweeps. Our novel interpretation reconciles apparently contradictory findings by making spatial sweeps dependent on the average behavior at each position, combining features and benefits of both kinds of sweep. In doing so, the model advances our understanding of how the mammalian brain represents past, present and future spatial positions for learning and planning, and provides a quantitative framework that can stimulate further research.
Materials and methods
Data analysis
We reanalyze data from two publicly available data sets (Mizuseki et al., 2013; Grosmark et al., 2016) containing recordings of male LongEvans rats running on linear tracks of various lengths for water rewards at both ends. From the first data set, we limited the analysis to the data from three animals, described in Mizuseki et al., 2009, which contained sufficient parallel recordings for Bayesian decoding of position. The second data set, described in Grosmark and Buzsáki, 2016, contains data from four animals running on a novel track. Data from one animal was excluded due to issues with local field potential recordings (see below), resulting in a total of six animals included in this study. The first 5 min of the recordings in a novel track were discarded since place fields of hippocampal place cells might be unstable in the first 5 min of novel experience (Frank et al., 2004) and we wanted to only include periods with stable spatial representations. Five of the animals had one to three experimental sessions available. The remaining animal had a disproportionately large number of experimental sessions, so a random subset was chosen. The exact number and identity of the sessions analyzed for each animal are reported in Figure 6—figure supplement 2A. In these data, neural activity was recorded using multishank silicon probes targeting region CA1 of dorsal hippocampus. After spike sorting, cells were classified as principal neurons or interneurons based on monosynaptic interactions, waveshapes and burstiness.
Local field potential
Request a detailed protocolWe filtered the local field potential (LFP) with a Butterworth filter of 3rd order between 4 and 12 Hz. We then estimated theta phase from the signal’s Hilbert transform and shifted it by 180° so that 0° and 360° correspond to the peaks of the filtered LFP. Individual theta cycles were then defined as spanning the range from 0° to 360°. Periods of significant theta oscillation were identified by an instantaneous amplitude above the 97th percentile of amplitudes from a shuffled surrogate signal. To create this surrogate, we highpass filtered the LFP at 1 Hz with another Butterworth filter of 3rd order and randomly permuted the time stamps. All the analyses carried out throughout the paper deal exclusively with periods with significant theta oscillations. In the excluded rat, the LFP signals were particularly noisy, leading to an atypically low fraction of theta cycles categorized as periods of significant theta oscillation as defined below ($0.38\pm 0.02$, compared to an average of $0.81\pm 0.06$ for the other animals).
Tracking data
Request a detailed protocolThe position of the rat was determined as the midpoint of the two LEDs mounted on its head. The 2D positions where then projected onto the linear track. We calculated instantaneous speed as the central difference of the position along the track, smoothed with a Gaussian filter with a standard deviation of 100 ms. Periods where rats ran continuously in the same direction from corner to corner were identified as rightward or leftward runs. A characteristic speed was calculated for each running direction in 4 cm spatial bins by taking the mean of speeds after discarding instantaneous speed values below 10 cm/s that did not occur within 40 cm of either end of the track (e.g. see Figure 6B). This was done to avoid contamination of the calculation of the mean speed by infrequent cases where rats stopped in the middle of the track. Near the ends of the tracks, however, low speeds are the norm and therefore we did not set a minimum threshold there. A mean acceleration value was also calculated for each spatial bin by taking the difference of the smoothed speeds.
Firing rates
Request a detailed protocolAfter excluding spikes during pauses in track running (previous paragraph), firing rates were calculated in 4 cm spatial bins and smoothed with a Gaussian filter with a standard deviation of 6 cm. Virtually the same results were produced without this restriction (not shown). Firing rates were calculated independently for each running direction.
Identification of place fields
Request a detailed protocolCandidate place fields were required to have a peak firing rate above 2 Hz and at least 25 spikes. The spatial extent of the field was defined by the positions at which the firing rate fell below 15% of the peak firing rate. If a place field was cut on either side by the end of the track, but the firing rate had gone below 66% of the peak firing rate before then, the field was accepted but marked as incomplete. If there were more than three consecutive spatial bins with zero occupancy between the field’s peak and one of the points at which the firing rate fell below threshold, the field was also marked as incomplete. Incomplete fields were excluded from the phase precession and place field skew analyses, and were treated differently in the place field size analysis (see below). Candidate place fields were screened manually to remove instances with multiple overlapping phase precession clouds.
Place field sizes
Request a detailed protocolFor incomplete fields, place field size was calculated as twice the distance between the field’s peak and the point on either side of the peak for which the firing rate fell below the 15% threshold. This ensured that a sufficient number of place fields at the ends of the track entered the analysis. Due to the pattern of place field skews along linear tracks (Diba and Buzsáki, 2008), we expect this method to slightly overestimate actual sizes, and thus the smaller place field sizes that we observed at the ends of the track should not be an artifact of the procedure.
For calculating the effect of running speed on place field sizes, we recalculated the firing rates with the same spatial bin size and smoothing as described above, but using data corresponding to periods with running speeds belonging to overlapping 20 cm/s wide speed bins in 10 cm/s steps starting at 2 cm/s. Rats spent too little time at some positions and speeds, often leading to an apparent firing rate of 0 due to the lack of time to produce any spikes. Thus, we defined a sampling index that identified areas within the spatial extent of the place field (defined above) that had been sufficiently sampled; we only attempt to measure the place field size in such cases. To obtain this sampling index, we summed the distances between all pairs of spatial bins within the field with occupancy above 300 ms, and divided it by the sum of distances between all pairs of bins in the field. This gave a number that increases nonlinearly from 0 (no valid bins) to 1 (all bins are valid) taking into account both the number of valid bins and how spread out they are through the field. We excluded place fields with a sampling index below 0.4. Place fields where then identified and their sizes calculated as described above. For the summary analyses, we removed extreme outliers below $Q1k\cdot IQR$ or above $Q3+k\cdot IQR$ where Q1 and Q3 are the 25% and 75% percentiles, $IQR=Q3Q1$ and $k=3$.
Phase precession slopes
Request a detailed protocolPhase precession slopes were measured from linear fits of phase precession clouds falling within the extent of place fields as defined above. The fitting of phase precession clouds is complicated by two matters: (i) phase is a circular variable, and (ii) the slope of the precession might be very steep. One possible way of dealing with the circularity of phase is to directly minimize angular distances between points and the best fitting line in the cylinder defined by position and phase. This can be done using circularlinear regression (Kempter et al., 2012; Schmidt et al., 2009) or by exhaustive search (O'Keefe and Recce, 1993). However, in such cases, one must set the minimum and maximum slopes allowed, otherwise the optimal solution would be a line with a slope approaching $\pm \mathrm{\infty}$ that loops around the cylinder going through all points. This would preclude us from correctly fitting steep phaseprecession clouds. Another possibility is to try to unwrap the phase precession cloud so that it lays uninterrupted in a plane and then perform a standard linear regression (LenckSantini and Holmes, 2008). However, this does not work well either for very steep phase precession clouds, since linear regression minimizes only the sum of square errors in phase, leading to excessively shallow fits of steep clouds.
We therefore developed a new method to determine phase precession slopes robustly even when they are very steep. It is based on orthogonal distance regression, which minimizes the orthogonal distance of the data points to the best fitting line. This method introduces fewer a priori assumptions than standard linear regression, since it does not distinguish between independent and dependent variables. Phase and positions were normalized to a range of $[0,1]$ to make their contribution equivalent in the calculation of orthogonal errors.
As commonly observed, spikes in the phase precession plot (theta phase vs. position) did not generally form a monotonic relationship. Instead, phase precession clouds slightly wrapped around 0° or 360°. This means that the theta phase, as extracted from the filtered LFP, does not accurately mark the transitions between actual theta cycles. Since we later analyze theta sequences, it is crucial to identify the proper beginning and end of the theta cycles. We did this by identifying the theta phase offset that optimized the phase precession relationship across all fields for each experimental session as follows. We considered potential offsets from −60° to 60° in 2° steps. For each value, we calculated orthogonal fits to the phase precession clouds for all fields within that session, and then selected the phase shift that led to the lowest mean orthogonal error across all fields. The optimal shift corresponded to the phase shift for which the most points fell along uninterrupted phase precession clouds.
In addition to ambiguity about boundaries of the theta cycle, for spikes near this boundary there is an ambiguity as to which cycle these spikes should be attributed to. This could lead to large errors in the orthogonal fit and therefore distortion in the estimate of the precession slope. Thus, we slightly modified the orthogonal fit procedure. We computed the slope and intercept of the line that minimized the sum of squared orthogonal distances with the following caveat. For points with normalized phases below 0.3 or above 0.7, we minimized the orthogonal distance to the line for either the original point or the point phase shifted in phase by 1 or −1, respectively, and chose whichever phase yielded the smallest distance. The minimization was done using the NelderMead algorithm (Gao and Han, 2012) implemented in the SciPy library (SciPy 1.0 Contributors et al., 2020).
For calculating the effect of running speed on phase precession we proceeded as described for the place field sizes. We only attempted to calculate phase precession slopes when there were 12 or more spikes. Additionally, we analyzed phase precession slopes in single passes through a field. We calculated the average speed of the pass through the field from the tracking data. Note that this 'traversal speed' typically deviates from the 'characteristic speed' which is determined by the average over all the field traversals in a session. We focused on passes with a running speed above 2 cm/s, six or more spikes, a duration between the first and last emitted spikes above 400 ms and a coefficient of variation (standard deviation / mean) of instantaneous speed below 0.3. Passes with too many invalid positions in the tracking data where also excluded (sampling index < 0.4). For the summary analyses, we removed extreme outliers as described for place field sizes with $k=3$ for phase precession slopes in the pooled phase precession analysis and $k=6$ for singlepass phase precession slopes.
Bayesian decoding and theta trajectory lengths
Request a detailed protocolWe performed a Bayesian decoding of position based on the ensemble spikes (Zhang et al., 1998) assuming a prior distribution over positions (Davidson et al., 2009). The probability of the rat being at position $x$ given a vector of spike counts for each cell, $n$, during a temporal bin of width $\tau $ is given by:
where $C(\tau ,n)$ is a normalization factor which can be determined by the normalization condition ${\sum}_{x}P(xn)=1$, and f_{i} is the firing rate of cell $i$ in the corresponding running direction. We shifted theta phases so as to minimize the wrapping of phase precession clouds (see above), therefore we expected theta trajectories to be centered within individual theta cycles. We decoded within each cycle in overlapping 90° windows with a step size of 30° (no windows crossed theta cycles). The relatively large window size was due to the need to gather a sufficient number of spikes for the decoding. These phase intervals were transformed into time intervals independently for each theta cycle based on the cycle’s duration. We attempted to decode position only in time bins where at least one spike was emitted, and for positions bins within a spatial extent of 70 cm centered at the current position. This value is below the average place field size at all running speeds (Figure 4C) and should therefore encompass the whole extent of the sweep.
When averaging across theta cycles with similar speeds, we calculated theta trajectory lengths only in samples with more than five cycles. When analyzing theta trajectories in individual cycles, we focused on cycles well covered by phase bins with peak decoded probabilities larger than 0.1. In particular, we required at least five such phase bins spanning a minimum of 210°. Theta trajectory lengths were derived from a best fit line. To calculate this best fit, we first found the line that maximized the sum of decoded probabilities for positions within ±5 cm of the line (Davidson et al., 2009) and then performed linear regression with the points in this region weighted by their probabilities.
Place field skew
Request a detailed protocolPlace field skew was calculated as the ratio of the third moment of the place field firing rate distribution divided by the cube of the standard deviation (Mehta et al., 2000; Davoudi and Foster, 2019):
where, unlike above, f_{j} is the firing rate of a given cell in the spatial bin x_{j}, $S$ is the number of spatial bins, and ${\mu}_{1}$ is the center of mass of the field:
Mathematical description of coding schemes
Spatial sweep
Request a detailed protocolIn the spatial sweep model, the represented position at time $t$, $r(t)$ is given by
where $x(t)$ indicates the actual location of the animal, ${d}_{\theta}$ represents the extent of the spatial sweep, $T$ is the period of the theta oscillation and t_{n} is the time for which $r(t)=x(t)$ within the current theta cycle.
In order to derive an expression for the length of theta trajectories, we can perform a Taylor series expansion around t_{n}:
where $v$ and $a$ are the speed and acceleration, respectively. Since $(t{t}_{n})$ is small, we can ignore the effects of the acceleration and higher order derivatives and approximate the represented position as:
Here, the first two terms reflect the actual movement of the animal and the last one represents the sweep across positions starting behind the current position of the animal and extending ahead. Note that the model makes the simplifying assumption that sweeps, and hence also phase precession, are linear. There are indications that this could be the case when analyzing single trials (Schmidt et al., 2009) or when calculating theta phase using a waveform method (Belluscio et al., 2012) (but see Souza and Tort, 2017; Yamaguchi et al., 2002).
From Equation 10, we can calculate the length of theta trajectories, which encompasses both the sweep and the change in the actual position of the animal due to its movement during a theta cycle:
where $\alpha $ is the relative position within the theta cycle for which $r(t)=x(t)$. The length of theta trajectories has an offset of ${d}_{\theta}$ and is only weakly dependent on speed since the speed term is multiplied by the relatively small theta period.
At the singlecell level, we postulate a cell’s activity is driven by the represented position $r(t)$ according to its true place field with preferred location r_{0} and width $\sigma $. Specifically,
All theta sweep models postulate that the position $r(t)$ represented by the place cell population differs from the actual location of the animal $x(t)$ depending on the phase of theta. $r(t)x(t)=\alpha {d}_{\theta}$ at the beginning of the theta cycle, and $r(t)x(t)=(1\alpha ){d}_{\theta}$ at the end. Since a place cell’s place field is determined by $r(t)$ at all times, its firing relative to $x(t)$ will shift with the theta phase and this gives rise to phase precession in this model. For instance, the peaks of firing occur at ${r}_{0}\alpha {d}_{\theta}$ at the beginning of the theta cycle and at ${r}_{0}+(1\alpha ){d}_{\theta}$ at the end of the cycle. Hence, the theta phase of maximal firing precesses over a range of ${d}_{\theta}$ and the slope of phase precession is:
Furthermore, the shift of the cell’s firing enlarges the measured place field beyond its true place field (size s_{0}) by the amount of the shift, that is the size of the measured place field is given by
However, in practice, this will be further modulated by other factors such as the presence of theta modulation or the smoothing used when calculating firing rates.
Temporal sweep
Request a detailed protocolFor the temporal sweep model, the represented position is given by,
where ${\tau}_{\theta}$ is the extent of the temporal sweep. Again, we can perform a Taylor series expansion around t_{n}:
And discarding the effects of higherorder derivatives:
where again the first two terms reflect the movement of the animal and the last one, the sweep. In this case, the length of the theta trajectories is directly proportional to running speed:
From the firstorder approximation of $r(t)$ in Equation 17, we see that the spatial extent of the sweep is $v({t}_{n}){\tau}_{\theta}$. Therefore, we can substitute this for ${d}_{\theta}$ in Equation 13 and Equation 14 to obtain the equations for phase precession slopes and place field sizes:
and
As speed goes to 0, phase precession slopes becomes increasingly steep and place field sizes converge to that of the underlying true place fields.
Behaviordependent sweep
Request a detailed protocolTo reconcile the presented analytical observations with aspects of spatial and temporal sweeps that they appear to be consistent with, we make the extent of spatial sweeps directly proportional to the characteristic running speed at each location. Thus, we set ${d}_{\theta}=\overline{v}(x(t)){\tau}_{\theta}$ in Equation 8:
Note that second term representing the sweep is equivalent to the sweep term in Equation 17, but using the characteristic speed through the current location as opposed to the instantaneous speed at which the animal is running.
Proceeding as above, we can derive equations for the theta trajectory length:
which is roughly proportional to the characteristic running speed. Similarly, we can obtain the equations for the phase precession slopes, $m$:
and place field sizes:
Place fields will therefore be larger and have shallower phase precession slopes for locations with higher characteristic running speed, but will not otherwise vary with instantaneous running speed.
Computational modeling
Request a detailed protocolWe generated surrogate data sets by taking the tracking and LFP data from experimental sessions and substituting the experimental spikes with those generated by our models under different coding assumptions. We discretized the session into 2 ms time bins and calculated for each bin the position that the cell population represents, $r(t)$, according to each coding scheme at that particular phase of theta, $\theta (t)$. For the temporal sweep model, $r(t)=x(t+{\tau}_{\theta}(\theta (t)180)/360)$, where $x(t)$ is the position obtained from the tracking and ${\tau}_{\theta}$ is the time interval swept over in each theta cycle. We manually tuned ${\tau}_{\theta}$ iteratively to minimize the deviations in theta trajectory lengths, place field sizes and phase precession slopes between experimental and simulated data (Figure 7). A good compromise was obtained for a ${\tau}_{\theta}$ of 0.55 s. For the spatial sweep model, $r(t)=x(t)+{d}_{\theta}(\theta (t)180)/360$, where ${d}_{\theta}$ is the spatial distance swept over in each theta cycle. We tuned ${d}_{\theta}$ as described for ${\tau}_{\theta}$, obtaining a value of 30 cm. For the behaviordependent sweep model, $r(t)=x(t)+\overline{v}(x(t)){\tau}_{\theta}(\theta (t)180)/360$, where $\overline{v}(x(t))$ was taken to be the experimentally observed characteristic running speed at each position, calculated independently for each experimental session and running direction (e.g. Figure 6A). ${\tau}_{\theta}$ was obtained from fitting Equation 23 to the relationship between inverse phase precession slopes and characteristic running speed (Figure 6I), resulting in a value of 0.57 s.
Then, for each time bin, we generated spikes for each of 20 simulated place cells uniformly distributed along the track. Spikes were generated based on the activation level of each cell $i$ at the represented position, as determined by the cell’s true place field. These true place fields were defined as Gaussian activation functions, f_{i}, with a peak value of 1, discretized in 1 cm steps. The standard deviation of the Gaussian, $\sigma $, determines the size of the true place fields, which controls how tight the relationship is between firing at a particular phase and the time or distance to the peak’s center. A small true place field size leads to very crisp phase precession clouds, whereas a bigger one results in wider clouds with a noisier relationship between phase and position. For the temporal and spatial sweep models, the standard deviation was set to 7 cm, which corresponds to true place field sizes of 27 cm. With this value, the model produced phase precession clouds approximately matching the experimental ones. For behaviordependent sweeps, the standard deviation was heterogeneous across the population, set to $\mathrm{max}(4,\mathrm{\hspace{0.25em}0.3}\overline{v}({c}_{i}){\tau}_{\theta})$, where c_{i} is the center of each place field.
Spikes were generated from a Poisson process with probability equal to an instantaneous firing rate times the width of the time bin:
where $v(t)$ is the instantaneous running speed in cm/s. The first term sets the maximum firing rate and the values were chosen to approximate the increase in peak firing rate with running speed observed in the experimental data (Figure 7—figure supplement 2). The second term introduces an inhibitory modulation by the amplitude of the theta oscillation with ${m}_{\theta}=0.35$ approximating the experimentally observed value in the experimental data set (not shown).
For the model predictions shown in the the schematics in Figure 1 and Figure 2, we simulated runs at constant speed with a regular 8 Hz theta oscillation, and used the models as described above, except for ${\tau}_{\theta}=0.5$ s and $\sigma =6$ cm.
Appendix 1
Variable theta phase locking fails to account for the combination of population and singlecell results
For completeness, we also considered whether the experimental results could be accounted for by a fourth model similar to the one proposed by Chadwick et al., 2015. Cells participate in spatial sweeps, but the coordination between cells increases with running speed. At lower speeds, the lack of coordination between cells should bias the decoder toward the current position, leading to shorter decoded theta trajectories.
We modeled this by introducing the following modifications to the spatial sweep model. To increase the coordination between pairs of cells at the theta timescale with speed, we introduced into each cell a certain amount of independent theta phase noise that decreased with running speed:
where $N(0,{\sigma}_{\theta})$ are samples obtained from a Gaussian distribution with standard deviation ${\sigma}_{\theta}$; with $k=120$ and $\gamma =0.025$. This is the crucial feature of the model. Additionally, to get a more realistic amount of variance in place field sizes and phase precession slopes, we used a slightly different theta distance for each cell:
with $d=35$, and ${\alpha}_{i}$ and ${\beta}_{i}$ derived from Gaussian distributions $N(1,0.3)$ and $N(0,10)$, respectively, and fixed for each cell for the entire simulation. The standard deviation setting the width of each true place fields was $\mathrm{max}(3,\mathrm{\hspace{0.25em}0.25}{d}_{\theta ,i})$.
As expected, the model provides a good fit for the increase in theta trajectory lengths with running speed. However, the model does not account for the increase in average place field sizes (Appendix 1—figure 1A,B). Furthermore, unlike the experimental data, the model produces atypically noisy phase precession clouds at low running speeds (Appendix 1—figure 1C) which become sharper with speed, as measured by decreasing residuals in the phase precession cloud fits (Appendix 1—figure 2A,B).
Even if phase precession clouds were noisier at lower speeds, cell coordination, and hence theta trajectory lengths could remain unaffected, if noise affected all cells in the same way. Therefore, we measured the effect of speed on cell coordination directly, by calculating the variance in phase differences between spikes of pairs of cells with overlapping place fields. First, we found cells whose place fields overlapped by more than 20 cm. Then, when rats were within 10 cm of the overlapping region of two cells, we collected, for each theta cycle individually, the phases at which spikes from each cell were emitted, and calculated all pairwise phase differences between them. Finally we calculated their circular variance (Fisher, 1993) as:
where ${\varphi}_{i}$ is $i$th pairwise phase difference between the two cells.
If the cells code for positions in a coordinated fashion, the variance in phase differences between their spikes should be low. We found that the level of variance present in the variable noise model at low speeds was unrealistically high as compared to the experimental data (Appendix 1—figure 2C,D). Furthermore, in the experimental data, the variance in phase differences for spikes of a cell pair did not significantly change with running speed for any of the animals ($p>0.15$; Wilcoxon signedrank test), whereas it did so for five of the six animals in the simulated data ($p<0.05$; Wilcoxon signedrank test).
Overall, we conclude that these results rule out the possibility that changes in cell coordination at the theta time scale play a major role in explaining the changes observed in theta trajectory lengths.
Appendix 2
Summary of statistical tests
Supplementary file 1 contains a table with a summary of all statistical tests performed for the analyses of Figure 4, Figure 5 and Figure 6. The table indicates animal names, number of samples (N), test types and pvalues.
Data availability
No new data was generated for this study. All analysis code has been made available at https://github.com/sencheng/modelsandanalysisofthetaphasecoding (copy archive at https://archive.softwareheritage.org/swh:1:rev:cadbae0ff9a9f1af82101229c15f4af213857773).

Collaborative Research in Computational NeuroscienceMultiple single unit recordings from different rat hippocampal and entorhinal regions while the animals were performing multiple behavioral tasks.https://doi.org/10.6080/K09G5JRZ

Collaborative Research in Computational NeuroscienceRecordings from hippocampal area CA1, PRE, during and POST novel spatial learning.https://doi.org/10.6080/K0862DC5
References

A computational model for preplay in the hippocampusFrontiers in Computational Neuroscience 7:00161.https://doi.org/10.3389/fncom.2013.00161

The boundary vector cell model of place cell firing and spatial memoryReviews in the Neurosciences 17:71–97.https://doi.org/10.1515/revneuro.2006.17.12.71

Effects of STN lesions on simple vs choice reaction time tasks in the rat: preserved motor readiness, but impaired response selectionEuropean Journal of Neuroscience 13:1609–1616.https://doi.org/10.1046/j.0953816x.2001.01521.x

Crossfrequency phasephase coupling between θ and γ oscillations in the hippocampusJournal of Neuroscience 32:423–435.https://doi.org/10.1523/JNEUROSCI.412211.2012

Reversed theta sequences of hippocampal cell assemblies during backward travelNature Neuroscience 17:719–724.https://doi.org/10.1038/nn.3698

The CRISP theory of hippocampal function in episodic memoryFrontiers in Neural Circuits 7:88.https://doi.org/10.3389/fncir.2013.00088

Hippocampal network dynamics constrain the time lag between pyramidal cells across modified environmentsThe Journal of Neuroscience 28:13448–13456.https://doi.org/10.1523/JNEUROSCI.382408.2008

Hippocampal sequences during exploration: mechanisms and functionsFrontiers in Cellular Neuroscience 13:00232.https://doi.org/10.3389/fncel.2019.00232

A goaldirected spatial navigation model using forward trajectory planning based on grid cellsEuropean Journal of Neuroscience 35:916–931.https://doi.org/10.1111/j.14609568.2012.08015.x

BookStatistical Analysis of Circular DataCambridge, United Kingdom: Cambridge University Press.

Hippocampal plasticity across multiple days of exposure to novel environmentsThe Journal of Neuroscience 24:7681–7689.https://doi.org/10.1523/JNEUROSCI.195804.2004

Slowness and sparseness lead to place, HeadDirection, and SpatialView cellsPLOS Computational Biology 3:e166.https://doi.org/10.1371/journal.pcbi.0030166

Implementing the NelderMead simplex algorithm with adaptive parametersComputational Optimization and Applications 51:259–277.https://doi.org/10.1007/s1058901093293

Segmentation of spatial experience by hippocampal θ sequencesNature Neuroscience 15:1032–1039.https://doi.org/10.1038/nn.3138

Accumulation of hippocampal place fields at the goal location in an annular watermaze taskThe Journal of Neuroscience 21:1635–1644.https://doi.org/10.1523/JNEUROSCI.210501635.2001

Thetamediated dynamics of spatial information in hippocampusThe Journal of Neuroscience 28:5959–5964.https://doi.org/10.1523/JNEUROSCI.526207.2008

Theta phase precession of grid and place cell firing in open environmentsPhilosophical Transactions of the Royal Society B: Biological Sciences 369:20120532.https://doi.org/10.1098/rstb.2012.0532

Neural ensembles in CA3 transiently encode paths forward of the animal at a decision pointThe Journal of Neuroscience 27:12176–12189.https://doi.org/10.1523/JNEUROSCI.376107.2007

Quantifying circularlinear associations: hippocampal phase precessionJournal of Neuroscience Methods 207:113–124.https://doi.org/10.1016/j.jneumeth.2012.03.007

Spatial information outflow from the hippocampal circuit: distributed spatial coding and phase precession in the subiculumThe Journal of Neuroscience 32:11539–11558.https://doi.org/10.1523/JNEUROSCI.594211.2012

Discharge properties of hippocampal neurons during performance of a jump avoidance taskThe Journal of Neuroscience 28:6773–6786.https://doi.org/10.1523/JNEUROSCI.532907.2008

Altered phase precession and compression of temporal sequences by place cells in epileptic ratsThe Journal of Neuroscience 28:5053–5062.https://doi.org/10.1523/JNEUROSCI.502407.2008

Prediction, sequences and the hippocampusPhilosophical Transactions of the Royal Society of London. Series B, Biological Sciences 364:1193–1201.https://doi.org/10.1098/rstb.2008.0316

Grid cells and place cells: an integrated view of their navigational and memory functionTrends in Neurosciences 38:763–775.https://doi.org/10.1016/j.tins.2015.10.004

Singletrial phase precession in the hippocampusThe Journal of Neuroscience 29:13232–13241.https://doi.org/10.1523/JNEUROSCI.227009.2009

Scalable representation of time in the hippocampusScience Advances 7:abd7013.https://doi.org/10.1126/sciadv.abd7013

The hippocampus as a predictive mapNature Neuroscience 20:1643–1653.https://doi.org/10.1038/nn.4650

BookReinforcement Learning: An IntroductionMassachusetts, United States: MIT Press.

Theta phase precession in rat ventral striatum links place and reward informationThe Journal of Neuroscience 31:2843–2854.https://doi.org/10.1523/JNEUROSCI.486910.2011

Hippocampal electrical activity and voluntary movement in the ratElectroencephalography and Clinical Neurophysiology 26:407–418.https://doi.org/10.1016/00134694(69)900923

Hippocampal theta sequences reflect current goalsNature Neuroscience 18:289–294.https://doi.org/10.1038/nn.3909

Bimodality of theta phase precession in hippocampal place cells in freely running ratsJournal of Neurophysiology 87:2629–2642.https://doi.org/10.1152/jn.2002.87.6.2629
Decision letter

Laura L ColginSenior and Reviewing Editor; University of Texas at Austin, United States
In the interests of transparency, eLife publishes the most substantive revision requests and the accompanying author responses.
Acceptance summary:
This work develops a novel and rigorous mathematical framework to analyze spatial and temporal sequence coding in hippocampal place cells. The findings have potential to advance our understanding of hippocampal place cell functions by providing an explanation for seemingly conflicting results in previous studies of theta phase precession and theta sequences. The findings are likely to have an important impact on the hippocampal community.
Decision letter after peer review:
Thank you for submitting your article "Neuronal sequences during theta rely on behaviordependent spatial maps" for consideration by eLife. Your article has been reviewed by 3 peer reviewers, and the evaluation has been overseen by a Reviewing Editor and Laura Colgin as the Senior Editor. The reviewers have opted to remain anonymous.
The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission. A list of Essential Revisions, compiled from all reviews, is provided below. Please refer to the individual reviews, shown in their entirety below, for additional details about the comments in the essential revisions.
Essential revisions:
1. The authors conclude the experimental data best fit the behaviordependent sweep model. However, the predicted effects on theta trajectory length and place cell properties are very similar between the temporal sweep model and the behaviordependent sweep model (Figure 7). Therefore, it is unclear if they can conclusively determine experimental data best fit the behaviordependent sweep model rather than the temporal sweep model, especially based on visual inspection. Their argument would be strengthened by analytically directly comparing the models and experimental data to determine which is a best fit. For example, is there are larger different between predicted and real data for the spatial and temporal sweep models than the behaviordependent sweep model? A deeper analysis of what specifically differentiates the temporal sweep and behaviordependent sweep is warranted. For example, the authors state "The temporal sweep model could be fitted to roughly capture the observed increase in theta trajectory lengths, place field sizes and phase precession slopes pooled by running speed, but it incorrectly predicted changes in individual fields with speed." Visually these "incorrect predictions" do not seem that far off. Are they significantly different and if so what is the magnitude of the difference?
2. The behaviordependent sweep model (equation 3) is essentially the spatial sweep model with dependence on the averaged speed which is a function of location. There is no instantaneous speed term in this model, even though they show the effects of instantaneous running speed in the model (Figure 2). The authors do not describe how exactly variation in instantaneous speed affect the model. Does the model only use average speed and if so, over what time scales? If the model uses average speed over long timescales like a whole trial or multiple trials, how does the model account for rapid changes in speed levels, like at the scale of a single theta cycle? Relatedly, the use of the speed term needs to be clarified in several places:
a. In Figure 7D, cell firing properties are separated for different speed levels. Over what time scales was speed measured? Are these speed levels the "average speed" term in equation (3)?
b. Based on equation (21), phase precession slope depends on the average speed in the behaviordependent sweep model. How does this fit on single trial phase precession slope? For single phase precession, is the "averaged speed" calculated from the limited data within that trial?
3. Related to the above points, the two models that the authors contrast with their own with are oversimplified. Rather than highlighting the virtues of their own model, this creates the impression that any model in which place cells do not have unrealistic properties, such as place field width vanishing as the animal slows down, would work equally well. This impression is reinforced by the fact that crucial aspects of the model are not tested, and instead very general properties, some of which were already known, are tested as predictions of the model: running speed and properties of place cells vary along the track. To increase the impact of this work, the text should be revised to ensure that the authors' model is not compared with overly simplified models.
4. The authors should make sure that prior work from other labs is presented in its proper context and not specifically associated with one of the two overly simplified models presented in the text.
5. To address the issue whether field size or speed is better correlated with theta (spatial) length, the authors may consider producing a plot similar to Figure 7A, but using (mean) place field size rather than (mean) running speed, and adding a simulation condition using mean place field size as a controlling variable. The outcome could be one is better than the other, or they are similar or equivalent. Regardless of the outcome, the authors could discuss further the functional differences between these scenarios.
6. What is the evidence for the assumption of a "true place field"? What are the potential limitations of this assumption?
7. To increase impact, the overall organization and presentation of ideas should be revised to ensure clarity for a general audience.
Reviewer #1:
In this work, the authors develop precise mathematical models to determine if sequential hippocampal neural activity during behavior is best described as spatial or temporal sweeps. While prior work has shown evidence relating neural activity to both spatial and temporal sweeps, a cohesive and quantitative description of how neural activity sweeps relate to both time and space is needed. Whether theta sweeps better represent spatial or temporal coding of position (eg distance vs time to past and future locations) is readily distinguishable when animals run at different speeds. The authors make use of these models to make specific predictions about how population codes and single cell properties will vary with animal speed. The authors find that neither the spatial sweep model nor temporal sweep model fully describes observed place cells firing properties at the single cell or population levels. They propose a 'behaviordependent' sweeps model to bridge both spatial temporal models and claim this model best described the experimental observations. Overall, this work develops a novel and rigorous mathematical framework to study spatial and temporal sequence coding in hippocampus and uses this framework to test whether theta sweeps in the hippocampus best represent spatial or temporal codes. Therefore, this work addresses important questions about how the hippocampus simultaneously encodes spatial and temporal information.
However, some clarifications are required. Specifically, it is unclear if they can conclusively determine experimental data best fit the behaviordependent sweep model rather than the temporal sweep model, especially based on visual inspection. Their argument would be strengthened by analytically directly comparing the models and experimental data to determine which is a best fit. Furthermore, the temporal resolution of speed used in the models and analysis of experimental data requires clarification. In particular, it is unclear if the temporal resolution of speed is precise enough to account for rapid changes in speed.
1. The authors conclude the experimental data best fit the behaviordependent sweep model. However, the predicted effects on theta trajectory length and place cell properties are very similar between the temporal sweep model and the behaviordependent sweep model (Figure 7). Therefore, it is unclear if they can conclusively determine experimental data best fit the behaviordependent sweep model rather than the temporal sweep model, especially based on visual inspection. Their argument would be strengthened by analytically directly comparing the models and experimental data to determine which is a best fit. For example, is there are larger different between predicted and real data for the spatial and temporal sweep models than the behaviordependent sweep model? A deeper analysis of what specifically differentiates the temporal sweep and behaviordependent sweep is warranted. For example, the authors state "The temporal sweep model could be fitted to roughly capture the observed increase in theta trajectory lengths, place field sizes and phase precession slopes pooled by running speed, but it incorrectly predicted changes in individual fields with speed." Visually these "incorrect predictions" do not seem that far off. Are they significantly different and if so what is the magnitude of the difference?
2. The behaviordependent sweep model (equation 3) is essentially the spatial sweep model with dependence on the averaged speed which is a function of location. There is no instantaneous speed term in this model, even though they show the effects of instantaneous running speed in the model (Figure 2). The authors do not describe how exactly variation in instantaneous speed affect the model. Does the model only use average speed and if so, over what time scales? If the model uses average speed over long timescales like a whole trial or multiple trials, how does the model account for rapid changes in speed levels, like at the scale of a single theta cycle? Relatedly, the use of the speed term needs to be clarified in several places:
a. In Figure 7D, cell firing properties are separated for different speed levels. Over what time scales was speed measured? Are these speed levels the "average speed" term in equation (3)?
b. Based on equation (21), phase precession slope depends on the average speed in the behaviordependent sweep model. How does this fit on single trial phase precession slope? For single phase precession, is the "averaged speed" calculated from the limited data within that trial?
3. What is the evidence for the assumption of a "true place field"? What are the potential limitations of this assumption?
Reviewer #2:
After the finding of theta phase precession in rat place cells, it was soon discovered that place cells form sequential firing patterns within individual theta cycles that maintain the sequential order of their place fields along a spatial trajectory. The socalled theta sequences have important functional consequences, because they indicate that place cells at the population level encode not just the animal's current location, but also the past and future locations, all amazingly in the short time scale of a theta cycle (~120 ms). In this paper, the authors ask whether the "past and future" coding is spatial or temporal, i.e., whether the spatial contents represented in theta sequences go beyond a fixed time or distance from the animal's current time or location. The authors realize that results from previous studies cannot be explained by either, especially those regarding how the spatial distance within a theta sequence depends on the animal's running speed. The authors present a new explanation, called "behaviordependent sweep model", which relies on a key point that place fields of individual place cells vary in their sizes (lengths) at different locations along a trajectory and they tend to be larger when speed is high. By analyzing existing data and by computational modeling, the authors present evidence that supports their model.
Although most of the results from the data analysis confirm the findings in previous studies, these results, together with the key new finding on the relationship between place field size and speed (Figure 6), support the authors' conclusion. The data analysis and modeling are straightforward, the writing is mostly clear, and the conclusion is well balanced with sufficient discussions.
However, there is one major concern that may help clarify or strengthen the author's model that emphasizes the speed at each location of a trajectory, which the authors conceptualize as varies around a "characteristic" (mean) speed. The question here is whether it is necessary to introduce a behavioral variable, rather than a neurophysiological or functional one, to explain the spatial contents in theta sequences. A related and perhaps important issue is which one, place field size or speed, is more fundamental here. It is possible that simply stating that field sizes systematically vary at different locations along a trajectory and the animal tends to run faster at locations with larger fields, together with the wellknown properties of of singlecell theta phase precession (termed "spatial sweep" by the authors), could be sufficient to explain all the data. The reason why emphasizing place field size is that place field is a functional concept that could be influenced by factors in spatial information encoding, such as task demand (e.g. turning points, reward sites), sensory cue density (e.g. rich in visual cues), or spatial layout (e.g. long straight arm). It is conceivable that these factors systematically vary from one location to another, leading to systematically larger or smaller place fields. On the other hand, running speed varies from one animal to another, from one session to another session in the same animal, and from one moment to another moment (and thus the definition of a "characteristic" mean speed is needed). From the data in Figures 3B, 6B, it seems that the same animal had more speed variation in one session (ec014, green), but the correlation between theta (spatial) length and speed was worse, than another (ec016, red). It is possible that the data like these can be better explained by directly targeting the relationship between theta length and place field size.
1) I only have one major suggestion. To address the issue whether field size or speed is better correlated with theta (spatial) length, the authors may consider producing a plot similar to Figure 7A, but using (mean) place field size rather than (mean) running speed, and adding a simulation condition using mean place field size as a controlling variable. The outcome could be one is better than the other, or they are similar or equivalent. Regardless of the outcome, the authors could discuss further the functional differences between these scenarios.
Reviewer #3:
ParraBarrero and colleagues analyze and compare conceptually different modes in which neuronal sequences could be organized within a theta cycle in the hippocampus. They show that we cannot think of them as purely temporal or purely spatial predictions, and instead propose that we should think of them as temporal predictions at the animals' characteristic speed in a given position, hence 'behaviordependent' sweeps. While this manuscript has many strengths and represents a significant step forward in organizing ideas around theta sweeps, my feeling is that it compares a reasonable model with two oversimplified models. More work should be directed to understanding which are the crucial ingredients for this model to work, and what are the degrees of freedom that could be used to build a family of models that would perform equally well.
ParraBarrero and colleagues organize existing ideas about theta sweeps into a framework that allows contrasting different models with key experimental observations. In particular, they show that purely spatial theta sweeps (where the extent of the spatial sweep, and thus the place field size, is the same for all locations) do not produce a dependence of place field size or phase precession slope on running speed, as observed in experimental data. Similarly, they show that purely temporal sweeps (projecting the current instantaneous trajectory of the animal for a fixed time interval), produce sweeps with a length proportional to running speed. As running speed approaches zero, this generates the unrealistic situation in which theta sweep length and place field width go to zero, while phase precession slope goes to minus infinity. The authors contrast these two models with one based on behaviordependent sweeps. In this model, sweeps are temporal but their spatial extension is proportional to the typical running speed in that position.
The major strengths of the manuscript are two. First, organizing previous ideas into a framework where different models can be contrasted. Second, proposing a model that does not have the caveats of the purely temporal or the purely spatial sweeps. I find that it also has some weaknesses. First, the two models that they contrast their own with are oversimplified. Rather than highlighting the virtues of their own model, this creates the impression that any model in which place cells do not have unrealistic properties, such as place field width vanishing as the animal slows down, would work equally well. This impression is reinforced by the fact that crucial aspects of the model are not tested, and instead very general properties, some of which were already known, are tested as predictions of the model: running speed and properties of place cells vary along the track. Second, I think that the authors have gone too far in associating the two oversimplified models with the previous work of colleagues that, in my view, not only would not accept these ideas as their own but in some cases would even claim that they have already published some results contradicting them. Carefully dissecting exactly which ideas were put forward by whom in the past would not only be fair to colleagues in the field but would also highlight the contrasting novelties presented in this manuscript. Third, the overall development of ideas is somewhat obscure and I think that the authors could find a way to present information so as to maximize the chances that interested readers will understand everything on the first attempt. The authors have chosen a way to present their ideas in which contradictions are left unresolved for a substantial part of the paper. In my view, this aesthetic choice has the risk of losing readers before they get to the point where everything becomes clear (the behaviordependent sweep model and the idea that different cells provide information about different parts of the track, with different typical speed and place field properties). There is no need to do this, contradictions could be resolved as they appear, helping the reader to better navigate the manuscript.
The main result of the authors is a model that is compatible with experimental results. In my view, they should put some effort into clarifying whether this is a unique model or similar proposals would perform equally well. This means dissecting the crucial aspects that make this model better than any other (not just the two oversimplified models with unrealistic place field properties). Variations that I can think of are, for example, temporal sweeps with an overall mean speed rather than the mean speed for a given position, or spatial sweeps with a d_theta that depends on the width and density of place fields. If they find that there is a family of models sharing some crucial element that perform similarly, this would strengthen rather than weaken the manuscript. In addition, they should test specific predictions of the behaviordependent sweep model. For example, characteristic speed and theta trajectory length along the track are not proportional (Figures 6B and C). Does the model require some improvement to account for this?
Overall I think that the authors have succeeded in bringing into the spotlight properties of theta sweeps that have been studied extensively from a qualitative perspective, but for which quantitative accounts are lacking. They have put forward a framework in which different models can be compared and proposed a model that is compatible with most of the experimental observations. In this sense, I think that a revised version of this manuscript would have an important impact on the hippocampal community.
30 – 'The current position of the animal'. There is an issue in how one defines this. What we typically have is an estimation of the position of LEDs that are placed somewhere above the animal's head. We ignore the distance between these LEDs and the position that CA1 considers to be the 'actual' position of the animal. Please comment on how this correction would affect the estimation of past and future positions at different speeds, especially when considering time sweeps.
69 – Geisler and colleagues (2007) claim in page 1:'Furthermore, the phase advance of the spikes relative to theta was steeper in fast than in slow trials'.
94 – Again, Geisler et al., 2007, seem to claim the opposite. On top of this, Maurer et al., 2012 do not seem to refer directly to the phase precession slope. They find a relationship between speed and look ahead distance and a speed dependent population CCG slope. Somehow this does not seem to comply with what is described here as the spatial sweep model not accounting for results at the population level. Perhaps what the authors present as 'the model' and the bits of it that can be related to previous descriptions could be described in greater depth.
98 – This length does not seem to be affected by a potential increase in field size as a result of place cells increasing their firing rate with speed. Why is this not taken into account?
625 – Equation 12. It should be clarified that this is an approximation, since phase precession has been shown to be highly nonlinear already by O'Keefe and Recce. Thus, the exact value of the slope is highly dependent on the method, especially on the relative sampling of different phase ranges.
108 – L = v(t). As I understand it, dimensions do not match. The same happens to Equation 16 in the methods. Do parenthesis stand for multiplication or evaluation of the function v at a given time?
635 to 637 – There is a problem with the logic here. As v, goes to 0, v*tau going to 0 implies a slope going to minus infinity. However, v*tau is roughly speaking the width of the field of a cell at speed v. I do not think any of the authors cited in this manuscript would claim that the width of fields vanishes as v goes to 0. What is this temporal sweep model actually modeling? The fact that tau is independent of speed is more a choice of the manuscript authors than a claim coming from experimental results.
108 – 'This is almost exactly the result reported by Maurer et al., (2012); Gupta et al., (2012).'. Please specify how and in which figures. For example, Figure 8 from Gupta et al., seems to be at odds with this claim.
112 – Please specify or give an example of which procedures or methods can cause a contradiction. It is not clear from the text.
Figure 4a – The visualization of these examples is really poor. Since the purpose of this panel is visualization, I suggest to find a better way, perhaps with fewer examples or speed bins.
Figure 4bc – Although the conclusion is plausible, and the examples seem to indicate this, the analysis is not convincing. The procedure based on regressing 7 datapoints has too much error, and this might mask an effect at the population level. (For example, are these individual regressions significant?) A high pvalue does not necessarily mean that there is no effect. I suggest trying other methods. For example, the halfwidth decay in the spatial autocorrelation for the population of all cells could be studied and compared at different speeds. Fewer speed groups would also help getting better statistics. All of the analyses could also be applied to pools of cells with neighboring fields, to explain the contradiction right a way and thus help the reader navigate the manuscript.
178 – It is not clear at this point of the manuscript why both results are compatible with behavior dependent sweeps. This might need some more explanation.
191 – I suggest to try to make explicit and consistent the description of slopes. Unfortunately, describing a negative slope as 'lower' is ambiguous. Similarly, in 209 an 'increase in the slope' is mentioned, which is also ambiguous. Please revise this language throughout the manuscript. I believe people in the past have referred to slopes as shallower or steeper to avoid ambiguity.
181 – 194. What would the different models predict and why?
234 – Why are these results striking? Similar findings have been reported before. For example in Gupta et al., 2012. I disagree with lines 312 – 314. Figure S3 of Gupta et al., shows very similar results to the ones analyzed here.
Figure 6A – If this explains the apparent contradictions found in Figures 4 and 5, then pooling locations with similar average speed should make the pooled average effects disappear. This needs to be shown in those figures to help readers navigate the manuscript.
Figure 6,BC – running speed at 0.25 is leeds then two thirds of the speed at 0.75. However theta length trajectories are similar. To my view this speaks directly against the simple explanation that is being tested 'Short theta trajectories and small place field sizes could occur where animals tend to run slow, contributing to the low speed averages, and long theta trajectories and large place field sizes could occur where animals tend to run fast, contributing to the fast speed averages'. There seems to be something else going on here.
Figure 7 – Comparisons are purely visual. Could some quantification be provided?
329 – Figure S5. In this paragraph an alternative model is discarded, but no quantification is provided. In the last two subpanels of panel F, Can the authors show how phase precession looks at these speeds in the experimental data and in their model, and compare it with the alternative model?
Please discuss how much of these behavioraldependent sweeps could be thought of a side effect of a behavioraldependent place field size and density resulting from the process of place cells learning their place fields.
https://doi.org/10.7554/eLife.70296.sa1Author response
Essential revisions:
1. The authors conclude the experimental data best fit the behaviordependent sweep model. However, the predicted effects on theta trajectory length and place cell properties are very similar between the temporal sweep model and the behaviordependent sweep model (Figure 7). Therefore, it is unclear if they can conclusively determine experimental data best fit the behaviordependent sweep model rather than the temporal sweep model, especially based on visual inspection. Their argument would be strengthened by analytically directly comparing the models and experimental data to determine which is a best fit. For example, is there are larger different between predicted and real data for the spatial and temporal sweep models than the behaviordependent sweep model? A deeper analysis of what specifically differentiates the temporal sweep and behaviordependent sweep is warranted. For example, the authors state "The temporal sweep model could be fitted to roughly capture the observed increase in theta trajectory lengths, place field sizes and phase precession slopes pooled by running speed, but it incorrectly predicted changes in individual fields with speed." Visually these "incorrect predictions" do not seem that far off. Are they significantly different and if so what is the magnitude of the difference?
We agree with this point and we have tried to improve on it. First, we have made the visualization in Figure 7 clearer. Initially, the withinfield increases in place field sizes and phase precession slopes corresponded to the increases between consecutive, partly overlapping, speed bins. This was suboptimal, since it did not highlight potential cumulative changes in place field sizes and phase precession slopes across speed bins. As a result, it underrepresented the magnitude of the discrepancy between the data and temporal sweeps. Therefore, we have now plotted withinfield increases in place field sizes and phase precession slopes as a function of the deviation from the field’s characteristic running speed. This visualization shows that individual cells get increasingly larger fields and shallower phase precession slopes with speed in the temporal sweep model, but not in the experimental data or in the behaviordependent sweep model.
Second, we have simplified the color code in the figure to reflect only whether the model fits with the experimental data qualitatively or not (e.g., whether a variable that increases with speed in the experimental data also does so in the simulated data). The qualitative differences are now all pronounced and it is clear that only the behaviordependent sweep qualitatively fits with all of the results. Third, we have provided quantitative measures for the fit of the models to the experimental data. In particular, we report the mean squared error (difference) between the average values produced by the model and the experimental data for each speed bin. The behaviordependent sweep model presents the lowest errors for 4 of the 5 analyzed variables.
2. The behaviordependent sweep model (equation 3) is essentially the spatial sweep model with dependence on the averaged speed which is a function of location. There is no instantaneous speed term in this model, even though they show the effects of instantaneous running speed in the model (Figure 2). The authors do not describe how exactly variation in instantaneous speed affect the model. Does the model only use average speed and if so, over what time scales? If the model uses average speed over long timescales like a whole trial or multiple trials, how does the model account for rapid changes in speed levels, like at the scale of a single theta cycle?
We hypothesize that in the behaviordependent sweep model, the characteristic speed is computed over a sufficiently long time scale that filters out variation in running speeds from run to run. In fact, in our simulations, we used the average speed in a given session (excluding outliers). However, we do not commit to any particular view regarding how exactly this characteristic speed is calculated in the brain (e.g., it could be some kind of moving average (cumulative, exponential, etc.), or it could be set in the first few runs and then remain mostly stable). We have now clarified this issue where the term is first introduced, and we also discuss some possibilities in the section “Potential mechanisms of behaviordependent sweeps”. Future experiments are needed to determine the exact nature and timescale of this average. Due to the hypothesized setting of the characteristic speed on a long timescale, it is not affected by rapid changes in running speed (within a trial or a single theta cycle). Therefore, in the behaviordependent sweep model, single cell variables that depend on characteristic speed, such as place field size and phase precession slope do not change with instantaneous speed either (Figures 4 and 5).
However, in behaviordependent sweeps, as well as in spatial sweeps, theta trajectory lengths are still somewhat affected by instantaneous running speed. This is because the sweep starts at some fixed distance behind the animal at the beginning of the theta cycle (t_{start}), and ends at some fixed distance ahead of the animal at the end of the theta cycle (t_{end}). However, the current position of the animal, x(t), changes slightly during that time (t_{end}t_{start} = T) due to the animal’s motion. This change depends on the instantaneous running speed v and is given by x(t_{end})x(t_{start}) ≈ v*T to a first approximation. This distance v*T is added to the constant d_{theta}, the sum of lookbehind and lookahead distances, to obtain the total theta trajectory length. We had described this effect for the spatial sweep model, but failed to alert the reader to the same effect arising in the behaviordependent model (which is illustrated in Figure 2). We rectified this oversight.
Relatedly, the use of the speed term needs to be clarified in several places:
a. In Figure 7D, cell firing properties are separated for different speed levels. Over what time scales was speed measured? Are these speed levels the "average speed" term in equation (3)?
We used the label “running speed” (without further qualifiers) consistently to refer to the instantaneous speed because we felt that the former was more standard even though the latter is more precise. Thus, “running speed” in Figure 7D refers to instantaneous running speed as in the other panels of Figure 7 and in Figures 35. The characteristic speed term in Eqation 3 was used when generating spiking activity from the behaviordependent model, but this activity is then analyzed and plotted as a function of instantaneous speed in Figure 7D. The only time we show the characteristic speed in a figure is Figure 6, where we explicitly use the label “characteristic speed“. We made our use of terms explicit.
b. Based on equation (21), phase precession slope depends on the average speed in the behaviordependent sweep model. How does this fit on single trial phase precession slope? For single phase precession, is the "averaged speed" calculated from the limited data within that trial?
This point is probably already clarified by our replies above. The characteristic speed that controls phase precession slopes is calculated over multiple runs through the environment. The average speed of a single place field traversal is in fact what we take to be the traversal’s instantaneous running speed. This is because we select place field traversals during which rats ran at approximately constant speed. We show that this traversal speed does not affect phase precession slopes (Figure 5 D, E). In addition to clarifying what we mean by “characteristic running speed”, we have added a note in the Methods reminding the reader that the average speed of a single place field traversal is different from what we refer to as characteristic running speed.
3. Related to the above points, the two models that the authors contrast with their own with are oversimplified. Rather than highlighting the virtues of their own model, this creates the impression that any model in which place cells do not have unrealistic properties, such as place field width vanishing as the animal slows down, would work equally well. This impression is reinforced by the fact that crucial aspects of the model are not tested, and instead very general properties, some of which were already known, are tested as predictions of the model: running speed and properties of place cells vary along the track. To increase the impact of this work, the text should be revised to ensure that the authors' model is not compared with overly simplified models.
We would like to address this complex point in three parts. A: We argue that while the spatial and temporal sweep models are simple they are not unrealistic. B: Whether one considers them oversimplified or not, we believe there are important reasons to include them in our study since the ideas underlying spatial and temporal sweeps have played an important role in the literature and shaped our implicit assumptions about theta sequences. C: We agree that one could test for more aspects of the model and we have improved on this point.
A.1 The reviewers seem concerned that in the temporal sweep model, place field sizes vanish as the animal slows down. This is actually not the case. We have now tried to clarify this point in the manuscript. In the temporal sweep model, at zero speed, the position represented by the population, r(t), remains fixed at the animal’s current position. If a cell only fired when r(t) crossed the cell’s preferred position, defined as a single point in space, then the cell’s place field would become infinitely narrow as speed goes to zero. However, the cell’s preferred position is not defined as a point but as a ‘true’ place field with a finite nonnegligible size (more on the assumption of true place field sizes in our reply to comment 6). In our simulations of the spatial and temporal sweep models, the true place field size is ~30cm. Therefore, cells fire everywhere within the cells’ true place fields, even at zero speeds, which acts as a lower bound on the measured place field size. Thanks to this feature, the temporal sweep model does not do a particularly bad job at reproducing experimentally observed place field sizes (Figure 7B). We also note that the reviewers themselves have pointed out above that the advantage of behaviordependent sweeps over temporal sweeps was not evident enough.
A.2 We note that the simulations of the temporal sweep (Figure 7B) and spatial sweep (Figure 7C) models were performed using experimentally measured theta phases and position data in the same way as they were for the behaviordependent model (Figure 7D). So, the three models are compared on an equal footing.
A.3 The behaviordependent sweep model is only minimally more complex than the other two. As discussed in the manuscript and above in comment 2, the behaviordependent sweep model is like the spatial sweep model where place field size depends on characteristic speed (Equation 5). Alternatively, it can also be seen as an approximation of temporal sweeps where characteristic speed is used instead of instantaneous speed. We feel that this additional assumption does not put the behaviordependent sweep model in a different class of models from the other two.
B.1 The spatial and temporal sweep models are the most straightforward explanation for certain subsets of experimental findings, and as such deserve attention. The spatial sweep model is the simplest model that explains constant place field sizes and phase precession slopes, and temporal sweeps are the simplest explanation for the approximately proportional increase in theta trajectory length with speed observed by (Maurer et al., 2012) and (Gupta et al., 2012).
B.2 The models serve the function of articulating two ways of understanding the theta phase code that are more or less implicit in the literature. Spatial and temporal sweeps crystallize the ideas that different phases of theta encode positions “behind or ahead” or “in the past and future” respectively, which are pervasive in the field. Most researchers likely use these terms rather loosely, and do not endorse spatial nor temporal sweeps fully. However, we believe it is important to highlight what this language implies when taken literally, as this can help bring greater clarity and understanding.
B.3 Sometimes this language is, in fact, used literally or reflected explicitly in computational models. For instance, (Itskov et al., 2008) write that “place cell activity on different phases of theta reflects positions shifted into the future or past along the animal’s trajectory in a twodimensional environment”. They conclude this after they find that among several models, the one that best fits experimental data is essentially what we describe as the temporal sweep (with the only difference that r(t) does not jump abruptly between theta cycles as in our model). (Chadwick et al., 2015)’s model of phase precession and theta trajectories, on the contrary, assumes that the phasevsposition relationship of all cells is identical, consistent with what we describe as spatial sweeps. Most computational modeling work using place cells for path integration or goal directed navigation (e.g., (Brzosko et al., 2017; Foster et al., 2000; Samsonovich and McNaughton, 1997)) also make the simplifying assumption that all place fields are identical, which is again consistent with spatial sweeps.
B.4 Spatial and temporal sweeps set the context for understanding behaviordependent sweeps, which can be construed as combining aspects of both.
C.1 When introducing the behaviordependent sweep model, we have added equations showing how theta trajectory lengths and place field sizes depend linearly, and phase precession slopes hyperbolically, on characteristic running speed. This makes it easier to understand why the data shown on Figure 6 supports the behaviordependent sweep model.
C.2 Since the model predicts a hyperbolic relationship between phase precession slopes and characteristic running speed, plotting the inverse of phase precession slopes should reveal a linear relationship. Therefore in Figure 6 we have plotted inverse phase precession slopes instead of phase precession slopes.
C.3 We have added moving averages to the plots showing place field size and inverse phase precession slope vs characteristic speed. The moving averages shows that the relationship between inverse phase precession slope and characteristic speed is indeed approximately linear for almost the complete range of speeds. The increases in theta trajectory lengths and place field sizes with characteristic speed also appear very linear for up to ~60 cm/s, which encompasses most of the data, and then flatten out. In the new supplementary figures S4 we show that the relationship between theta trajectory length and characteristic speed for each individual animal does not seem to flatten out, suggesting that the flattening in the pooled data is at least partly caused by combining points from clouds with different slopes and speed ranges.
C.4 We discuss whether we could additionally compare behaviordependent sweeps to other models in our reply to comment 5.
4. The authors should make sure that prior work from other labs is presented in its proper context and not specifically associated with one of the two overly simplified models presented in the text.
We did not intend to imply that our colleagues have explicitly endorsed or would endorse either of these models. We simply meant to point out which individual previous findings were consistent with each of these conceptual models in the regimes that were examined. We have clarified this where possible.
There might have also been some specific misunderstandings regarding our citations of (Maurer et al., 2012) and (Geisler et al., 2007). Upon reflection we realized that we used the reference to Maurer et al., in a confusing way, since we cite them as evidence for both spatial and temporal sweeps without clarification. Their main findings (theta trajectory length increasing proportionally with speed) appear consistent with temporal sweeps, whereas their supplementary figure 1 (place field sizes do not change with speed) appears consistent with spatial sweeps. We clarified which result of Maurer et al., is consistent with which model. We also note that we have discussed our work with Andrew Maurer, who does not feel we have misrepresented his findings or interpretations.
We cited the work by Geisler et al., in support of spatial sweeps, while Reviewer 3 comments that Geisler et al., seem to claim the opposite, for example based on the following quote: 'Furthermore, the phase advance of the spikes relative to theta was steeper in fast than in slow trials'. The key to resolving this apparent contradiction is the underlined phrase. Geisler et al., describes phase precession relative to theta. We refer to phase precession with respect to position. There is actually no contradiction. In order to keep the phase vs. position relationship fixed (as described by spatial sweeps), the phase vs. theta/time relationship needs to become steeper with increasing speed. By contrast, if the phase vs. theta/time relationship remained constant, it would always take the same number of theta cycles to complete the phase precession, and that would result in place field sizes and (spatial) phase precession slopes increasing with speed. Hence, Geisler et al., conclude: “Here we directly show that the temporalphase precession slope, and therefore the oscillation frequency of place cells, is positively correlated with the locomotion speed of the rat, such that the phasedistance relationship remains invariant”. We clarified in our manuscript that phase precession can be/was studied with respect to different variables.
5. To address the issue whether field size or speed is better correlated with theta (spatial) length, the authors may consider producing a plot similar to Figure 7A, but using (mean) place field size rather than (mean) running speed, and adding a simulation condition using mean place field size as a controlling variable. The outcome could be one is better than the other, or they are similar or equivalent. Regardless of the outcome, the authors could discuss further the functional differences between these scenarios.
Following the reviewers' request, we added a new supplementary figure S3 which shows the mutual relationships between theta trajectory lengths, place field sizes and also (inverse) phase precession slopes. Based on the equations we derive in the section “Mathematical description of coding schemes”, we expected these variables to display linear relationships to one another. This is indeed the case. The three variables display noisy but strikingly linear relationships to each other. The relationships between theta trajectory length and either mean place field size or mean (inverse) phase precession slope have correlation coefficients of 0.29, whereas the relationship between theta trajectory length and characteristic running speed has a slightly stronger correlation coefficient of 0.35. A couple of explanations for this small discrepancy quickly come to mind. First, some cells participating in the analysis of theta trajectory lengths were excluded from the analysis of place field size or phase precession slope because they displayed overlapping phase precession clouds. Second, place fields are skewed in systematic ways (Figure S6A). Theta trajectory lengths will be shorter or longer depending on whether they occur on the shorter or longer tails of the place fields. The place field size is calculated over the whole field and therefore misses this effect. Based on these results and considerations, we would expect a model that takes place field sizes as input to perform reasonably well, especially if it can also take into account other measures such as place field skews. However, note that theta trajectory lengths, place field sizes, skews or phase precession slopes are all partly redundant measurements of the same underlying neuronal activity. As such, it must be possible to reconstruct one measurement out of combinations of the others. But this would offer no direct insight as to why any of the variables changes in the first place. The three models we have put forward and contrasted to each other attempt to provide an account for the theta phase code. But what the cells are coding for must necessarily be described in terms of variables that are external to the place cells themselves. This is why we decided not to include results on a model where d_theta depends on the width and density of place fields or some other combination of place cell measurements.
6. What is the evidence for the assumption of a "true place field"? What are the potential limitations of this assumption?
The idea of a ‘true’ place field dates back at least to (Tsodyks et al., 1996)’s model of phase precession and virtually all experimental studies on theta sequences assume (even if implicitly) that the true place field of a place cell differs from its measured firing field. In the Tsodyks et al., model, at the beginning of each theta cycle, the place cells selective for the current position of the animal become activated, and then trigger the activation of cells that represent positions progressively further ahead. This results in the fact that only firing in the last part of the measured place field (where cells fire at the beginning of the theta cycle) is indicative of the animal being at the cells’s preferred location. John Lisman explicitly used the term “true place field” to refer to this preferred firing location when discussing a similar model (Lisman et al., 2005; Sanders et al., 2015). In experimental studies, it is generally agreed upon that the position represented by the hippocampal population sweeps forward during theta cycles, possibly starting behind the animal and reaching ahead (e.g. (Cei et al., 2014; Dragoi and Buzsáki, 2006; Drieu and Zugaro, 2019; Gupta et al., 2012; Itskov et al., 2008; Jensen and Lisman, 1996; Kay et al., 2020; Muessig et al., 2019; Terada et al., 2017)). This actually implies the existence of a ‘true’ place field. The true place field is, by definition, the portion of the field where the cell fires when representing the current position of the animal. When cells fire to represent positions behind or ahead of the animal, they would be firing outside of their true place fields. Another way of looking at it is that if the firing of place cells is indicative of a represented location r(t), which deviates from the current location x(t), then cells can fire when r(t) is located inside the cell’s preferred location while x(t) is not. That would result in firing outside of the cell’s preferred location or true place field. The opposite can also happen: that a place cell fails to spike when the animal is located within its true place field because the population is representing an r(t) that lies outside of it.
The alternative to the concept of true place fields would be to assume that cells always represent the current position of the animal (r(t) is always equal to x(t)). In this view, the change in theta phase across the field would just add more precision to the spatial code (e.g., cell A firing at 300º indicates that the animal is currently at position x, and the same cell firing at 60º indicates that the animal is currently at a different position y) (O’Keefe and Recce, 1993). However, in 2D open fields, the onetoone mapping between positions and phases breaks down. A cell will fire at different phases in the same position depending on whether it is arriving at the field or exiting it (Huxter et al., 2008; Jeewajee et al., 2014). Hence, the spatial code would become less straightforward, having to take into account both theta phase and movement direction to decode the current spatial position. The interpretation that firing at different phases reflects arriving at or coming from the cell’s true place field then becomes more parsimonious. It also seems to fit better with accounts of phase precession reversal during backwards travel (Cei et al., 2014; Maurer et al., 2014), prospective shifts in the location of place fields (Battaglia et al., 2004), or constant subsecond cycling between representations of possible futures (Kay et al., 2020), as well as with the potential role of theta phase precession in memory and planning (Bolding et al., 2020; Robbe and Buzsáki, 2009; Zheng et al., 2021).
So the assumption of true place fields, although rarely made explicit, is actually deeply ingrained in the field. If it turned out to be wrong, a reinterpretation of most of the literature on theta phase coding would be required and some common methods would need to be reevaluated (e.g., the ways in which position is decoded from ensemble place cell activity would turn out be misleading, since they produce theta trajectories that constantly deviate from the current position of the animal).
We changed the text to discuss the concept of true place fields explicitly in the manuscript.
7. To increase impact, the overall organization and presentation of ideas should be revised to ensure clarity for a general audience.
After making numerous clarifications and improvements throughout the text motivated by the reviewer’s comments, we feel that the manuscript has become much more accessible for a general audience.
We considered trying to resolve the contradictions earlier, in Figures 4 and 5, as opposed to waiting until Figure 6, like Reviewer 3 suggested. We decided not to do so because we think it is helpful to keep a twoparts structure, where in the first part we reproduce in the same dataset the combination of conflicting results, and in the second part we offer a solution to the conflict. The solution in Figure 6 now includes 9 panels. We believe it is beneficial to consider all of them together when trying to understand the proposed solution, so we prefer to dedicate a figure for this purpose. However, we have tried to add more early hints as to what the solution will be so that readers can better navigate the manuscript.
Reviewer #3:
The main result of the authors is a model that is compatible with experimental results. In my view, they should put some effort into clarifying whether this is a unique model or similar proposals would perform equally well. This means dissecting the crucial aspects that make this model better than any other (not just the two oversimplified models with unrealistic place field properties). Variations that I can think of are, for example, temporal sweeps with an overall mean speed rather than the mean speed for a given position, or spatial sweeps with a d_theta that depends on the width and density of place fields. If they find that there is a family of models sharing some crucial element that perform similarly, this would strengthen rather than weaken the manuscript.
It is a fair point to ask whether other models might account for the data equally well or better. However, the options advanced by the reviewer are problematic. Temporal sweeps with an overall mean speed rather than the mean speed at each position would end up being equivalent to spatial sweeps, because the lookahead and lookbehind distances are independent of location or characteristic speed. Spatial sweeps with a d_theta that depends on place field sizes would work, but as we explain in our reply to the essential revision number 5, we believe that such a model would play a different kind explanatory role, and is therefore not directly comparable to the models we consider.
In trying to improve on this point, we have tested another explanatory variable: the distance to the nearest end of the track, which is also the distance to the nearest reward location. This variable also turns out to have a significant effect on place field parameters, but characteristic running speed uniquely accounts for a larger fraction of the variance (when using linear models). Of course, it is possible that the relationship between place field parameters and distance to borders or reward is nonlinear. Further experiments are needed to fully dissociate the two variables. These results were added to the Results.
Finally, in the Discussion section we have tried to provide more alternatives to behaviordependent sweeps. For instance, we note that (Tanni et al., 2021) propose that place field sizes, and hence, presumably, theta trajectory lengths, depend on the spatial rate of change of visual input. Other alternatives could involve the density of sensory cues, the complexity of the maze, the level of retrospection and prospection required for the task, etc. Characteristic running speed is likely to be correlated with many of these variables. Further dedicated experimentation would be needed to determine which is more fundamental in driving the theta phase code.
30 – 'The current position of the animal'. There is an issue in how one defines this. What we typically have is an estimation of the position of LEDs that are placed somewhere above the animal's head. We ignore the distance between these LEDs and the position that CA1 considers to be the 'actual' position of the animal. Please comment on how this correction would affect the estimation of past and future positions at different speeds, especially when considering time sweeps.
This comment might be getting at two related issues. One is whether there is a shift between the position represented by CA1 and the position of the LEDs. This seems very likely. However, in a linear track, this would just mean that the position of all place fields and theta trajectories should be shifted forwards or backwards by some fixed amount. Other than that, place field and theta trajectory parameters should remain constant, including lookbehind and lookahead distances.
The second issue is whether we can know at which phase of theta the CA1 population represents the ‘actual’ position of the animal. This seems difficult, especially in a linear track. In our equations, the phase at which the current position is represented is θ_{0}. This parameter determines the ratio between lookahead and lookbehind. As the reviewer points out, changing this ratio would have an effect on temporal sweeps in the presence of positive or negative acceleration. For instance, given positive acceleration, the more (temporal) lookahead there is as compared to lookbehind, the bigger the place fields would become. We have added this point to the discussion.
98 – This length does not seem to be affected by a potential increase in field size as a result of place cells increasing their firing rate with speed. Why is this not taken into account?
We assume that firing rate is modulated by a multiplicative factor that scales up or down the activity of place cells. This multiplicative scaling would mean that the shapes of place cells’ firing fields remain unaffected. Since the size of place fields is calculated by considering when the firing rate falls below a certain fraction of the peak firing rate, scaling the place fields would not affect their sizes. We observe an increase in firing rate with speed (Figure S6 B), but no change in place field sizes within individual cells (Figure 4B). Therefore, the assumption of multiplicative scaling seems reasonable. The multiplicative scaling would also mean that firing rate changes have no effect on theta trajectories. This is because the ratios between spike counts of different cells at different phases of theta, which drive the Bayesian decoding of position, would remain unaffected.
625 – Equation 12. It should be clarified that this is an approximation, since phase precession has been shown to be highly nonlinear already by O'Keefe and Recce. Thus, the exact value of the slope is highly dependent on the method, especially on the relative sampling of different phase ranges.
We agree. We have added the following clarification:
“Note that the model makes the simplifying assumption that sweeps, and hence also phase precession, are linear. There are indications that this could be the case when analyzing single trials (Schmidt et al., 2009) or when calculating theta phase using a waveform method (Belluscio et al., 2012) (but see (Souza and Tort, 2017; Yamaguchi et al., 2002)).”
108 – L = v(t). As I understand it, dimensions do not match. The same happens to Equation 16 in the methods. Do parenthesis stand for multiplication or evaluation of the function v at a given time?
Unfortunately, standard mathematical notation uses parenthesis for both multiplication and function evaluation. Here, they were meant to indicate multiplication, and therefore the units on both sides of the equation match. To avoid the ambiguity, we swapped the terms in the product, i.e., L=(tau+T)v.
108 – 'This is almost exactly the result reported by Maurer et al., (2012); Gupta et al., (2012).'. Please specify how and in which figures. For example, Figure 8 from Gupta et al., seems to be at odds with this claim.
Unfortunately, standard mathematical notation uses parenthesis for both multiplication and function evaluation. Here, they were meant to indicate multiplication, and therefore the units on both sides of the equation match. To avoid the ambiguity, we swapped the terms in the product, i.e., L=(tau+T)v.
112 – Please specify or give an example of which procedures or methods can cause a contradiction. It is not clear from the text.
We have added some preliminary suggestions here and now refer the reader to the Discussion, where discuss specific hypotheses in the subsection “Relationship to previous studies on the speeddependence of the hippocampal code”. We feel that the details given there would be too much in the beginning of the paper.
Figure 4a – The visualization of these examples is really poor. Since the purpose of this panel is visualization, I suggest to find a better way, perhaps with fewer examples or speed bins.
We have zoomed in around the fields, which seems to help.
Figure 4bc – Although the conclusion is plausible, and the examples seem to indicate this, the analysis is not convincing. The procedure based on regressing 7 datapoints has too much error, and this might mask an effect at the population level. (For example, are these individual regressions significant?) A high pvalue does not necessarily mean that there is no effect. I suggest trying other methods. For example, the halfwidth decay in the spatial autocorrelation for the population of all cells could be studied and compared at different speeds. Fewer speed groups would also help getting better statistics. All of the analyses could also be applied to pools of cells with neighboring fields, to explain the contradiction right a way and thus help the reader navigate the manuscript.
We agree that regressing 7 datapoints (at most; there can be as few as two, depending on the number of speed bins with valid measurements) is definitely noisy and we do not expect those individual regressions to be statistically significant. However, we do not see any reason to suspect that the noise could be systematically biased in any particular direction (e.g., that the regressions would tend to produce positive or negative slopes in the absence of an underlying positive or negative relationship, respectively). Therefore, it is appropriate to aggregate many of those noisy measurements and then apply a statistical test to assess whether the population of place fields as a whole increases or decreases place field size or phase precession slope with speed. The pvalues in Figure 4B refer to the population level test. The same principle is applied in all statistical tests, noisy individual measurements are pooled and tested at the population level, e.g. whether a drug alleviates an illness in a specific person is a very noisy measurement, but nevertheless one can find evidence for an effect in a large population.
With regards to the alternative analysis suggested, one could in principle compare the spatial autocorrelation for the population of cells at different speeds. However, that is a population measure and not a singlecell measure, which is what we focus on in Figure 4B. Nevertheless, since individual place field sizes do not change with speed, the halfwidth decay of the spatial autocorrelation of the population should not change either (we imagine this could be the reviewer’s reasoning). There is one problem with this reasoning: Not all positions were traversed at all speeds, e.g., some positions near the borders were never traversed at high speed; some positions near the center were never traversed at low speeds. Hence firing rate maps are undefined at some positions and speeds and would not participate in the autocorrelation. The autocorrelation would then reflect data from different positions at different speeds. In other words, the population vector cannot be used in this way to study withincell changes due to speed. In the end, we would see a similar effect of speed on autocorrelation width as we seen when we combine place field sizes across fields for each speed bin (Figure 4C). That relationship is statistically significant.
178 – It is not clear at this point of the manuscript why both results are compatible with behavior dependent sweeps. This might need some more explanation.
We now make that more explicit that this is the prediction depicted in Figure 2.
191 – I suggest to try to make explicit and consistent the description of slopes. Unfortunately, describing a negative slope as 'lower' is ambiguous. Similarly, in 209 an 'increase in the slope' is mentioned, which is also ambiguous. Please revise this language throughout the manuscript. I believe people in the past have referred to slopes as shallower or steeper to avoid ambiguity.
We agree with the reviewer and have made the suggested change.
181 – 194. What would the different models predict and why?
After the single pass phase precession analysis we briefly commented on which of the results fitted which of the models. This was meant to apply also to the pooled phase precession results discussed above, but that was not clear. We have improved on this and also added references to the relevant equations.
234 – Why are these results striking? Similar findings have been reported before. For example in Gupta et al., 2012. I disagree with lines 312 – 314. Figure S3 of Gupta et al. shows very similar results to the ones analyzed here.
That is a fair point. We removed the word “striking” and changed “Two previous studies (Maurer et al., 2012; Gupta et al., 2012) pooled theta trajectories based exclusively on speed, therefore masking the role of position in mediating the relationship between speed and theta trajectory length” to “[…] pooled theta trajectories across different positions when showing the effect of speed on theta trajectory length”.
Figure 6A – If this explains the apparent contradictions found in Figures 4 and 5, then pooling locations with similar average speed should make the pooled average effects disappear. This needs to be shown in those figures to help readers navigate the manuscript.
The reviewer is correct in principle, however, the suggested analysis is unlikely to add more clarity. If the range of characteristic speeds considered was too narrow, too few place fields would be pooled together, and the relationship between place field size and speed would be very noisy. If, on the other hand, a bigger range of characteristic speeds was used to pool place fields, we would start to see again the problem that different place fields contribute to the low and high speed averages. However, we have added some more early hints as to what is happening so that the readers are less confused in the buildup to Figure 6.
Figure 6,BC – running speed at 0.25 is leeds then two thirds of the speed at 0.75. However theta length trajectories are similar. To my view this speaks directly against the simple explanation that is being tested 'Short theta trajectories and small place field sizes could occur where animals tend to run slow, contributing to the low speed averages, and long theta trajectories and large place field sizes could occur where animals tend to run fast, contributing to the fast speed averages'. There seems to be something else going on here.
The reviewer is right, this a curious effect that might arise due to interindividual differences between animals or differences in acceleration at different locations. Regarding the first point, the relationships between theta trajectory length and characteristic speed for each animal are mostly linear (new Figure S4), whereas the relationship flattens in the pooled data (new Figure 6G). We added a discussion of this point to the Results. Regarding the second point, there might be differences in acceleration between the first and second halves of the track. If there was more lookahead than lookbehind, then, given equal speed, theta trajectories could be longer in areas of positive acceleration. As we had commented in the Discussion, future work is needed to the study the potential effects of acceleration for future work where the data analyzed contains periods of more sustained acceleration and deceleration.
329 – Figure S5. In this paragraph an alternative model is discarded, but no quantification is provided. In the last two subpanels of panel F, Can the authors show how phase precession looks at these speeds in the experimental data and in their model, and compare it with the alternative model?
To facilitate a fairer evaluation of the Chadwick et al., model, we now quantify the differences between the experimental data and our “variable noise model”, which is based on the same principle as Chadwick et al.,’s, but was fitted to our experimental data. The conclusion remains that this type of model cannot account for some key aspects in our data.
Please discuss how much of these behavioraldependent sweeps could be thought of a side effect of a behavioraldependent place field size and density resulting from the process of place cells learning their place fields.
As we discussed in the reply to Essential Revisions no. 5, since place field size is correlated with characteristic speed, we cannot rule out that the effect of characteristic speed on theta coding is mediated via place field size. We have therefore added the following to the section titled “Potential mechanisms of behaviordependent sweeps”:
“Alternatively, on the view that theta sequences arise from independent single cell coding (Chadwick et al., 2015), behaviordependent sweeps could be seen as resulting from larger learned place fields in areas of faster running.”
References
Battaglia, F. P., Sutherland, G. R., and McNaughton, B. L. (2004). Local sensory cues and place cell directionality: Additional evidence of prospective coding in the hippocampus. The Journal of Neuroscience : The Official Journal of the Society for Neuroscience, 24(19), 4541–4550. https://doi.org/10.1523/JNEUROSCI.489603.2004
Belluscio, M. A., Mizuseki, K., Schmidt, R., Kempter, R., and Buzsáki, G. (2012). CrossFrequency Phase–Phase Coupling between Theta and Γ Oscillations in the Hippocampus. The Journal of Neuroscience, 32(2), 423–435. https://doi.org/10.1523/jneurosci.412211.2012
Bolding, K. A., Ferbinteanu, J., Fox, S. E., and Muller, R. U. (2020). Place cell firing cannot support navigation without intact septal circuits. Hippocampus, 30(3), 175–191. https://doi.org/10.1002/hipo.23136
Brzosko, Z., Zannone, S., Schultz, W., Clopath, C., and Paulsen, O. (2017). Sequential neuromodulation of Hebbian plasticity offers mechanism for effective rewardbased navigation. eLife, 6, e27756. https://doi.org/10.7554/eLife.27756
Cei, A., Girardeau, G., Drieu, C., Kanbi, K. E., and Zugaro, M. (2014). Reversed theta sequences of hippocampal cell assemblies during backward travel. Nat Neurosci, 17(5), 719–724. https://doi.org/10.1038/nn.3698
Chadwick, A., van Rossum, M. C., and Nolan, M. F. (2015). Independent theta phase coding accounts for CA1 population sequences and enables flexible remapping. ELife, 4, e03542. https://doi.org/10.7554/eLife.03542
Dragoi, G., and Buzsáki, G. (2006). Temporal Encoding of Place Sequences by Hippocampal Cell Assemblies. Neuron, 50(1), 145–157. https://doi.org/10.1016/j.neuron.2006.02.023
Drieu, C., and Zugaro, M. (2019). Hippocampal Sequences During Exploration: Mechanisms and Functions. Frontiers in Cellular Neuroscience, 13. https://doi.org/10.3389/fncel.2019.00232
Foster, D. J., Morris, R. G., and Dayan, P. (2000). A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus, 10(1), 1–16. https://doi.org/10.1002/(SICI)10981063(2000)10:1<1::AIDHIPO1>3.0.CO;21
Geisler, C., Robbe, D., Zugaro, M., Sirota, A., and Buzsáki, G. (2007). Hippocampal place cell assemblies are speedcontrolled oscillators. Proceedings of the National Academy of Sciences of the United States of America, 104(19), 8149–8154. https://doi.org/10.1073/pnas.0610121104
Gupta, A. S., van der Meer, M. A., Touretzky, D. S., and Redish, A. D. (2012). Segmentation of spatial experience by hippocampal theta sequences. Nature Neuroscience, 15(7), 1032–1039. https://doi.org/10.1038/nn.3138
Huxter, J. R., Senior, T. J., Allen, K., and Csicsvari, J. (2008). Theta phasespecific codes for twodimensional position, trajectory and heading in the hippocampus. Nature Neuroscience, 11(5), 587–594. https://doi.org/10.1038/nn.2106
Itskov, V., Pastalkova, E., Mizuseki, K., Buzsaki, G., and Harris, K. D. (2008). Thetamediated dynamics of spatial information in hippocampus. The Journal of Neuroscience, 28(23), 5959–5964. https://doi.org/10.1523/JNEUROSCI.526207.2008
Jeewajee, A., Barry, C., Douchamps, V., Manson, D., Lever, C., and Burgess, N. (2014). Theta phase precession of grid and place cell firing in open environments. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1635), 20120532. https://doi.org/10.1098/rstb.2012.0532
Jensen, O., and Lisman, J. E. (1996). Hippocampal CA3 region predicts memory sequences: Accounting for the phase precession of place cells. Learning and Memory (Cold Spring Harbor, N.Y.), 3(2–3), 279–287.
Kay, K., Chung, J. E., Sosa, M., Schor, J. S., Karlsson, M. P., Larkin, M. C., Liu, D. F., and Frank, L. M. (2020). Constant Subsecond Cycling between Representations of Possible Futures in the Hippocampus. Cell, 180(3), 552567.e25. https://doi.org/10.1016/j.cell.2020.01.014
Lisman, J. E., Talamini, L. M., and Raffone, A. (2005). Recall of memory sequences by interaction of the dentate and CA3: A revised model of the phase precession. Neural Networks, 18(9), 1191–1201. https://doi.org/10.1016/j.neunet.2005.08.008
Maurer, A. P., Burke, S. N., Lipa, P., Skaggs, W. E., and Barnes, C. A. (2012). Greater running speeds result in altered hippocampal phase sequence dynamics. Hippocampus, 22(4), 737–747.
Maurer, A. P., Lester, A. W., Burke, S. N., Ferng, J. J., and Barnes, C. A. (2014). Back to the future: Preserved hippocampal network activity during reverse ambulation. The Journal of Neuroscience : The Official Journal of the Society for Neuroscience, 34(45), 15022–15031. https://doi.org/10.1523/jneurosci.112914.2014
Muessig, L., Lasek, M., Varsavsky, I., Cacucci, F., and Wills, T. J. (2019). Coordinated Emergence of Hippocampal Replay and Theta Sequences during Postnatal Development. Current Biology, 29(5), 834840.e4. https://doi.org/10.1016/j.cub.2019.01.005
O’Keefe, J., and Recce, M. L. (1993). Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus, 3(3), 317–330. https://doi.org/10.1002/hipo.450030307
Robbe, D., and Buzsáki, G. (2009). Alteration of theta timescale dynamics of hippocampal place cells by a cannabinoid is associated with memory impairment. The Journal of Neuroscience : The Official Journal of the Society for Neuroscience, 29(40), 12597–12605. https://doi.org/10.1523/JNEUROSCI.240709.2009
Samsonovich, A., and McNaughton, B. L. (1997). Path integration and cognitive mapping in a continuous attractor neural network model. The Journal of Neuroscience, 17(15), 5900–5920.
Sanders, H., RennóCosta, C., Idiart, M., and Lisman, J. (2015). Grid Cells and Place Cells: An Integrated View of their Navigational and Memory Function. Trends in Neurosciences, 38(12), 763–775. https://doi.org/10.1016/j.tins.2015.10.004
Schmidt, R., Diba, K., Leibold, C., Schmitz, D., Buzsáki, G., and Kempter, R. (2009). Singletrial phase precession in the hippocampus. The Journal of Neuroscience : The Official Journal of the Society for Neuroscience, 29(42), 13232–13241. https://doi.org/10.1523/jneurosci.227009.2009
Souza, B. C., and Tort, A. B. L. (2017). Asymmetry of the temporal code for space by hippocampal place cells. Scientific Reports, 7(1), 8507. https://doi.org/10.1038/s41598017086093
Tanni, S., Cothi, W. de, and Barry, C. (2021). State transitions in the statistically stable place cell population are determined by visual change. BioRxiv, 2021.06.16.448638. https://doi.org/10.1101/2021.06.16.448638
Terada, S., Sakurai, Y., Nakahara, H., and Fujisawa, S. (2017). Temporal and Rate Coding for Discrete Event Sequences in the Hippocampus. Neuron, 94(6), 12481262.e4. https://doi.org/10.1016/j.neuron.2017.05.024
Tsodyks, M. V., Skaggs, W. E., Sejnowski, T. J., and McNaughton, B. L. (1996). Population dynamics and theta rhythm phase precession of hippocampal place cell firing: A spiking neuron model. Hippocampus, 6(3), 271–280. https://doi.org/10.1002/(sici)10981063(1996)6:3\%3C271::aidhipo5\%3E3.0.co;2q
Yamaguchi, Y., Aota, Y., McNaughton, B. L., and Lipa, P. (2002). Bimodality of theta phase precession in hippocampal place cells in freely running rats. J Neurophysiol, 87(6), 2629–2642.
Zheng, C., Hwaun, E., Loza, C. A., and Colgin, L. L. (2021). Hippocampal place cell sequences differ during correct and error trials in a spatial memory task. Nature Communications, 12(1), 3373. https://doi.org/10.1038/s4146702123765x
https://doi.org/10.7554/eLife.70296.sa2Article and author information
Author details
Funding
German Research Foundation (419037518  FOR 2812,P2)
 Sen Cheng
Federal Ministry of Education and Research (01GQ1506)
 Sen Cheng
National Institute of Mental Health (NIMH R01MH109170)
 Kamran Diba
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Loren Frank for helpful discussions and Laia Serratosa Capdevila for feedback on the draft. We thank the anonymous reviewers for their thoughtful and extensive feedback which led to a clearer and more comprehensive article.
Senior and Reviewing Editor
 Laura L Colgin, University of Texas at Austin, United States
Publication history
 Preprint posted: April 14, 2021 (view preprint)
 Received: May 12, 2021
 Accepted: October 15, 2021
 Accepted Manuscript published: October 18, 2021 (version 1)
 Version of Record published: November 3, 2021 (version 2)
Copyright
© 2021, ParraBarrero et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics

 1,098
 Page views

 194
 Downloads

 1
 Citations
Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading

 Neuroscience
The automatic initiation of actions can be highly functional. But occasionally these actions cannot be withheld and are released at inappropriate times, impulsively. Striatal activity has been shown to participate in the timing of action sequence initiation and it has been linked to impulsivity. Using a selfinitiated task, we trained adult male rats to withhold a rewarded action sequence until a waiting time interval has elapsed. By analyzing neuronal activity we show that the striatal response preceding the initiation of the learned sequence is strongly modulated by the time subjects wait before eliciting the sequence. Interestingly, the modulation is steeper in adolescent rats, which show a strong prevalence of impulsive responses compared to adults. We hypothesize this anticipatory striatal activity reflects the animals’ subjective reward expectation, based on the elapsed waiting time, while the steeper waiting modulation in adolescence reflects agerelated differences in temporal discounting, internal urgency states, or explore–exploit balance.

 Computational and Systems Biology
 Neuroscience
How dynamic interactions between nervous system regions in mammals performs online motor control remains an unsolved problem. In this paper, we show that feedback control is a simple, yet powerful way to understand the neural dynamics of sensorimotor control. We make our case using a minimal model comprising spinal cord, sensory and motor cortex, coupled by long connections that are plastic. It succeeds in learning how to perform reaching movements of a planar arm with 6 muscles in several directions from scratch. The model satisfies biological plausibility constraints, like neural implementation, transmission delays, local synaptic learning and continuous online learning. Using differential Hebbian plasticity the model can go from motor babbling to reaching arbitrary targets in less than 10 min of in silico time. Moreover, independently of the learning mechanism, properly configured feedback control has many emergent properties: neural populations in motor cortex show directional tuning and oscillatory dynamics, the spinal cord creates convergent force fields that add linearly, and movements are ataxic (as in a motor system without a cerebellum).