Firing rate adaptation affords place cell theta sweeps, phase precession, and procession
Abstract
Hippocampal place cells in freely moving rodents display both theta phase precession and procession, which is thought to play important roles in cognition, but the neural mechanism for producing theta phase shift remains largely unknown. Here, we show that firing rate adaptation within a continuous attractor neural network causes the neural activity bump to oscillate around the external input, resembling theta sweeps of decoded position during locomotion. These forward and backward sweeps naturally account for theta phase precession and procession of individual neurons, respectively. By tuning the adaptation strength, our model explains the difference between ‘bimodal cells’ showing interleaved phase precession and procession, and ‘unimodal cells’ in which phase precession predominates. Our model also explains the constant cycling of theta sweeps along different arms in a Tmaze environment, the speed modulation of place cells’ firing frequency, and the continued phase shift after transient silencing of the hippocampus. We hope that this study will aid an understanding of the neural mechanism supporting theta phase coding in the brain.
eLife assessment
This study provides valuable new insights on how a prevailing model of hippocampal sequence formation can account for recent data, including forward and backward sweeps, as well as constant cycling of sweeps across different arms of a Tmaze. The convincing evidence presented in support of this work relies on classical analytical and computational techniques about continuous attractor networks.
https://doi.org/10.7554/eLife.87055.4.sa0Introduction
One of the strongest candidates for temporal coding of a cognitive variable by neural firing is the ‘theta phase precession’ shown by hippocampal place cells. As an animal runs through the firing field of a place cell, the cell ﬁres at progressively earlier phases in successive cycles of the ongoing local ﬁeld potential (LFP) theta oscillation, so that firing phase correlates with distance traveled (O’Keefe and Recce, 1993; Skaggs et al., 1996; see also Schmidt et al., 2009; Figure 1a and b). At the population level, phase precession of individual cells gives rise to forward theta sequences once starting phases are aligned across the population (Feng et al., 2015), where neurons representing successive locations along the trajectory of the animal display predictable firing sequences within individual theta cycles (Johnson and Redish, 2007). These prospective sequential experiences (looking into the future) are potentially useful for a range of cognitive faculties, e.g., planning, imagination, and decisionmaking (O’Keefe and Recce, 1993; Skaggs et al., 1996; Hassabis et al., 2007; Wikenheiser and Redish, 2015; Kay et al., 2020).
Besides prospective representation, ﬂexible behaviors also require retrospective representation of sequential experiences (looking into the past). For instance, in goaldirected behaviors, it is important to relate the reward information that might only occur at the end of a sequence of events to preceding events in the sequence (Foster et al., 2000; Foster and Wilson, 2006; Diba and Buzsáki, 2007). A recent experimental study (Wang et al., 2020) described retrospective sequences during online behaviors (also indicated by Skaggs et al., 1996; Yamaguchi et al., 2002), namely, reverse theta sequences, interleaved with forward theta sequences in individual theta cycles (Figure 1c). Such retrospective sequences, together with the prospective sequences, may cooperate to establish higherorder associations in episodic memory (Diba and Buzsáki, 2007; Jaramillo and Kempter, 2017; Pfeiffer, 2020).
While a large number of computational models of phase precession and the associated forward theta sequences have been proposed, e.g., the singlecell oscillatory models (O’Keefe and Recce, 1993; Kamondi et al., 1998; Harris et al., 2002; Lengyel et al., 2003; Losonczy et al., 2010) and recurrent activity spreading models (Tsodyks et al., 1996; Romani and Tsodyks, 2015), the underlying neural mechanism for interleaved forward and reverseordered sequences remains largely unclear. Do reverse theta sequences share the same underlying neural mechanism as forward sequences, or do they reﬂect different mechanisms? If they do, what kind of neural architecture can support the emergence of both kinds of theta phase shift? Furthermore, since forward theta sequences are commonly seen, but reverse theta sequences are only seen in some circumstances (Wang et al., 2020), are they commensurate with forward theta sequences? If not, to what degree are forward theta sequences more significant than the reverse ones?
To address these questions, we built a continuous attractor neural network (CANN) of the hippocampal place cell population (Amari, 1977; Tsodyks and Sejnowski, 1995; Samsonovich and McNaughton, 1997; Tsodyks, 1999). The CANN conveys a map of the environment in its recurrent connections that affords a single bump of activity on a topographically organized sheet of cells which can move smoothly so as to represent the location of the animal as it moves in the environment. Each neuron exhibits firing rate adaptation which destabilizes the bump attractor state. When the adaptation is strong enough, the network bump can travel spontaneously in the attractor space, which we term as the intrinsic mobility. Intriguingly, we show that, under competition between the intrinsic mobility and the extrinsic mobility caused by locationdependent sensory inputs, the network displays an oscillatory tracking state, in which the network bump sweeps back and forth around the external sensory input. This phenomenon naturally explains the theta sweeps found in the hippocampus (Skaggs et al., 1996; Burgess et al., 1994; Foster and Wilson, 2007), where the decoded position sweeps around the animal’s physical position at theta frequency. More specifically, phase precession occurs when the bump propagates forward while phase procession occurs when the network bump propagates backward. Moreover, we find that neurons can exhibit either only predominant phase precession (unimodal cells) when adaptation is relatively strong, or interleaved phase precession and procession (bimodal cells) when adaptation is relatively weak.
In addition to theta phase shift, our model also successfully explains the constant cycling of theta sweeps along different upcoming arms in a Tmaze environment (Kay et al., 2020), and other phenomena related to phase precession of place cells (Geisler et al., 2007; Zugaro et al., 2005). We hope that this study facilitates our understanding of the neural mechanism underlying the rich dynamics of hippocampal neurons and lays the foundation for unveiling their computational functions.
Results
A network model of hippocampal place cells
To study the phase shift of hippocampal place cells, we focus on a onedimensional (1D) CANN (mimicking the animal moving on a linear track, see Figure 2a), but generalization to the 2D case (mimicking the animal moving in a 2D arena) is straightforward (see Discussion for more details). Neurons in the 1D CANN can be viewed as place cells rearranged according to the locations of their firing fields on the linear track (measured during free exploration). The dynamics of the 1D CANN is written as:
Here, $U(x,t)$ represents the presynaptic input to the neuron located at position $x$ on the linear track, and $r(x,t)$ represents the corresponding firing rate constrained by global inhibition (Hao et al., 2009). $\tau $ is the time constant, $\rho $ the neuron density, $k$ the global inhibition strength, and $g$ is the gain factor. The dynamics of $U(x,t)$ is determined by the leaky term $U(x,t)$, the recurrent input from other neurons, the firing rate adaptation $V(x,t)$, and the external input ${I}^{ext}(x,t)$. The recurrent connection strength $J(x,{x}^{\prime})$ between two neurons decays with their distance. For simplicity, we set $J(x,{x}^{\prime})$ to be the Gaussian form, i.e., $J(x,{x}^{\prime})={J}_{0}/\sqrt{2\pi a}\mathrm{exp}\left[{(x{x}^{\prime})}^{2}/(2{a}^{2})\right]$, with ${J}_{0}$ controlling the connection strength and $a$ the range of neuronal interaction. Such connectivity gives rise to a synaptic weight matrix with the property of translation invariance. Together with the global inhibition, the translation invariant weight matrix ensures that the network can hold a continuous family of stationary states (attractors) when no external input and adaptation exist (Tsodyks and Sejnowski, 1995; Samsonovich and McNaughton, 1997; McNaughton et al., 2006; Wu et al., 2008), where each attractor is a localized firing bump representing a single spatial location (Figure 2b). These bump states are expressed as (see ‘Stability analysis of the bump state’ for the parameter settings and ‘Deriving the network state when the external input does not exist (I^{ext} = 0)’ for the detailed mathematical derivation):
where ${A}_{r}(t)$ denotes the bump height and $z(t)$ the bump center, i.e., the spatial location represented by the network. For convenience, we set the external input to be of the Gaussian form, which is written as: ${I}^{ext}\left(x,t\right)=\alpha exp\left[{\left(x{\mathcal{v}}_{ext}t\right)}^{2}/\left(4{a}^{2}\right)\right]$, with ${v}_{ext}$ representing the moving speed and $\alpha $ controlling the external input strength. Such external moving input represents locationdependent sensory inputs (i.e. corresponding to the animal’s physical location) which might be conveyed via the entorhinalhippocampal or subcortical pathways (van Strien et al., 2009). The term $V(x,t)$ represents the firing rate adaptation (Alonso and Klink, 1993; Fuhrmann et al., 2002; Benda and Herz, 2003; Treves, 2004), whose dynamics is written as:
where $m$ controls the adaptation strength, and $\tau}_{\mathcal{v}$ is the time constant. The condition ${\tau}_{\mathcal{v}}\gg \tau$ holds, implying that the firing rate adaptation is a much slower process compared to neuronal firing. In effect, the firing rate adaptation increases with the neuronal activity and contributes to destabilizing the active bump state, which induce rich dynamics of the network (see below).
Oscillatory tracking of the network
Overall, the bump motion in the network is determined by two competing factors, i.e., the external input and the adaptation. The interplay between these two factors leads to the network exhibiting oscillatory tracking in an appropriate parameter regime. To elucidate the underlying mechanism clearly, we explore the effects of the external input and the adaptation on bump motion separately. First, when firing rate adaptation does not exist in the network ($m=0$), the bump tracks the external moving input smoothly (see Figure 2c). We refer to this as the ‘smooth tracking state’, where the internal location represented in the hippocampus (the bump position) is continuously tracking the animal’s physical location (the external input location). This smooth tracking property of CANNs has been widely used to model spatial navigation in the hippocampus (Tsodyks and Sejnowski, 1995; Samsonovich and McNaughton, 1997; McNaughton et al., 2006; Battaglia and Treves, 1998). Second, when the external drive does not exist in the network ($\alpha =0$) and the adaptation strength $m$ exceeds a threshold ($m>\tau /{\tau}_{\mathcal{v}}$), the bump moves spontaneously with a speed calculated as $\mathcal{v}}_{int}=\left(2a/{\tau}_{\mathcal{v}}\right)\sqrt{m{\tau}_{\mathcal{v}}/\tau \sqrt{m{\tau}_{\mathcal{v}}/\tau}$ (see Figure 2d and e and ‘Analysis of the intrinsic mobility of the bump state’ for more details). We refer to this as the ‘traveling wave state’, where the internal representation of location in the hippocampus is sequentially reactivated without external drive, resembling replaylike dynamics during a quiescent state (see Discussion for more details). This intrinsic mobility of the bump dynamics can be intuitively understood as follows. Neurons around the bump center have the highest firing rates and hence receive the strongest adaptation. Such strong adaptation destabilizes the bump stability at the current location, and hence pushes the bump away. After moving to a new location, the bump will be continuously pushed away by the firing rate adaptation at the new location. As a result, the bump keeps moving on the linear track. Similar mechanisms have been applied to explain mental exploration (Hopfield, 2010), preplay during sharp waveripple events in the hippocampus (Azizi et al., 2013), and the free memory recall phenomenon in the brain (Dong et al., 2021).
When both the external input and adaptation are applied to the CANN, the interplay between the extrinsic mobility (caused by the external input) and the intrinsic mobility (caused by the adaptation) will induce three different dynamical behaviors of the network (see Video 1 for demonstration), i.e., (1) when $m$ is small and $\alpha $ is large, the network displays the smooth tracking state; (2) when $m$ is large and $\alpha $ is small, the network displays the traveling wave state; (3) when both $m$ and $\alpha $ have moderate values, the network bump displays an interesting state, called the ‘oscillatory tracking state’, where the bump tracks the external moving input in an oscillatory fashion (Figure 2f and g). Intuitively, the mechanism for oscillatory tracking can be understood as follows. Due to the intrinsic mobility of the network, the bump tends to move at its own intrinsic speed (which is faster than the external moving input, see Figure 2d), i.e., the bump tries to escape from the external input. However, due to the strong locking effect of the external input, the bump cannot run too far away from the location input, but instead, is attracted back to the location input. Once the bump returns, it will keep moving in the opposite direction of the external input until it is pulled back by the external input again. Over time, the bump will sweep back and forth around the external moving input, displaying the oscillatory tracking behavior. It is noteworthy that the activity bump does not live within a window circumscribed by the external input bump (bouncing off the interior walls of the input during the oscillatory tracking state), but instead is continuously pulled back and forth by the external input (see Appendix 1—figure 1).
Our study shows that during oscillatory tracking, the bump shape is roughly unchanged (see previous sections for the condition of shape variability), and the bump oscillation can be well represented as the bump center sweeping around the external input location. The dynamics of the bump center can be approximated as a propagating sinusoidal wave (Figure 2f), i.e.,
where $z(t)$ is the bump center at time $t$ (see Equation 3). $s(t)$ denotes the displacement between the bump center and the external input, which oscillates at the frequency $\omega $ with the amplitude ${c}_{0}>0$ and a constant offset ${d}_{0}>0$ (see ‘Analysis of the oscillatory tracking behavior of the bump state’ for the values of these parameters and ‘Deriving the oscillatory tracking state of the network when the external input is applied (I^{ext}≠0)’ for the detailed derivation). When the firing rate adaptation is relatively small, the bump oscillation frequency can be analytically solved to be (see also Appendix 1—figure 2):
We see that the bump oscillation frequency $\omega $ increases sublinearly with the external input strength $\alpha $ and the adaptation strength $m$ (Figure 2h and i). By setting the parameters appropriately, the bump can oscillate in the theta band (6–10 Hz), thus approximating the experimentally observed theta sweeps (see below). Notably, LFP theta is not explicitly modeled in the network. However, since theta sweeps are bounded by individual LFP theta cycles in experiments, they share the same oscillation frequency as LFP theta. For convenience, we will frequently use the term LFP theta below and study firing phase shift in individual oscillation cycles.
Oscillatory tracking accounts for both theta phase precession and procession of hippocampal place cells
In our model, the bump center and external input represent the decoded and physical positions of the animal, respectively, thus the oscillatory tracking of the bump around the external input naturally gives rise to the forward and backward theta sweeps observed empirically (Figure 3a and b; Wang et al., 2020). Here, we show that oscillatory tracking of the bump accounts for the theta phase precession and procession of place cell firing.
Without loss of generality, we select the neuron at location $x=0$ as the probe neuron and examine how its firing phase changes as the external input traverses its firing field (Figure 3c). In the absence of explicitly simulated spike times, the firing phase of a neuron in each theta cycle is measured by the moment when the neuron reaches the peak firing rate (see ‘Spike generation from the firing rate’ for modeling spike times in the CANN). Based on Equations 3 and 5, the firing rate of the probe neuron, denoted as ${r}_{0}(t)$, is expressed as:
where ${A}_{r}(t)$ is the bump height, and $h(t)$ is an oscillatory moving term denoting the displacement between the bump center and the location of the probe neuron. It is composed of a moving signal ${\mathcal{v}}_{ext}t$ and an oscillatory signal ${c}_{0}\mathrm{sin}\omega t+{d}_{0}$, with ${c}_{0}$ the oscillation amplitude, $\omega $ the frequency, and ${d}_{0}$ an oscillation offset constant. It can be seen that the firing rate of the probe neuron is determined by two factors, ${A}_{r}(t)$ and $h(t)$. To simplify the analysis below, we assume that the bump height ${A}_{r}(t)$ remains unchanged during bump oscillations (for the case of timevarying bump height, see previous sections). Thus, the firing rate only depends on $h(t)$, which is further determined by two timevarying terms, the oscillation term ${c}_{0}\mathrm{sin}\omega t$ and the location of the external input ${\mathcal{v}}_{ext}t$. The first term contributes to firing rate oscillations of the probe neuron, and the second term contributes to the envelope of neuronal oscillations exhibiting a waxingandwaning profile over time, as the external input traverses the firing field (the absolute value $\left{v}_{ext}t\right$ first decreases and then increases; see Figure 3d, also Video 2). Such a waxingandwaning profile agrees well with the experimental data (Skaggs et al., 1996). In each LFP theta cycle, the peak firing rate of the probe neuron is achieved when $h(t)$ reaches a local minima (Figure 3c and d). We differentiate three stages as the external input passes through the probe neuron (i.e. the animal travels through the place field of the probe neuron), i.e.,
The entry stage. As the external input enters the firing field of the probe neuron (moving from left to right), $h\left(t\right)<0$ always holds (Figure 3c). In this case, the peak firing rate of the probe neuron in each oscillatory cycle is achieved when $h(t)$ reaches the maximum (i.e. $h(t)$ reaches the minimum). This corresponds to ${c}_{0}\mathrm{sin}\omega t={c}_{0}$, i.e., $\omega t=\pi /2$ (Figure 3e). This means that the firing phase of the probe neuron at the entry stage is constant, which agrees with experimental observations (O’Keefe and Recce, 1993; Skaggs et al., 1996).
The phase shift stage. As the external input moves into the center of the firing field, $h(t)=0$ can be achieved in each oscillatory cycle (Figure 3c). Notably, it is achieved twice in each cycle, once as the bump sweeps over the probe neuron in the forward direction and the other as the bump sweeps over the probe neuron in the backward direction. Therefore, there are two firing peaks in each bump oscillation cycle (Figure 3d), which are expressed as (by solving ${\mathcal{v}}_{ext}t+{c}_{0}sin\omega t+{d}_{0}=0$):
 (8) ${\varphi}_{f}=arcsin\left[\frac{{d}_{0}+{\mathcal{v}}_{ext}{t}_{f}}{{c}_{0}}\right],\text{}\text{}\text{}{\varphi}_{b}=\pi +arcsin\left[\frac{{d}_{0}+{\mathcal{v}}_{ext}{t}_{b}}{{c}_{0}}\right],$
where ${t}_{f}$ and ${t}_{b}$ denote the moments of peak firing in the forward and backward sweeps, respectively, and ${\varphi}_{f}$ and ${\varphi}_{b}$ the corresponding firing phases of the probe neuron. As the external input travels from $({c}_{0}{d}_{0})$ to $({c}_{0}{d}_{0})$, the firing phase ${\varphi}_{f}$ in the forward sweep decreases from $\pi /2$ to $\pi /2$, while the firing phase ${\varphi}_{r}$ in the backward sweep increases from $\pi /2$ to $3\pi /2$ (Figure 3e). These give rise to the phase precession and procession phenomena, respectively, agreeing well with experimental observations (Skaggs et al., 1996; Wang et al., 2020; Yamaguchi et al., 2002).
The departure stage. As the external input leaves the firing field, $h\left(t\right)>0$ always holds (Figure 3c), and the peak firing rate of the probe neuron is achieved when $h(t)$ reaches its minimum in each oscillatory cycle, i.e., ${c}_{0}\mathrm{sin}(\omega t)={c}_{0}$ with $\omega t=\pi /2$ (Figure 3e). Therefore, the firing phase of the probe neuron is also constant during the departure stage.
In summary, oscillatory tracking of the CANN well explains the firing phase shift of place cells when the animal traverses their firing fields. Speciﬁcally, when the animal enters the place field, the firing phase of the neuron remains constant, i.e., no phase shift occurs, which agrees with experimental observations (O’Keefe and Recce, 1993; Skaggs et al., 1996). As the animal approaches the center of the place field, the firing phase of the neuron starts to shift in two streams, one to earlier phases during the forward sweeps and the other to later phases during the backward sweeps. Finally, when the animal leaves the place field, the firing phase of the neuron stops shifting and remains constant. Over the whole process, the firing phase of a place cell is shifted by 180 degrees, which agrees with experimental observations (O’Keefe and Recce, 1993; Skaggs et al., 1996).
Different adaptation strengths account for bimodal and unimodal cells
The results above show that during oscillatory tracking, a place cell exhibits both significant phase precession and procession, which are associated with two firing peaks in a theta cycle. These neurons have been described as bimodal cells (Wang et al., 2020; Figure 4a). Conversely, previous experiments have primarily focused on the phase precession of place cell firing, while tending to ignore phase procession, which is a relatively weaker phenomenon (O’Keefe and Recce, 1993; Skaggs et al., 1996). Place cells with negligible phase procession have been described as unimodal cells (Figure 4b).
Here, we show that by adjusting a single parameter in the model, i.e., the adaptation strength $m$, neurons in the CANN can exhibit either interleaved phase precession and procession (bimodal cells) or predominant phase precession (unimodal cells). To understand this, we first recall that the firing rate adaptation is a much slower process compared to neural firing and its timescale is in the same order as the LFP theta (i.e. ${\tau}_{v}=100$ ms while $\tau =5$ ms). This implies that when the bump sweeps over a neuron, the delayed adaptation it generates will suppress the bump height as it sweeps back to the same location. Furthermore, since the oscillatory tracking always begins with a forward sweep (as the initial sweep is triggered by the external input moving in the same direction), the suppression effects are asymmetric, i.e., forward sweeps always strongly suppress backward sweeps. On the contrary, the opposite effect is much smaller, since neuronal activities in backward sweeps have already been suppressed, and they can only generate weak adaptation. Because of this asymmetric suppression, the bump height in the forward sweep is always higher than that in the backward sweep (see Figure 4c and Appendix 1—figure 3a). When the adaptation strength $m$ is small, the suppression effect is not significant, and the attenuation of the bump height during the backward sweep is small (Figure 4d). In such case, the firing behavior of a place cell is similar to the situation as the bump height remains unchanged as analyzed in previous sections, i.e., the neuron can generate two firing peaks in a theta cycle at the phase shift stage, manifesting the property of a bimodal cell of having both signiﬁcant phase precession and procession (Figure 4e and g and Video 2). When the adaptation strength $m$ is large, the bump height in the backward sweep attenuates dramatically (see Figure 4c and d and the Video demonstration). As a result, the firing peak of a place cell in the backward sweep becomes nearly invisible at the phase shift stage, and the neuron exhibits only predominant phase precession, manifesting the property of a unimodal cell (Figure 4f and h and Video 3).
In summary, different adaptation strengths explain the emergence of bimodal and unimodal cells. In fact, there is no sharp separation between bimodal and unimodal cells. As the firing rate adaptation gets stronger, the network bump is more attenuated during the backward sweep, and cells with the bimodal firing property will gradually behave more like those with the unimodal firing property (see Appendix 1—figure 3b). Moreover, our model confirms that even though phase procession is weak, it still exists in unimodal cells (Figure 4h, lower panel), which has been reported in previous studies (Wang et al., 2020; Yamaguchi et al., 2002). This implies that phase procession is not a characteristic feature of bimodal cells, but instead, is likely a common feature of hippocampal activity, with a strength controlled by adaptation. Furthermore, the experimental data (FernándezRuiz et al., 2017) has indicated that there is a laminar difference between unimodal cells and bimodal cells, with bimodal cells correlating more with the firing patterns of deep CA1 neurons and unimodal cells with the firing patterns of superficial CA1 neurons. Our model suggests that this difference may come from the different adaptation strengths in the two layers.
Constant cycling of multiple future scenarios in a Tmaze environment
We have shown that our model can reproduce the forward and backward theta sweeps of decoded position when the animal runs on a linear track. It is noteworthy that there is only a single hypothetical future scenario in the linear track environment, i.e., ahead of the animal’s position, and hence place cells firing phase can only encode future positions in one direction. However, ﬂexible behaviors requires the animal encoding multiple hypothetical future scenarios in a quick and constant manner, e.g., during decisionmaking and planning in complex environments (Johnson and Redish, 2007; Wikenheiser and Redish, 2015). One recent study (Kay et al., 2020) showed constant cycling of theta sweeps in a Tmaze environment (Figure 5a), i.e., as the animal approaches the choice point, the decoded position from hippocampal activity propagates down one of the two arms alternatively in successive LFP theta cycles. To reproduce this phenomenon, we change the structure of the CANN from a linear track shape to a Tmaze shape where the neurons are aligned according to the location of their firing fields in the Tmaze environment. Neurons are connected with a strength proportional to the Euclidean distance between their firing fields on the Tmaze and the parameters are set such that the network is in the oscillatory tracking state (see details in ‘Implementation details of the Tmaze environment’). Mimicking the experimental protocol, we let the external input (the artificial animal) move from the end of the center arm to the choice point. At the beginning, when the external input is far away from the choice point, the network bump sweeps back and forth along the center arm, similar to the situation on the linear track. As the external input approaches the choice point, the network bump starts to sweep onto left and right arms alternatively in successive theta cycles (Figure 5b and Video 4; see also Romani and Tsodyks, 2015, for a similar model of cyclical sweeps spanning several theta cycles). The underlying mechanism is straightforward. Suppose that the bump first sweeps to the left arm from the current location, it will sweep back to the current location first due to the attraction of the external input. Then in the next round, the bump will sweep to the right arm, since the neurons on the left arm are suppressed due to adaptation. This cycling process repeats constantly between the two upcoming arms before the external input enters one of the two arms (i.e. before the decision is made). At the single cell level, this bump cycling phenomenon gives rise to the ‘cycle skipping’ effect (Kay et al., 2020; Deshmukh et al., 2010; Brandon et al., 2013), where a neuron whose place field is on one of the two arms fires on every other LFP theta cycle before the decision is made (Figure 5c, left panel and Figure 5d, upper panel). For example, a pair of cells with firing fields on each of the two arms will fire in regular alternation on every other theta cycle (Figure 5c, right panel and Figure 5d, lower panel). These celllevel firing patterns agree well with the experimental observations (Kay et al., 2020).
In summary, our model, extended to a Tmaze structure, explains the constant cycling of two possible future scenarios in a Tmaze environment. The underlying mechanism relies on delayed adaptation, which alternately causes neurons on one arm to be more suppressed than those on the other arm. Such highspeed cycling may contribute to the quick and continuous sampling among multiple future scenarios in realworld decisionmaking and planning. We also note that there is a cyclical effect in the sweep lengths across oscillation cycles before the animal enters the left or right arm (see Figure 5b, lower panel), which may be interesting to check in the experimental data in future work (see Discussion for more details).
Robust phase coding of position with place cells
As the firing rate shows large variability when the animal runs through the firing field (Fenton and Muller, 1998), it has been suggested that the theta phase shift provides an additional mechanism to improve the localization of animals (O’Keefe and Burgess, 2005). Indeed, Jensen and Lisman, 2000, showed that taking phase into account leads to a significant improvement in the accuracy of localizing the animal. To demonstrate the robustness of phase coding, previous experiments showed two intriguing findings: a linear relationship between the ﬁring frequency of place cells and the animal’s moving speed (Geisler et al., 2007), and the continued phase shift after interruption of hippocampal activity (Zugaro et al., 2005). We show that our model can also reproduce these two phenomena.
To investigate the relationship between the single cell’s oscillation frequency and the moving speed as the animal runs through the firing field, we consider a unimodal cell with predominant phase precession as studied in Geisler et al., 2007. As we see from Figure 3d and Figure 4a and b, when the animal runs through the firing field of a place cell, the firing rate oscillates because the activity bump sweeps around the firing field center. Therefore, the ﬁring frequency of a place cell has a baseline theta frequency, which is the same as the bump oscillation frequency. Furthermore, due to phase precession, there will be half a cycle more than the baseline theta cycles as the animal runs over the ﬁring ﬁeld, and hence singlecell oscillatory frequency will be higher than the baseline theta frequency (Figure 6a). The faster the animal runs, the faster the extra half cycle can be accomplished. Consequently, the firing frequency will increase more (a steeper slope in Figure 6a, red dots) than the baseline frequency. This linear relationship ensures that the firing phase of a unimodal cell in each theta cycle is locked with the relative location of the animal in the firing field of that cell, which supports a robust phaseposition code. Notably, in our model, the speed modulation of the place cells’ firing frequency is not the cause of theta phase shift, but rather a result of oscillatory tracking. This is different from the dual oscillator model (Lengyel et al., 2003), which assumes that phase precession is caused by a speeddependent increase in the dendritic oscillation frequency (see Discussion for more details).
In a different experiment, Zugaro et al., 2005, found that the firing phase of a place cell continues to precess even after hippocampal activity was transiently silenced for up to 250 ms (around 2 theta cycles). To reproduce this phenomenon, we also study a unimodal cell by manually turning off the network activity for a few hundred milliseconds (by setting $r(x,t)=0$ for all neurons) and then letting the network dynamics evolves again with all parameters unchanged. Based on the theoretical analysis (Equation 8), we see that the firing phase is determined by the location of the animal in the place field, i.e., ${v}_{ext}t$. This means that the firing phase keeps tracking the animal’s physical location. No matter how long the network is inactivated, the new firing phase will only be determined by the new location of the animal in the place field. Therefore, the firing phase in the first bump oscillation cycle after the network perturbation is more advanced than the firing phase in the last bump oscillation cycle right before the perturbation, and the amount of precession is similar to that in the case without perturbation (Figure 6c). This agrees well with the experimental observation (Zugaro et al., 2005), and indicates that the phaseposition code is robust to the perturbation of the hippocampal dynamics.
Overall, our model reproduces these two experimental findings, and suggests that there exists a onetoone correspondence between the firing phase of a place cell and the traveled distance in the neuron’s place field, which is independent of the animal’s running speed or the perturbation duration (Appendix 1—figure 4). This agrees well with experimental observations (O’Keefe and Recce, 1993) that theta phase correlates better with the animal’s location than with time (Figure 6). In addition to the results for unimodal cells as introduced above, our model predicts new results for bimodal cells. First, in contrast to a unimodal cell, a bimodal cell will have two peaks in its firing frequency, with one slightly higher than the LFP theta baseline (due to phase precession) and the other slightly lower than the LFP theta baseline (due to phase procession). The precessionassociated frequency positively correlates with the running speed of the animal, while the processionassociated frequency negatively correlates with the running speed (Figure 6b). Second, similar to the preserved phase shift in unimodal cells, both the phase precession and procession of a bimodal cell after transient intrahippocampal perturbation continue from the new location of the animal (see Appendix 1—figure 5), no matter how long the silencing period lasts. The two predictions could be tested by experiments.
Discussion
Model contributions
In this paper, we have proposed a CANN with firing rate adaptation to unveil the underlying mechanism of place cell phase shift during locomotion. We show that the interplay between intrinsic mobility (owing to firing rate adaptation) and extrinsic mobility (owing to the locationdependent sensory inputs) leads to an oscillatory tracking state, which naturally accounts for theta sweeps where the decoded position oscillates around the animal’s physical location at the theta rhythm. At the single neuron level, we show that the forward and backward bump sweeps account for, respectively, phase precession and phase procession. Furthermore, we show that the varied adaptation strength explains the emergence of bimodal and unimodal cells, i.e., as the adaptation strength increases, forward sweeps of the bump gradually suppress backward sweeps, and as a result, neurons initially exhibiting both significant phase precession and procession (due to a lowlevel adaptation) will gradually exhibit only predominant phase precession (due to a highlevel adaptation).
Computational models for theta phase shift and theta sweeps
As a subject of network dynamics, oscillatory tracking has been studied previously in an excitatoryinhibitory neural network (Folias and Bressloff, 2004), where it was found that decreasing the external input strength can lead to periodic emission of traveling waves in the network (Hopf instability), which is analogous to the oscillatory tracking state in our model. However, their focus was on the mathematical analysis of such dynamical behavior, while our focus is on the biological implications of oscillatory tracking, i.e., how can it be linked to phase precession and procession of hippocampal place cells.
Due to their potential contributions to the temporal sequence learning involved in spatial navigation and episodic memory (Mehta et al., 1997; Mehta et al., 2002; Yamaguchi, 2003), theta phase precession and forward theta sweeps have been modeled in the field for decades. These models can be divided into two main categories, with one relying on the mechanism of singlecell oscillation (O’Keefe and Recce, 1993; Kamondi et al., 1998; Lengyel et al., 2003; O’Keefe and Burgess, 2005; Mehta et al., 2002) and the other relying on the mechanism of recurrent interactions between neurons (Tsodyks et al., 1996; Romani and Tsodyks, 2015; Kang and DeWeese, 2019). A representative example of the former is the oscillatory interference model (O’Keefe and Recce, 1993; Lengyel et al., 2003), which produces phase precession via the superposition of two oscillatory signals, with one from the baseline somatic oscillation at the LFP theta frequency (reﬂecting the inputs from the medial septal pacemaker; Stewart and Fox, 1990), and the other from the dendritic oscillation whose frequency is slightly higher. While these models can explain a large variety of experimental phenomena, it remain unclear how oscillation of individual neurons has a frequency higher than the baseline theta frequency. Here, our model provides a network mechanism for how such higherfrequency oscillation emerges.
A representative model relying on neuronal recurrent interactions is the activation spreading model (Tsodyks et al., 1996). This model produces phase precession via the propagation of neural activity along the movement direction, which relies on asymmetric synaptic connections. A later version of this model considers shortterm synaptic plasticity (shortterm depression) to implicitly implement asymmetric connections between place cells (Romani and Tsodyks, 2015), and reproduces many other interesting phenomena, such as phase precession in different environments. Different from these two models, our model considers firing rate adaptation to implement symmetry breaking and hence generates activity propagation. To prevent the activity bump from spreading away, their model considers an external theta input to reset the bump location at the end of each theta cycle, whereas our model generates an internal oscillatory state, where the activity bump travels back due to the attraction of external location input once it spreads too far away. Moreover, theoretical analysis of our model reveals how the adaptation strength affects the direction of theta sweeps, as well as offers a more detailed understanding of theta cycling in complex environments.
Based on our simulation, both STD and SFA show the ability to produce bidirectional sweeps within a CANN model, with the SFA uniquely enabling unidirectional sweeps in the absence of external theta inputs. This difference might be due to the lack of exhaustive exploration of the entire parameter space. However, it might also attribute to the subtle yet important theoretical distinctions between STD and SFA. Specifically, STD attenuates the neural activity through a reduction in recurrent connection strength, whereas SFA provides inhibitory input directly to the neurons, potentially impacting all excitatory inputs. These differences might explain the diverse dynamical behaviors observed in our simulations. Future experiments could clarify these distinctions by monitoring changes in synaptic strength and inhibitory channel activation during theta sweeps.
Beyond the linear track environment
Besides the linear track environment, the mechanism of generating theta sweeps proposed in our model can also be generalized to more complex environments. For instance, in a Tmaze environment, our model explains the constant cycling of theta sweeps between left and right arms. Such cycling behavior may be important for highspeed actions such as predating and escaping which require animals to make decision among several future scenarios at the subsecond level. Similar alternative activity sweeps in the Tmaze environment has been studied in a previous paper (Romani and Tsodyks, 2015), which showed that the frequency of alternation correlates with overtly deliberative behaviors such as head scans (frequency at 1 Hz or less) (Johnson and Redish, 2007). In contrast to our model, the network activity in their model propagates continuously from the current location on the center arm till the end of the outer arm, which takes a few theta cycles (i.e. 1 s or more). In our model, the network bump alternately sweeps to one of the two outer arms at a much higher frequency (∼ 8 Hz), which may be related to fast decisionmaking or planing in natural environments (Kay et al., 2020). Furthermore, our model can also be easily extended to the multiplearms (>2) environment (Gillespie et al., 2021) or the cascadeT environment (Johnson and Redish, 2007) with the underlying mechanism of generating theta cycling remaining unchanged. In addition to the linear and Tmaze environments, phase shift has also been reported when an animal navigates in an open field environment. However, due to the lack of recorded neurons, decoding theta sweeps in the 2D environment is not as straightforward as in the 1D case. While theta sweeps in the 1D case have been associated with goaldirected behaviors and spatial planning (Wikenheiser and Redish, 2015), it remains unclear whether such conclusion is applicable to the 2D case. Our preliminary result shows that in the 2D CANN where neurons are arranged homogeneously according to their relative firing locations, the activity bump will sweep along the tangent direction of the movement trajectory, similar to the 1D case (see ‘Oscillatory tracking in the 2D CANN – modeling theta sweeps in the open ﬁeld environment’ and Appendix 1—figure 6 for details). It will be interesting to explore theta sweeps in the open field environment in detail when more experimental data is available.
Model predictions and future works
Our model has several predictions which can be tested in future experiments. For instance, the height of the activity bump in the forward sweep window is higher than that in the backward sweep window (Figure 4c) due to the asymmetric suppression effect from the adaptation. For bimodal cells, they will have two peaks in their firing frequency as the animal runs across the firing ﬁelds, with one corresponding to phase precession and the other corresponding to phase procession. Similar to unimodal cells, both the phase precession and procession of a bimodal cell after transient intrahippocampal perturbation will continue from the new location of the animal (Appendix 1—figure 7). Interestingly, our model of the Tmaze environment showed an expected phenomenon that as the animal runs toward the decision point, the theta sweep length also shows cyclical patterns (Figure 5b, lower panel). An intuitive explanation is that, due to the slow dynamics in firing rate adaptation (with a large time constant compared to neural firing), a long sweep leads to an adaptation effect on the neurons at the end of the sweep path. Consequently, the activity bump cannot travel as far due to the adaptation effect on those neurons, resulting in a shorter sweep length compared to the previous one. In the next round, the activity bump exhibits a longer sweep again because those neurons have recovered from the previous adaptation effect. We plan to test this phenomenon in future experiments.
In the current study, we have modeled the place cell population in the hippocampus with a CANN and adopted firing rate adaptation to generate theta phase shift. In fact, this model can be easily extended to the grid cell population without changing the underlying mechanism. For instance, we can induce the toruslike connection profile (periodic boundary in the 2D space) (Samsonovich and McNaughton, 1997; McNaughton et al., 2006) or the locally inhibitory connection profile (Burak and Fiete, 2009; Couey et al., 2013) in the CANN structure to construct a grid cell model, and by imposing firing rate adaptation, neurons in the grid cell network will also exhibit phase shift as the animal moves through the grid field, as reported in previous experimental studies (Hafting et al., 2008; van der Meer and Redish, 2011). Notably, although for both grid cells and place cells, CANNs can generate theta phase shift, it does not mean that they are independent from each other. Instead, they might be coordinated by the same external input from the environment, as well as by the medial septum which is known to be a pacemaker that synchronizes theta oscillations across different brain regions (King et al., 1998; Wang, 2002). We will investigate this issue in future work.
Our model also suggests that the ‘online’ theta sweep and the ‘offline’ replay may share some common features in their underlying mechanisms (Romani and Tsodyks, 2015; Hopfield, 2010; Kang and DeWeese, 2019; Jahnke et al., 2015). We have shown that the activity bump with strong adaptation can move spontaneously when the external input becomes weak enough (see previous sections). Such nonlocal spreading of neural activity has a speed much faster than the conventional speed of animals (the external input speed in our model, see Figure 2d), which resembles the fast spreading of the decoded position during sharp waveripple events (Diba and Buzsáki, 2007; Foster and Wilson, 2006; Karlsson and Frank, 2009; Dragoi and Tonegawa, 2011). This indicates that these two phenomena may be generated by the same neural mechanism of firing rate adaptation, with theta sweeps originating from the interplay between the adaptation and the external input, while replay originating from only the adaptation, since the external input is relatively weak during the ‘offline’ state. This hypothesis seems to be supported by the coordinated emergence of theta sequences and replays during the postnatal development period (Muessig et al., 2019), as well as their simultaneous degradation when the animal traveled passively on a model train (Drieu et al., 2018).
Nevertheless, it is important to note that the CANN we adopt in the current study is an idealized model for the place cell population, where many biological details are missed (Amari, 1977; Tsodyks and Sejnowski, 1995; Samsonovich and McNaughton, 1997; Tsodyks, 1999). For instance, we have assumed that neuronal synaptic connections are translationinvariant in the space. In practice, such a connection pattern may be learned by a synaptic plasticity rule at the behavioral timescale when the animal navigates actively in the environment (Bittner et al., 2017). In future work, we will explore the detailed implementation of this connection pattern, as well as other biological correspondences of our idealized model, to establish a comprehensive picture of how theta phase shift is generated in the brain.
Materials and methods
General summary of the model
Request a detailed protocolWe consider a 1D CANN, in which neurons are uniformly aligned according to their firing fields on a linear track (for the Tmaze case, see ‘Implementation details of the Tmaze environment’ below; for the case of the open field (2D CANN), see ‘Oscillatory tracking in the 2D CANN – modeling theta sweeps in the open ﬁeld environment’). Denote $U(x,t)$ the synaptic input received by the place cell at location $x$, and $r(x,t)$ the corresponding firing rate. The dynamics of the network is written as:
where $\tau $ is the time constant of $U(x,t)$ and $\rho $ the neuron density. The firing rate $r(x,t)$ is given by:
where $k$ controls the strength of the global inhibition (divisive normalization), $g$ denotes a gain factor. $J(x,{x}^{\prime})$ denotes the connection weight between place cells at location $x$ and ${x}^{\prime}$, which is written as:
where ${J}_{0}$ controls the strength of the recurrent connection and $a$ the range of neuronal interaction. Notably, $J(x,{x}^{\prime})$ depends on the relative distance between two neurons, rather than the absolute locations of neurons. Such translationinvariant connection form is crucial for the neutral stability of the attractor states of CANNs (Wu et al., 2016). ${I}^{ext}(x,t)$ represents the external input which conveys the animal location information to the hippocampal network, which is written as:
with $\mathcal{v}}_{ext$ denoting the animal’s running speed and $\alpha $ controlling the input strength to the hippocampus. $\sigma $ denotes the width of the external input ${I}^{ext}$, which is set to be equal to the recurrent connection width $a$ in the main text and the following derivation. $V(x,t)$ denotes the adaptation effect of the place cell at location $x$, which increases with the synaptic input (and hence the place cell’s firing rate), i.e.,
with ${\tau}_{v}$ denoting the time constant of $V(x,t)$ and $m$ the adaptation strength. Note that ${\tau}_{\mathcal{v}}\gg \tau$, meaning that adaptation is a much slower process compared to the neural firing.
Stability analysis of the bump state
Request a detailed protocolWe derive the condition under which the bump activity is the stable state of the CANN. For simplicity, we consider the simplest case that there is no external input and adaptation in the network, i.e., $m=\alpha =0$. In this case, the network state is determined by the strength of the recurrent excitation and global inhibition. When the global inhibition is strong ($k$ is large), the network is silent, i.e., no bump activity emerges in the CANN. When the global inhibition is small, an activity bump with the Gaussianshaped profile emerges, which is written as:
with ${A}_{u}$ and ${A}_{r}$ representing the amplitudes of the synaptic input bump and the firing rate bump, respectively. $z(t)$ represents the bump center, and $a$ is the range of neuronal interaction (defined in ‘General summary of the model’). To solve the network dynamics, we substitute Equations 14 and 15 into Equations 9 and 10, which gives (see ‘Deriving the network state when the external input does not exist (I^{ext} = 0)’ for more details of the derivation):
These two equations describe how the bump amplitudes change with time. For instance, if neurons are weakly connected (small ${J}_{0}$) or they are connected sparsely (small $\rho $), the second term on the righthand side of Equation 16 is small, and ${A}_{u}$ will decay to zero, implying that the CANN cannot sustain a bump activity. By setting $d{A}_{u}/dt=0$, we obtain:
It is straightforward to check that only when:
${A}_{u}$ have two real solutions (indicated by the ± sign in Equation 18), i.e., the dynamic system (Equations 16 and 17) has two fixed points. It can be checked that only ${A}_{u}=\left(\rho {J}_{0}+\sqrt{{\rho}^{2}{J}_{0}^{2}8\sqrt{2\pi}2k\rho a}\right)/\left(4\sqrt{\pi}k\rho a\right)$ is the stable solution.
Analysis of the intrinsic mobility of the bump state
Request a detailed protocolWe derive the condition under which the bump of the CANN moves spontaneously in the attractor space without relying on external inputs. As the adaptation strength increases, the bump activity becomes unstable and has tendency to move away from its location spontaneously. Such intrinsic mobility of the CANN has been shown in previous studies (Bressloff, 2012; Wu et al., 2016; Mi et al., 2014). We set $\alpha =0$ (no external input), and investigate the effect of adaptation strength $m$ on the bump dynamics. Our simulation result shows that during the spontaneous movement, $V(x,t)$ can also be represented by a Gaussianshaped bump, which is written as:
where $A}_{\mathcal{v}$ denotes the amplitude of the adaptation bump, and $d(t)$ the displacement between the bump centers of $U(x,t)$ and $V(x,t)$. This displacement originates from the slow dynamics of adaptation, which leads to the adaptation bump always lags behind the neural activity bump. Similar to ‘Stability analysis of the bump state’, we substitute the bump profiles Equations 14, 15, 21 into the network dynamics Equations 9, 10, 13, and obtain:
where $N\left(x,z,2a\right)=exp\left\{{\left[xz\right]}^{2}/4{a}^{2}\right\}$.
At first glance, the resulting equations given by Equations 22 and 24 may seem intractable due to the high dimensionality (i.e. $2N$, where $N$ is the number of neurons in the network). However, a key property of CANNs is that their dynamics are dominated by a few motion modes, which correspond to distortions of the bump shape in terms of height, position, width, etc. (Fung et al., 2010). By projecting the network dynamics onto its dominant motion modes (Fung et al., 2010) (which involves computing the inner product of a function $f(x)$ with a mode ${u}_{n}(x)$), we can significantly simplify the network dynamics. Typically, projecting onto the first two motion modes is suﬃcient to capture the main features of the dynamics, which are given by:
By projecting the network dynamics onto these two motion modes, we obtain:
Note that we assume that the bump height keep as constant over time, i.e., $d{A}_{u}/dt=d{A}_{\mathcal{v}}/dt=0$ is assumed. Equations 27–30 describe the relationships between bump features $A}_{u},{A}_{r},{A}_{\mathcal{v}},{\mathcal{v}}_{int$, and $d$, where ${v}_{int}=dz/dt$ representing the intrinsic moving speed of the bump center. By solving these equations together with Equation 23, we obtain:
Equations 31–33 describe the amplitudes of the bumps of synaptic input, firing rate, and adaptation in the CANN, respectively, and Equation 34 describes the displacement between the neural activity and adaptation bumps. From Equation 35, we see that for the bump to travel spontaneously, it requires $m>\tau /{\tau}_{\mathcal{v}}$, i.e., the adaptation strength is larger than a threshold given by the ratio between two time constants $\tau $ and $\tau}_{\mathcal{v}$. As the adaptation strength increases (larger $m$), the traveling speed of the bump increases (larger $\mathcal{v}}_{int$).
Analysis of the oscillatory tracking behavior of the bump state
Request a detailed protocolWhen both the external input and the adaptation are applied to the CANN, the bump activity can oscillate around the external input if the strengths of the external input and the adaptation are appropriated. The simulation shows that during the oscillatory tracking, the bump shape is roughly unchanged, and the oscillation of the bump center can be approximated as a sinusoidal wave expressed as:
where ${c}_{0}$ and $\omega $ denote, respectively, the oscillation amplitude and frequency, and ${d}_{0}$ denotes a constant offset between the oscillation center and the external input.
Similar to the analysis in ‘Analysis of the intrinsic mobility of the bump state’, we substitute the expression of $z(t)$ (Equation 36) into Equations 14, 15, 21, and then simplify the network dynamics by applying the projection method (see ‘Deriving the oscillatory tracking state of the network when the external input is applied (I^{ext}≠0)’ for more detailed derivation). We obtain:
Equations 37–41 describe the relationships among six oscillation features ${A}_{u},{A}_{r},{A}_{v},{c}_{0},{d}_{0}$, and $\omega $. By solving these equations, we obtain:
It can be seen from Equation 45 that for the bump activity to oscillate around the external input (i.e. the oscillation amplitude ${c}_{0}>0$), it requires that $8{a}^{2}ln\left(m{A}_{u}/{A}_{\mathcal{v}}\right){\tau}_{\mathcal{v}}^{2}{\mathcal{v}}^{2}>0$. This condition gives the boundary (on the parameter values of the input strength $\alpha $ and the adaptation strength $m$) that separate two tracking states, i.e., smooth tracking and oscillatory tracking (see Figure 2g and Appendix 1—figure 8 for the comparison between the simulation results and theoretical results).
Note that to get the results in Equations 37–41, we have assumed that the amplitudes of neural activity bumps and the adaptation bump remain unchanged during the oscillation (i.e. $A}_{u},{A}_{\mathcal{v}},{A}_{r$ are constants). However, this assumption is not satisfied when the SFA strength $m$ is large (see previous sections and Figure 4). In such a case, we carry out simulation to analyze the network dynamics.
Implementation details of the linear track environment
Request a detailed protocolFor the linear track environment, we simulate an 1D CANN with 512 place cells topographically organized on the 1D neuronal track. Since we are interested in how the neuronal firing phase shifts as the animal moves through the firing field of a place cell, we investigate the place cell at location $x=0$ and ignore the boundary effect, i.e., we treat the linear track with the infinite length. The neural firing time constant is set to be 3 ms, while the time constant of spike frequency adaptation is much longer, which is set to be 144 ms. The density of place cells on the linear track is set to be $256/\pi $. The excitatory interaction range of place cells is set to be $0.4m$, while the maximum excitatory connection strength ${J}_{0}$ is set to be 0.2. The gain factor is set to be 5. The global inhibition strength $k$ is set to be 5. The moving speed of the virtual animal ${v}_{ext}$ is set to be 1.5 m/s. For the simulation details, we use the firstorder Euler method with the time step $\delta t$ set to be 0.3, the duration of simulation $T$ set to be 10 s. These parameters are commonly used in all plots related to the linear track environment (see Appendix 1—table 1 for a summary).
For the two key parameters, i.e., the external input strength $\alpha $ and the adaptation strength $m$, we vary their values in different plots. Specifically, for illustrating the smooth tracking state in Figure 2c, we set $\alpha =0.19$ and $m=0$. For illustrating the traveling wave state (intrinsic mobility of the bump state) in Figure 2d, we set $\alpha =0$ and $m=0.31$. For plotting the relationship between the intrinsic speed ${v}_{int}$ and the adaptation strength $m$ shown in Figure 2e, we keep $\alpha =0$, but vary $m$ in the range between 0 and 0.1 with a step of 0.05. For plotting the overall phase diagram including all three moving states as shown in Figure 2g, we vary $\alpha $ in the range between 0.05 and 0.16 with a step of 0.001, and $m$ in the range between 0.9 and 1.8 with a step of 0.01. To generate bimodal cell firing patterns in Figure 3a and Figure 4a, e, and g, we choose $\alpha =0.19$ and $m=3.02$. To generate unimodal firing patterns in Figure 4b, f, and h, we choose $\alpha =0.19$ but a relatively larger adaptation strength with $m=3.125$. The values of these two parameters in different plots are summarized in Appendix 1—table 2.
Implementation details of the Tmaze environment
Parameter configurations during simulation
Request a detailed protocolTo simulate the Tmaze environment, we consider a CANN in which place cells are topographically organized in a Tshaped area which consists of a vertical central arm and two horizontal left and right arms (Figure 5a). The width of the central arm is set to be 0.84 m and the length is set to be 3.14 m. The widths of the two horizontal arms are also set to be 0.84 m, while the lengths of both arms are set to be 2.36 m. The connection strength between two neurons is determined by the distance between them, which is written as:
Here, $(x,y)$ and $({x}^{\prime},{y}^{\prime})$ represent the coordinates of two neurons in the Tmaze environment, $a$ is the recurrent connection range which is set to be 0.3, and ${J}_{0}$ controls the connection strength which is set to be 0.0125. Since we are interested in investigating theta sweeps when the animal is running on the central arm toward the junction point, the external input is restricted on the central arm which is modeled by a Gaussianlike moving bump written as:
where ${x}_{0}=0$ and ${y}_{0}={\mathcal{v}}_{ext}t$ represent the center location of the external input with a moving speed ${\mathcal{v}}_{ext}=1.5$ m/s. In the simulation, we used the firstorder Euler method with the time step $\delta t=0.3$ s and the duration of simulation T = 4.2 s. The parameters used are summarized in Appendix 1—table 3.
Calculating autocorrelogram and crosscorrelogram
Request a detailed protocolTo show the ‘cycle skipping’ effect of a single place cell in the Tmaze environment, we calculate the autocorrelogram of the firing rate trace of a place cell whose ﬁring ﬁeld encodes a location on the left arm (the upper panel in Figure 5d). Assume the firing trace of the place cell is $f(t)$ (shown in left panel in Figure 5c), the autocorrelogram is calculated as:
where $\tau $ represents the time offset.
To show the ‘alternative cycling’ effect of a pair of place cells with each of them encoding a location on each of the two outward arms, we calculate the crosscorrelogram between their firing traces (the lower panel in Figure 5d). It measures the similarity of the two firing traces as a function of the temporal offset of one relative to the other. Assume the ﬁring traces of the two place cells are $f(t)$ and $g(t)$, respectively, the crosscorrelogram is calculated as:
where $\tau $ represents the time offset.
Details of generating the probability heatmap of theta phase shift
Request a detailed protocolIn Figure 4g and h we described the smoothed probability heatmaps of theta phase versus normalized position in the place field of both bimodal and unimodal cells. Generally, these two plots are similar to the traditional spike plot of phase and position traveled in the place field (O’Keefe and Recce, 1993; Skaggs et al., 1996). However, in our ratebased model, the phase of neuronal spike is not directly modeled, rather we use the phase of firing rate peak to represent the phase shift in neuronal firing. Here, we describe the implementation details of generating the heatmaps.
The xaxis denotes the normalized position in the place field, with –1 representing the position where the animal just enters the place field, and 1 representing the position where the animal just leaves the place field. In our simulation, the ﬁring ﬁeld of a place cell with preferred location at ${x}_{0}$ is defined as $x\in ({x}_{0}2.5*a,{x}_{0}+2.5a)$, with $a$ roughly the half size of the firing field. Consider the animal is at ${x}_{t}$ at time $t$ (note that ${x}_{t}={\mathcal{v}}_{ext}t$), then its normalized position ${\tilde{x}}_{t}$ is calculated as ${\tilde{x}}_{t}=({x}_{t}{x}_{0})/(5a)$. The yaxis represents the phase of neuronal activity, which is in the range of (0°, 720°). To calculate the phase at every time step, we divide the duration of the animal traversing the linear track into multiple theta cycles according to the bump’s oscillation. We can calculate the phase by ${\theta}_{t}=(t{t}_{0})/T$, with ${t}_{0}$ referring to the beginning of the present theta cycle and T referring to the theta period. Denote the firing rate of the ith neuron at time t as ${r}_{i}({\tilde{x}}_{t},{\theta}_{t})$, the probability heatmap is calculated by:
where $C=1/{\displaystyle \sum _{t}{\displaystyle {\sum}_{i=1}^{{N}_{c}}{\theta}_{t}{r}_{i}(\tilde{x},{\theta}_{t})}}$ is the normalization factor.
Spike generation from the firing rate
Request a detailed protocolTo understand phase shift based on spiking time rather than the peak firing rate, we convert the firing rate into spike trains according to the Poisson statistics (note that our analysis is ratebased, but converting to spikebased does not change the underlying mechanism). For the ith place cell which encodes position ${x}_{i}$ on the linear track, the number of spikes ${n}_{i}$ it generates within a time interval $\Delta t$ satisfies a Poisson distribution, which is expressed as:
where $z$ is the animal’s location, and ${f}_{i}(z)$ is the tuning function of cell i, which is given by:
where ${A}_{r}$ denotes the amplitude of the neural activity bump and a the range of recurrent interaction.
Appendix 1
1 The network model
We consider a CANN, in which neurons are uniformly distributed in a 1D environment, mimicking place cells rearranged according to the locations of their firing fields on the linear track. Neurons in the CANN are connected with each other recurrently. Denote $U(x,t)$ the synaptic input received by neurons at location $x$, with $x\in (\infty ,\infty )$, and $r(x,t)$ the corresponding firing rate. The dynamics of the network are written as:
where $\tau $ is the time constant of $U(x,t)$, $\rho $ the neuron density, and ${I}^{ext}(x,t)$ the external input. $J(x,{x}^{\prime})$ represents the connection strength between neurons at $x$ and ${x}^{\prime}$. $V(x,t)$ representing the effect of firing rate adaptation on this neuron. ${\tau}_{v}$ is the time constant of $V(x,t)$, and $m$ controls the adaptation strength. The parameter $k$ controls the amount of divisive normalization, reﬂecting the contribution of inhibitory neurons (not explicitly modeled) (Mitchell and Silver, 2003).
The connection profile between two neurons with firing fields at location $x$ and ${x}^{\prime}$ is set as:
where the parameter ${J}_{0}$ controls the amount of recurrent connection strength and $a$ represents the range of neuronal interactions. Notably, the recurrent connection between place cells is translationinvariant, i.e., $J(x,{x}^{\prime})$ is a function of $(x{x}^{\prime})$. This feature is crucial for the neutral stability of continuous attractor networks.
It is known that when there is no external input or firing rate adaptation ($m=0$,${I}^{ext}=0$), the CANN can hold a continuous family of Gaussianshaped stationary states (Fung et al., 2010; Fung et al., 2012), called bump activities, as long as $k$ is smaller than a critical value ${k}_{c}=\rho {J}_{0}^{2}/(8\sqrt{2\pi}a)$. These bump states are expressed as $\overline{U}(x)={A}_{U}\mathrm{exp}\left[{(xz)}^{2}/(4{a}^{2})\right]$, with $z$ a free parameter representing the bump center and ${A}_{U}$ a constant representing the bump amplitude.
In general, although the state of the network is affected by external inputs and adaptation, the network bump can still be well approximated with Gaussianlike profiles (Mi et al., 2014). Therefore, we assume the state of the network to be of the following Gaussian form:
where ${A}_{u}$, $A}_{\mathcal{v}$, and ${A}_{r}$ represent the amplitudes of these Gaussian bumps. $z(t)$ is the center of $U(x,t)$ and $r(x,t)$. $d(t)$ denotes the distance between $U(x,t)$ and $V(x,t)$, and $d\left(t\right)>0$ always holds, as the firing rate adaptation is a much slower dynamics lagging behind the neural dynamics. Here, we assume that the bump heights, i.e., ${A}_{u}$, $A}_{\mathcal{v}$, and ${A}_{r}$, are all constants during the evolution of the neural dynamics.
To solve the specific solution of the network state, we need to substitute the general solution given by Equations A5–A7 into the network dynamics Equations A1–A3, we obtain:
where $\mathcal{N}\left(z,2a\right)=exp\left\{{\left[xz\right]}^{2}/4{a}^{2}\right\}$. Given ${I}^{ext}(x,t)=0$, we can solve Equations A8–A10 to get the solution of the network state. An important property of a CANN is that its dynamics is dominated by a few motion modes, as a consequence of the translationinvariant connections between neurons. We can therefore simplify the network dynamics significantly by projecting the network dynamics onto its dominating motion modes (Fung et al., 2010) (by projecting a function $f(x)$ onto a mode ${u}_{n}(x)$, it means to compute ${\int}_{x}f}(x){u}_{n}(x)dx$). Typically, projecting onto the first two motion modes is adequate (see next section).
For the bump $U(x,t)$, the first two motion modes are:
For the bump $V(x,t)$, the first two motion modes are:
2 Deriving the network state when the external input does not exist (${I}^{ext}=0$)
2.1 Static bump state of the network
We first analyze the condition for the network holding a static bump as its stationary state. In this case, the positions of bumps $U$ and $V$ remain unchanged, i.e., $dz/dt=0$, and the discrepancy between them is zero, i.e., $d=0$. Thus, Equations A9 and A10 can be simplified as:
Combining them with Equation A8, we obtain the solution of the steady state of the network as:
To analyze the stability of this solution, we calculate the Jacobian matrix at this state, which is given by:
Denote the eigenvalues of the Jacobian matrix as ${\lambda}_{1}$ and ${\lambda}_{2}$. Therefore, the condition for the solution to be stable is that both eigenvalues are negative, which gives
The above inequalities are satisfied when,
It is easy to check that $k}_{c2}<{k}_{c1$, so the condition for the network to hold static bumps as its steady state is $0<k<{k}_{c2}$.
2.2 Traveling wave state of the network
We further analyze the condition for the network holding a continuously moving bump (traveling wave) as its steady state. In this state, the bump moves at a constant speed, and the center position is expressed as:
where $\mathcal{v}}_{int$ is called the intrinsic speed of the bump activity. Since the bump height is roughly unchanged and the discrepancy $d$ is a constant, Equations A9 and A10 can be simplified as:
In order to obtain the solution of variables of ${A}_{u},{A}_{\mathcal{v}},{A}_{r},d$, and ${v}_{int}$, we reduce the dimensionality of the network dynamics by projecting Equations A26 and A27 onto the dominant motion modes ${u}_{0}\left(x\right),{u}_{1}\left(x\right),{\mathcal{v}}_{0}\left(x\right),{\mathcal{v}}_{1}\left(x\right)$. First, projecting both sides of Equation A26 onto the motion mode ${u}_{0}(x)$ (expressed in Equation A11), we obtain:
Equating both sides, we have
Similarly, projecting Equation A26 onto the motion mode ${u}_{1}(x)$ (expressed in Equation A12) and equating both sides, we obtain:
Again, projecting both sides of Equation A27 onto the motion modes ${u}_{0}(x)$ and ${u}_{1}(x)$, respectively, and equating both sides, we obtain:
Combining Equation A8 and Equations A28–A31, we obtain the values of ${A}_{u},{A}_{\mathcal{v}},{A}_{r},d$, and ${v}_{int}$ in the traveling wave state as follows:
It is straightforward to check from Equation A36 that, to obtain a traveling wave state, ${v}_{int}$ should be a real positive value. This gives the condition that
Equations A24 and A37 give the phase diagram of the network state when external input does not exist, as shown in Appendix 1—figure 2g in the main text.
3 Deriving the oscillatory tracking state of the network when the external input is applied (${I}^{ext}\ne 0$)
The external input is given by:
where $\alpha $ is the input strength and ${v}_{ext}$ is the speed of the external input, mimicking the moving speed of the artificial animal.
The network state is mainly affected by two competing factors: one is the intrinsic mobility of the network originated from the firing rate adaptation, which drives the bump to move spontaneously (see section Traveling wave state of the network above); the other is the extrinsic mobility driven by the external input, which drives the bump to move at the same speed of ${v}_{ext}$. The competition between these two factors leads to three tracking states of the network: traveling wave, oscillatory tracking, and smooth tracking. Among the three states, the traveling wave state and the smooth tracking state are similar to the two cases we described in the previous section. Here, we only focus on the analytical derivation of the oscillatory tracking state. By numerically simulating the attractor network, we find that the bump center position can be roughly expressed as a sinusoidal moving wave given by:
where ${c}_{0}$ and $\omega $ represent the amplitude and frequency of the sinusoidal wave, respectively, and ${d}_{0}$ denotes the offset between the center of the activity bump and the center of the external input. Substituting the form of external input expressed in Equation A38 into Equations A9 and A10, we obtain:
Again, to get the solution of variables of $A}_{u},{A}_{\mathcal{v}},{A}_{r},{c}_{0},\omega ,{d}_{0$ we reduce the dimensionality of the network dynamics by projecting Equations A40 and A41 onto the dominant motion modes ${u}_{0}\left(x\right),{u}_{1}\left(x\right),{\mathcal{v}}_{0}\left(x\right),{\mathcal{v}}_{1}\left(x\right)$. Projecting Equation A40 onto ${u}_{0}$ and ${u}_{1}$, respectively, gives
where $s(t)={c}_{0}\mathrm{sin}(\omega t)+{d}_{0}$ denotes the offset between $U(x,t)$ and ${I}_{ext}(x,t)$. For clearance, we denote ${A}_{temp}={A}_{\mathcal{v}}exp\left({d}^{2}/8{a}^{2}\right)$ hereafter.
We first solve the dynamics of the distance $d(t)$, i.e., the distance between $U(x,t)$ and $V(x,t)$. To do this, we substitute Equations A39 and A42 into Equation A43 and obtain:
Since $s\ll 2a$ generally holds, we have $\mathrm{exp}({s}^{2}/8{a}^{2})\approx 1$. With this approximation, the equation above can be rewritten as:
where the parameters are solved as:
Again, projecting Equation A41 onto $\mathcal{v}}_{0$ and $\mathcal{v}}_{1$, respectively, gives
To solve the expression of ${A}_{u}$, we substitute Equations A8 and A49 into Equations A42 and obtain:
Since $s\ll 2a$ and $d\ll 2a$, the approximations of $\mathrm{exp}({s}^{2}/8{a}^{2})\approx 1$ and $\mathrm{exp}({d}^{2}/4{a}^{2})\approx 1$ hold, and the above equation can be simplified as:
We can rearrange Equation A52 into a general cubic equation of ${A}_{u}$, which is written as:
It’s easy to check that Equation A53 only has one real solution, which is:
The analytical solution of ${A}_{u}$ given by Equations A58–A60 is very complicated. However, by numerically simulating the network, we find that $\sqrt{2\pi}ak\rho {A}_{u}^{2}\gg 1$ can be hold when the network is at the oscillatory tracking state. This gives ${A}_{u}^{2}/(1+\sqrt{2\pi}ak\rho {A}_{u}^{2})\approx 1/\sqrt{2\pi}ak\rho $. Therefore, we can simplify the expression of ${A}_{u}$ to
To solve $\omega ,{d}_{0}$, and ${c}_{0}$, we further substitute Equation A49 into Equation A50 and obtain:
The above equation can be expanded by substituting Equations A39 and A45 into Equation A62 which gives
Using the trigonometric transformation formula, we can rewrite the above equation as:
where $\gamma $ is given by:
Equating two sides of Equation A63, we have:
Now we combine the three equations given by Equations A65–A67 to get the solutions of ${c}_{0},\omega $, and ${d}_{0}$. Substituting Equation A48 into Equation A65, we obtain:
Applying the cosine function to both sides of Equation A66, we obtain:
Substituting Equations A46 and A64 into Equation A69, we have:
Combining Equation A70 with Equation A61, we obtain the expression for the oscillating frequency $\omega $, i.e.,
Substituting Equations A47 and A70 into Equation A67, and taking square on both sides, we have:
Solving the above equation for ${A}_{temp}$, we get:
Substituting Equation A73 into Equation A68, we can get the expression for the average offset ${d}_{0}$ between the bump center and the external input center, which is:
Since ${A}_{temp}=m{A}_{u}\mathrm{exp}\left[d{(t)}^{2}/(4{a}^{2})\right]$ varies across time, we take the approximation
with $\overline{d{\left(t\right)}^{2}}$ the timeaveraged value, which is calculated to be:
Substituting Equations A73 and A76 into Equation A75, we obtain the expression for the oscillating amplitude ${c}_{0}$, i.e.,
Substituting Equation A73 into Equation A49 and utilizing the condition of $\mathrm{exp}({d}^{2}/8{a}^{2})=\sqrt{{A}_{temp}/m{A}_{u}}$, we obtain the expression for the bump height of $V(x,t)$:
Overall, combining Equations A8, A61, A71, A74, A77, and A78, we get the solutions of all variables in the oscillatory tracking state, which are expressed as:
It is noteworthy that the theoretical solutions given by Equations A82–A84 exist only if the sweep amplitude ${c}_{0}$ given by Equation A82 is of real value. This gives the condition for the CANN to be in the oscillatory tracking state, which is:
We carry out numerical simulations to verify our theoretical results, including the theoretical solutions of the mean offset ${d}_{0}$ given by Equation A83 (see Appendix 1—figure 2a–c) and the theoretical boundary that separates the smooth tracking state and the oscillatory tracking state given by Equation A85 (see Appendix 1—figure 2d). The results show that our theoretical analysis agrees well with the simulation results.
4 Oscillatory tracking in the 2D CANN – modeling theta sweeps in the open field environment
4.1 Model description
In the 2D CANN, neurons are uniformly distributed on a rectangular neuronal sheet arranged according to the locations of their firing ﬁelds. Denote $U(x,t)$ as the synaptic input to the neuron at location $x$, with $x=({x}_{1},{x}_{2})$ and ${x}_{1},{x}_{2}\in (\infty ,\infty )$, and $r(x,t)$ as the corresponding firing rate. The dynamics of $U(x,t)$ is determined by its own relaxation, the recurrent inputs from other neurons, and the firing rate adaptation, which is written as:
Here, $\tau $ is the time constant of synaptic current and $\rho $ is the neuronal density. The recurrent connection is defined as:$J(x,{x}^{\prime})={J}_{0}/(2\pi {a}^{2})\mathrm{exp}\left[\Vert x{x}^{\prime}{\Vert}^{2}/(2{a}^{2})\right]$, with $\Vert \mathbf{x}{\mathbf{x}}^{\mathrm{\prime}}{\Vert}^{2}={\left({x}_{1}{x}_{1}^{\mathrm{\prime}}\right)}^{2}+{\left({x}_{2}{x}_{2}^{\mathrm{\prime}}\right)}^{2}$ which is translationinvariant on the neuronal sheet (Appendix 1—figure 6a). The nonlinear relationship between the firing rate $r(x,t)$ and the synaptic input $U(x,t)$ is implemented by the divisive normalization, which is:
where $k$ controls the normalization strength. In the neural system, divisive normalization could be implemented by shunting inhibition (Mitchell and Silver, 2003). The term $V(x,t)$ on the righthand side of Equation A86 represents the effect of firing rate adaptation, with the dynamics written as:
where $\tau}_{\mathcal{v}$ is the time constant, and $m$ is the adaptation strength.
4.2 Theta sweeps in the 2D CANN
We study the network dynamics when an moving external input is applied to the network, which is written as:
where ${\mathbf{v}}_{\mathbf{e}\mathbf{x}\mathbf{t}}=\left({\mathcal{v}}_{x},{\mathcal{v}}_{y}\right)$ represents the speed of the external input and $\alpha $ represents the input strength. We consider one simple case, where the external input is moving on a straight line along the xaxis, i.e., ${\mathcal{v}}_{y}=0$. We find that, similar to 1D CANN, when the input strength $\alpha $ and adaptation strength $m$ is set appropriately, the bump activity also oscillates around the moving input along the moving direction, which give rise to the alternative forward and reverse theta sequences along moving direction of the external input (Appendix 1—figure 6b). The heatmap of the phase shift of the probe neuron which is located at $x=0,y=0$ is shown in Appendix 1—figure 6c.
Data availability
The current manuscript is a computational study, so no data have been generated for this manuscript. Modelling code has been uploaded as Source code 1.
References

Differential electroresponsiveness of stellate and pyramidallike cells of medial entorhinal cortex layer IIJournal of Neurophysiology 70:128–143.https://doi.org/10.1152/jn.1993.70.1.128

Dynamics of pattern formation in lateralinhibition type neural fieldsBiological Cybernetics 27:77–87.https://doi.org/10.1007/BF00337259

A computational model for preplay in the hippocampusFrontiers in Computational Neuroscience 7:161.https://doi.org/10.3389/fncom.2013.00161

A universal model for spikefrequency adaptationNeural Computation 15:2523–2564.https://doi.org/10.1162/089976603322385063

Segregation of cortical head direction cell assemblies on alternating theta cyclesNature Neuroscience 16:739–748.https://doi.org/10.1038/nn.3383

Spatiotemporal dynamics of continuum neural fieldsJournal of Physics A 45:033001.https://doi.org/10.1088/17518113/45/3/033001

Accurate path integration in continuous attractor network models of grid cellsPLOS Computational Biology 5:e1000291.https://doi.org/10.1371/journal.pcbi.1000291

A model of hippocampal functionNeural Networks 7:1065–1081.https://doi.org/10.1016/S08936080(05)801595

Recurrent inhibitory circuitry as a mechanism for grid formationNature Neuroscience 16:318–324.https://doi.org/10.1038/nn.3310

Theta modulation in the medial and the lateral entorhinal corticesJournal of Neurophysiology 104:994–1006.https://doi.org/10.1152/jn.01141.2009

Forward and reverse hippocampal placecell sequences during ripplesNature Neuroscience 10:1241–1242.https://doi.org/10.1038/nn1961

ConferenceNoisy adaptation generates lévy ﬂights in attractor neural networksAdvances in Neural Information Processing Systems. pp. 16791–16804.

Breathing pulses in an excitatory neural networkSIAM Journal on Applied Dynamical Systems 3:378–407.https://doi.org/10.1137/030602629

Spike frequency adaptation and neocortical rhythmsJournal of Neurophysiology 88:761–770.https://doi.org/10.1152/jn.2002.88.2.761

A unified dynamic model for learning, replay, and sharpwave/ripplesThe Journal of Neuroscience 35:16236–16258.https://doi.org/10.1523/JNEUROSCI.397714.2015

Phase precession: a neural code underlying episodic memory?Current Opinion in Neurobiology 43:130–138.https://doi.org/10.1016/j.conb.2017.02.006

Position reconstruction from an ensemble of hippocampal place cells: contribution of theta phase codingJournal of Neurophysiology 83:2602–2609.https://doi.org/10.1152/jn.2000.83.5.2602

Neural ensembles in CA3 transiently encode paths forward of the animal at a decision pointThe Journal of Neuroscience 27:12176–12189.https://doi.org/10.1523/JNEUROSCI.376107.2007

Awake replay of remote experiences in the hippocampusNature Neuroscience 12:913–918.https://doi.org/10.1038/nn.2344

Path integration and the neural basis of the “cognitive map.”Nature Reviews Neuroscience 7:663–678.https://doi.org/10.1038/nrn1932

ConferenceSpike frequency adaptation implements anticipative tracking in continuous Attractor neural networksAdvances in Neural Information Processing Systems.

Path integration and cognitive mapping in a continuous attractor neural network modelThe Journal of Neuroscience 17:5900–5920.https://doi.org/10.1523/JNEUROSCI.171505900.1997

Singletrial phase precession in the hippocampusThe Journal of Neuroscience 29:13232–13241.https://doi.org/10.1523/JNEUROSCI.227009.2009

Do septal neurons pace the hippocampal theta rhythm?Trends in Neurosciences 13:163–169.https://doi.org/10.1016/01662236(90)90040H

Associative memory and hippocampal place cellsInternational Journal of Neural Systems 6:81–86.

Theta phase precession in rat ventral striatum links place and reward informationThe Journal of Neuroscience 31:2843–2854.https://doi.org/10.1523/JNEUROSCI.486910.2011

The anatomy of memory: an interactive overview of the parahippocampal–hippocampal networkNature Reviews Neuroscience 10:272–282.https://doi.org/10.1038/nrn2614

Pacemaker neurons for the theta rhythm and their synchronization in the septohippocampal reciprocal loopJournal of Neurophysiology 87:889–900.https://doi.org/10.1152/jn.00135.2001

Hippocampal theta sequences reflect current goalsNature Neuroscience 18:289–294.https://doi.org/10.1038/nn.3909

Dynamics and computation of continuous attractorsNeural Computation 20:994–1025.https://doi.org/10.1162/neco.2008.1006378

Bimodality of theta phase precession in hippocampal place cellsin freely running ratsJournal of Neurophysiology 87:2629–2642.https://doi.org/10.1152/jn.2002.87.6.2629

A theory of hippocampal memory based on theta phase precessionBiological Cybernetics 89:1–9.https://doi.org/10.1007/s0042200304159

Spike phase precession persists after transient intrahippocampal perturbationNature Neuroscience 8:67–71.https://doi.org/10.1038/nn1369
Article and author information
Author details
Funding
Science and Technology Innovation 2030Brain Science and Braininspired Intelligence Project (2021ZD0200204)
 Si Wu
 Yuanyuan Mi
Science and Technology Innovation 2030Brain Science and Braininspired Intelligence Project (2021ZD0203700)
 Yuanyuan Mi
Science and Technology Innovation 2030Brain Science and Braininspired Intelligence Project (2021ZD0203705)
 Yuanyuan Mi
UK Research and Innovation (Frontier Research Grant EP/X023060/1)
 Daniel Bush
Wellcome (Principal Research Fellowship)
 Neil Burgess
National Natural Science Foundation of China (62088102)
 Yuanyuan Mi
National Natural Science Foundation of China (62136001)
 Yuanyuan Mi
National Natural Science Foundation of China (T2122016)
 Yuanyuan Mi
International Postdoctoral Exchange Fellowship Program (PC2021005))
 Zilong Ji
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication. For the purpose of Open Access, the authors have applied a CC BY public copyright license to any Author Accepted Manuscript version arising from this submission.
Acknowledgements
We thank Brad Pfeiﬀer for sharing the data. We also thank Brad Pheiﬀer, Cheng Wang, Li Yao for valuable discussions. This work was support by: Science and Technology Innovation 2030Brain Science and Braininspired Intelligence Project (No.2021ZD0200204, SW; No.2021ZD0200204/2021ZD0203700/2021ZD0203705, YM), the UKRI Frontier Research Grant (EP/X023060/1, DB), the Wellcome Principal Research Fellowship (NB), the National Natural Science Foundation of China (No. 62088102/62136001/T2122016, YM), and an International Postdoctoral Exchange Fellowship Program (No. PC2021005, ZJ).
Version history
 Preprint posted: February 16, 2023 (view preprint)
 Sent for peer review: March 17, 2023
 Preprint posted: May 17, 2023 (view preprint)
 Preprint posted: January 11, 2024 (view preprint)
 Preprint posted: June 5, 2024 (view preprint)
 Version of Record published: July 22, 2024 (version 1)
Cite all versions
You can cite all versions using the DOI https://doi.org/10.7554/eLife.87055. This DOI represents all versions, and will always resolve to the latest one.
Copyright
© 2023, Chu, Ji et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics

 1,167
 views

 95
 downloads

 5
 citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading

 Neuroscience
The brain’s ability to appraise threats and execute appropriate defensive responses is essential for survival in a dynamic environment. Humans studies have implicated the anterior insular cortex (aIC) in subjective fear regulation and its abnormal activity in fear/anxiety disorders. However, the complex aIC connectivity patterns involved in regulating fear remain under investigated. To address this, we recorded single units in the aIC of freely moving male mice that had previously undergone auditory fear conditioning, assessed the effect of optogenetically activating specific aIC output structures in fear, and examined the organization of aIC neurons projecting to the specific structures with retrograde tracing. Singleunit recordings revealed that a balanced number of aIC pyramidal neurons’ activity either positively or negatively correlated with a conditioned toneinduced freezing (fear) response. Optogenetic manipulations of aIC pyramidal neuronal activity during conditioned tone presentation altered the expression of conditioned freezing. Neural tracing showed that nonoverlapping populations of aIC neurons project to the amygdala or the medial thalamus, and the pathway bidirectionally modulated conditioned fear. Specifically, optogenetic stimulation of the aICamygdala pathway increased conditioned freezing, while optogenetic stimulation of the aICmedial thalamus pathway decreased it. Our findings suggest that the balance of freezingexcited and freezinginhibited neuronal activity in the aIC and the distinct efferent circuits interact collectively to modulate fear behavior.

 Neuroscience
Motor learning is often viewed as a unitary process that operates outside of conscious awareness. This perspective has led to the development of sophisticated models designed to elucidate the mechanisms of implicit sensorimotor learning. In this review, we argue for a broader perspective, emphasizing the contribution of explicit strategies to sensorimotor learning tasks. Furthermore, we propose a theoretical framework for motor learning that consists of three fundamental processes: reasoning, the process of understanding action–outcome relationships; refinement, the process of optimizing sensorimotor and cognitive parameters to achieve motor goals; and retrieval, the process of inferring the context and recalling a control policy. We anticipate that this ‘3R’ framework for understanding how complex movements are learned will open exciting avenues for future research at the intersection between cognition and action.