Skipping ahead: A circuit for representing the past, present, and future
Abstract
Envisioning the future is intuitively linked to our ability to remember the past. Within the memory system, substantial work has demonstrated the involvement of the prefrontal cortex and the hippocampus in representing the past and present. Recent data shows that both the prefrontal cortex and the hippocampus encode future trajectories, which are segregated in time by alternating cycles of the theta rhythm. Here, we discuss how information is temporally organized by these brain regions supported by the medial septum, nucleus reuniens, and parahippocampal regions. Finally, we highlight a brain circuit that we predict is essential for the temporal segregation of future scenarios.
Introduction
Our ability to imagine the future is nested in our capacity to remember the past. At their most basic description, memory and imagination are both cognitive processes in which mental constructs can be formed in the absence of directly relevant sensory information. It is not surprising that both processes draw on input from similar brain regions, as evidenced by human neuroimaging studies reporting that frontal cortices and the hippocampus are activated during both memory retrieval and planning or imagination. Individuals with memory impairments report difficulty in planning and imagination (Hassabis et al., 2007) and when asked to imagine future possible scenarios, the same cortical and hippocampal regions active during memory retrieval are active during imagination (Schacter et al., 2008; Svoboda et al., 2006). It has therefore been theorized that previously formed memories – encoded by the frontal cortices and hippocampus – provide the building blocks that are used to imagine upcoming events (Buckner, 2010).
The hippocampus has long been associated with episodic memory (O’Keefe and Nadel, 1978; Scoville and Milner, 1957; Vargha-Khadem et al., 1997). In contrast, the prefrontal cortex has typically been linked to decision-making (Rushworth et al., 2011) and executive control (Posner et al., 2007). While the two structures were at one time thought to have mutually exclusive roles in cognition, this view was challenged by human imaging reports; neuroimaging studies demonstrate the co-activation of the medial prefrontal cortex (mPFC) and the hippocampus during a range of memory processes (Fletcher and Henson, 2001; Miyashita, 2004; Ranganath et al., 2004). Patients with damage to the mPFC show similar impairments with autobiographical memories (Bertossi et al., 2016; Fletcher and Henson, 2001) and imagination of future scenarios (Bertossi et al., 2017). Animal models also support the important contribution of the frontal cortex in a range of memory functions including with contextual fear memory (Frankland et al., 2004; Rozeske et al., 2018), odor reward association (Tronel and Sara, 2003), and spatial memory (Maviel et al., 2004). Together these studies support the view that both the hippocampus and the mPFC have integral roles in learning and memory.
The following review will discuss the roles of the hippocampus and the prefrontal cortex in memory functions and planning the future. We first provide a brief overview of the functional contributions of each region and their anatomical connectivity. We then discuss a key role for oscillatory synchrony that links neural representations of past, present, and future events. It should be noted, of course, that while human research can examine our capacity to imagine the future, research on the true sense of ‘imagination’ in animal models is not possible. We can however examine the neural representations of memory-based planning, which is closely linked to imagining the future and will be discussed here. Finally, we highlight a key circuit between the prefrontal cortex, nucleus reuniens (NRe), and hippocampus that may function to temporally segregate representations of alternate upcoming choices, which could reflect the planning of future trajectories.
Prefrontal cortex-hippocampal pathways
The mPFC and hippocampus interact through several direct and indirect pathways. The first direct monosynaptic pathway to be described is a projection from the ventral and intermediate portion of CA1 and proximal subiculum. This projection innervates all layers of the mPFC and extends to the orbital portion of the PFC with the densest projections concentrated in the infralimbic (IL) and prelimbic (PL) regions (Cenquizca and Swanson, 2007; Hoover and Vertes, 2007; Jay et al., 1989; Figure 1A). The ventral portions of the hippocampus have been associated with a range of functions including fear (Kjelstrup et al., 2002), stress (Chang and Gean, 2019), anxiety (Jimenez et al., 2018), and social memory (Phillips et al., 2019). The ventral hippocampus (vHPC), like the dorsal portion, codes for spatial location, though place fields formed by ventral hippocampal neurons are considerably larger (Jung et al., 1994; Kjelstrup et al., 2008). Given its related functions and larger spatial scale, it is theorized that the vHPC transmits broad spatial and contextual information to the prefrontal cortices (Eichenbaum, 2017; Komorowski et al., 2013). Since this initial pathway was described, additional connections have been identified from the dorsal hippocampus (dHPC) which provides direct projections to the PL region of the mPFC, with activation of this pathway shown to mediate context fear memory retrieval (Ye et al., 2017). The mPFC in return sends direct monosynaptic projections to the hippocampus from the dorsal anterior cingulate portion of the mPFC to CA1 and CA3 subregions of the dHPC (Rajasethupathy et al., 2015), and from the PL to inhibitory neurons in dorsal CA1 (Malik et al., 2021, preprint) (Figure 1A).
Two of the main indirect pathways between the mPFC and the hippocampus pass either through the perirhinal and entorhinal cortices or through the NRe. One connection between the PL and IL and the hippocampus is a bidirectional pathway that passes through the perirhinal and entorhinal cortices to CA1 and CA3 of the hippocampus (Burwell et al., 1995; Lavenex et al., 2002; Vertes, 2004). The mPFC projects to both the superficial layers of the perirhinal cortex (PRC) as well as to the deep layers of both the lateral entorhinal cortex (LEC) and medial entorhinal cortex (MEC) (Agster and Burwell, 2009; Apergis-Schoute et al., 2006; Burwell and Amaral, 1998). This pathway to LEC and PRC is implicated in supporting the representations of objects and events (Deshmukh and Knierim, 2011; Eichenbaum, 2017; Kinnavane et al., 2016; Figure 1Bi). A second indirect pathway between the mPFC and the hippocampus passes through the thalamic subregion − the NRe (Vertes et al., 2007). The NRe sits along the midline of the thalamus and provides a bridge point between the prefrontal cortex and the hippocampal formation (McKenna and Vertes, 2004; Prasad and Chudasama, 2013; Vertes, 2006). Both the PL and IL provide dense projections to the NRe (McKenna and Vertes, 2004; Vertes, 2002; Vertes, 2004), and in turn, the NRe innervates many regions within the hippocampal formation including the entorhinal cortex (Wouterlood et al., 1990), presubiculum (McKenna and Vertes, 2004), parasubiculum (Wouterlood et al., 1990), and across the distal apical lamina of CA1 of the hippocampus (Bertram and Zhang, 1999). From the NRe, distinct populations of neurons project to the entorhinal cortex, CA1, and the subiculum, with entorhinal projections originating in the dorsolateral portion of the NRe, while more medial portions of the NRe project to CA1 (Dolleman-Van Der Weel and Witter, 1996). The NRe forms primarily excitatory synaptic connections to CA1 (Bertram and Zhang, 1999), and appears to innervate both pyramidal cells and putative interneurons (Dolleman-Van der Weel et al., 1997). Importantly, this pathway is bidirectional and functions as a link between the hippocampal formation and the mPFC. The NRe receives inputs from the subiculum and projects heavily to the PFC (Vertes, 2006). This link can be bypassed however as CA1, the subiculum and the EC also project directly to the PFC (Bertram and Zhang, 1999; Swanson and Kohler, 1986; Figure 1Bii).
The NRe neuron population is functionally heterogeneous, with hippocampal theta oscillations differentially modulating separate populations of neurons. Across the midline of the thalamus there are a high proportion of cells expressing both calretinin and calbindin, proteins known to regulate calcium homeostasis (Lara-Vasquez et al., 2016). Calretinin expressing cells do not alter their activity during bouts of theta but are inhibited by sharp-wave ripples (SWR). In contrast, cells lacking calretinin discharge at higher rates during hippocampal theta but are inactive during SWR activity (Lara-Vasquez et al., 2016).
Inactivation or lesions to the NRe result in memory deficits that resemble lesions to the mPFC and hippocampus, including with goal-directed spatial memory (Hallock et al., 2016; Hembrook et al., 2012; Layfield et al., 2015) and contextual fear memory (Ramanathan et al., 2018). In relation to hippocampal spatial coding, lesions to the NRe and the rhomboid nucleus of the thalamus do not impact hippocampal place cell characteristics in a familiar environment (Cholvin et al., 2018). However in novel environments, lesions induced place cell instability and high firing variability (Cholvin et al., 2018). The role of the NRe is therefore theorized to support long-term spatial stability and to synchronize the mPFC and hippocampus to facilitate memory processing (Cholvin et al., 2018; Ketz et al., 2015).
Theta oscillations and the medial septum
One of the most prominent features of the hippocampus is the presence of strong oscillatory dynamics. The three main rhythms recorded in the hippocampus are theta (4–12 Hz) (Winson, 1974), SWR (~110–250 Hz ripples on ~125 ms sharp waves) (Buzsaki, 1986), and gamma (25–150 Hz) (Colgin et al., 2009). While each of the three main types of rhythms is functional distinct, the current review is focused on theta rhythms. Theta rhythms are essential to hippocampal-dependent functions including spatial navigation and memory (Winson, 1978). Disruptions to hippocampal theta results in significant deficits in spatial memory, which are often as severe as lesions to the hippocampus itself (O’Keefe and Nadel, 1978; Winson, 1978).
The medial septum (MS) is the central pacemaker for generating theta rhythms in the hippocampus and the entorhinal cortex (Colgin, 2013; Mizumori et al., 1990; Vertes and Kocsis, 1997). The MS consists of three separate populations: GABAergic, glutamatergic, and cholinergic neurons (Brashear et al., 1988; Kimura et al., 1980; Panula et al., 1980; Kohler et al., 1984; Shute and Lewis, 1967; Sotty et al., 2003). Each population of the MS has both distinct firing patterns and projection targets. Cholinergic neurons make up the largest portion of septal neurons with approximately 47% of the total MS population and are characterized by their slow-firing patterns (~5 Hz) (Colom et al., 2005; Griffith and Matthews, 1986; Markram and Segal, 1990). The majority of MS cholinergic neurons projections to the hippocampus innervate pyramidal cells and interneurons as well as some granule cells in the dentate gyrus (DG) (Cole and Nicoll, 1983Frotscher and Léránth, 1985; Widmer et al., 2006). In the entorhinal cortex, septal cholinergic neurons project more to the MEC than the LEC, 5% vs. 3.37% respectively, with most of the projections terminating in layers I and II (Desikan et al., 2018). Septal GABAergic neurons comprise approximately 28% of the total MS population (Colom et al., 2005). This population is characterized by its fast-firing and burst firing patterns as well as the presence of Ih hyperpolarization-activated current. Hyperpolarization-activated currents are inward currents that are activated by the hyperpolarizing of cells and are found in rhythmically active neurons (Hangya et al., 2009; Varga et al., 2008). MS GABAergic neurons form local projections within the septum with cholinergic and other GABAergic neurons (Henderson et al., 2001) as well as long-range projections to both the hippocampus and the medial entorhinal cortex (Gulyás et al., 1991; Henderson et al., 2001; Gonzalez-Sulser et al., 2014). The population can be subdivided into at least two separate populations, those cells positive for the parvalbumin (PV) marker and cells positive for calbindin marker (Kiss et al., 1997). MS GABAergic neurons project to CA1, CA3, and the DG subregions of the hippocampus and primarily innervate other GABAergic interneurons (Freund and Antal, 1988). Similar to the projection pattern in the hippocampus, the MS GABAergic population primarily projects to interneurons across all layers of the MEC including both fast-spiking and low threshold spiking interneurons (Gonzalez-Sulser et al., 2014).
Septal glutamatergic neurons make up approximately 25% of the MS population (Colom et al., 2005). MS glutamatergic neurons provide excitatory inputs to cholinergic, GABAergic, and other glutamatergic neurons within the MS (Manseau et al., 2005; Robinson et al., 2016), with the majority of projections to fast-spiking putative GABAergic neurons (Robinson et al., 2016). Next, these neurons constitute between 4% and 23% of the septo-hippocampal projections (Colom et al., 2005; Henderson et al., 2010) with projections to both interneurons and pyramidal cells in CA1 and CA3 (Fuhrmann et al., 2015; Robinson et al., 2016). MS glutamatergic neurons also send direct projections to the MEC and appear to preferentially project to pyramidal cells in the MEC (Gonzalez-Sulser et al., 2014; Justus et al., 2017).
Lesions or inactivation of the entire MS abolishes theta oscillations in the hippocampus and entorhinal cortex (Green and Arduini, 1954; Jeffery et al., 1995; Mitchell et al., 1982), and recordings from septal neurons display rhythmic burst firing patterns that are synchronized to the ongoing hippocampal theta oscillation (Stumpf et al., 1962). Each separate MS population contributes differently to the rhythm generation. MS GABAergic neurons are hypothesized to drive theta oscillations by providing rhythmic inputs to local interneurons in the hippocampus (Freund and Antal, 1988). These interneurons then rhythmically disinhibit pyramidal cells in the hippocampus therefore promoting widespread and synchronized theta oscillation. Rhythmic optogenetic stimulation of septal GABAergic neurons drives hippocampal oscillations with a high level of entrainment within the theta range (Zutshi et al., 2018) and optogenetic silencing of GABAergic neurons significantly reduced theta power both during REM sleep (Boyce et al., 2016). Septal cholinergic neurons have been reported to control the amplitude of ongoing theta rhythms (Lee et al., 1994). Despite these findings, recent chemogenetic and optogenetic experiments suggest that modulation of septal cholinergic neurons may have more moderate effects on hippocampal theta rhythms than previously reported. Chemogenetic activation of septal cholinergic neurons moderately reduces theta rhythm frequency within the MEC (Carpenter et al., 2017), and optogenetic stimulation of septal cholinergic neurons at theta frequencies promotes theta rhythms during anesthesia, however has little effect in the awake and behaving mouse (Vandecasteele et al., 2014). Septal glutamatergic cells may contribute to theta rhythm generation, as rhythmic optogenetic activation of septal glutamatergic neurons within the theta range strongly drives theta rhythms in the hippocampus (Fuhrmann et al., 2015; Robinson et al., 2016). Activation of glutamatergic neurons also results in locomotor initiation and have therefore been suggested to mediate transition states associated with locomotion (Fuhrmann et al., 2015). The direct contribution of septal glutamatergic neurons to the generation of theta oscillations or movement transitions remains to be determined, as it has yet to be reported if silencing this population has any effect on theta oscillations or movement.
Oscillatory synchrony and the NRe
Across the brain, a proposed function for neural oscillations is to facilitate long-range communication between brain areas. In both rodent and human studies, theta coherence between the mPFC and the hippocampus has been related to both working memory (Anderson et al., 2010; Benchenane et al., 2010; Hyman et al., 2005) and goal-directed spatial navigation (Ito et al., 2015). During goal-directed spatial navigation tasks, many mPFC cells become phase-locked to hippocampal theta rhythms (Hyman et al., 2005; Siapas et al., 2005). In simultaneous recordings of units in the mPFC and field activity from CA1, a high level of coherence between the two regions is present at the choice point in a Y-maze task (Benchenane et al., 2010). This choice point-related coherence increases following acquisition of the task (Benchenane et al., 2010). A decrease in the phase-locking between the two regions is also predictive of errors during cognitive testing (Hyman et al., 2010).
The NRe is key in supporting synchrony between the mPFC and the hippocampus across frequency bands. Inactivation of the NRe disrupts gamma synchrony between the hippocampus and mPFC during urethane anesthesia (Ferraris et al., 2018). In addition, during the choice point of a delayed alternation T-maze task, muscimol infusion into the NRe results in a significant decrease in both mPFC spike phase-locking to theta and a decrease in oscillatory coherence between the two regions (Hallock et al., 2016). The importance of the NRe is highlighted during a spatial alternation T-maze task, where recordings from the mPFC and NRe show that the firing rates of neurons predict future turns at the choice point (Ito et al., 2015). This predictive and trajectory-dependent activity during the stem portion of the T-maze is abolished during optogenetic silencing or lesions to the NRe (Ito et al., 2015). These studies support the theory that the NRe is critically involved in synchronizing the mPFC and the hippocampus during periods when the animal could be contemplating an upcoming decision (Ito et al., 2015; Eichenbaum, 2017). Further support for the role of the NRe in hippocampal-related memory processing comes from a study that used optogenetic activation of the NRe, which resulted in an enhancement for memory performance during a context conditioning task (Xu and Sudhof, 2013). It should be noted with many direct and indirect pathways, theta coherence may be in part regulated through other connections, for example, the direct vHPC to mPFC connections also contribute to theta synchrony between the two regions (O’Neill et al., 2013). Together these studies demonstrate the importance of theta synchrony in supporting memory performance and highlights the role of the NRe as a bridge point between the mPFC and the hippocampus to facilitate bidirectional communication.
Hippocampal representations are organized within theta cycles
Within the hippocampus, theta rhythms provide a temporal framework to organize spatial information. The hippocampus creates a distinctive spatial representation of its environments, in the form of populations of ‘place cells’, that form an internal map of the environment and are hypothesized to enable spatial memory (Burgess et al., 2001; Buzsaki and Moser, 2013). In relation to individual cycles of the theta rhythm, the initial firing of a place cell occurs at a late phase of the theta cycle − at the peak of the oscillation − but as the animal traverses through the place field the cell fires at progressively earlier phases within each subsequent theta cycle, known as phase precession (O’Keefe and Recce, 1993; Skaggs et al., 1996). At the population level, a sequence of place cells within each theta cycle will spike in the same order that place fields were visited, in a time-compressed format (Lee and Wilson, 2002; Skaggs et al., 1996; Figure 2). One important consequence of this temporal organization is that place fields centered behind the animal will fire first in the sequence, at the earliest theta phase. Likewise, cells with a field centered in front of the animal will fire at later phases. The temporal organization of theta sequences therefore represent the immediate past, present, and future of the animal’s location within a theta cycle (Figure 2C; Skaggs et al., 1996).
Representations of past and potential future experiences are not only present during active navigation, but these sequences are also observed with replay during SWR. SWR occur during ‘offline’ states of the animal, including during non-REM sleep, immobility, as well as eating and drinking (Buzsaki, 1986). Although this phenomenon may play an essential role in memory formation and future decision-making (Buzsáki, 2015; Foster, 2017; Joo and Frank, 2018; Shin et al., 2019), this review will focus on hippocampal representations during active navigation.
Phase precession and theta sequences are related but have distinct phenomena. Theta sequences emerge following experience, while phase precession can be recorded during the first time traversing through a novel environment (Feng et al., 2015). It was therefore theorized that phase precession is a building block of theta sequences, with theta sequences being formed by synchronizing multiple neurons into coherent ensembles through experience-dependent plasticity (Feng et al., 2015). However, recent reports show that the two phenomena are independent from one another. Following modulation of cholinergic tone, phase precession is disrupted while hippocampal ensembles remain intact (Venditto et al., 2019). Furthermore, the reduction of hippocampal theta oscillations does not affect place cell phase precession (Schlesiger et al., 2015), but will eliminate theta sequences in both time cells and place cells (Figure 2B and C; Wang et al., 2015).
Phase precession has recently been identified in human subjects during goal-directed navigation tasks. In recordings performed in a virtual environment, theta oscillations in CA1 are present at a broader range compared to rodent theta (2–10 Hz) (Qasim et al., 2021). Recordings from across the hippocampus and the entorhinal cortex demonstrate spatially tuned neurons spike at progressively earlier phases of the theta oscillation while an individual navigates through the cells’ firing field (Qasim et al., 2021). In addition, there is evidence of phase precession in non-spatially modulated cells during specific goal states. This phase precession is present in the hippocampus as well as in the anterior cingulate and orbitofrontal cortex. This goal-specific phase precession suggests that phase precession may be functionally relevant for neural representations of both spatial and non-spatial information across both the medial temporal and prefrontal cortex (Qasim et al., 2021).
Many questions remain regarding theta sequences including how are these spatial and temporal patterns formed and if these temporally precise patterns are necessary for memory formation. For insights into these questions, we turn to one of the main input pathways into the hippocampus, the MEC. The MEC contains a variety of spatially modulated neurons that include grid cells (Hafting et al., 2005), border cells, (Solstad et al., 2008), and head direction (HD) cells (Sargolini et al., 2006). Since the identification of grid cells, it was widely theorized that inputs from the MEC and grid cells support the formation of place cells in the hippocampus (Buzsaki and Moser, 2013; Cheng and Frank, 2011; de Almeida et al., 2012; McNaughton et al., 2006; Moser and Moser, 2013; Rolls et al., 2006; Savelli and Knierim, 2010; Si and Treves, 2009). Despite these theories, however, it was shown that inactivation of the MS and the attenuation of theta rhythms completely abolishes grid cell spatial firing (Brandon et al., 2011; Koenig et al., 2011) while hippocampal place cells remain unaffected in both familiar and novel environments (Brandon et al., 2014; Koenig et al., 2011). Thus, the retrieval of previously stored spatial maps, as well as the generation of new spatial maps, is not dependent on inputs from the MS nor from MEC grid cells. This relationship between grid cells and place cells is further supported by early recordings in rat pups, which show that place cell spatial firing develops days earlier (P15-17) than grid cells (P20-22) (Langston et al., 2010; Wills et al., 2010). Even though grid cells are not essential to support place cell spatial firing, other inputs from the MEC are necessary as shown by lesions to the entire EC disrupts both the temporal precision and the spatial stability of place cells (Miller and Best, 1980; Schlesiger et al., 2018; Van Cauter et al., 2008).
Given that the disruption of the MS and the reduction in theta oscillations results in strong deficits in spatial memory performance, the role of septal inputs to the hippocampus has been theorized to temporally coordinate cell assemblies to enable memory formation (Buzsaki and Moser, 2013) and may also provide a framework for the representation of future possible trajectories. Recent work has provided insight into how the septum supports this temporal coordination. The complete MS inactivation and theta reduction results in the attenuation of theta sequences in both time cells and place cells while phase precession is maintained (Figure 2B and C; Wang et al., 2015). With a more moderate alternation to MS activity, by cooling the septum, the temporal organization of hippocampal place cells exhibited less of a disruption. Cooling of the MS reduced both theta frequency and power, leaving theta oscillations intact but slowed during a T-maze task (Petersen and Buzsaki, 2020). Slowing theta oscillations did not affect the distance between place cell peaks or the phase lag time but the presence of an increased time lag suggested that the same number of place cell assemblies were compressed into a theta cycle, however, the assemblies were proportionally altered within the lengthened theta cycle during MS cooling (Petersen and Buzsaki, 2020). Different populations of the MS have distinctive contributions to the temporal coding of information in the hippocampus. As discussed earlier, the systemic modulation of cholinergic neurons results in the disruption of phase precession, however, theta sequences were maintained (Venditto et al., 2019). In addition, optogenetic activation of MS PV neurons to drive hippocampal rhythms outside the endogenous range (10–12 Hz) does not alter place cell spatial firing nor cell phase precession (Zutshi et al., 2018). Together these studies indicate that the MS is not required for temporal coordination of individual cells relative to theta oscillations (phase precession); however, the timing between hippocampal place cells is altered, suggesting that MS inputs are essential for the generation of theta sequences.
Recordings in developing rat pups further supports this relationship between the MS, theta oscillations, and sequences. During development in rat pups, the spatial coding of hippocampal place cells appears as early as P15 (Farooq and Dragoi, 2019; Langston et al., 2010; Wills et al., 2010) and phase precession in these cells appears shortly thereafter, as early as P17 (Wills et al., 2010). However, temporal organization between cells, or theta sequences that represent previous, present, and future locations, do not develop until considerably later, at P23-24. Thus at the earliest stages of the spatial coding network, the hippocampus represents the animal’s current location only, whereas representations that extend into the immediate past and future are not present until P23-24 (Farooq and Dragoi, 2019). Of course, many important features of the network are rapidly maturing between P15 and P24. Here, we highlight the development of the MS theta generation circuit as an important candidate to support theta sequence development. In the MS, neurons begin to express PV neurons at P16, however, very few neurons are present at this stage (Guo et al., 2014). Between P16 and P21 there is a rapid development of this cell type, with numbers of PV positive immunoreactive cells nearly tripling during this time and then reaching close to fully mature levels by P28 (Guo et al., 2014). In addition, peak theta frequency increases with age along with the proportion of CA1 and MEC cells that are theta-modulated (Farooq and Dragoi, 2019; Wills et al., 2010). The development of theta sequences also corresponds with the maturation of the MEC and the emergence of grid cell spatial firing (P20-22) (Langston et al., 2010; Wills et al., 2010), which may enable the appearance of theta sequences in CA1 (Farooq and Dragoi, 2019). If we use PV development and hippocampal theta as indicators of MS maturation, the MS and theta oscillations are critical components for the emergence of MEC grid cells and hippocampal theta sequences. The emergence of MEC grid cells may support hippocampal theta sequences through path integration. For hippocampal place cells to code for both past and future trajectories while the animal navigates through an environment, the hippocampus needs to integrate multiple sensory inputs and self-generated cues by the animal’s movement for both retrospective and prospective coding. Grid cells may play a pivotal role in theta sequence generation by providing idiothetic cues for path integration. Path integration is a form of navigation that relies on the continuous integration of self-motion information about distance traveled and running speed. The regular hexagonal firing pattern of grid cells may support prospective coding through the integration of self-motion-based information chunked into a metric of space.
The maturation of hippocampal theta, the development of grid cells, and the emergence of theta sequences all coincide with the successful acquisition of hippocampal-dependent learning and memory tasks. In the Morris water maze, evidence for place learning can occur as early as P19-20 (Brown and Whishaw, 2000), but quadrant preference during the probe trial develops at a similar age as the emergence of theta sequences (P20-21) (Akers and Hamilton, 2007). Similarly, rat pup performance exceeds chance levels in an alternation T-maze at P21-25 (Bronstein and Spear, 1972), corresponding to when theta sequences emerge. Together, these developmental studies and others strongly suggest that the maturation of the MS to drive theta rhythms and development of grid cells may be essential for temporal coding of theta sequences, enabling the representation of past, present, and future trajectories.
In addition to developmental studies, there are several lines of evidence that support the theory that the temporal coding and binding of successive locations into theta sequences is essential for both memory formation and representing future events. Theta sequences are more frequently represented between landmarks in an environment separating the environment into segments (Gupta et al., 2012). Therefore, the hippocampus may encode spatial information into segments of experience, suggesting that the brain organizes vast amounts of information in an efficient and useful way (Gupta et al., 2012). Theta sequences are absent when navigating through an environment for the first time (Feng et al., 2015). Following experience in an environment, theta sequences emerge, predicting the immediate future of the animal path (Feng et al., 2015; Pfeiffer and Foster, 2013). These studies support the notion that theta sequences play roles in both consolidating past experiences while planning for the future.
Sequence alternation and the representation of future scenarios
To represent past and future trajectories, hippocampal place cells display both prospective and retrospective coding. Initial reporting showed that during a modified T-maze task hippocampal place cells display differential firing during the stem portion of the maze, depending on the animals upcoming trajectory (Wood et al., 2000). Later studies reveal that during goal-directed spatial navigation, cell assembles exhibit both prospective coding of the upcoming path and retrospective coding of where the animal has been (Ferbinteanu and Shapiro, 2003; Wang et al., 2020). Recently, it has been shown that within a single theta cycle, hippocampal place cell sequences alternate between forward and reverse ordered sequences (Wang et al., 2020). Forward sequences have a preferred phase around 250–420°, while the reverse phase occurs between 80° and 230° of the theta cycle (where 0° is the peak of theta). Interestingly, the reverse ordered sequences appear very similar to reverse replay which can be recorded during SWR (Wang et al., 2020), and thus may facilitate the expression of reverse replay and memory consolidation.
Alternation between sequences is also present when two possible paths lie ahead. During a T-maze, when two trajectories are possible leading up to the choice point of a maze, hippocampal theta sequences map out the future paths that correspond to potential future actions, indicating the animal could be deliberating between two choices (Johnson and Redish, 2007; Kay et al., 2020). This mapping of potential future paths is organized into alternating theta cycles (Kay et al., 2020). In the MEC, HD cells segregate onto alternating theta cycles (Brandon et al., 2013; Jeffery et al., 1995). This phenomenon is lost when theta rhythms are disrupted through MS inactivation, pointing toward theta oscillations as a means to segregate discrete information in time by assigning this information to alternating cycles of the theta rhythm (Figure 3A; Brandon et al., 2013). Along these same lines, during a T-maze task, the hippocampus will represent both options (left or right) when the animal reaches the choice point; first sweeping forward along one potential path and then the other, possibly evaluating both options (Johnson and Redish, 2007). More recently, it has been shown that prior to this left-right decision at a choice point, CA1 cells that encode the left choice will be selectively active on one theta cycle followed by cells that encode the right choice will then be active on the next theta cycle (alternating every ~125 ms) (Figure 3B; Kay et al., 2020). This alternation between left and right begins as early as 25 cm prior to the choice point and will continue until the animal makes its turn (Kay et al., 2020). When the hippocampal representation alternates between two possible future trajectories or choices, this organization may be driven by theta cycles and inputs received from theta alternating cells in the MEC (Figure 3). Further evidence for theta skipping can be found across several regions that provide input to the MEC including (1) the MS where theta skipping neurons are also visible in directionally tuned cells that are only theta rhythmic when the animal runs in a specific direction (King et al., 1998), and (2) the pre- and parasubiculum where theta skipping can be seen in HD and directionally modulated ‘border cells’ (Boccara et al., 2010).
Representations of past, present, and future trajectories have most recently been recorded in the PFC (Tang et al., 2021). PFC cell ensembles are organized into sequences within a single theta cycle that occur concurrently with hippocampal sequences. During the W-maze spatial alteration task, approximately half of the sequences recorded in the PFC and CA1 exhibit theta cycle skipping. Interestingly, while the animal navigates toward the choice point, CA1, but not PFC, theta sequences alternate between possible upcoming trajectories. Instead, PFC sequences preferentially encode the animals’ upcoming choice (Tang et al., 2021). It appears that the hippocampus equally represents both potential paths, while the PFC will represent the future choice earlier, with CA1-PFC theta sequence coherence between the two regions biased toward the upcoming choice. Therefore, it is suggested that the hippocampus interacts with the prefrontal sequences to guide the selection of an upcoming choice.
As discussed above, the interaction between the mPFC and the hippocampus through the NRe during a spatial memory task is critical, particularly leading up to the decision point. Since this is the portion of the task when future sequences are being actively represented, the interaction between the PFC and hippocampus is of particular importance. During exploration in an open field environment, the NRe contains one population of cells that codes for HD and a separate population that are ‘purely’ theta cycle skipping (Jankowski et al., 2014). While these cells are in separate populations in the NRe, this information may be integrated further down the line at the level of the pre- and parasubiculum and the MEC (Figure 4). During spatial navigation, the NRe supports the animals’ future trajectory firing in CA1, however, this trajectory-dependent firing is lost with NRe lesioning or optogenetic shutdown (Ito et al., 2015). We propose that this loss is due to the inactivation of theta alternating inputs to the pre- and parasubiculum and the MEC. In this model, the central role of the MS is to drive theta rhythms and provide a time course to segment incoming sensory information in the parahippocampal regions, and the role of the NRe is to provide input that separates this information into adjacent theta cycles. Together, theta cycle spiking would be first integrated at the level of the pre- and parasubiculum and the MEC. The pre- and parasubiculum and the MEC represent HD to the animal’s right and left on alternating theta cycles. In turn, these inputs drive the expression of alternating theta sequences that map out future scenarios in both the hippocampus and mPFC to guide the animals’ upcoming choices and behavior. It should be noted that to date cycle skipping has not to be linked to any type of behavioral correlate, we theorize that theta skipping in parahippocampal areas plays a key role in supporting the segmentation of different spatial representations to enable the representation of multiple possible of future trajectories.
While the mechanisms outlined in the current review are focused on spatial representations, this circuit can be extended to non-spatial tasks as well. Spatial representation is one example of a more general mechanism for the encoding of salient variables by the hippocampus (Buzsaki and Moser, 2013; Constantinescu et al., 2016; Schiller et al., 2015; Tavares et al., 2015). Although the data presented here has been primarily focused on spatial representations, firing of hippocampal cells can be modulated by a range of non-spatial variables including time (Wang et al., 2015), sound (Aronov et al., 2017; Sakurai, 2002), odors (Eichenbaum et al., 1987), faces, and objects (Fried et al., 1997). Given that hippocampal theta sequences have been observed in relation to time cells, and that these cells can be modulated by MS modulation, we believe this phenomenon can extend to any variable coded for by the hippocampus.
Looking more broadly, we predict that theta cycle skipping plays an important role in multiple functions including in deliberative decision-making behaviors. When an animal is navigating through an environment and comes to a decision point, the animal sometimes pauses and looks before executing the choice, seemingly deliberating between options, known as ‘vicarious trial and error’ (VTE) (Muenzinger, 1956; Tolman, 1948). During VTE, it has been suggested that the animal may be ‘thinking about the future’ (Redish, 2016). Further research could aim to unpack the relationship between alternating theta sequences and VTE behavior. This could be achieved through a detailed analysis of the animals’ running speed, head movement, and eye saccades with simultaneously recorded theta sequences. Recent reports have demonstrated the use of head-mounted camera to capture eye movements in freely moving rodents, allowing the possibility to examine rodent head and bilateral eye movement (Meyer et al., 2020). Using this technique during a goal-directed task, we predict that the precise analysis of the animals’ behavior, specifically of the animals’ head movement and saccades, would correspond to the theta skipping content in the prefrontal cortex and the hippocampus.
The mechanism discussed here refers to representations when only two possible outcomes are available, however, this alternation of cell assembles may also occur when multiple outcomes are possible. When there are two possible outcomes, for example, as an animal runs toward the choice point of a T-maze, each possible outcome remains ahead of the animal and can be represented on alternate theta cycles. These separate populations of neurons may interact competitively via lateral inhibition. Thus, alternating theta cycles provides a mechanism to prevent interference between attractor states while the animal deliberates. While the phenomenon of cycle skipping has been discussed here as deliberation between with two options performing in a T-maze, choices are often quite numerous. When there are multiple potential outcomes, for example, with a radial arm maze, an animal is presented with many available paths ahead. When this occurs, multiple attractor states may be present representing the potential paths. While the animal deliberates, theta sequence representation may occur intermittently and would likely be represented on separate theta cycles sporadically, perhaps not initially on alternating theta cycles. One possibility is that, as lateral inhibition of the competing attractors occurs, the hippocampus would eventually narrow down the potential path to two possible outcomes. At this point, we envision that the hippocampus would then represent the two possible attractor states on alternating cycles to drive the activation of cortex-wide representations relevant to the upcoming decision faced by the animal. Such a mechanism would allow the animals to explore previously encoded information to help consider the possible consequences of each decision.
Concluding Remarks
Theta sequences may not only enable memory formation but also map out future potential paths. Representations of different outcomes are supported by segregation of content of these paths into alternating theta cycles in the hippocampus, which then allows for the final choice to be represented in the PFC. We propose that sequence representation on alternating theta cycles in both the PFC and the hippocampus is driven from inputs received from the parahippocampal regions including the presubiculum, parasubiculum, and the MEC. Furthermore, we suggest that to facilitate theta cycle skipping, as the animal weighs out two potential choices, requires the convergence of several regions that merge within the parahippocampal regions, and then the hippocampus and PFC. Specifically, inputs from the NRe, together with theta oscillations driven by the MS, are integrated at the level of the pre- and parasubiclulum and/or MEC. We propose that theta cycle skipping enables the mPFC and the hippocampus to segment unique possible outcomes, providing a framework for envisioning the future to guide behavior.
References
-
Comparison of developmental trajectories for place and cued navigation in the Morris water taskDevelopmental Psychobiology 49:553–564.https://doi.org/10.1002/dev.20227
-
Ultrastructural organization of medial prefrontal inputs to the rhinal corticesThe European Journal of Neuroscience 24:135–144.https://doi.org/10.1111/j.1460-9568.2006.04894.x
-
Grid cells in pre- and parasubiculumNature Neuroscience 13:987–994.https://doi.org/10.1038/nn.2602
-
Segregation of cortical head direction cell assemblies on alternating theta cyclesNature Neuroscience 16:739–748.https://doi.org/10.1038/nn.3383
-
Acquisition of a spatial discrimination by rats as a function of ageJournal of Comparative and Physiological Psychology 78:208–212.https://doi.org/10.1037/h0032188
-
The role of the hippocampus in prediction and imaginationAnnual Review of Psychology 61:27–48.https://doi.org/10.1146/annurev.psych.60.110707.163508
-
Memory for events and their spatial context: models and experimentsPhilosophical Transactions of the Royal Society of London. Series B, Biological Sciences 356:1493–1503.https://doi.org/10.1098/rstb.2001.0948
-
Cortical afferents of the perirhinal, postrhinal, and entorhinal cortices of the ratThe Journal of Comparative Neurology 398:179–205.https://doi.org/10.1002/(sici)1096-9861(19980824)398:2<179::aid-cne3>3.0.co;2-y
-
Hippocampal sharp waves: their origin and significanceBrain Research 398:242–252.https://doi.org/10.1016/0006-8993(86)91483-6
-
Memory, navigation and theta rhythm in the hippocampal-entorhinal systemNature Neuroscience 16:130–138.https://doi.org/10.1038/nn.3304
-
Ventral Midline Thalamus Is Necessary for Hippocampal Place Field Stability and Cell Firing ModulationThe Journal of Neuroscience 38:158–172.https://doi.org/10.1523/JNEUROSCI.2039-17.2017
-
Mechanisms and functions of theta rhythmsAnnual Review of Neuroscience 36:295–312.https://doi.org/10.1146/annurev-neuro-062012-170330
-
Representation of non-spatial and spatial information in the lateral entorhinal cortexFrontiers in Behavioral Neuroscience 5:69.https://doi.org/10.3389/fnbeh.2011.00069
-
ConferenceProceedings of the National Academy of Sciences of the United States of America Vol. 115Target selectivity of septal cholinergic neurons in the medial and lateral entorhinal cortex. pp. E2644–E2652.https://doi.org/10.1073/pnas.171653111529487212
-
Prefrontal-hippocampal interactions in episodic memoryNature Reviews. Neuroscience 18:547–558.https://doi.org/10.1038/nrn.2017.74
-
The Nucleus Reuniens Controls Long-Range Hippocampo-Prefrontal Gamma Synchronization during Slow OscillationsThe Journal of Neuroscience 38:3026–3038.https://doi.org/10.1523/JNEUROSCI.3058-17.2018
-
Replay Comes of AgeAnnual Review of Neuroscience 40:581–602.https://doi.org/10.1146/annurev-neuro-072116-031538
-
GABAergic projections from the medial septum selectively inhibit interneurons in the medial entorhinal cortexThe Journal of Neuroscience 34:16739–16743.https://doi.org/10.1523/JNEUROSCI.1612-14.2014
-
Hippocampal electrical activity in arousalJournal of Neurophysiology 17:533–557.https://doi.org/10.1152/jn.1954.17.6.533
-
Electrophysiology of AChE-positive neurons in basal forebrain slicesNeuroscience Letters 71:169–174.https://doi.org/10.1016/0304-3940(86)90553-7
-
Postnatal development of nestin positive neurons in rat basal forebrain: different onset and topography with choline acetyltransferase and parvalbumin expressionInternational Journal of Developmental Neuroscience 35:72–79.https://doi.org/10.1016/j.ijdevneu.2014.03.004
-
Segmentation of spatial experience by hippocampal theta sequencesNature Neuroscience 15:1032–1039.https://doi.org/10.1038/nn.3138
-
Ventral Midline Thalamus Is Critical for Hippocampal-Prefrontal Synchrony and Spatial Working MemoryThe Journal of Neuroscience 36:8372–8389.https://doi.org/10.1523/JNEUROSCI.0991-16.2016
-
GABAergic neurons of the medial septum lead the hippocampal network during theta activityThe Journal of Neuroscience 29:8094–8102.https://doi.org/10.1523/JNEUROSCI.5665-08.2009
-
Anatomical analysis of afferent projections to the medial prefrontal cortex in the ratBrain Structure & Function 212:149–179.https://doi.org/10.1007/s00429-007-0150-4
-
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision pointThe Journal of Neuroscience 27:12176–12189.https://doi.org/10.1523/JNEUROSCI.3761-07.2007
-
The hippocampal sharp wave-ripple in memory retrieval for immediate use and consolidationNature Reviews. Neuroscience 19:744–757.https://doi.org/10.1038/s41583-018-0077-1
-
Comparison of spatial firing characteristics of units in dorsal and ventral hippocampus of the ratThe Journal of Neuroscience 14:7347–7356.
-
Ventral hippocampal neurons are shaped by experience to represent behaviorally relevant contextsThe Journal of Neuroscience 33:8079–8087.https://doi.org/10.1523/JNEUROSCI.5458-12.2013
-
Perirhinal and parahippocampal cortices of the macaque monkey: projections to the neocortexThe Journal of Comparative Neurology 447:394–420.https://doi.org/10.1002/cne.10243
-
Inactivation of the nucleus reuniens/rhomboid causes a delay-dependent impairment of spatial working memoryNeurobiology of Learning and Memory 125:163–167.https://doi.org/10.1016/j.nlm.2015.09.007
-
A functional glutamatergic neurone network in the medial septum and diagonal band areaThe Journal of Physiology 566:865–884.https://doi.org/10.1113/jphysiol.2005.089664
-
Afferent projections to nucleus reuniens of the thalamusThe Journal of Comparative Neurology 480:115–142.https://doi.org/10.1002/cne.20342
-
Two Distinct Types of Eye-Head Coupling in Freely Moving MiceCurrent Biology 30:2116–2130.https://doi.org/10.1016/j.cub.2020.04.042
-
On the origin and early use of the term vicarious trial and error (VTEPsychological Bulletin 53:493–494.https://doi.org/10.1037/h0044135
-
The anterior cingulate gyrus and the mechanism of self-regulationCognitive, Affective & Behavioral Neuroscience 7:391–395.https://doi.org/10.3758/cabn.7.4.391
-
Viral tracing identifies parallel disynaptic pathways to the hippocampusThe Journal of Neuroscience 33:8494–8503.https://doi.org/10.1523/JNEUROSCI.5072-12.2013
-
Vicarious trial and errorNature Reviews. Neuroscience 17:147–159.https://doi.org/10.1038/nrn.2015.30
-
Optogenetic Activation of Septal Glutamatergic Neurons Drive Hippocampal Theta RhythmsThe Journal of Neuroscience 36:3016–3023.https://doi.org/10.1523/JNEUROSCI.2141-15.2016
-
Hebbian analysis of the transformation of medial entorhinal grid-cell inputs to hippocampal place fieldsJournal of Neurophysiology 103:3167–3183.https://doi.org/10.1152/jn.00932.2009
-
Episodic simulation of future events: concepts, data, and applicationsAnnals of the New York Academy of Sciences 1124:39–60.https://doi.org/10.1196/annals.1440.001
-
Memory and Space: Towards an Understanding of the Cognitive MapThe Journal of Neuroscience 35:13904–13911.https://doi.org/10.1523/JNEUROSCI.2618-15.2015
-
Loss of recent memory after bilateral hippocampal lesionsJ Neurol Neurosurg Psychiatry 20:11–21.https://doi.org/10.1136/jnnp.20.1.11
-
The ascending cholinergic reticular system: neocortical, olfactory and subcortical projectionsBrain : A Journal of Neurology 90:497–520.https://doi.org/10.1093/brain/90.3.497
-
The role of competitive learning in the generation of DG fields from EC inputsCognitive Neurodynamics 3:177–187.https://doi.org/10.1007/s11571-009-9079-z
-
The significance of the rabbit’s septum as a relay station between the midbrain and the hippocampus. II. The differential influence of drugs upon both the septal cell firing pattern and the hippocampus theta activityElectroencephalography and Clinical Neurophysiology 14:212–219.https://doi.org/10.1016/0013-4694(62)90031-7
-
Blockade of NMDA receptors in prelimbic cortex induces an enduring amnesia for odor-reward associative learningThe Journal of Neuroscience 23:5472–5476.
-
Unstable CA1 place cell representation in rats with entorhinal cortex lesionsThe European Journal of Neuroscience 27:1933–1946.https://doi.org/10.1111/j.1460-9568.2008.06158.x
-
The presence of pacemaker HCN channels identifies theta rhythmic GABAergic neurons in the medial septumThe Journal of Physiology 586:3893–3915.https://doi.org/10.1113/jphysiol.2008.155242
-
Analysis of projections from the medial prefrontal cortex to the thalamus in the rat, with emphasis on nucleus reuniensThe Journal of Comparative Neurology 442:163–187.https://doi.org/10.1002/cne.10083
-
Theta sequences are essential for internally generated hippocampal firing fieldsNature Neuroscience 18:282–288.https://doi.org/10.1038/nn.3904
-
Patterns of hippocampal theta rhythm in the freely moving ratElectroencephalography and Clinical Neurophysiology 36:291–301.https://doi.org/10.1016/0013-4694(74)90171-0
-
Direct dorsal hippocampal-prelimbic cortex connections strengthen fear memoriesNature Neuroscience 20:52–61.https://doi.org/10.1038/nn.4443
Article and author information
Author details
Funding
Canadian Institutes of Health Research (367017)
- Mark Brandon
Canadian Institutes of Health Research (377074)
- Mark Brandon
Natural Sciences and Engineering Research Council of Canada (74105)
- Mark Brandon
Canada Research Chairs
- Mark Brandon
National Institute of Mental Health (R01 MH120073 awarded to Dr. Michael Hasselmo)
- Jennifer C Robinson
National Institute of Mental Health (R01 MH060013 awarded to Dr. Michael Hasselmo)
- Jennifer C Robinson
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
JCR was supported by NIMH R01 and MH120073 through Dr Michael Hasselmo. The work was also supported by funding from the Canadian Institutes for Health Research grants (#367017 and #377074), the Natural Sciences and Engineering Council (Discovery grant #74105), and the Canada Research Chairs Program to MPB. We would like to thank Dr Robert Rozeske and Johnson Ying for their contributions to this review.
Copyright
© 2021, Robinson and Brandon
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,752
- views
-
- 390
- downloads
-
- 19
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Motivation depends on dopamine, but might be modulated by acetylcholine which influences dopamine release in the striatum, and amplifies motivation in animal studies. A corresponding effect in humans would be important clinically, since anticholinergic drugs are frequently used in Parkinson’s disease, a condition that can also disrupt motivation. Reward and dopamine make us more ready to respond, as indexed by reaction times (RT), and move faster, sometimes termed vigour. These effects may be controlled by preparatory processes that can be tracked using electroencephalography (EEG). We measured vigour in a placebo-controlled, double-blinded study of trihexyphenidyl (THP), a muscarinic antagonist, with an incentivised eye movement task and EEG. Participants responded faster and with greater vigour when incentives were high, but THP blunted these motivational effects, suggesting that muscarinic receptors facilitate invigoration by reward. Preparatory EEG build-up (contingent negative variation [CNV]) was strengthened by high incentives and by muscarinic blockade, although THP reduced the incentive effect. The amplitude of preparatory activity predicted both vigour and RT, although over distinct scalp regions; frontal activity predicted vigour, whereas a larger, earlier, central component predicted RT. The incentivisation of RT was partly mediated by the CNV, though vigour was not. Moreover, the CNV mediated the drug’s effect on dampening incentives, suggesting that muscarinic receptors underlie the motivational influence on this preparatory activity. Taken together, these findings show that a muscarinic blocker impairs motivated action in healthy people, and that medial frontal preparatory neural activity mediates this for RT.
-
- Neuroscience
Complex macro-scale patterns of brain activity that emerge during periods of wakeful rest provide insight into the organisation of neural function, how these differentiate individuals based on their traits, and the neural basis of different types of self-generated thoughts. Although brain activity during wakeful rest is valuable for understanding important features of human cognition, its unconstrained nature makes it difficult to disentangle neural features related to personality traits from those related to the thoughts occurring at rest. Our study builds on recent perspectives from work on ongoing conscious thought that highlight the interactions between three brain networks – ventral and dorsal attention networks, as well as the default mode network. We combined measures of personality with state-of-the-art indices of ongoing thoughts at rest and brain imaging analysis and explored whether this ‘tri-partite’ view can provide a framework within which to understand the contribution of states and traits to observed patterns of neural activity at rest. To capture macro-scale relationships between different brain systems, we calculated cortical gradients to describe brain organisation in a low-dimensional space. Our analysis established that for more introverted individuals, regions of the ventral attention network were functionally more aligned to regions of the somatomotor system and the default mode network. At the same time, a pattern of detailed self-generated thought was associated with a decoupling of regions of dorsal attention from regions in the default mode network. Our study, therefore, establishes that interactions between attention systems and the default mode network are important influences on ongoing thought at rest and highlights the value of integrating contemporary perspectives on conscious experience when understanding patterns of brain activity at rest.