Experience-driven rate modulation is reinstated during hippocampal replay
Abstract
Replay, the sequential reactivation within a neuronal ensemble, is a central hippocampal mechanism postulated to drive memory processing. While both rate and place representations are used by hippocampal place cells to encode behavioral episodes, replay has been largely defined by only the latter – based on the fidelity of sequential activity across neighboring place fields. Here, we show that dorsal CA1 place cells in rats can modulate their firing rate between replay events of two different contexts. This experience-dependent phenomenon mirrors the same pattern of rate modulation observed during behavior and can be used independently from place information within replay sequences to discriminate between contexts. Our results reveal the existence of two complementary neural representations available for memory processes.
Editor's evaluation
The hippocampal cells that comprise the place cell map for the most part ‘remap’ between different environments – they change their preferred firing locations and rates. This article poses an important question about offline reactivation that has not been explicitly tested: are differences in firing rate preserved during sequential, temporally compressed offline replay events? They find that yes, individual neurons show context-specific firing rates during replay, an important finding and a confirmation of critical theoretical foundations in the field of learning and memory. The evidence is convincing, with good support for the claims. At the same time, this demonstration hinges on some relatively subtle methodological points specific to replay detection, and thus serves as an invitation to the field to further explore the precise structure of context-specific offline activity.
https://doi.org/10.7554/eLife.79031.sa0eLife digest
How do our brains store memories? We now know that this is a complex and dynamic process, involving multiple regions of the brain. A brain region, called the hippocampus, plays an important role in memory formation. While we sleep, the hippocampus works to consolidate information, and eventually creates stable, long-term memories that are then stored in other parts of the brain.
But how does the hippocampus do this? Neuroscientists believe that it can replay the patterns of brain activity that represent particular memories. By repeatedly doing this while we sleep, the hippocampus can then direct the transfer of this information to the rest of the brain for storage.
The behaviour of nerve cells in the brain underpins these patterns of brain activity. When a nerve cell is active, it fires tiny electrical impulses that can be detected experimentally. The brain thus represents information in two ways: which nerve cells are active and when (sequential patterns); and how active the nerve cells are (how fast they fire electrical impulses or firing rate). For example, when an animal moves from one location to another, special place cells in the hippocampus become active in a distinct sequence. Depending on the context, they will also fire faster or slower.
We know that the hippocampus can replay sequential patterns of nerve cell activity during memory consolidation, but whether it can also replay the firing rates associated with a particular experience is still unknown. Tirole, Huelin Gorriz et al. set out to determine if the hippocampus could also preserve the information encoded by firing rate during replay.
In the experiments, rats explored two different environments that they had not seen before. The activity of the rats’ place cells was recorded before and after they explored, and also later while they were sleeping. Analysis of the recordings revealed that during replay, the rats’ hippocampi could indeed reproduce both the sequential patterns of activity and the firing rate of the place cells. It also confirmed that each environment was associated with unique firing rates – in other words, the firing rates were memory-specific.
These results contribute to our understanding of how the hippocampus represents and processes information about our experiences. More broadly, they also shed new light on how the brain lays down memories, by revealing a key part of the mechanism that it uses to consolidate that information.
Introduction
A key function of the hippocampus is the initial encoding and subsequent consolidation of episodic memories. Hippocampal place cells are activated in sequential patterns during behavioral episodes (e.g., a rodent running toward a goal), with each neuron’s activity modulated by the animal’s position within an environment (i.e., a place field) (OKeefe and Dostrovsky, 1971). During offline periods such as sleep, place cells spontaneously reactivate, replaying the same sequential pattern previously activated during the behavioral episode (Lee and Wilson, 2002; Wilson and McNaughton, 1994). This phenomenon of neural replay is postulated to drive systems-level memory consolidation (Crowley et al., 2019; Fernández-Ruiz et al., 2019; Girardeau et al., 2009; Gridchyn et al., 2020). Hippocampal replay has largely been defined by the sequential reactivation of place cell ensembles (Davidson et al., 2009; Foster and Wilson, 2006; Genzel et al., 2020; Lee and Wilson, 2002), driven by both where and when each place field is activated during a behavioral episode (here referred to as place representation). Yet, place cells also carry additional information in the magnitude of their place field’s activity (here referred to as rate representation). The magnitude of a place field’s activity (i.e., peak in-field firing rate) is modulated by both local and global contextual cues (Leutgeb et al., 2005; Ravassard et al., 2013; Zhao et al., 2020), as well as behavioral variables (e.g., animal’s speed during locomotion) (Huxter et al., 2003), and cognitive events (e.g., animal’s attention and perception) (Monaco et al., 2014; Olypher et al., 2002). Reactivation events may also be capable of representing information using firing rate (Schwindel et al., 2016; Takahashi, 2015); however, because the detection of reactivation events is based on the firing rate of place cells, it is necessary to eliminate or at least control the effects of firing rate at the point of event detection to avoid any circular reasoning. Examining whether rate modulation is reinstated during replay will help discern whether replay only represents possible transitions between adjacent locations (i.e., the order of place fields within a spatial trajectory) or alternatively whether replay could serve a larger role, with the capacity to reinstate a near replica of neural activity previously driven during behavior, providing a richer, more complete memory trace.
Results
Place cells reinstate their rate modulation during replay
To address this question, we recorded extracellularly from the dorsal CA1 of rats (n = 5, male Lister-hooded), running back and forth along two novel linear tracks (2 m) to collect a liquid reward at each end (Figure 1A, Figure 1—figure supplement 1A, Table 1, and see ‘Methods’). A view-obstructing divider was placed between tracks and distinguishing visual cues were present within each environment to facilitate contextual discrimination and, in turn, hippocampal remapping. Additionally, rats rested in a quiet remote location, both before (PRE) and after (POST) the exploration of the two tracks.
We observed global remapping of place cells between the two linear tracks (Pearson’s correlation coefficient r between tracks population vectors, r = 0.11 ± 0.13), such that the majority of place fields shifted their location along the track and/or modulated their firing rate (i.e., changed to higher or lower peak in-field firing rate) (Figure 1—figure supplement 1B). Both the context (which linear track) and current position (location of the animal on the linear track) could be inferred from place cell activity with high accuracy using a naïve Bayes decoder (Figure 1B, Figure 1—figure supplement 1C). Track detection accuracy exceeded 80% during RUN periods on both tracks (all sessions: 93 ± 3%) with an average median error of 5 cm (all sessions: 6.26 ± 2.6 cm). A Population Vector Analysis showed high correlation between the ratemaps of the first and second half of running within each track (Pearson’s correlation coefficient r within track population vectors, r = 0.81 ± 0.11), suggesting high place field stability over run. We also used Bayesian decoding to detect replay sequences of each linear track (Figure 1B), with statistically significant replay trajectories identified by comparing the weighted correlation score obtained from the posterior probabilities (normalized across both tracks) of each decoded event to three types of event shuffles (Figure 1—figure supplement 2; total replay events = 5396, PRE: Track 1 = 52 ± 33, Track 2 = 47 ± 23; POST: Track 1 = 145 ± 56, Track 2 = 149 ± 35; RUN: Track 1 = 68 ± 20, Track 2 = 79 ± 27; see ‘Methods’). Replay events passing our criteria for significance comprised of 11.7% of PRE candidate replay events (989/8485) and 20.7% of POST candidate replay events (2964/14326).
First, we sought to investigate whether the contextually driven place fields’ rate modulation between tracks is conserved during offline replay. We use the term ‘contextually driven’ to indicate a rate change occurring between the Track 1 and Track 2 contexts, albeit driven by environmental cues, track position, and/or behavioral differences in the rat. Using all place cells active and stable during the whole run on both tracks (Figure 1—figure supplement 1B; see ‘Methods’), we compared the place fields’ peak in-field firing rate differences between tracks (Track 1–Track 2) to the difference (Track 1–Track 2) in average peak instantaneous rate of those same cells during significant replay events (Figure 1C, Figure 1—figure supplement 2). For replay events during POST, the difference in peak in-field firing rate between tracks was predictive of the difference in average peak instantaneous rates during replay events from both tracks (Figure 1D; POST: B = 0.031, F(1,270) = 100, p<0.001, R2 = 0.27; Figure 1—figure supplement 3 for individual sessions). In other words, if a place field had a higher firing rate on Track 2 (compared to Track 1), it also tended to have a higher mean firing rate across all Track 2 replay events (compared to Track 1 events) during POST. This was not the case during PRE (Figure 1D; PRE: B = −0.001, F(1,250) = 0.11, p=0.74, R2 = 0.0004). This suggests that any contextually driven rate modulation between two behavioral episodes is maintained during offline replay. This observation was consistent over a wide range of alterations in the criteria used for selecting neurons, place fields, and replay events, including (1) using a more selective criteria of place field activity (e.g., place fields with higher minimum or maximum peak firing rate or place cells with a single field) (Figure 1—figure supplements 4 and 5D), (2) alternative metrics for both replay firing rate (e.g., median replay rate and mean number of spikes per replay event) (Figure 1—figure supplement 5B and C) and place fields firing rate (e.g., place field’s area under the curve) (Figure 1—figure supplement 5A), (3) using a more relaxed criteria for a significant replay event, including using only two two shuffles in replay detection, raising the replay detection p-value cutoff to 0.1, or not requiring a threshold for ripple power for candidate replay events (Figure 1—figure supplement 6A, B, and D), (4) using a stricter p-value cutoff (0.01) for replay detection (Figure 1—figure supplement 6C), and (5) using either all spatially tuned cells or only cells with a place field on a single track (rather than cells with stable place fields on both tracks) (Figure 1—figure supplement 6E and F). It is important to note that a significant regression would be expected when analyzing neurons with a place field only on one track, as they are expected to participate in replay events of this track, while being silent during the replay of the other track. As such, our regression analysis only analyzed place cells active on both tracks and stable across the whole run (Figure 1—figure supplement 1B; see ‘Methods’). When we applied our analysis separately to either non-spatially selective cells (pyramidal neurons with firing rates less than 1 spk/s on both tracks) or interneurons, we did not observe a significant regression (Figure 1—figure supplement 6G and H).
Replay detection methods generally detect the statistical significance of cells sequences based on templates derived from the behavioral episode, which are sensitive to the order of place field activation (during RUN and replay). However, because Bayesian decoding can also be influenced by firing rate, we next tested whether firing rate differences between tracks may bias the selection of the replay events used in the regression analysis. To remove the influence of firing rate in the replay event selection, we employed two independent types of shuffles before repeating the detection of replay events: (1) track rate shuffle, which randomizes the overall firing rate of place fields within a track (Figure 2A–C), and (2) replay rate shuffle, which randomizes the cell’s firing rate during replay events (Figure 2D–F). For both shuffles, each place cell’s firing rate was scaled based on a value randomly drawn from a distribution of firing rates obtained from the analyzed place cells on the track (for the track rate shuffle) or during the replay events (for the replay rate shuffle). These re-identified significant replay events were then used to repeat the regression analysis but using the original data (i.e., the original replay spike train and place fields, instead of the shuffled ones). For both shuffles, we observed a significant contextual rate modulation of replay, where track differences in the place fields’ in-peak firing rate remained predictive of track differences in the average peak instantaneous rates during replay events in POST (Figure 2C and F; POST: track rate shuffle p<0.001, replay rate shuffle: p<0.001), but not PRE (Figure 2B and E; PRE: track rate shuffle p=0.32, replay rate shuffle: p=0.23). As an additional control, we detected replay events using a rank-order correlation method independent of Bayesian decoding (Spearman’s correlation), which relies only on comparing the median spike times across the place cells of a replay event compared to the sequential order of place field activity along the track (Figure 2G and I). Repeating the regression analysis based on the track differences in the place fields’ in-peak firing rate against the replay events detected using a Spearman’s correlation still resulted in a significant contextual rate modulation of the replay events rate in POST, but not PRE (Figure 2H and I; PRE: B = −0.001, F(1,251) = 0.09, p=0.76, R2 = 0.0004, POST: B = 0.03, F(1,269) = 101, p<0.001, R2 = 0.273). Overall, these results indicate that the contextual rate modulation observed during replay is not a result of a bias within the replay detection analysis (namely, Bayesian decoding). Importantly, we did not observe any significant track differences in place field or replay properties (Figure 2—figure supplement 1), including the place fields’ peak in-field firing rate (Figure 2—figure supplement 1B; two-sided two-sample Kolmogorov–Smirnov test, p=0.59) and the replay average peak instantaneous rate (Figure 2—figure supplement 1B; two-sided two-sample Kolmogorov–Smirnov test, p=0.25), and confirmed that our regression analysis was not influenced by any intrinsic biases between tracks by remeasuring the statistical significance relative to a shuffled distribution (Figure 2—figure supplement 2).
Replay rate modulation emerges quickly with experience
The phenomenon of replay also occurs during awake quiescent states (e.g., while the animal pauses on the track) and has been proposed to serve different functional roles, ranging from planning to memory storage (Diba and Buzsáki, 2007; Foster and Wilson, 2006; Gillespie et al., 2021; Pfeiffer and Foster, 2013; Xu et al., 2019). We observed that during the behavioral episode on the tracks contextual rate modulation was expressed across local awake replay events (Figure 3A; RUN: B = 0.05, F(1,268) = 186, p<0.001, R2 = 0.41). Rate modulation during replay was even more closely aligned with behavior during RUN compared to POST (Figure 1D; RUN: F(1,268) = 186, POST: F(1,270) = 100). Place cells during RUN already showed evidence of contextual rate modulation during awake local replay events within the first two laps of experience (Figure 3B; two laps: B = 0.06, F(1,40) = 12.37, p=0.001, R2 = 0.246). Furthermore, place cells expressing rate modulation during RUN replay events were also likely to show a similar direction of contextual rate modulation (e.g., Track 1 > Track 2) during POST replay events (Figure 3C; B = 0.83, F(1,268) = 173.9, p<0.001, R2 = 0.39). We did not observe a significant regression during PRE (Figure 3—figure supplement 1A; B = 0.13, F(1,248) = 2.76, p=0.1, R2 = 0.01), including when our three alternative replay detection methods that controlled for rate biases were used (Figure 3—figure supplement 1B–D, p>0.05). Contextual rate modulation during replay was significantly expressed throughout the entire rest period during POST (at least 1 hr cumulatively, limited only by the maximum time period tested), with the strongest effect observed in the earliest portion of POST rest (Figure 3D).
Replay rate representations can be used to discriminate between contexts
Our data suggest that both place (i.e., sequences) and rate information is embedded within hippocampal replay events. If this is the case, then the spatial context (i.e., track identity) associated with a replay event should be identifiable using either the place or rate representations alone. To address this question, we modified the current Bayesian framework such that it would rely on either or both place and rate information (Figure 4A). For each decoded replay event, we measured the probabilistic bias towards one of the two tracks using the z-scored log odds (Carey et al., 2019), Thus, for a given replay event, this method summed the decoded posterior probability for each track, quantified the logarithmic ratio between the two tracks, and then z-scored this ratio relative to a shuffled distribution (ratemap track label shuffle, Figure 4—figure supplement 1; see ‘Methods’). For example, a higher positive z-scored log odds would indicate a greater probabilistic bias towards Track 1. Therefore, if the content of a replay event was detected for Track 1 (based on a statistically significant sequence), the corresponding z-scored log odds would reflect how well a place and/or rate representation could be used to correctly classify this replay event as Track 1 (rather than Track 2) (Figure 4B).
In particular, we used two measurements to assess the replay track identity classification performance when using either the rate and/or place representation (Figure 4—figure supplement 1; see ‘Methods’): (1) the log odds difference between two tracks compared to a replay track identity shuffled distribution and (2) the binary discriminability of a replay event’s track identity using receiver-operative characteristic (ROC) curves, in which the area under the ROC curve (AUC) of 0.5 indicates chance discriminability (and an AUC of 1 indicates perfect discriminability). For both measurements, only replay events with a statistically significant replay sequence were used. When both place and rate information was unaltered, the z-scored log odds difference and the track discriminability were highest for RUN (Δ(z-scored log odds) = 2.61 ± 0.25, p<0.001, AUC = 0.97), significant but marginally lower for POST (Δ(z-scored log odds) = 1.19 ± 0.18, p<0.001, AUC = 0.77), but indistinguishable from the null distribution and at chance levels for PRE (Δ(z-scored log odds) = 0.05 ± 0.10, p=0.24, AUC = 0.53) (Figure 4C and D, Table 2). Because the number of cells common to both tracks varies between sessions, and affects classification accuracy, we compared the number of cells with the mean log odds difference between tracks for each session (Figure 4—figure supplement 2). A higher number of cells was significantly predictive of a higher log odds difference for POST (B = 0.0338, F(1,8) = 7.91, p=0.02, R2 = 0.50) and RUN (B = 0.055, F(1,8) = 18.93, p=0.002, R2 = 0.70), but not PRE (B = 0.011, F(1,8) = 1.89, p=0.21, R2 = 0.19). An example of this is the presence of a session with lower log odds difference value during RUN in Figure 4C (n = 9 cells).
We then proceeded to selectively remove either the firing rate or place information available to the Bayesian decoder and assess its ability to determine the track being replayed. First, we removed the firing rate information by both setting each place field’s in-field peak firing rate to its average across both tracks and rescaling each cell’s replay spike trains to its average firing rate across all replay events (rate fixed manipulation). We found that the remaining information, arising most likely from ensemble co-activity – that is, which cells were active in a decoding bin – was sufficient to correctly classify replay events to each track, although both the z-scored log odds difference and the AUC were slightly lower than when both place and firing rate information were available (Figure 5A and E–G; AUC difference <0.1 compared to the original for all task periods, Table 3A).
Next, we selectively removed the sequential spatial and temporal relationship between neighboring place fields without altering rate information by expanding the size of both the position and time bins during the decoding: a single position bin spanning the entire track and a single time bin spanning the entire replay event (place removed manipulation, Figure 5B and E–G). This manipulation still led to a significant log odds difference towards the correct track and a high track discriminability for RUN (Δ(z-scored log odds) = 1.17 ± 0.20, p<0.001, AUC = 0.80), POST (Δ(z-scored log odds) = 0.52 ± 0.12, p<0.001, AUC = 0.65), but not PRE (Δ(z-scored log odds) = –0.04 ± 0.05, p=0.43, AUC = 0.53), supporting the finding that rate modulation is reinstated during replay and is experience-dependent. Finally, as a negative control for both manipulations, where rate and place representations were disrupted, each remaining non-manipulated representation (place or rate) was then randomized (rate fixed place randomized manipulation and place removed rate randomized manipulation, respectively). Removing both place and rate representations resulted in chance-level discriminability for both conditions (Figure 5C–G, Table 3B).
Discussion
Here, we have shown that contextually driven place and rate representations used by the hippocampus during behavior are reinstated during replay, with either representation being sufficient to successfully discriminate which context is being replayed. These results support a model in which the hippocampus can encode more than the order of previously experienced place cell firing, with firing rates actively changing for each replay event to reflect contextual changes that have previously occurred between different behavioral episodes. This phenomenon is experience-dependent as rate modulation within replay was only observed during and after a behavioral episode, but not prior to it. Importantly, our paradigm allows us to uniquely demonstrate that rate modulation during local awake replay emerges rapidly with experience of novel environments.
The concept that a place cell’s firing rate during a reactivation event is influenced by its firing rate during behavior has been put forward by several previous studies (Pavlides and Winson, 1989; Huxter et al., 2003; Ravassard et al., 2013; Savelli and Knierim, 2019; Schwindel et al., 2016; Takahashi, 2015; Farooq et al., 2019). However, one challenge in interpreting these studies is that reactivation methods typically use firing rate in their detection, in turn potentially biasing their selection to events with rate modulation. To avoid the potential for such circular reasoning, and more rigorously demonstrate the reinstatement of rate modulation, here we incorporate four key advances over previous studies. First is our analysis of replay rather than reactivation, which uses the sequential pattern of firing across place cells for detection, in turn providing significantly more statistical power than using a sequenceless-based reactivation approach. Our methods allowed us to still detect events when firing rate information is removed, which we accomplished in three different ways (Figure 2). Second is our use of two distinct behavioral tracks within a recording session (Karlsson and Frank, 2009; Gupta et al., 2010), allowing us to compute the relative change in firing rates between tracks (both for behavior and replay). This avoids the problem of slow variations in neuronal excitability potentially confounding the measurement of correlation between behavior and sleep, when the analysis is limited to the absolute firing rates within a single context. It is worth noting that this study has focused on global remapping as testing for reinstated rate modulation within a rate remapping paradigm lacks the ability to cross-reference rate changes using rate-independent replay content decoding. Third, previous studies using multiple tracks did not remove neurons that only fired in one context from their analysis, which can artificially boost the detection of rate modulation. This is because the replay of a track activates place fields from that same track, but these same place cells should be silent when another track is replaying (if no place field exists on this second track). For this reason, our analysis of rate modulation focused exclusively on neurons with stable place fields on both tracks, and similar results were obtained using higher thresholds for what qualified as a place field (Figure 1—figure supplement 4). Finally, our approach provides a new method to cross-validate replay events by comparing whether the track with the significant sequence matches the track with the higher likelihood of occupancy (log odd analysis). This allows us to verify that both rate and place information present in replay events can independently be used downstream to identify the context being replayed.
What advantage does the reinstatement of firing rate during replay provide for memory consolidation? When minor modifications are made to an environment (e.g., changing the wall color), place cells can change their in-field firing rates without altering the location of their place fields, a phenomenon referred to as rate remapping (Leutgeb et al., 2005). As such, replay sequences would not be able to discriminate between behavioral episodes from before and after the contextual change. Our results present a possible solution to this problem as two marginally similar contexts are still potentially separable due to their rate modulation differences. It is also important to consider that computational models of replay have commonly used modified synfire chains, sequentially connected neurons that are often embedded within distinct recurrent networks (Abeles, 1982; Chenkov et al., 2017; Diesmann et al., 1999). While these models aim to replicate the sequential nature of replay, it remains to be seen whether they can also recreate experience-dependent rate modulation or whether additional mechanisms may need to be considered. Experimental evidence indicates that neocortical activity preceding a hippocampal replay event plays a key role in determining its content (Bendor and Wilson, 2012; Lewis and Bendor, 2019; Rothschild et al., 2017). As such, if cortical inputs to the hippocampus during behavior underlie rate modulation (Renno-Costa and Tort, 2017), a reinstatement of these same inputs prior to replay may be necessary for the subsequent rate modulation of hippocampal place fields during offline states.
Methods
Animals
Five male Lister-hooded rats (350–450 g) were implanted with a microdrive with 24 independently moveable tetrodes. Prior to surgery, rats were kept at 90% of their free-feeding weight and housed in pairs on a 12 hr light/dark cycle, with 1 hr of simulated dusk/dawn. All experimental procedures and postoperative care were approved and carried out in accordance with the UK Home Office, subject to the restrictions and provisions contained within the Animal (Scientific Procedures) Act of 1986.
Surgery
Animals were deeply anesthetized under isoflurane anesthesia (1.5–3% at 2 L/min) and implanted with a custom-made microdrive array carrying 24 independently moveable tetrodes (modified from microdrive first published by Davidson et al., 2009). Each tetrode consisted of a twisted bundle of four tungsten microwires (12 µm diameter, Tungsten 99.95% CS, California Fine Wire), gold-plated to reduce impedance to <200 kΩ. Three rats were implanted with a dual-hippocampal microdrive targeting both dorsal hippocampal CA1 areas (AP: –3.48 mm; ML: ±2.4 mm from Bregma), each output carrying 12 tetrodes. The two remaining rats were implanted with a microdrive targeting the right dorsal hippocampal CA1 area (AP: 3.72 mm, ML: 2.5 mm from Bregma) and the left primary visual cortex (AP: –5.76 mm; ML: –3.8 mm from Bregma), using 16 and 8 tetrodes, respectively. After surgery, animals were housed individually and allowed to recover with food and water ad libitum for a week before returning to being kept at 90% of their free-feeding weight.
Experimental design
A given recording session started with a 1 hr rest period in which the rats were placed in a quiet, remote location (rest pot), to which they had been previously habituated. The rest pot consisted of a black circular enclosure of 20 cm of diameter, surrounded by a 50 cm tall black plastic sheet that isolated them from the surroundings. The animals went through one of the two following protocols:
Following the rest period, the rats were exposed to two novel 2 m linear tracks in which they were allowed to run back and forth for 15 min, except for one session in which the animal ran for 30 min in the second track. (Rat 4 session 3; Rat 2 and Rat 3 all sessions.)
Following the rest period, the rats were exposed to three novel 2 m linear tracks in which they were allowed to run back and forth for 15 min. Data from the first track has been removed for this study to ensure consistency between protocols, such as temporal proximity to final rest session, and for all analyses. (Rat 1 session 1; Rat 4 sessions 1 + 2, and Rat 5 all sessions.)
Prior to the start of recordings, rats were trained for approximately 2 days, 30 min each, to run back and forth on a linear track with reward delivered at each end. Training occurred in a different room and track from the one used during the recordings. Liquid reward was dispensed at each end of the track (0.1 mL chocolate-flavored soy milk) to encourage the animals to traverse the entirety of the track. In all except one session (Rat 2 session 2), the exposures to the two tracks were separated by a 10 min rest period in the rest pot. The recording session finished with a final 2 hr rest period inside the rest pot.
The linear tracks used in every experiment were designed to be novel to the animal. To accomplish this, the shape of the tracks was changed between recording sessions and their surfaces covered with different textured fabrics. In each session, the room was surrounded by black curtains with different high-contrast visual cues. The tracks were separated using view-obstructing dividers.
Spike detection and unit isolation
Spiking data was sorted using the semi-automatic clustering software KlustaKwik 2.0 (K.Harris, http://klustakwik.sourceforge.net/) and then manually curated with either Phy-GUI (https://github.com/kwikteam/phy; Rossant et al., 2022; Rossant et al., 2016) or Klustaviewa (https://github.com/klusta-team/klustaviewa; Rossant et al., 2017; Rossant et al., 2016). Putative single units were discriminated based on the spike waveform, a clean inter-spike interval, and their stability across the recording session. The rest of the clustered activity was classified in either multi-unit activity (MUA) or noise.
LFP analysis
The power spectral density (PSD) of the LFP was calculated using Welch’s method (pwelch, MATLAB) to identify the channels with higher power for theta (4–12 Hz) and ripple (125–300 Hz) oscillations, as well as the channel with the largest difference in normalized theta to ripple power. The LFP of selected channels was next downsampled from 30 kHz to 1 kHz and band-passed filtered (MATLAB command filtfilt). The instantaneous phases were estimated using Hilbert transform.
Criteria for place cell selection
Putative principal cells were identified by selecting units with a half width half max (HWHM) larger than 500 µs and mean firing rate <5 Hz across the entire recording session. For place cell classification, spike trains were speed-filtered to only include the spiking activity between 4 cm/s and 50 cm/s. A principal cell was classified as a place cell if it had a minimum peak firing rate that was >1 Hz in its unsmoothed ratemap. Furthermore, place cells were required to have stable place fields, defined as a minimum peak firing rate >1 Hz for both the first half and second half of the RUN session. Only place cells satisfying these two criteria for each linear track independently were included in the regression analysis (Figures 1—3) and log odds analysis (Figures 4 and 5).
To generate firing ratemaps (the spike histogram divided by the total dwell time at each position bin), the position data was discretized in 2 cm bins for visualization and plotting, and 10 cm bins for Bayesian decoding. Only raw (unsmoothed) ratemaps were used for all Bayesian decoding analyses.
Population vector analysis
A Population Vector Analysis was used to assess the ratemap stability for each track as well as the degree of between track remapping (Leutgeb et al., 2005). For each session, the linearized ratemaps of all recorded pyramidal cells with a firing rate >1 Hz were stacked into a 20 position bins × N cells matrix for each track. To assess remapping between tracks, the ratemaps computed from the entire track experience were compared, while to assess ratemap stability within a track, a ratemap was computed for both the first and second half of the behavioral episode. The population vector of rates at each position bin was then correlated with its counterpart vector: either on the other track or during the other half of the experience. The mean Pearson’s correlation value was first averaged across position bins and then across sessions.
Bayesian decoding
A naïve Bayesian decoding algorithm was applied to reconstruct the animal’s spatial trajectory during both behavior and replay events from CA1 hippocampal spiking activity (Zhang et al., 1998):
where P(x|n) is the probability of the animal being at a specific position given the observed spiking activity, C is a normalization constant, x is the subject’s position, fi(x) is the firing rate of the ith place field at a given location x, and n is the number of spikes in the time window τ. The normalization constant was redefined as the summed posterior probabilities across both tracks. Since we are using a naïve decoder, the prior P(x) is uniform across all position and therefore set to 1. The maximum probability of the subject’s position was decoded using 250 ms and 20 ms time bin during behavior and replay, respectively. All place cells with a place field on at least one of the two tracks were used for decoding.
The decoding error was defined as the differences between the real location of the animal and the estimated position with maximum likelihood.
Candidate replay event detection
Candidate replay events were detected based on MUA. MUA was first smoothed with a Gaussian kernel (sigma = 5 ms) and binned into 1 ms steps. Only MUA bursts with a maximum duration of 300 ms and z-scored activity over 3 were selected.
Candidate replay events passing this threshold were next speed-filtered (the animal’s speed was required to be less than 5 cm/s) and discarded if their sequence had less than five different units active or if their duration was below 100 ms or over 750 ms (thus, candidate events had at least five consecutive 20ms bins). Events detected within 50 ms were combined. Additionally, the ripple-band filtered LFP signal was smoothed with a 0.1 s moving average filter and a threshold over 3 was set for the z-scored ripple power, and used as an additional criterion for candidate replay events. In an effort to optimize detection of replay events and avoid a minority of events that were discarded due to noisy probability decoding at the beginning or the end of the event, candidate replay events were split in half. To do so, the minimum MUA activity in the middle third of the candidate replay event was used to determine a natural midpoint to split the event in two segments. Both segments were decoded and tested for significance independently following the same procedure as the ‘intact’ candidate replay events (i.e., same criteria including minimum duration, etc.), for the exception of an adjusted p-value threshold (p<0.025).
Replay events were classified as rest or awake local replay. Awake replay was defined as replay events occurring while the animals were running on either of the tracks and classified as local if the content of the replay event reflected the current track on which the animal was running. Replay events detected during sleep or rest periods within the rest pot were classified as rest replay events.
Replay events scoring and significance
Replay events were scored using weighted correlation between decoded posterior probabilities across position and time.
Weighted mean:
Weighted covariance:
Weighted correlation:
where is the ith position bin, is the jth time bin, and is the probability at the position bin i and time bin j.
The statistical significance of the weighted correlation for each candidate replay event was assessed by comparison with three different 1000 shuffle distributions:
Spike train circular shift, in which the spike count vectors for each cell were independently circularly shifted in time within each replay event, prior to decoding.
Place field shift, in which each ratemap was circularly shifted in space by a random amount of position bins prior to decoding.
Circular shift of position, in which posterior probability vectors for each time bin were independently circularly shifted by a random amount.
If the score of the candidate event was greater than the 95th percentile of the distribution for all three shuffles, then the event was considered to be significant. In a few occasions, replay events were found to be significant for both tracks. For our regression analysis (Figures 1—3), those events were assigned to one of the tracks by computing the ‘Bayesian bias’ score for each track. Each score was calculated as the sum of the posterior probability matrix for one track, normalized by the total sum across both tracks. To assign the replay event to a specific track, the Bayesian bias score had to be greater than 60%, otherwise the event was discarded. For our log odds analysis (Figures 4 and 5), replay events detected as significant for both tracks were not used in the analysis to avoid our log odds analysis being confounded by our replay event selection method. Out of a total of 5396 significant replay events (across PRE, RUN, and POST), we found a total of 356 replay events detected as significant on both tracks simultaneously, a ratio of 0.066.
Reinstatement of rate modulation analysis
Linear regression was used to measure the reinstatement of rate modulation between place fields on the track and replay events (MATLAB function fitlm). For each place cell active on both tracks, rate modulation on the track was measured by calculating (1) the difference in peak in-field firing rate across tracks and (2) the difference in the area under the curve (AUC; MATLAB function trapz). Place fields with a peak in-field firing rate <1 Hz on either track were excluded. As a control, a variation of the analysis was done by excluding all cells with multiple place fields on the same track. Multiple peaks for a single cell were considered to be different place fields when their peak firing rate was >1 Hz, each place field width was over two spatial bins (20 cm), and the distance between the peaks was of four spatial bins (40 cm).
Rate modulation during replay events was calculated as the change in each cell’s firing activity between the replay events encoding for each track. Included cells had to participate in at least one replay event for each track. The firing rate change for a given neuron was calculated only using replay events where that neuron fired one or more spikes, and was measured as (1) the difference in the average peak instantaneous rate across tracks, (2) the difference in the median rate across replay events, and (3) the difference in the mean number of spikes across replay events.
To obtain the peak instantaneous rate of each event, each cell’s spike train was binned into 1 ms steps, filtered with a 100-ms-long Gaussian window with σ = 20 ms (MATLAB command filter), and the peak amplitude of the resulting signal measured.
Controls for replay detection analysis
Two types of shuffles were applied to the data before repeating the detection of replay events using Bayesian decoding: a track rate shuffle and replay rate shuffle. The track rate shuffle consisted in the randomization of the firing rate of the place fields within a track, while the replay rate shuffle randomized the cells’ firing rate during the replay events. For both shuffles, each place cell’s firing rate was scaled based on a value randomly drawn from a distribution of firing rates obtained from the analyzed place cells on the track (for the track rate shuffle) or during the replay events (for the replay rate shuffle). The shuffled data was then used to repeat the detection of replay events, and the newly identified significant replay events were used in a linear regression comparing their original spike content (instead of the shuffled one) against the original differences in the peak in-field rate.
Remapping classification
A bootstrapping procedure was used to identify the rate and place modulation properties of each cell. Modulation was defined when the track difference in a place field’s specific parameter (e.g., peak in-field firing rate or peak location) exceeded the intrinsic variability of such parameter on a single track. The distribution of each parameter was computed for both tracks by calculating firing ratemaps from a randomly sampled N out of N laps (1000 iterations, with replacement). The median value of a track distribution was then compared to the 5th/95th percentiles of the other track, and vice versa. If either median exceeded either percentile, the cell was classified as being modulated between tracks for that parameter.
Sequenceless Bayesian decoding
The sequenceless Bayesian decoding approach used here was modified from a previous method described by Carey et al., 2019. Only cells with stable place fields on the track in the first and second half of the behavioral episode (peak in-field firing rate >1 Hz) and replay events significant for a single track were included in our sequenceless decoding analysis.
Before Bayesian decoding, ratemaps for Track 1 and Track 2 were concatenated as a single matrix [nCell × (nPosition(T1) + nPositions(T2))]. Unless otherwise mentioned, 20 ms time bins and 10 cm position bins were used for decoding. After decoding, the posterior probabilities for each time bin were normalized across all position bins from both tracks to sum to 1. Then, the summed posterior probability across all time bins within each replay event was computed, and the probabilistic bias towards Track 1 or Track 2 for each replay event was quantified as (log odds), where and referred to the summed posterior probabilities for Track 1 and Track 2, respectively. To remove any intrinsic probabilistic bias, each raw log odds calculation was then z-scored relative to a shuffled log odds distribution (ratemap track label shuffle), obtained by randomly permuting each cell’s Track 1 and Track 2 ratemaps 1000 times for each replay event. The permutation was done by either keeping a cell’s ratemap unaltered or performing a between track swap.
To test the decoding when only using place or rate information, the original data were manipulated as the following:
Rate fixed manipulation: Rate information was fixed both by rescaling each cell’s peak in-field firing rate to the mean value across both tracks and by rescaling its spike count in each replay event to the average firing rate across all replay events.
Place removed manipulation: The place (and sequence) information was removed by decoding with only a single position bin, which encompassed the entire track (mean firing rate on each track when speed is above 5 cm/s) and a single time bin, which spanned the entire replay event.
Two negative controls were used to disrupt both rate and place information:
Rate fixed place randomized manipulation: After the rate fixed manipulation, place information was randomized using a cell ID shuffle in which all cells were randomly reassigned to a different cell’s ratemap for each replay event.
Place removed rate randomized manipulation: After place removed manipulation, rate information was randomized by scaling the firing rate on each track based on a value randomly drawn from a distribution of firing rates obtained from the analyzed place cells on the track.
Given the inherent random nature of our shuffling procedure, it was important to ensure that the result of a single simulation was reproducible. Thus, for both negative control manipulations, we ran our simulations 10 times. We observed that 9/10 times the results were not significant (rank-sum test, p>0.05, uncorrected). The data presented in Figure 5 was selected from the negative control simulation nearest the median log odd difference (out of 10 simulations) (Table 4).
ROC analysis
The ‘ground truth’ track identity for each replay event was assigned based on the sequenceness of the replay, which was determined by comparing the event’s weighted correlation score to three shuffled distributions. The binary discriminability of a replay event’s identity (Track 1 or Track 2) during PRE, POST, or RUN was quantified using the ROC curve. The ROC curve was constructed based on a range of true- and false-positive rates obtained by systematically shifting the discrimination threshold along the z-scored log odds distributions for both Track 1 and Track 2 replay events. A trapezoidal approximation was used to estimate the area under each ROC curve (MATLAB function perfcurve for both constructing ROC curve and estimating AUC). The bootstrapped distributions of ROC curves and the area under the corresponding ROC curves were produced by resampling with replacement 1000 times.
Statistics
Z-scored log odds significance
The statistical significance of the mean difference between Track 1 and Track 2 z-scored log odds is quantified using a one-tailed rank-sum test in which mean z-scored log odds track differences across sessions was compared to the mean shuffled differences across sessions. The shuffled difference distribution for each session was obtained by resampling replay events 1000 times with replacement and assigning their track identities randomly (referred to as replay track identity shuffle). The mean z-scored log odds difference was considered significantly different from the shuffled distribution at the significance level of 0.05.
Bootstrapping for ROC significance
To determine whether rate and/or place representation manipulations significantly changed the AUC of the ROC curves, we calculated the confidence interval for the difference between each condition’s bootstrapped AUC distribution and that of the original data. This was repeated in an additional analysis by replacing the original data by one of the negative controls (rate fixed place randomized manipulation and place removed rate randomized manipulation). The mean difference between two bootstrapped AUC distributions were only considered statistically significant when the 95% confidence interval did not overlap with 0.
Delong test for ROC
To determine whether rate and/or place manipulations statistically significantly changed the AUC of ROC curves within the same behavioral epochs, the AUC of both manipulations (i.e., rate fixed or place removed) were compared with the AUC of the original data or their corresponding negative controls (i.e., rate fixed vs. rate fixed place randomized and place removed vs. place removed rate randomized). The DeLong test (Sun and Xu, 2014) was employed to perform pairwise comparisons between two ROC curves. The DeLong variance–covariance matrix for two ROC curves was computed using MATLAB-based algorithm (https://github.com/PamixSun/DeLongUI; Sun, 2015) developed by Sun and Xu, 2014.
A z-score was calculated based on the following equation:
where AUC is the area under the ROC curve, var(X) is the variance of ROC curves from a 1000 bootstrapped distribution, and cov(X) is the covariance of ROC curves from both 1000 bootstrapped distributions.
The z-score for each pair of comparisons was subsequently used to calculate the two-tailed p-value. Two AUC distributions were considered significantly different when p≤0.05.
All analyses were carried out using MATLAB (MathWorks, Natick, MA).
Data availability
The data used in this manuscript are available on DRYAD [https://doi.org/10.5061/dryad.ksn02v76h]. All custom-written code is available on GitHub (https://github.com/bendor-lab/Elife_Tirole_Huelin_Gorriz_2022 copy archived at swh:1:rev:44ecf4275c2a7ca33dda6b67f11b4e854c3123e9).
-
Dryad Digital Repositorydata from: Experience-driven rate modulation is reinstated during hippocampal replay.https://doi.org/10.5061/dryad.ksn02v76h
References
-
Role of the cortical neuron: integrator or coincidence detector?Israel Journal of Medical Sciences 18:83–92.
-
Biasing the content of hippocampal replay during sleepNature Neuroscience 15:1439–1444.https://doi.org/10.1038/nn.3203
-
Reward revaluation biases hippocampal replay content away from the preferred outcomeNature Neuroscience 22:1450–1459.https://doi.org/10.1038/s41593-019-0464-6
-
Memory replay in balanced recurrent networksPLOS Computational Biology 13:e1005359.https://doi.org/10.1371/journal.pcbi.1005359
-
Forward and reverse hippocampal place-cell sequences during ripplesNature Neuroscience 10:1241–1242.https://doi.org/10.1038/nn1961
-
A consensus statement: defining terms for reactivation analysisPhilosophical Transactions of the Royal Society of London. Series B, Biological Sciences 375:20200001.https://doi.org/10.1098/rstb.2020.0001
-
Selective suppression of hippocampal ripples impairs spatial memoryNature Neuroscience 12:1222–1223.https://doi.org/10.1038/nn.2384
-
Awake replay of remote experiences in the hippocampusNature Neuroscience 12:913–918.https://doi.org/10.1038/nn.2344
-
Attentive scanning behavior drives one-trial potentiation of hippocampal place fieldsNature Neuroscience 17:725–731.https://doi.org/10.1038/nn.3687
-
Place and grid cells in a loop: implications for memory function and spatial codingThe Journal of Neuroscience 37:8062–8076.https://doi.org/10.1523/JNEUROSCI.3490-16.2017
-
Spike sorting for large, dense electrode arraysNature Neuroscience 19:634–641.https://doi.org/10.1038/nn.4268
-
Origin and role of path integration in the cognitive representations of the hippocampus: computational insights into open questionsThe Journal of Experimental Biology 222:1–13.https://doi.org/10.1242/jeb.188912
-
Reactivation of rate remapping in CA3The Journal of Neuroscience 36:9342–9350.https://doi.org/10.1523/JNEUROSCI.1678-15.2016
-
Fast implementation of delong’s algorithm for comparing the areas under correlated receiver operating characteristic curvesIEEE Signal Processing Letters 21:1389–1393.https://doi.org/10.1109/LSP.2014.2337313
Article and author information
Author details
Funding
Biotechnology and Biological Sciences Research Council (BB/M009513/1)
- Margot Tirole
Biotechnology and Biological Sciences Research Council (BB/T005475/1)
- Daniel Bendor
European Research Council (CHIME)
- Daniel Bendor
Human Frontier Science Program (RGY0067/2016)
- Daniel Bendor
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Yu Qian, Sophie Renaudineau, and Julieta Campi for technical assistance; members of the Bendor Lab for valuable discussion; and Aman Saleem and Caswell Barry for their comments on the manuscript. This work was supported by the Biotechnology and Biological Sciences Research Council scholarship (BB/M009513/1) (MTir), the European Research Council starter grant (CHIME) (DB), the Human Frontiers Science Program Young Investigator Award (RGY0067/2016) (DB), and the Biotechnology and Biological Sciences Research Council Research grant (BB/T005475/1) (DB). The Titan Xp used for this research was donated by the NVIDIA Corporation
Ethics
All experimental procedures and post operative care were approved and carried out in accordance with the UK Home Office, subject to the restrictions and provisions contained within the Animal Scientific Procedures Act of 1986. Experiments were conducted under PPL P61EA6A72 (Bendor).
Copyright
© 2022, Tirole, Huelin Gorriz et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,511
- views
-
- 353
- downloads
-
- 9
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Addiction is commonly characterized by escalation of drug intake, compulsive drug seeking, and continued use despite harmful consequences. However, the factors contributing to the transition from moderate drug use to these problematic patterns remain unclear, particularly regarding the role of sex. Many preclinical studies have been limited by small sample sizes, low genetic diversity, and restricted drug access, making it challenging to model significant levels of intoxication or dependence and translate findings to humans. To address these limitations, we characterized addiction-like behaviors in a large sample of >500 outbred heterogeneous stock (HS) rats using an extended cocaine self-administration paradigm (6 hr/daily). We analyzed individual differences in escalation of intake, progressive ratio (PR) responding, continued use despite adverse consequences (contingent foot shocks), and irritability-like behavior during withdrawal. Principal component analysis showed that escalation of intake, progressive ratio responding, and continued use despite adverse consequences loaded onto a single factor that was distinct from irritability-like behaviors. Categorizing rats into resilient, mild, moderate, and severe addiction-like phenotypes showed that females exhibited higher addiction-like behaviors, with a lower proportion of resilient individuals compared to males. These findings suggest that, in genetically diverse rats with extended drug access, escalation of intake, continued use despite adverse consequences, and PR responding are highly correlated measures of a shared underlying construct. Furthermore, our results highlight sex differences in resilience to addiction-like behaviors.
-
- Neuroscience
Traumatic brain injury (TBI) caused by external mechanical forces is a major health burden worldwide, but the underlying mechanism in glia remains largely unclear. We report herein that Drosophila adults exhibit a defective blood–brain barrier, elevated innate immune responses, and astrocyte swelling upon consecutive strikes with a high-impact trauma device. RNA sequencing (RNA-seq) analysis of these astrocytes revealed upregulated expression of genes encoding PDGF and VEGF receptor-related (Pvr, a receptor tyrosine kinase), adaptor protein complex 1 (AP-1, a transcription factor complex of the c-Jun N-terminal kinase pathway) composed of Jun-related antigen (Jra) and kayak (kay), and matrix metalloproteinase 1 (Mmp1) following TBI. Interestingly, Pvr is both required and sufficient for AP-1 and Mmp1 upregulation, while knockdown of AP-1 expression in the background of Pvr overexpression in astrocytes rescued Mmp1 upregulation upon TBI, indicating that Pvr acts as the upstream receptor for the downstream AP-1–Mmp1 transduction. Moreover, dynamin-associated endocytosis was found to be an important regulatory step in downregulating Pvr signaling. Our results identify a new Pvr–AP-1–Mmp1 signaling pathway in astrocytes in response to TBI, providing potential targets for developing new therapeutic strategies for TBI.