Drift of neural ensembles driven by slow fluctuations of intrinsic excitability

Version of Record

The authors declare this version of their article to be the Version of Record.

Download
Cite
Share
CommentOpen annotations (there are currently 0 annotations on this page).

Version of Record published: May 7, 2024 (This version)
Reviewed preprint version 2: December 15, 2023 (Go to version)
Reviewed preprint version 1: June 8, 2023 (Go to version)
Sent for peer review: April 7, 2023
Preprint posted: March 17, 2023 (Go to version)

1. Of interest
FMRP regulates postnatal neuronal migration via MAP1B

Salima Messaoudi, Ada Allam ... Isabelle Caille

Research Article May 17, 2024
Further reading

Abstract
eLife assessment
Introduction
Results
Discussion
Methods
Data availability
References
Article and author information
Metrics

Abstract

Representational drift refers to the dynamic nature of neural representations in the brain despite the behavior being seemingly stable. Although drift has been observed in many different brain regions, the mechanisms underlying it are not known. Since intrinsic neural excitability is suggested to play a key role in regulating memory allocation, fluctuations of excitability could bias the reactivation of previously stored memory ensembles and therefore act as a motor for drift. Here, we propose a rate-based plastic recurrent neural network with slow fluctuations of intrinsic excitability. We first show that subsequent reactivations of a neural ensemble can lead to drift of this ensemble. The model predicts that drift is induced by co-activation of previously active neurons along with neurons with high excitability which leads to remodeling of the recurrent weights. Consistent with previous experimental works, the drifting ensemble is informative about its temporal history. Crucially, we show that the gradual nature of the drift is necessary for decoding temporal information from the activity of the ensemble. Finally, we show that the memory is preserved and can be decoded by an output neuron having plastic synapses with the main region.

eLife assessment

This is an important theoretical study providing insight into how fluctuations in excitability can contribute to gradual changes in the mapping between population activity and stimulus, commonly referred to as representational drift. The authors provide convincing evidence that fluctuations can contribute to drift. Overall, this is a well-presented study that explores the question of how changes in intrinsic excitability can influence distinct memory representations.

https://doi.org/10.7554/eLife.88053.3.sa0

About eLife assessments

Introduction

In various brain regions, the neural code tends to be dynamic although behavioral outputs remain stable. Representational drift refers to the dynamic nature of internal representations as they have been observed in sensory cortical areas (Driscoll et al., 2017; Sadeh and Clopath, 2022; Driscoll et al., 2022) or the hippocampus (Ziv et al., 2013; Hainmueller and Bartos, 2018) despite stable behavior. It has even been suggested that pyramidal neurons from the CA1 and CA3 regions form dynamic rather than static memory engrams (Hainmueller and Bartos, 2018; Spalla et al., 2021), namely that the set of neurons encoding specific memories varies across days. In the amygdala, retraining of a fear memory task induces a turnover of the memory engram (Cho et al., 2021). Additionally, plasticity mechanisms have been proposed to compensate for drift and to provide a stable read-out of the neural code (Rule and O’Leary, 2022), suggesting that information is maintained. Altogether, this line of evidence suggests that drift might be a general mechanism with dynamical representations observed in various brain regions.

However, the mechanisms underlying the emergence of drift and its relevance for the neural computation are not known. Drift is often thought to arise from variability of internal states (Sadeh and Clopath, 2022), neurogenesis (Rechavi et al., 2022; Driscoll et al., 2017) or synaptic turnover (Attardo et al., 2015) combined with noise (Kossio et al., 2021; Manz and Memmesheimer, 2023). On the other hand, excitability might also play a role in memory allocation (Zhou et al., 2009; Mau et al., 2020; Rogerson et al., 2014; Silva et al., 2009), so that neurons having high excitability are preferentially allocated to memory ensembles (Cai et al., 2016; Rashid et al., 2016; Silva et al., 2009). Moreover, excitability is known to fluctuate over timescales from hours to days, in the amygdala (Rashid et al., 2016), the hippocampus (Cai et al., 2016; Grosmark and Buzsáki, 2016), or the cortex (Huber et al., 2013; Levenstein et al., 2019). Subsequent reactivations of a neural ensemble at different time points could therefore be biased by excitability (Mau et al., 2022), which varies at similar timescales than drift (Mau et al., 2018). Altogether, this evidence suggest that fluctuations of excitability could act as a cellular mechanism for drift (Mau et al., 2020).

In this short communication, we aimed at proposing how excitability could indeed induce a drift of neural ensembles at the mechanistic level. We simulated a recurrent neural network (Delamare et al., 2022) equipped with intrinsic neural excitability and Hebbian learning. As a proof of principle, we first show that slow fluctuations of excitability can induce neural ensembles to drift in the network. We then explore the functional implications of such drift. Consistent with previous works (Rubin et al., 2015; Clopath et al., 2017; Mau et al., 2018; Miller et al., 2018), we show that neural activity of the drifting ensemble is informative about the temporal structure of the memory. This suggest that fluctuations of excitability can be useful for time-stamping memories (i.e. for making the neural ensemble informative about the time at which it was form). Finally, we confirmed that the content of the memory itself can be steadily maintained using a read-out neuron and local plasticity rule, consistently with previous computational works (Rule and O’Leary, 2022). The goal of this study is to show one possible mechanistic implementation of how excitability can drive drift.

Results

Many studies have shown that memories are encoded in sparse neural ensembles that are activated during learning and many of the same cells are reactivated during recall, underlying a stable neural representation (Josselyn and Tonegawa, 2020; Poo et al., 2016; Mau et al., 2020). After learning, subsequent reactivations of the ensemble can happen spontaneously during replay, retraining or during a memory recall task (e.g. following presentation of a cue Josselyn and Tonegawa, 2020; Káli and Dayan, 2004). Here, we directly tested the hypothesis that slow fluctuations of excitability can change the structure of a newly-formed neural ensemble, through subsequent reactivations of this ensemble.

To that end, we designed a rate-based, recurrent neural network, equipped with intrinsic neural excitability (Methods). We considered that the recurrent weights are all-to-all and plastic, following a Hebbian rule (Methods). The network was then stimulated following a 4day protocol: the first day corresponds to the initial encoding of a memory and the other days correspond to spontaneous or cue-induced reactivations of the neural ensemble (Methods). Finally, we considered that excitability of each neuron can vary on a day long timescale: each day, a different subset of neurons has increased excitability (Figure 1a, Methods).

Figure 1 with 2 supplements see all

Download asset Open asset

Excitability-induced drift of memory ensembles.

(a) Distribution of excitability $ϵ_{i}$ for each neuron i, fluctuating over time. During each stimulation, a different pool of neurons has a high excitability (Methods). (**b, c**) Firing rates of the neurons across time. The red traces in panel (c) correspond to neurons belonging to the first assembly, namely that have a firing rate higher than the active threshold after the first stimulation. The black bars show the stimulation and the dashed line shows the active threshold. (d) Recurrent weights matrices after each of the four stimuli show the drifting assembly.

Fluctuations of intrinsic excitability induce drifting of neural ensembles

While stimulating the naive network on the first day, we observed the formation of a neural ensemble: some neurons gradually increase their firing rate (Figure 1b and c, neurons 10–20, time steps 1000–3000) during the stimulation. We observed that these neurons are highly recurrently connected (Figure 1d, leftmost matrix) suggesting that they form an assembly. This assembly is composed of neurons that have a high excitability (Figure 1a, neurons 10–20 have increase excitability) at the time of the stimulation. We then show that further stimulations of the network induce a remodeling of the synaptic weights. During the second stimulation for instance (Figure 1b and c, time steps 4000–6000), neurons from the previous assembly (10–20) are reactivated along with neurons having high excitability at the time of the second stimulation (Figure 1a, neurons 20–30). Moreover, across several days, recurrent weights from previous assemblies tend to decrease while others increase (Figure 1d). Indeed, neurons from the original assembly (Figure 1c, red traces) tend to be replaced by other neurons, either from the latest assembly or from the pool of neurons having high excitability. This is translated at the synaptic level, where weights from previous assemblies tend to decay and be replaced by new ones. Overall, each new stimulation updates the ensemble according to the current distribution of excitability, inducing a drift towards neurons with high excitability. Finally, in our model, the drift rate does not depend on the size of the original ensemble (Figure 1—figure supplement 2, Methods).

Activity of the drifting ensemble is informative about the temporal structure of the past experience

After showing that fluctuations of excitability can induce a drift among neural ensembles, we tested whether the drifting ensemble could contain temporal information about its past experiences, as suggested in previous works (Rubin et al., 2015).

Inspired by these works, we asked whether it was possible to decode relevant temporal information from the patterns of activity of the neural ensemble. We first observed that the correlation between patterns of activity after just after encoding decreases across days (Figure 2a, Methods), indicating that after each day, the newly formed ensemble resembles less the original one. Because the patterns of activity differ across days, they should be informative about the absolute day from which they were recorded. To test this hypothesis, we designed a day decoder (Figure 2b, Methods), following the work of Rubin et al., 2015. This decoder aims at inferring the reactivation day of a given activity pattern by comparing the activity of this pattern during training and the activity just after memory encoding without increase in excitability (Figure 2b, Methods). We found that the day decoder perfectly outputs the reactivation day as compared to using shuffled data (Figure 2c).

Figure 2 with 4 supplements see all

Download asset Open asset

Neuronal activity is informative about the temporal structure of the reactivations.

(a) Correlation of the patterns of activity between the first day and every other days, for n=10 simulations. Data are shown as mean ± s.e.m. (b) Schema of the day decoder. The day decoder maximises correlation between the patterns of each day with the pattern from the simulation with no increase in excitability. (c) Results of the day decoder for the real data (red) and the shuffled data (orange). Shuffled data consist of the same activity pattern for which the label of each cell for every seed has been shuffled randomly. For each simulation, the error is measured for each day as the difference between the decoded and the real day. Data are shown for n=10 simulations and for each of the 4 days. (d) Schema of the ordinal time decoder. This decoder output the permutation $𝒑$ that maximises the sum $S (𝒑)$ of the correlations of the patterns for each pairs of days. (e) Distribution of the value $S (𝒑)$ for each permutation of days $𝒑$ . The value for the real permutation $S (𝒑_{real})$ is shown in black. (f) Student’s test t-value for n=10 simulations, for the real (red) and shuffled (orange) data and for different amplitudes of excitability $E$ . Data are shown as mean ± s.e.m. for n=10 simulations.

After showing that the patterns of activity are informative about the reactivation day, we took a step further by asking whether the activity of the neurons is also informative about the order in which the memory evolved. To that end, we used an ordinal time decoder (Methods, as in Rubin et al., 2015) that uses the correlations between activity patterns for pairs of successive days, and for each possible permutation of days $𝒑$ (Figure 2d, Methods). The sum of these correlations $S (𝒑)$ differs from each permutation $𝒑$ and we assumed that the neurons are informative about the order at which the reactivations of the ensemble happened if the permutation maximising $S (𝒑)$ corresponds to the real permutation $𝒑^{real}$ (Figure 2e, Methods). We found that $S (𝒑^{real})$ was indeed statistically higher than $S (𝒑)$ for the other permutations $p$ (Figure 2f, Student’s t-test, Methods). However, this was only true when the amplitude of the fluctuations of excitability $E$ was in a certain range. Indeed, when the amplitude of the fluctuations is null, that is when excitability is not increased ( $E = 0$ ), the ensemble does not drift (Figure 1—figure supplement 1a). In this case, the patterns of activity are not informative about the order of reactivations. On the other hand, if the excitability amplitude is too high ( $E = 3$ ), each new ensemble is fully determined by the distribution of excitability, regardless of any previously formed ensemble (Figure 1—figure supplement 1c). In this regime, the patterns of activity are not informative about the order of the reactivations either. In the intermediate regime ( $E = 1.5$ ), the decoder is able to correctly infer the order at which the reactivations happened, better than using the shuffled data (Figure 2f, Figure 1—figure supplement 1b).

Finally, we sought to test whether the results are independent on the specific architecture of the model. To that end, we defined a change of excitability as a change in the slope of the activation function, rather than of the threshold (Figure 2—figure supplement 2, Methods). We also used sparse recurrent synaptic weights instead of the original all-to-all connectivity matrix (Figure 2—figure supplement 1, Methods). In both cases, we observed a similar drifting behavior and were able to decode the temporal order in which the memory evolved.

A read-out neuron can track the drifting ensemble

So far, we showed that the drifting ensemble contains information about its history, namely about the days and the order at which the subsequent reactivations of the memory happened.

However, we have not shown that we could use the neural ensemble to actually decode the memory itself, in addition to its temporal structure. To that end, we introduced a decoding output neuron connected to the recurrent neural network, with plastic weights following a Hebbian rule (Methods). As shown by Rule and O’Leary, 2022, the goal was to make sure that the output neuron can track the ensemble even if it is drifting. This can be down by constantly decreasing weights from neurons that are no longer in the ensemble and increasing those associated with neurons joining the ensemble (Figure 3a). We found that the output neuron could steadily decode the memory (i.e. it has a higher firing than in the case where the output weights are randomly shuffled; Figure 3b). This is due to the fact that weights are plastic under Hebbian learning, as shown by Rule and O’Leary, 2022. We confirmed that this was induced by a change in the output weights across time (Figure 3c). In particular, the weights from neurons that no longer belong to the ensemble are decreased while weights from newly recruited neurons are increased, so that the center of mass of the weights distribution drifts across time (Figure 3d). Finally, we found that the quality of the read-out decreases with the rate of the drift (Figure 3—figure supplement 1, Methods).

Figure 3 with 1 supplement see all

Download asset Open asset

A single output neuron can track the memory ensemble through Hebbian plasticity.

(a) Conceptual architecture of the network: the read-out neuron $y$ in red ‘tracks’ the ensemble by decreasing synapses linked to the previous ensemble and increasing new ones to linked to the new assembly. (b) Output neuron’s firing rate across time. The red trace corresponds to the real output. The dark blue, light blue and yellow traces correspond to the cases where the output weights were randomly shuffled for every time points after presentation of the first, second and third stimulus, respectively. (c) Output weights for each neuron across time. (d) Center of mass of the distribution of the output weights (Methods) across days. The output weights are centered around the neurons that belong to the assembly at each day. Data are shown as mean ± s.e.m. for n=10 simulations.

Two memories drift independently

Finally, we tested whether the network is able to encode two different memories and whether excitability could make two ensembles drift. On each day, we stimulated a random half of the neurons (context A) and the other half (context B) sequentially (Methods). We found that, day after day, the two ensembles show a similar drift than when only one ensemble was formed (Figure 2—figure supplement 3). In particular, the correlation between the patterns activity on the first day and the other days decay in a similar way (Figure 2—figure supplement 4a). For both contexts, the temporal order of the reactivations can be decoded for a certain range of excitability amplitude (Figure 2—figure supplement 4b). Finally, we found that using two output decoders allowed us to decode both memories independently. The output weights associated to both ensembles are remodeled to follow the drifting ensembles, but are not affected by the reactivation of the other ensemble (Figure 2—figure supplement 4c). Indeed, both neurons are able to ‘track’ the reactivation of their associated ensemble while not responding to the other ensemble (Figure 2—figure supplement 4d).

Discussion

Overall, our model suggests a potential cellular mechanisms for the emergence of drift that can serve a computational purpose by ‘time-stamping’ memories while still being able to decode the memory across time. Although the high performance of the day decoder was expected, the performance of the ordinal time decoder is not trivial. Indeed, the patterns of activity of each day are informative about the distribution of excitability and therefore about the day at which the reactivation happened. However, the ability for the neural ensemble to encode the order of past reactivations requires drift to be gradual (i.e. requires consecutive patterns of activity to remain correlated across days). Indeed, if the amplitude of excitability is too low ( $E = 0$ ) or too high ( $E = 3$ ), it is not possible to decode the order at which the successive reactivations happened. This result is consistent with the previous works showing gradual change in neural representations, that allows for decoding temporal information of the ensemble (Rubin et al., 2015). Moreover, such gradual drifts could support complex cognitive mechanisms like mental time-travel during memory recall (Rubin et al., 2015).

In our model, drift is induced by co-activation of the previously formed ensemble and neurons with high excitability at the time of the reactivation. The pool of neurons having high excitability can therefore ‘time-stamps’ memory ensembles by biasing allocation of these ensembles (Clopath et al., 2017; Mau et al., 2018; Rubin et al., 2015). We suggest that such time-stamping mechanism could also help link memories that are temporally close and dissociate those which are spaced by longer time (Driscoll et al., 2022; Mau et al., 2020; Aimone et al., 2006). Indeed, the pool of neurons with high excitability varies across time so that any new memory ensemble is allocated to neurons which are shared with other ensembles formed around the same time. This mechanism could be complementary to the learning-induced increase in excitability observed in amygdala (Rashid et al., 2016), hippocampal CA1 (Cai et al., 2016) and dentate gyrus (Pignatelli et al., 2019).

Finally, we intended to model drift in the firing rates, as opposed to a drift in the turning curve, of the neurons. Recent studies suggest that drifts in the mean firing rate and tuning curve arise from two different mechanisms (Geva et al., 2023; Khatib et al., 2023). Experience drives a drift in neurons turning curve while the passage of time drives a drift in neurons firing rate. In this sense, our study is consistent with these findings by providing a possible mechanism for a drift in the mean firing rates of the neurons driven a dynamical excitability. Our work suggests that drift can depend on any experience having an impact on excitability dynamics such as exercise as previously shown experimentally (Rechavi et al., 2022; de Snoo et al., 2023) but also neurogenesis (Aimone et al., 2006; Tran et al., 2022; Rechavi et al., 2022), sleep (Levenstein et al., 2017) or increase in dopamine level (Chowdhury et al., 2022).

Overall, our work is a proof of principle which highlights the importance of considering excitability when studying drift, although further work would be needed to test this link experimentally.

Methods

Recurrent neural network with excitability

Our rate-based model consists of a single region of $N$ neurons (with firing rate $r_{i}$ , $1 \leq i \leq N$ ). All-to-all recurrent connections $W$ are plastic and follow a Hebbian rule given by:

\frac{d W_{i j}}{d t} = r_{i} * r_{j} / τ_{W} - W_{i j} / τ_{decay}

where $i$ and $j$ correspond to the pre- and post-synaptic neuron respectively. $τ_{W}$ and $τ_{decay}$ are the learning and the decay time constants of the weights, respectively.

A hard bound of $[0, c]$ was applied to these weights. We also introduced a global inhibition term dependent on the activity of the neurons:

I = I_{0} + I_{1} \sum_{i = 1}^{N} r_{i} + I_{2} \sum_{i = 1}^{N} r_{i}^{2}

here $I_{0}$ , $I_{1}$ and $I_{2}$ are positive constants. All neurons receive the same input, $Δ (t)$ , during stimulation of the network (Figure 1c, black bars). Finally, excitability is modeled as a time-varying threshold $ϵ_{i}$ of the input-output function of each neuron $i$ . The rate dynamics of a neuron $i$ is given by:

τ_{r} \frac{d r_{i}}{d t} + r_{i} = ReLU (Δ (t) + \sum_{j = 1}^{N} W_{i j} r_{j} - I + ϵ_{i} (t))

where $τ_{r}$ is the decay time of the rates and ReLU is the rectified linear activation function. We considered that a neurons is active when its firing rate reaches the active threshold $θ$ .

In Figure 2—figure supplement 1, we applied a random binary mask to the recurrent weights in order to set 50% of the synapses at 0. A new mask was randomly sampled for each simulation.

In Figure 2—figure supplement 2, we modeled excitability as a change of the slope of the activation function (ReLU) instead of a change of the threshold as previously used (Figure 2—figure supplement 2a):

τ_{r} \frac{d r_{i}}{d t} + r_{i} = ϵ_{i} (t) * ReLU (Δ (t) + \sum_{j = 1}^{N} W_{i j} r_{j} - I)

Protocol

We designed a 4-day protocol, corresponding to the initial encoding of a memory (first day) and subsequent random or cue-induced reactivations of the ensemble (Josselyn and Tonegawa, 2020; Káli and Dayan, 2004) (second, third, and fourth day). Each stimulation consists of $N_{rep}$ repetitions of interval $T$ spaced by a inter-repetition delay $I R$ . $Δ (t)$ takes the value $δ$ during these repetitions and is set to 0 otherwise. The stimulation is repeated four times, modeling four days of reactivation, spaced by an inter-day delay $I D$ . Excitability $ϵ_{i}$ of each neuron $i$ is sampled from the absolute value of a normal distribution of mean 0 and standard deviation 1. In Figure 2—figure supplement 2, excitability $ϵ_{i}$ is sampled from the absolute value of a normal distribution of mean 0.4 and standard deviation 0.2. Neurons 10–20, 20–30, 30–40, and 40–50 then receive an increase of excitability of amplitude $E$ , respectively on days 1, 2, 3, and 4 (Figure 1a). A different random seed is used for each repetition of the simulation. When two memories were modeled (Figure 2—figure supplements 3 and 4), we stimulated a random half of the neurons (context A) and the other half (context B) successively (Figure 2—figure supplement 3a), every day.

Decoders

For each day $d$ , we recorded the activity pattern $V_{d}$ , which is a vector composed of the firing rate of the neurons at the end of the last repetition of stimulation. To test the decoder, we also stimulated the network while setting the excitability at baseline ( $E = 0$ ), and recorded the resulted pattern of activity $V_{d}^{0}$ for each day $d$ . We then designed two types of decoders, inspired by previous works (Rubin et al., 2015): (1) a day decoder which infers the day at which each stimulation happened and (2) an ordinal time decoder which infers the order at which the reactivations occurred. For both decoders, the shuffled data was obtained by randomly shuffling the day label of each neuron. When two memories were modeled (Figure 2—figure supplements 3 and 4), the patterns of activity were taken at the end of the stimulations by context A and B, and the decoders were used independently on each memory.

1. The day decoder aims at inferring the day at which a specific pattern of activity occurred. To that end, we computed the Pearson correlation between the pattern with no excitability $V_{d}^{0}$ of the day $d$ and the patterns of all days $d^{'}$ from the first simulation $V_{d^{'}}$ . Then, the decoder outputs the day $d_{inf}$ that maximises the correlation:

d_{inf} = \underset{d^{'}}{a r g m a x} {corr (V_{d}^{0}, V_{d^{'}})}

The error was defined as the difference between the inferred and the real day $d_{inf} - d$ .

2. The ordinal time decoder aims at inferring the order at which the reactivations happened from the patterns of activity $V_{d}$ of every day $d$ . To that end, we computed the pairwise correlations of each pair of consecutive days, for the $4!$ possible permutations of days $𝒑$ . The real permutation is called $𝒑^{real} = (1, 2, 3, 4)$ and corresponds to the real order of reactivations: day 1 → day 2 → day 3 → day 4. The sum of these correlations over the 3 pairs of consecutive days is expressed as:

S (p) = \sum_{i = 1}^{3} corr (V_{p_{i}}, V_{p_{i + 1}})

We then compared the distribution of these quantities for each permutation $𝒑$ to that of the real permutation $S (𝒑^{real})$ (Figure 2). The patterns of activity are informative about the order of reactivations if $S (𝒑^{real})$ corresponds to the maximal value of $S (𝒑)$ . To compare $S (𝒑^{real})$ with the distribution $S (𝒑)$ , we performed a Student’s t-test, where the t-value is defined as:

t = \frac{S (p^{real}) - μ}{σ / \sqrt{N}}

where μ and σ correspond to the mean and standard deviation of the distribution $S (𝒑)$ , respectively.

The drift rate Δ (Figure 1—figure supplement 2 and Figure 3—figure supplement 1) was computed as:

Δ = \sum_{i = 2}^{4} (1 - corr (V_{1}, V_{i}))

Memory read-out

To test if the network is able to decode the memory at any time point, we introduced a read-out neuron with plastic synapses to neurons from the recurrent network, inspired by previous computational works (Rule and O’Leary, 2022). The weights of these synapses are named $𝑾^{out} = {(W_{i}^{out})}_{1 \leq i \leq N}$ and follow the Hebbian rule defined as:

\frac{d W_{i j}^{out}}{d t} = h (W^{out}) * r_{i} * y / τ_{out}^{+} - W_{i}^{out} / τ_{out}^{-}

where $τ_{out}^{+}$ and $τ_{out}^{-}$ corresponds to the learning time and decay time constant, respectively. $h (𝑾^{out})$ is a homeostatic term defined as $h (𝑾^{out}) = 1 - \sum_{j = 1}^{N} W_{j}^{out}$ which decreases to 0 throughout learning. $h$ takes the value 1 before learning and 0 when the sum of the weights reaches the value 1. $y$ is the firing rate of the output neuron defined $y$ as:

y = \sum_{i = 1}^{N} W_{i}^{out} r_{i}

The read-out quality index $Q$ (Figure 3—figure supplement 1) was defined as:

Q = ⟨ \sum_{d = 2}^{4} y_{d} / y_{d}^{shuffle} ⟩_{N_{shuffle}}

where $y_{d}$ corresponds to the value of $y$ taken at the end of the last repetition of day $d$ , and $y_{d}^{shuffle}$ the equivalent with shuffled outputs weights. $⟨ . . . ⟩_{N_{shuffle}}$ indicates the average over $N_{shuffle} = 10$ simulations.

In Figure 2—figure supplements 3 and 4, two output decoders $y_{k}$ , $k \in {1, 2}$ , with corresponding weights $𝑾_{𝒌}^{out} = {(W_{i, k}^{out})}_{1 \leq i \leq N}$ are defined as:

y_{k} = \sum_{i = 1}^{N} W_{i, k}^{out} r_{i} + β_{k}

and follow the Hebbian rule defined as:

\frac{d W_{i, k}^{out}}{d t} = h (W_{i, k}^{out}) * r_{i} * y_{k} / τ_{out}^{+} - W_{i, k}^{out} / τ_{out}^{-}

Then, we aimed at allocating $y_{1}$ and $y_{2}$ to the first and the second ensemble (context A and B), respectively. To that end, we used supervised learning on the first day by adding a current $β_{k}$ to the output neurons which is positive when the corresponding context is on:

\begin{array}{ll} β_{0} = 0.1 if 1000 < t < 3000, 0 otherwise \\ β_{1} = 0.1 if 4000 < t < 6000, 0 otherwise \end{array}

The shuffled traces were obtained by randomly shuffling the output weights $𝑾^{out}$ or $𝑾_{𝒌}^{out}$ for each ensemble $k$ .

Table of parameters

The following parameters have been used for the simulations. When unspecified, the defaults values were used. All except $N$ are in arbitrary unit. Figure 2—figure supplement 2 corresponds to the change from a threshold-based to a slope-based excitability. Figure 2—figure supplements 3 and 4 corresponds to the stimulation of two ensembles. Figure 2—figure supplement 1 corresponds to the sparsity simulation.

Param.	Description	Default	Figure 2—figure supplement 2	Figure 2—figure supplements 3 and 4	Figure 2—figure supplement 1
N	Number of neurons	50	-	-	-
$τ_{W}$	Learning time constant of the recurrent weights	800	700	-	-
$τ_{decay}$	Decay time constant of the recurrent weights	1000	800	4000	-
$τ_{r}$	Decay time constant of the firing rates	20	-	-	-
$τ_{out}^{+}$	Learning time constant of the output weights	200	-	-	-
$τ_{out}^{-}$	Decay time constant of the output weights	1000	-	-	-
$I_{0}$	First inhibition parameter	12	4	8	7
$I_{1}$	Second inhibition parameter	0.5	0.7	0.8	0.8
$I_{2}$	Third inhibition parameter	0.05	-	-	-
$δ$	Input current during stimulation	15	-	12	20
$E$	Amplitude of the fluctuations of excitability	1.5	0.5	-	-
$N_{rep}$	Number of repetitions	10	-	-	-
$T$	Duration of each repetition	100	-	-	-
$I R$	Inter-repetition delay	100	-	-	-
$I D$	Inter-stimulation delay	1000	-	-	-
$θ$	Active threshold	5	1	-	-
$c$	Cap on the recurrent weights	1	.5	-	-

Data availability

The code for simulations and figures is available at GitHub (copy archived at Delamare, 2024).

References

(2006) Potential role for adult neurogenesis in the encoding of time in new memories
Nature Neuroscience 9:723–727.
https://doi.org/10.1038/nn1707
- PubMed
- Google Scholar
(2015) Impermanence of dendritic spines in live adult CA1 hippocampus
Nature 523:592–596.
https://doi.org/10.1038/nature14467
- PubMed
- Google Scholar
1. Cai DJ
2. Aharoni D
3. Shuman T
4. Shobe J
5. Biane J
6. Song W
7. Wei B
8. Veshkini M
9. La-Vu M
10. Lou J
11. Flores SE
12. Kim I
13. Sano Y
14. Zhou M
15. Baumgaertel K
16. Lavi A
17. Kamata M
18. Tuszynski M
19. Mayford M
20. Golshani P
21. Silva AJ
(2016) A shared neural ensemble links distinct contextual memories encoded close in time
Nature 534:115–118.
https://doi.org/10.1038/nature17955
- PubMed
- Google Scholar
1. Cho HY
2. Shin W
3. Lee HS
4. Lee Y
5. Kim M
6. Oh JP
7. Han J
8. Jeong Y
9. Suh B
10. Kim E
11. Han JH
(2021) Turnover of fear engram cells by repeated experience
Current Biology 31:5450–5461.
https://doi.org/10.1016/j.cub.2021.10.004
- PubMed
- Google Scholar
1. Chowdhury A
2. Luchetti A
3. Fernandes G
4. Filho DA
5. Kastellakis G
6. Tzilivaki A
7. Ramirez EM
8. Tran MY
9. Poirazi P
10. Silva AJ
(2022) A locus coeruleus-dorsal CA1 dopaminergic circuit modulates memory linking
Neuron 110:3374–3388.
https://doi.org/10.1016/j.neuron.2022.08.001
- PubMed
- Google Scholar
(2017) Variance and invariance of neuronal long-term representations
Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 372:20160161.
https://doi.org/10.1098/rstb.2016.0161
- PubMed
- Google Scholar
Preprint
(2022) Intrinsic Neural Excitability Induces Time-Dependent Overlap of Memory Engrams
bioRxiv.
https://doi.org/10.1101/2022.08.27.505441
- Google Scholar
Software
1. Delamare G
(2024) Drift, version swh:1:rev:c79e1baeff8e3c3294ef794c77287827e3af9cec
Software Heritage.

https://archive.softwareheritage.org/swh:1:dir:50f44c9d73aa82fd3cd38347b9b6ed5c9af43a53;origin=https://github.com/gdelamar/drift;visit=swh:1:snp:d7c0ec941cf4282bc25b00df0862de834b7e1ed1;anchor=swh:1:rev:c79e1baeff8e3c3294ef794c77287827e3af9cec
(2023) Exercise accelerates place cell representational drift
Current Biology 33:R96–R97.
https://doi.org/10.1016/j.cub.2022.12.033
- PubMed
- Google Scholar
(2017) Dynamic reorganization of neuronal activity patterns in parietal cortex
Cell 170:986–999.
https://doi.org/10.1016/j.cell.2017.07.021
- PubMed
- Google Scholar
(2022) Representational drift: Emerging theories for continual learning and experimental future directions
Current Opinion in Neurobiology 76:102609.
https://doi.org/10.1016/j.conb.2022.102609
- PubMed
- Google Scholar
1. Geva N
2. Deitch D
3. Rubin A
4. Ziv Y
(2023) Time and experience differentially affect distinct aspects of hippocampal representational drift
Neuron 111:2357–2366.
https://doi.org/10.1016/j.neuron.2023.05.005
- PubMed
- Google Scholar
1. Grosmark AD
2. Buzsáki G
(2016) Diversity in neural firing dynamics supports both rigid and learned hippocampal sequences
Science 351:1440–1443.
https://doi.org/10.1126/science.aad1935
- PubMed
- Google Scholar
1. Hainmueller T
2. Bartos M
(2018) Parallel emergence of stable and dynamic memory engrams in the hippocampus
Nature 558:292–296.
https://doi.org/10.1038/s41586-018-0191-2
- PubMed
- Google Scholar
1. Huber R
2. Mäki H
3. Rosanova M
4. Casarotto S
5. Canali P
6. Casali AG
7. Tononi G
8. Massimini M
(2013) Human cortical excitability increases with time awake
Cerebral Cortex 23:332–338.
https://doi.org/10.1093/cercor/bhs014
- PubMed
- Google Scholar
1. Josselyn SA
2. Tonegawa S
(2020) Memory engrams: Recalling the past and imagining the future
Science 367:eaaw4325.
https://doi.org/10.1126/science.aaw4325
- PubMed
- Google Scholar
1. Káli S
2. Dayan P
(2004) Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions
Nature Neuroscience 7:286–294.
https://doi.org/10.1038/nn1202
- PubMed
- Google Scholar
1. Khatib D
2. Ratzon A
3. Sellevoll M
4. Barak O
5. Morris G
6. Derdikman D
(2023) Active experience, not time, determines within-day representational drift in dorsal CA1
Neuron 111:2348–2356.
https://doi.org/10.1016/j.neuron.2023.05.014
- PubMed
- Google Scholar
(2021) Drifting assemblies for persistent memory: Neuron transitions and unsupervised compensation
PNAS 118:e2023832118.
https://doi.org/10.1073/pnas.2023832118
- PubMed
- Google Scholar
(2017) Sleep regulation of the distribution of cortical firing rates
Current Opinion in Neurobiology 44:34–42.
https://doi.org/10.1016/j.conb.2017.02.013
- PubMed
- Google Scholar
(2019) NREM sleep in the rodent neocortex and hippocampus reflects excitable dynamics
Nature Communications 10:2478.
https://doi.org/10.1038/s41467-019-10327-5
- PubMed
- Google Scholar
1. Manz P
2. Memmesheimer RM
(2023) Purely STDP-based assembly dynamics: Stability, learning, overlaps, drift and aging
PLOS Computational Biology 19:e1011006.
https://doi.org/10.1371/journal.pcbi.1011006
- PubMed
- Google Scholar
(2018) The Same Hippocampal CA1 population simultaneously codes temporal information over multiple timescales
Current Biology 28:1499–1508.
https://doi.org/10.1016/j.cub.2018.03.051
- PubMed
- Google Scholar
1. Mau W
2. Hasselmo ME
3. Cai DJ
(2020) The brain in motion: How ensemble fluidity drives memory-updating and flexibility
eLife 9:e63550.
https://doi.org/10.7554/eLife.63550
- PubMed
- Google Scholar
Preprint
1. Mau W
2. Morales-Rodriguez D
3. Dong Z
4. Pennington ZT
5. Francisco T
6. Baxter MG
7. Shuman T
8. Cai DJ
(2022) Ensemble Remodeling Supports Memory-Updating
bioRxiv.
https://doi.org/10.1101/2022.06.02.494530
- Google Scholar
(2018) Memory: Ironing out a wrinkle in time
Current Biology 28:R599–R601.
https://doi.org/10.1016/j.cub.2018.03.053
- PubMed
- Google Scholar
1. Pignatelli M
2. Ryan TJ
3. Roy DS
4. Lovett C
5. Smith LM
6. Muralidhar S
7. Tonegawa S
(2019) Engram cell excitability state determines the efficacy of memory retrieval
Neuron 101:274–284.
https://doi.org/10.1016/j.neuron.2018.11.029
- PubMed
- Google Scholar
1. Poo MM
2. Pignatelli M
3. Ryan TJ
4. Tonegawa S
5. Bonhoeffer T
6. Martin KC
7. Rudenko A
8. Tsai LH
9. Tsien RW
10. Fishell G
11. Mullins C
12. Gonçalves JT
13. Shtrahman M
14. Johnston ST
15. Gage FH
16. Dan Y
17. Long J
18. Buzsáki G
19. Stevens C
(2016) What is memory? The present state of the engram
BMC Biology 14:6.
https://doi.org/10.1186/s12915-016-0261-6
- Google Scholar
1. Rashid AJ
2. Yan C
3. Mercaldo V
4. Hsiang H-LL
5. Park S
6. Cole CJ
7. De Cristofaro A
8. Yu J
9. Ramakrishnan C
10. Lee SY
11. Deisseroth K
12. Frankland PW
13. Josselyn SA
(2016) Competition between engrams influences fear memory formation and recall
Science 353:383–387.
https://doi.org/10.1126/science.aaf0594
- PubMed
- Google Scholar
1. Rechavi Y
2. Rubin A
3. Yizhar O
4. Ziv Y
(2022) Exercise increases information content and affects long-term stability of hippocampal place codes
Cell Reports 41:111695.
https://doi.org/10.1016/j.celrep.2022.111695
- PubMed
- Google Scholar
1. Rogerson T
2. Cai DJ
3. Frank A
4. Sano Y
5. Shobe J
6. Lopez-Aranda MF
7. Silva AJ
(2014) Synaptic tagging during memory allocation
Nature Reviews. Neuroscience 15:157–169.
https://doi.org/10.1038/nrn3667
- PubMed
- Google Scholar
1. Rubin A
2. Geva N
3. Sheintuch L
4. Ziv Y
(2015) Hippocampal ensemble dynamics timestamp events in long-term memory
eLife 4:e12247.
https://doi.org/10.7554/eLife.12247
- PubMed
- Google Scholar
1. Rule ME
2. O’Leary T
(2022) Self-healing codes: How stable neural populations can track continually reconfiguring neural representations
PNAS 119:e2106692119.
https://doi.org/10.1073/pnas.2106692119
- PubMed
- Google Scholar
1. Sadeh S
2. Clopath C
(2022) Contribution of behavioural variability to representational drift
eLife 11:e77907.
https://doi.org/10.7554/eLife.77907
- PubMed
- Google Scholar
1. Silva AJ
2. Zhou Y
3. Rogerson T
4. Shobe J
5. Balaji J
(2009) Molecular and cellular approaches to memory allocation in neural circuits
Science 326:391–395.
https://doi.org/10.1126/science.1174519
- PubMed
- Google Scholar
(2021) Continuous attractors for dynamic memories
eLife 10:e69499.
https://doi.org/10.7554/eLife.69499
- PubMed
- Google Scholar
1. Tran LM
2. Santoro A
3. Liu L
4. Josselyn SA
5. Richards BA
6. Frankland PW
(2022) Adult neurogenesis acts as a neural regularizer
PNAS 119:e2206704119.
https://doi.org/10.1073/pnas.2206704119
- PubMed
- Google Scholar
1. Zhou Y
2. Won J
3. Karlsson MG
4. Zhou M
5. Rogerson T
6. Balaji J
7. Neve R
8. Poirazi P
9. Silva AJ
(2009) CREB regulates excitability and the allocation of memory to subsets of neurons in the amygdala
Nature Neuroscience 12:1438–1443.
https://doi.org/10.1038/nn.2405
- PubMed
- Google Scholar
1. Ziv Y
2. Burns LD
3. Cocker ED
4. Hamel EO
5. Ghosh KK
6. Kitch LJ
7. El Gamal A
8. Schnitzer MJ
(2013) Long-term dynamics of CA1 hippocampal place codes
Nature Neuroscience 16:264–266.
https://doi.org/10.1038/nn.3329
- PubMed
- Google Scholar

Article and author information

Author details

Geoffroy Delamare

Department of Bioengineering, Imperial College London, London, United Kingdom

Contribution
Conceptualization, Data curation, Software, Formal analysis, Visualization, Methodology, Writing - original draft, Writing - review and editing

For correspondence
g.delamare21@imperial.ac.uk

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0001-6217-4370
Yosif Zaki

Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, United States

Contribution
Conceptualization, Writing - review and editing

Competing interests
No competing interests declared
Denise J Cai

Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, United States

Contribution
Conceptualization, Project administration, Writing - review and editing

Competing interests
Reviewing editor, eLife

"This ORCID iD identifies the author of this article:" 0000-0002-7729-0523
Claudia Clopath

Department of Bioengineering, Imperial College London, London, United Kingdom

Contribution
Conceptualization, Resources, Supervision, Funding acquisition, Validation, Investigation, Methodology, Project administration, Writing - review and editing

For correspondence
c.clopath@imperial.ac.uk

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0003-4507-8648

Funding

Biotechnology and Biological Sciences Research Council (BB/N013956/1)

Claudia Clopath

Wellcome Trust

https://doi.org/10.35802/200790

Claudia Clopath

Simons Foundation (564408)

Claudia Clopath

Engineering and Physical Sciences Research Council (EP/R035806/1)

Claudia Clopath

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication. For the purpose of Open Access, the authors have applied a CC BY public copyright license to any Author Accepted Manuscript version arising from this submission.

Version history

Preprint posted: March 17, 2023 (view preprint)
Sent for peer review: April 7, 2023
Preprint posted: June 8, 2023 (view preprint)
Preprint posted: December 15, 2023 (view preprint)
Version of Record published: May 7, 2024 (version 1)

Cite all versions

You can cite all versions using the DOI https://doi.org/10.7554/eLife.88053. This DOI represents all versions, and will always resolve to the latest one.

Copyright

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.