Hippocampal place cells construct reward related sequences through unexplored space

  1. H Freyja Ólafsdóttir  Is a corresponding author
  2. Caswell Barry
  3. Aman B Saleem
  4. Demis Hassabis
  5. Hugo J Spiers  Is a corresponding author
  1. University College London, United Kingdom
4 figures and 4 tables

Figures

Figure 1 with 4 supplements
Preferential preplay of a behaviourally relevant, unvisited environment.

(A) Experimental protocol. (i) Prior to running on the track, the animals rested for at least an hour (REST1). (ii) Following REST1, animals ran 20 laps on the stem (RUN1). Access to the arms was blocked by a barrier at the end of the stem which the animals could see through but not pass. (iii) Following RUN1, the experimenter baited one arm so to provoke the animals' interest in that arm (GOAL-CUE). (iv) Following goal-cueing, the animal rested for at least another hour (REST2). (v) Following REST2, the barrier was removed and the animals traversed the extent of the track, in alternate L-shaped laps (RUN2). (B) Left: an example template for a run to the cued arm. x-axis shows location on the track and y-axis cell IDs. Right: Example raster plots of preplay events—the title shows the correlation between the preplay event and the template sequence. C same as B but for the uncued template.

https://doi.org/10.7554/eLife.06063.004
Figure 1—figure supplement 1
Schematic of experimental apparatus black rectangles on track represent texture cues, dotted line transparent barrier, circle rest enclosure (18 cm wide), wiggly border demarcates the white curtains surrounding the environment, with distal landmarks fixed to the curtain (‘X’ and ‘0’).

Note, the rest enclosure was only present during rest periods.

https://doi.org/10.7554/eLife.06063.005
Figure 1—figure supplement 2
Ripple power is elevated during preplay events power in the ripple spectrum (80–250 Hz) is higher during preplay events (red) than during both non-significant spiking events (black, p < 0.001) and non-event periods (dashed line, p < 0.001).

Vertical lines represent start and end of spiking events.

https://doi.org/10.7554/eLife.06063.006
Figure 1—figure supplement 3
Place cell templates place cell sequences for each template.

Cells are ordered according to the location of their place field. x-axis shows location on arm (cm)—left side closer to the stem, and y-axis cell IDs. UCA = Up Cued Arm, DCA = Down Cued Arm, UUA = Up Uncued Arm, DUA = Down Uncued Arm.

https://doi.org/10.7554/eLife.06063.007
Figure 1—figure supplement 4
Spiking events for cued arm in REST2 centre: bootstrapped cumulative distribution of (absolute) correlations between spiking events and the cued template in REST2 (red = data, black = shuffle).

Lighter areas of the curve show 1 standard deviation of the mean. Raster plots: spiking events of varying correlations with the future cued arm template. The title of each quadrant shows the correlation range for raster plots in that quadrant. Labels above the top row in each quadrant show which animal the spiking events belong to. Red rasters = first spike emitted from a cell in an event, grey rasters = consecutive spikes emitted from a cell.

https://doi.org/10.7554/eLife.06063.008
Figure 2 with 2 supplements
Preplay is a function of goal-cueing.

(A) Bootstrapped cumulative distribution of (absolute) correlations between spiking events and the cued template in REST2 (red = data, black = shuffle). Lighter areas of the curve show 1 standard deviation of the mean. Inset: difference between the data and shuffle distributions. If there are more high correlations in the data compared to the shuffle then the data distribution will deviate below the shuffle distribution. (B–C) same as A but for the uncued template in REST2 and the cued template in REST1, respectively. (D) Proportion of spiking events categorised as preplay events in REST2 for the cued and uncued arms. Bars show mean for all animals, and the black lines show the result for each animal. The grey dashed line shows the proportion of preplay events expected by chance. (E) Same as D but comparing proportion of preplay events for the cued template in REST1 and REST2.

https://doi.org/10.7554/eLife.06063.009
Figure 2—figure supplement 1
Preplay of cued arm in REST2—distribution-based analysis A mean difference between the bootstrapped cumulative distributions of absolute correlations for the data and the bootstrapped shuffle for the cued and uncued arms in REST2 and the cued arm in REST1.

If a place cell template is preplayed then the AUC of the data distribution should be smaller than that of the shuffled distribution (i.e., negative difference score). To assess significance we computed 95% confidence intervals for the difference scores (obtained by subtracting the AUC of the bootstrapped data from the AUC of the bootstrapped shuffle). If the confidence interval did not contain 0 we deemed the data distribution to be significantly different from the shuffle distribution. The distribution for the cued arm in REST2 was found to be significantly different from the shuffle (p < 0.001), yet that of the uncued arm in REST2 and the cued arm in REST1 were not (uncued REST2: p = 0.22, cued REST1: p = 0.14). Black lines on bars show one standard deviation, *** = p < 0.001. (B) Frequency distribution of absolute correlation coefficients between spiking events and future cued arm templates. Red bars represent data and the grey bars the shuffle distribution. p-value above histogram is based on a two-sample Kolmogorov–Smirnov test comparing the data distribution to the shuffle distribution.

https://doi.org/10.7554/eLife.06063.010
Figure 2—figure supplement 2
Preplay of stem during REST1 bootstrapped cumulative distribution of absolute correlations for spiking events of the stem, recorded during REST1.

Green line shows the data and the black line the bootstrapped distribution obtained after shuffling events 100 times. Light green regions show 1 standard deviation of the distribution. Inset: difference between the two distributions. If the stem was preplayed during REST1 then one would expect the data distribution to deviate below the shuffle distribution (p = 0.053, area under the curve (AUC) test).

https://doi.org/10.7554/eLife.06063.011
Figure 3 with 4 supplements
Spatial and temporal dynamics of preplay.

(A) The proportion of preplay events when negative (‘reverse’) and positive (‘forward’) spiking event correlations are analysed separately. Bars show means for all data and black lines the results for each animal. (B) Frequency of preplay events vs location on the cued (red) and uncued (blue) arms normalised by the density of place field centres—100% indicates the expected number of preplay events under an even distribution across each arm. No bias towards particular sections of the arms was evident (cued p = 0.22, uncued p = 0.15, based on a two-sample Kolmogorov–Smirnov test). Lighter areas show standard error of the mean (SEM) and the black line the expected distribution. (C) Bootstrapped cumulative distribution of (absolute) correlations between spiking events and the cued template during GOAL-CUE (red = data, black = shuffle). Lighter areas of the curve show 1 standard deviation of the mean. Inset: difference between the data and shuffle distributions. (D) Ratio of activity levels between cued and uncued arm cells (cued/uncued) during events for the first and second half of each experimental period. Red line shows mean ratio, derived from bootstrapped data, obtained for each period, and the shaded areas 1sd of the bootstrapped data. The black horizontal line indicates equal rates for the two arms. * = significantly different from 1 based on 95% confidence intervals.

https://doi.org/10.7554/eLife.06063.013
Figure 3—figure supplement 1
Preplay of cued arm during GOAL-CUE—distribution-based analysis A mean difference between the cumulative distributions of absolute correlations for the bootstrapped data and shuffle for the cued and uncued arms during GOAL-CUE.

If a place cell template is preplayed then AUC of the data distribution should be smaller than that of the shuffled distribution (i.e., negative difference score). To assess significance we computed 95% confidence intervals for the difference scores. If the confidence interval did not contain 0 we deemed the data distribution to be significantly different from the shuffle distribution. The distribution for the cued arm was found to be significantly different from the shuffle (p = 0.02), yet that of the uncued arm was not (uncued p = 0.24). Black lines on bars show one standard deviation, * < 0.05. (B) Frequency distribution of absolute correlation coefficients between spiking events and future cued arm templates. Red bars represent data and the grey bars the shuffle distribution. p-value above histogram is based on a two-sample Kolmogorov–Smirnov test comparing the data distribution to the shuffle distribution.

https://doi.org/10.7554/eLife.06063.014
Figure 3—figure supplement 2
Preferential preplay of the cued arm is not confounded by the number and activity of cells on the cued arm.

(A) Proportion of preplay events for the cued and uncued arm in REST2 following down-sampling to equate the number of cells on the two arms. Bars show means, black lines the results for individual animals and the dashed grey lines the proportion of preplay events expected by chance. (B) same as a but comparing the proportion of preplay events for the cued arm in REST1 and REST2. CD same as AB but following down-sampling to equate firing rates during rest.

https://doi.org/10.7554/eLife.06063.015
Figure 3—figure supplement 3
Animals' interest in cued arm during GOAL-CUE is associated with subsequent preplay for each animal.

The proportion of preplay events for the cued arm recorded during REST2 is shown plotted against that animal's interest in the cued arm assessed by body position during GOAL-CUE. −0 indicates animal showed equal interest in the cued and uncued arm, values above 0 indicate more interest in the cued arm. Animals exhibiting a greater interest in the cued arm subsequently appear to experience a greater proportion of preplay for that same arm (Spearman's rank order correlation r = 1, p = 0.0833, note correlation is based on only 4 data points).

https://doi.org/10.7554/eLife.06063.016
Figure 3—figure supplement 4
Tetrode tracts example histology showing the location of tetrode recording from area CA1 in rat R504.

Staining: cresyl violet.

https://doi.org/10.7554/eLife.06063.017
Bayesian reconstruction confirms preferential cued arm preplay.

(A–B) Confusion matrices based on RUN2 data showing decoding accuracy for the cued (A) and uncued arms (B). Columns show the mean posterior probability distribution across the arm ordered by the true position of the rat (2 cm bins, data for R504). Decoding errors appear as power away from the identity diagonal—here both arms yield accurate estimates of the animal's position at all points on the track. (CD) Representative preplay events for the cued (C) and uncued (D) arms showing, (left) the straight line trajectory that best fits the decoded event (x-axis indicates time bin (5 ms) within the event, y-axis position on arm, title indicates probability of obtaining a better trajectory by chance) and, (right) the null distribution of trajectory fits obtained by shuffling the cell identities for each event (x-axis, quality of trajectory fit, y-axis, proportion of shuffled events). (E) Proportion of spiking events categorised as preplay events for the cued and uncued arms in REST2. Bars show mean for all data with SEM. (F) Same as E but comparing preplay in REST1 and REST2 for the cued arm.

https://doi.org/10.7554/eLife.06063.020

Tables

Table 1

Experimental parameters

https://doi.org/10.7554/eLife.06063.003
R1838R505R584R504All rats (mean)
Cue bias (dwell time)
 RUN10.330.32−0.05−0.200.10
 GOAL-CUE0.460.200.310.320.33
Cue bias (looking time)
 RUN1−0.09−0.020.01−0.36−0.11
 GOAL-CUE0.060.310.090.050.13
RUN2 arm bias
 RUN21.00.841.01.00.96
Session duration (min)
 SLEEP16088757474
 RUN1131013911
 GOAL-CUE1017121113
 SLEEP26067716065
 RUN23419353130
Template length (number of cells)
 Up cued arm2036534338
 Down cued arm1535453332
 Up uncued arm1926454033
 Down uncued arm1532414333
Table 2

REST period results

https://doi.org/10.7554/eLife.06063.012
AnimalArm# spiking events# preplay events% preplay% chancep-value
REST2
R1838Cued44920.456.866.56 × 10−4
Uncued26311.546.770.10
R505Cued631386.024.570.037
Uncued860293.373.820.72
R584Cued437327.324.736.20 × 10−3
Uncued398225.534.740.19
R504Cued516417.955.150.0027
Uncued373195.094.400.21
All ratsCued16281207.374.864.12 × 10−6
Uncued1657734.414.220.33
REST1
R1838Cued6334.767.050.66
Uncued3525.717.370.48
R505Cued664395.874.340.025
Uncued1215383.133.450.70
R584Cued269145.204.670.28
Uncued247218.504.720.0035
R504Cued31161.934.440.99
Uncued173116.364.210.063
All ratsCued1307624.744.560.34
Uncued1670724.313.800.12
  1. Summary results from REST1 and REST2 for the cued and uncued arms for individual animals. # Spiking events = total number of spiking events recorded. # preplay events = number of significant spiking events. % preplay = Proportion of the spiking events that qualified as preplay events (i.e., that were significant), expressed as a percentage. % chance = proportion of spiking events from the shuffled data that qualified as preplay events, expressed as a percentage. p-value = probability, derived from a binomial test, of obtaining the observed number of preplay events for each template given the chance level calculated from the shuffled data.

Table 3

REST1 stem results

https://doi.org/10.7554/eLife.06063.018
Animal# spiking events# preplay events% preplay% chancep-value
R18386834.416.010.59
R505980353.574.030.74
R584329175.174.530.24
R504396184.553.500.11
All rats1773734.124.080.44
  1. Summary results from REST1 analysing preplay of the stem. # Spiking events = total number of spiking events recorded. # Preplay events = number of significant spiking events. % preplay = Proportion of the spiking events that qualified as preplay events (i.e., that were significant), expressed as a percentage. % chance = proportion of spiking events from the shuffled data that qualified as preplay events, expressed as a percentage. p-value = probability, derived from a binomial test, of obtaining the observed number of preplay events for each template given the chance level calculated from the shuffled data.

Table 4

GOAL-CUE results

https://doi.org/10.7554/eLife.06063.019
AnimalArm# spiking events# preplay events% preplay% chancep-value
R1838Cued50070.30
Uncued50070.30
R505Cued4536.674.020.11
Uncued4812.083.570.52
R584Cued11187.214.810.087
Uncued11254.464.820.46
R504Cued11004.360.39
Uncued7114.295.000.044
All ratsCued172116.404.640.11
Uncued17074.124.490.50
  1. Summary results from GOAL-CUE analysis # Spiking events = total number of spiking events recorded. # Preplay events = number of significant spiking events. % preplay = Proportion of the spiking events that qualified as preplay events (i.e., that were significant), expressed as a percentage. % chance = proportion of spiking events from the shuffled data that qualified as preplay events, expressed as a percentage. p-value = probability, derived from a binomial test, of obtaining the observed number of preplay events for each template given the chance level calculated from the shuffled data.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. H Freyja Ólafsdóttir
  2. Caswell Barry
  3. Aman B Saleem
  4. Demis Hassabis
  5. Hugo J Spiers
(2015)
Hippocampal place cells construct reward related sequences through unexplored space
eLife 4:e06063.
https://doi.org/10.7554/eLife.06063