Sleep plays a crucial role in the consolidation of newly acquired memories. Yet, how our brain selects the noteworthy information that will be consolidated during sleep remains largely unknown. Here we show that post-learning sleep favors the selectivity of long-term consolidation: when tested three months after initial encoding, the most important (i.e., rewarded, strongly encoded) memories are better retained, and also remembered with higher subjective confidence. Our brain imaging data reveals that the functional interplay between dopaminergic reward regions, the prefrontal cortex and the hippocampus contributes to the integration of rewarded associative memories. We further show that sleep spindles strengthen memory representations based on reward values, suggesting a privileged replay of information yielding positive outcomes. These findings demonstrate that post-learning sleep determines the neural fate of motivationally-relevant memories and promotes a value-based stratification of long-term memory stores.https://doi.org/10.7554/eLife.07903.001
Fresh memories are strengthened while we sleep. However, we don’t remember every detail of our daily life experiences. Instead, it is essential that we retain information that promotes our survival, such as what we call "rewards" (including food, money or sex) and dangers that we should avoid.
Igloi et al. sought to find out how the human brain picks out important memories to be consolidated during sleep, while discarding irrelevant information. Healthy participants learned series of pictures associated with either high or low rewards. After learning, some of the participants had a nap, while others remained awake. Directly after this and three months later, all the participants returned for a memory test. Igloi et al. found that the highly rewarded pictures were better remembered at both time points (at the expense of lowly rewarded ones), but only for participants who had slept after learning.
Further analysis revealed that distinctive bursts of brain activity occurring during sleep, so-called “sleep spindles", favor the reorganization of memories stored in a region of the brain called the hippocampus, often considered to be the organ of memory.
These findings uncover how sleep enhances long-term memory selectivity thus demonstratethat sleep does not just passively increase the retention of all memories. In the future, this work may inspire educational strategies that combine the careful use of rewards followed by an overnight period of sleep.https://doi.org/10.7554/eLife.07903.002
It is well established that sleep contributes to memory consolidation processes (Diekelmann and Born, 2010; Maquet, 2001; Stickgold and Walker, 2013). In animals and humans memory traces are reinforced through neural reactivation and trimmed through synaptic downscaling. Critically, both neural replay and synaptic downscaling entail the tagging of neural elements coding for specific memories and coincide with the occurrence of specific oscillatory elements in sleep such as sleep spindles, and slow wave activity (Ringli and Huber, 2011; Tononi and Cirelli, 2003; Schwindel and Mcnaughton, 2011; Wilhelm et al., 2011; Káli and Dayan, 2004). For memory consolidation to be adaptive, information that is critical for survival, such as stimuli with an emotional or rewarding value, should be consolidated in priority during sleep (Perogamvros and Schwartz, 2012; Sterpenich et al., 2009). Consistent with this hypothesis, behavioral studies in humans suggest that reward may modulate sleep-related memory consolidation (Fischer and Born, 2009; Werchan and Gómez, 2013; Oudiette et al., 2013). At the neural level, animal studies provide evidence for spontaneous coordinated replay of neural activity in memory and reward brain structures during slow-wave sleep (Lansink et al., 2009; Pennartz et al., 2004), suggesting that the activation of reward circuits during sleep influences neural plasticity. Further, within the rat hippocampus, the firing patterns of CA1 and CA3 neurons encode the high or low reward outcome of items in an associative memory task (Mckenzie et al., 2014). In humans, at wake, the activation of the mesolimbic dopaminergic system enhances associative memory through interactions with the hippocampus (Shohamy and Wagner, 2008), as well as subjective confidence and feeling of goal attainment during successful retrieval (Shohamy and Wagner, 2008; Adcock et al., 2006; Wolosin et al., 2012). Yet, it is unclear whether the replay of rewarded memories during sleep primarily involves the transfer of hippocampal memories to cortical sites (Frankland and Bontempi, 2005; Gais et al., 2007; Takashima et al., 2009), or the strengthening of memory-reward associations, implicating hippocampal-striatal interactions (Lansink et al., 2009). Based on these findings and recent theoretical proposals suggesting that sleep may influence associative memory by facilitating the integration of multi-item sequences (Stickgold and Walker, 2013; Ellenbogen et al., 2007), a critical and unanswered question that we ask here is whether reward values linked to recent memory items control the remodeling of associative knowledge during sleep. Specifically, we test whether reward influences sleep-dependent memory consolidation by promoting associative processes in the hippocampus, ultimately prioritizing long-term retention and subjective confidence for highly (over lowly) rewarded stimuli.
We designed an associative memory task in which participants learned series of pictures yielding high or low reward outcomes. To assess the influence of sleep and reward, and their potential interaction, memory for these series was tested following a nap or a rest period, and then again 3 months later during the retest session (Figure 1A). The task was composed of eight series of six successive pictures each; four series were associated with high reward outcome (HR: dollar coin) and four with low reward outcome (LR: cent coin) all participants received the same total payment. The participants first saw the eight series once during the encoding session (Figure 1B and Figure 1—figure supplement 1A), followed by the 2-alternative forced choice learning session with feedback during which participants successively selected the next picture in the series among two presented pictures Figure 1—figure supplement 1B). Then, the participants either took a 90-min nap (Sleep group, n = 16) or spent an equivalent period quietly awake (Wake group; n = 15), both monitored by polysomnography EEG. After this delay and again three months later, the participants performed an associative memory task on pairs of pictures with different relational distances (direct, inference of order 1 and order 2). They were presented with one image and were then asked which one among two images was part of the same series as the first image (while the other image belonged to a different series) and gave confidence ratings for each answer (Figure 1C and Figure 1—figure supplement 1C). Functional MRI (fMRI) data were acquired during all experimental sessions and analyzed using SPM8 (see Materials and methods).
First, we assessed the effect of reward on learning performance (hit rate) during the learning phase using an ANOVA with Reward (high, low) and learning Block (1,2,3, see Materials and methods) as within-subject factors and Group (Sleep, Wake) as between-subject factor. Performance was superior for high reward (HR) than for low reward (LR) picture pairs (F(1,28) = 35.86, p<0.001), with a significant learning effect over Blocks (F(2,56) = 20.68, p<0.001), and a Reward x Block interaction effect (F(2,56) = 4.72, p=0.012). Importantly, there was no Group difference (F(1,28) = 2.59, p>0.05) and participants of the two groups reached similar levels of performance for HR and LR trials at the third block of the learning (post-hoc test p>0.05; Figure 2—figure supplement 1A). For all three learning blocks, performance was above chance level (one-way T-tests comparing performance to 50%, all p<0.05). Reward-related performance improvement during the learning phase (HR vs. LR) was paralleled by an increase in midbrain activity, in a region compatible with the ventral tegmental area (VTA) [z-score = 3.71 (-3x, -13y, -20z), p<0.05, small-volume corrected (SVC) for familywise error (Bunzeck and Düzel, 2006); see Materials and methods] (Figure 2—figure supplement 1B and Supplementary file 2).
Next, we tested whether the consolidation of rewarded associative memory was selectively enhanced by post-encoding sleep. After a nap (Sleep group) or rest (Wake group), participants were tested on direct pairs of pictures in the series, and on non-consecutive pairs of pictures, that is inference of order 1 and 2 measuring associative memory, namely the strength of the integration of non-consecutive images in a sequence (Ellenbogen et al., 2007) (Figure 1C and Figure 1—figure supplement 1C). Both groups performed above chance level for HR and LR trials and direct, inference 1 and inference 2 trials (one-way T-tests p<0.05). Participants performed better for HR than LR trials (F(1,84) = 15.88, p<0.001), and for close relational distance trials (F(2,84) = 4.16, p=0.018). Further, the Sleep group performed better than the Wake group (F(1,84) = 4.52, p=0.036; Figure 2A). Notably, within HR trials, the sleep Group performed better than the wake group (F(1,84) = 5.07, p=0.027), which was not the case for LR trials (F(1,84) = 1.52, p=0.22). However the Group x Reward interaction was not significant (F(1,84) = 0.23, p=0.63). In the Sleep group, the number of slow spindles (11–13 Hz) correlated with memory improvement from learning to test specifically for HR (R = 0.69, p<0.001) and not for LR trials (R = -0.27, p>0.05; Figure 2B). The correlation for HR trials was significantly higher than that for LR trials (Fisher’s z-score = 2.15, two-tailed p=0.01) (Lee and Preacher, 2013). Additionally, the correlation effect was not linked to sleep duration as there was no correlation between performance improvement in the HR trials and sleep duration, while the correlation with performance improvement in HR persisted when considering slow spindles density (number of slow spindles per second of sleep; R = 0.586, p=0.028).
To investigate fMRI responses from the Sleep and Wake groups during the test session, we used a general linear model distinguishing successful trials according to Reward (HR, LR), Relational Distance (direct, inference 1, inference 2) and Confidence (‘certain’ vs lower confidence judgments, i.e. ‘not sure’, ‘guess’, ‘by elimination’). A direct comparison between the Sleep and Wake groups for HR versus LR (independently of Relational Distance) revealed increased activity in the right hippocampus [z-score = 4.04 (30x, -10y, -23z), p<0.05 SVC; Figure 2C)]. Within this interaction, post-hoc analysis of the extracted beta values showed that both for Sleep and Wake groups HR condition was different from LR condition (both p=0.02). Because the integration of distant associative memories possibly relies on sleep spindles (Tamminen et al., 2010), we tested for the brain correlates of this functional relationship. To test specifically for the integration of associative memories (and not the consolidation of previously seen associations, as in direct trials), we considered associations between non-consecutive images with distinct relational distances by comparing inference 2 to inference 1 trials (inference 2 > inference 1). We found that the number of slow spindles in the Sleep group positively correlated with activation in the right hippocampus for HR distant associations [HR inference 2 versus HR inference 1; z-score = 3.75 (27x, -16y, -11z), p<0.05 SVC; Figure 2D], and not for LR associations.
We assessed long-term memory in a retest session identical to the test session, three months later. Both Sleep and Wake groups performed above chance level for HR and LR series (one-way T-tests, all p<0.05; Figure 3A). While we found no main effect of Group, Reward, or Relational Distance (ANOVA all p>0.05), we found a Group x Reward interaction (F(1,66) = 4.21, p=0.044). Only the Sleep group remembered HR compared to LR series better (T(32) = 2.91, p=0.006), while no such difference was found in the Wake group (T(38) = -0.25, p=0.80). In fMRI, we tested for Group differences between HR and LR trials according to Relational Distance. We observed a selective increase of left hippocampus activity for HR versus LR during inference 2 trials in the Sleep group compared to the Wake group [z-score = 3.78 (-36x, -28y, -8z), p<0.05 SVC; Figure 3B], we observed no Group difference for direct and inference 1 trials. Post-hoc analyses of the hippocampal beta values showed that the interaction was due to an increased hippocampal response to HR vs. LR trials in the Sleep group only (p=0.03). Further, using psychophysiological interaction (PPI), we asked whether sleep had some long-term effects on the functional coupling between the hippocampus and other brain regions during the processing of HR (vs. LR) trials (see Materials and methods). Both the caudate nucleus [z-score = 3.41 (15x, 20y, 7z); p<0.05 SVC] and the medial prefrontal cortex [z-score = 2.99 (15x, 59y, -5z); p<0.05 SVC] showed such pattern of increased functional connectivity in the Sleep (compared to the Wake) group (Figure 3C). Because striatal activation may be relevant for the reprocessing of rewarded associations during sleep (Lansink et al., 2009), we tested whether the strength of the caudate-hippocampal functional coupling correlated with the number of slow sleep spindles during the nap in the Sleep group, and found that this correlation was significant (R = 0.591, p=0.028, Figure 3D). Note that no such correlation was observed for the connectivity between the hippocampus and medial prefrontal cortex (mPFC).
Beyond performance effects, it has been shown that remembering emotional events elicits a stronger feeling of recollection (Sharot et al., 2004), yet higher confidence seems adaptive only if associated with accurate memory recall (Schultz, 2006). We therefore analyzed ‘certain’ confidence responses. To correct for potential performance biases, we considered the percentage of ‘certain’ responses for hits only. For the test session, we found a main effect of Group (F(1,78) = 4.90, p=0.029; more ‘certain’ responses for the Sleep group), of Reward (F(1,78) = 59.06,p<0.001; higher confidence for HR (Figure 4A). Further, we found a Group effect (Sleep>Wake) within HR hits (F(1,78) = 6.63, p=0.01), and not for LR hits (F(1,78) = 0.73, p=0.39). Importantly, the Group effect was not due to an unspecific influence of sleep, as confidence judgments for incorrect responses did not differ between the groups, neither for HR trials (U = 72.50, p=0.35) nor for LR trials (U = 84, p=0.51). Note that we performed U-Tests because of small sample size and non-normal distribution of incorrect responses. For the retest session, we found a main effect of Reward (higher confidence for HR trials; F(1,66) = 18.92, p<0.001) and a post-hoc difference between HR and LR confidence within the Sleep group only (p=0.003 for the Sleep group and p=0.38 for Wake group) (Figure 4B). At retest, there were very few certain responses. To obtain correctly sized samples to analyze confidence judgments at retest, we grouped ‘certain’, ‘by elimination’ and ‘not sure’ answers together and contrasted them to ‘guess’ answers. In line with our main imaging results for inference 2 trials (Figure 3B), this analysis on confidence yielded higher activation in the parahippocampus [z-score = 3.49 (27x, -25y, 26z) p<0.05 SVC] and in the putamen [z-score = 3.46 (-18x, -1y, 7z), p<0.05 SVC] for Sleep > Wake selectively for HR inference 2 when comparing some confidence to guess (Figure 4C).
Here we show that sleep favors the selectivity of memory consolidation and confidence for these memories by promoting the integration and long-term retention of the most important (i.e. here highly rewarding) memories.
First, our results show that slow sleep spindles were critically involved in the consolidation of series with high reward outcome (Figure 2B), consistent with Schmidt et al. (Schmidt et al., 2006) who reported that memory improvement for word-pairs over a nap implicated slow spindles. Sleep spindles may induce long-term synaptic plastic changes (Marshall et al., 2006), thus consolidating newly learned information into a more stable form of long-term memory. Slow spindles (11–13 Hz) are dominant over the prefrontal lobe (Saletin and Walker, 2012) and are related to a cross-linking of transferred information within prefrontal circuitry (Clemens et al., 2007). Moreover, activity in dopaminergic reward regions such as the VTA is increased during slow spindles in humans (Schabus et al., 2007). Consistent with these observations, we found that slow spindles after learning were related to the functional interplay between the hippocampus and the caudate nucleus during the long-term recall of high rewarded series. From these connectivity findings, we conclude that slow spindles may primarily favor the long-term consolidation of rewarded stimuli across striatal and hippocampal networks. We may speculate that enhanced hippocampal recruitment for HR trials at retest could possibly foster recall processes subserved by the mPFC, a brain region reportedly involved in the retrieval of episodic memories (Düzel et al., 1999).
Second, our results confirm that sleep does not only strengthen memory for recently (and possibly more strongly) encoded items (Diekelmann and Born, 2010) but also boosts the integration of associative memories, via a hippocampus-dependent mechanism (Werchan and Gómez, 2013; Ellenbogen et al., 2007; Lau et al., 2010) (Figure 2D). Importantly, there was no difference between reaction times for inference trials and direct trials (Table 1), supporting the idea that the consolidation of associative memory involved the integration of discrete events (i.e., generalization of memories) rather than sequential inferential reasoning (Shohamy and Wagner, 2008). This mechanism could promote the conversion of implicit forms of memory into more explicit and conscious memories (Wilhelm et al., 2013), and also facilitate the access to remote associations (Zeithamova et al., 2012).
Third, we show that sleep after learning reinforces the subjective feeling of recollection for correct recall (Figure 4A), and at long-term retest selectively enhances performance for rewarded information (Sharot et al., 2004) (Figure 3A), although this interaction effect was not present at short-term. These effects were not present for missed trials and were thus not due to a general increase in confidence judgments after sleep. Moreover, we report that medium to high confidence is characterized by parahippocampal and striatal activation at retest. Both these structures have previously been linked to confidence measures (Daniel and Pollmann, 2012; Eichenbaum et al., 2007), with parahippocampal activation involved in remembering contextual information about a memory, which contributes to increased confidence about the information being recalled (Eichenbaum et al., 2007), while striatum (in particular putamen) activation has been shown to reflect an internal error signal about probable outcome in the absence of feedback (or prediction error of confidence measures) (Daniel and Pollmann, 2012).
At a more conceptual level, rewards may act as a ‘relevance tag’ that would prioritize the neural reprocessing of associative memories during sleep via a 2-step process: (i) during encoding, potential rewards activate dopaminergic midbrain regions, which would seal a ‘relevance tag’ to recently learned and rewarded information; (ii) during sleep (in particular sleep oscillations), the activation of a striatal-hippocampal network would favor the reprocessing of recent memories with a high relevance (Perogamvros and Schwartz, 2012).
Overall, by determining the fate of motivationally-relevant memory traces, post-learning sleep, even in the form of a nap, sharpens the skyline of our memories.
Thirty-one healthy young volunteers (16 women and 15 men, age range = 18–30 years old) gave written informed consent and received financial compensation for their participation in this study, which was approved by the Ethics Committee of Geneva University Hospitals. All participants were right-handed, non-smokers, free from psychiatric and neurological history, and had a normal or corrected-to-normal vision. They were within the normal ranges on self-assessed questionnaires for depression, anxiety, circadian typology, had no excessive daytime sleepiness and reported taking regular naps. Before inclusion in the study, all selected participants came for a habituation nap monitored by polysomnography. They then kept a regular sleep-wake schedule during five days prior to the experimental day. Compliance was documented by actigraphy (Actiwatch, Cambridge Neuroscience, Cambridge, UK) and sleep diary. Moreover, they were requested to refrain from all caffeine and alcohol-containing beverages and intense physical activity for the 48h preceding the experiment. Participants were randomly assigned to either a ‘Sleep’ group (n = 16, 8 men), or to a ‘Wake’ group (n = 15, 7 men). There was no group difference for any of the questionnaires (all p>0.05), so both groups had in particular equal sensitivity to reward as assessed by the SPSRQ questionnaire.
Participants arrived at 12:45 PM at the Brain and Behavior Laboratory of the University of Geneva. Before each fMRI session, participants got acquainted with the task on two series of pictures that were not used in the main experiment. At 1 PM, the participants were comfortably installed in the fMRI scanner, and performed the encoding session directly followed by the learning session (Figure 1A). Then, electrodes were applied to all the participants to ensure similar experimental conditions for all participants: between 2 PM and 3:30 PM participants of the Sleep group took a nap and participants of the Wake group stayed quietly awake in a sound-attenuated room. At 4:30 PM, participants underwent the test fMRI session. A surprise retest session similar to the test session took place three months later at 3:30 PM. Before each fMRI session, a psychomotor vigilance task (PVT) was performed (Blatter and Cajochen, 2007) (see Table 2).
Behavioral task. We developed an associative memory task comprising 8 series of pictures; 4 series yielded high reward outcome (HR) (1 dollar symbol for each picture correctly selected) while 4 series yielded low reward outcome (LR) (1 cent symbol). Each series was composed of 6 photographs presented in the following order: pillow, sofa, kitchen, bedroom, house, and landscape (Figure 1B). We told the participants that their final gain depended on their performance, namely that the dollar sign indicated a sequence that would be more rewarded while the cent indicated a sequence proportionally less rewarded. Critically, we also explicitly told them that both the dollar and the cent were ‘symbols’ and that we would convert their performance (not the accumulated US tokens) into Swiss Francs at the end of the learning session, so that if they performed well they would receive the maximal amount (i.e. 120 Swiss Francs). This manipulation was meant to (i) ensure that the participants paid attention to the distinct reward levels associated with each sequence, (ii) increase the participants’ motivation to obtain the rewards, and (iii) also ensure that each participant got the same final monetary outcome (i.e. 120 Swiss Francs). Participants were alsoinformed in the initial instructions that they would have to do an inference task, and were explicitly asked to memorize series as wholes rather than as isolated pair-wise associations.
Encoding session. Participants watched each of the 8 series once, one picture at a time (2000 ms each), and were asked to encode them. At the beginning of each series, a dollar or a cent picture indicated the reward value (high or low) associated with the series (Figure 1B and Figure 1—figure supplement 1A).
Learning session. Each series is formed by 6 pictures, which that can therefore be grouped into 5 successive direct pairs (pillow-sofa, sofa-kitchen, kitchen-bedroom, bedroom-house, house-scene). Participants were trained on all successive pairs of each of the 8 series in the following way : participants were shown the first picture (pillow) of the series. Then, the same picture was shown together with two options for the second item (sofa). The onset of this display was used for the fMRI analysis (red frame on Figure 1—figure supplement 1B). Two seconds later, when the sentence ‘choose next picture’ appeared in the middle of the screen, participants could give their answer by pressing on an MRI compatible response box (Current Designs Inc., USA) (Figure 1—figure supplement 1B). Next, the correct second item (sofa) was presented for two seconds, followed by this item together with the two options for the third item (kitchen), and so on until the sixth picture (landscape). At the end of each series, participants were shown how much they earned in dollars or cents, for high or low reward outcome series respectively. During the learning, participants got feedback about the correctness of their choice on each trial: after each ‘choice’ display, the correct picture was presented on the subsequent trial, as the next element in the sequence for which the following picture should be selected, and so on until the last trial, for which the ultimate correct choice (landscape) was also shown. The total amount of correct responses on a given sequence was also summarized at the end of the sequence, as a display with filled dollar (for HR) or cents (for LR) symbols (see Figure 1—figure supplement 1). All volunteers underwent 3 blocks of learning; in each block, each of the 8 series was presented once, in a randomized order.
Nap time. Half of the participants took a nap (Sleep group), the other half stayed awake (Wake group), both for 1h30. The Wake group was allowed to read in dim light (25 lux), on a topic not involving memorization or high cognitive load. For both groups the temperature of the room was controlled (21°C) and polysomnographic data was continuously recorded (see below EEG acquisition). Participants in the Sleep group were allowed to sleep for up to 90 min and were woken only from sleep stages 1, 2 or REM (see Supplementary file 1 for characteristics of the nap period for participants in the Sleep group). Before starting the test phase, the participants spent at least 40 min awake, in order to dissipate effects of sleep inertia in the Sleep group, and they all completed the St. Mary's Hospital questionnaire. One participant’s sleep data were lost due to a computer failure. This participant was excluded from the sleep data analyses.
Test session. Participants were tested on all possible direct (or immediately consecutive) pairs of pictures in the series, and also on pairs of non-consecutive pictures, i.e., inference of order 1 and 2 pairs. In inference trials, participants were also presented with a cue picture and had to select which of two pictures belonged to the same series as the cue picture, but for pairs of pictures that were more distant in the series (i.e., separated by one or two intermediate pictures; Figure 1C and Figure 1—figure supplement 1C). During test and retest sessions all possible combinations were presented once per session: all 5 direct pairs (from each of the 8 series), inference 1 pairs (for each of the 8 series there are 4 possible inference 1 pairs: pillow-kitchen, sofa-bedroom, kitchen-house and bedroom-scene) and inference 2 pairs (for each of the 8 series there are 3 possible inference 2 pairs: pillow-bedroom, sofa-house, kitchen-landscape). The order of the presentation of the pairs was randomized. Like in the learning session, they were first shown one picture alone, then the 2-alternative forced choice display, which was used as onset time for the fMRI analysis (indicated by a red frame on Figure 1—figure supplement 1C). They could only give their answer after a 2 s delay when the ‘choose next picture’ sentence appeared. After each response, participants rated how confident they were when selecting the correct picture among 4 possible options: ‘certain’, ‘not sure’, ‘guess’, or ‘by elimination’ (Figure 1—figure supplement 1C). In order to prevent further learning, no feedback at all was shown during the test and retest sessions. Two participants (one of the Sleep and one of the Wake group) did not understand the confidence question, the data of these participants wer excluded from the confidence analysis.
Retest session. Three months after the experiment, the participants were asked to come back for a retest session that was similar to the test session. Participants did not know at test that there would be a retest session. Out of the 31 participants 25 were able to come back after three months for the retest session.
During the learning session, a picture in a series was considered learnt when the participant had selected the correct picture at least twice out of three times during the three learning blocks. Pictures that did not meet this learning criterion were removed from the analysis of the test and retest sessions (3.1 ± 2.26 pairs per participant out of 40, see Table 3). One participant had to be excluded of all analyses because of memory performance below two standard deviations of the group mean, thus the final group comprised 15 participants for both Sleep and Wake groups, which were included in fMRI analyses.
All behavioral analyses were performed using Statistica (Version 11, www.statsoft.com, StatSoft, Inc. TULSA, OK, USA); non parametric tests were used when normal distribution and equal variance criteria were not met. Post-hoc tests were performed using the Scheffe method.
We first removed false alarms (reaction times under 50ms) and then computed the mean and median reaction times values. We did not remove slow reaction times as this was not a rapidity task, and participants were told that they could take up to 8 s to answer. We performed ANOVAs on mean and median RT values with Reward (high, low) and Relational Distance (direct, inference 1, inference 2) as within-subject factors, and Group (Sleep, Wake) as between-subject factor. These analyses revealed a main effect of Reward for both means and medians (F(1, 84) = 4.8263, p=0.031 and F(1, 84) = 6.8350, p=0.011, respectively) but no main effect of Relational Distance and no interaction with Relational Distance. Participants were faster for trials belonging to HR series as compared to LR series, thus attesting an influence of the reward manipulation on behavior, see Table 1.
Similar analyses on the mean and median reaction times for ‘certain’ responses during the test phase did not show any main effect of Reward, Relational Distance, or Group, see Table 4.
PVT was administered three times: before the encoding session (PVT 1), before the test session (after the sleep/rest period; PVT 2), and before the retest session (PVT 3; see Figure 1A). Analysis of the PVT data showed that reaction times were normally distributed for Sleep and Wake groups during the learning, test and retest sessions. Importantly, there was no group difference for reaction times, false alarms, or lapses at any time point (all p>0.05), see Table 2.
Nap-time was monitored using a V-Amp recorder (Brain Products, Gilching, Germany). Standard polysomnography included 6 EEG (Fz, Cz, Pz, Oz, C3, C4, reference on both mastoids), chin EMG, and vertical and horizontal EOG recordings (sampling rate: 250 Hz).
For PSG analyses, we used FASST (fMRI Artifact rejection and Sleep Scoring Toolbox; Cyclotron Research Centre, University of Liège, Belgium) implemented in Matlab (MATLAB version 126.96.36.1994 R2011b, Natick, Massachusetts: The MathWorks Inc., 2011). Fourteen naps and fifteen periods of quiet wakefulness were visually scored on a 20 s epoch basis by two independent scorers, according to standard criteria by the AASM Manual for the Scoring of Sleep (Iber et al., 2007). Additionally, automatic detection of spindles was performed. Sleep spindles were detected based on an algorithm previously developed by Molle et al. (Mölle et al., 2002). Sleep spindles were separated according to their main frequency (i.e. maximum power amplitude within the 11–15 hz range), in line with the global standards used in sleep research (Schabus et al., 2007; Maquet, 2010). Slow sleep spindles were defined as spindles with predominant frequency between 11 and 13 Hz and fast spindles between 13.1 and 15 Hz. Spindle frequency computation was done by a Matlab toolbox (FASST, Cyclotron Liège) (Schabus et al., 2007; Sterpenich et al., 2007). The distribution of fast and slow spindles has been reported to be bimodal (Astill et al., 2014) and corresponds to an approximate topographical localization, fast spindles having a predominant distribution over parietal regions and slow spindles over prefrontal regions (Schabus et al., 2007; Andrillon et al., 2011). Slow spindles had a predominant frequency below 13 Hz (mean: 12.55; SEM: 0.08) and fast spindles had a predominant frequency above 13.5 Hz (mean: 14.33; SEM: 0.06). Sleep data are summarized in Supplementary file 1. None of the participants in the Wake group fell asleep.
MRI data were acquired on a 3 Tesla MRI scanner (SIEMENS Trio System, Siemens, Erlangen, Germany). Multislice T2*-weighted fMRI 2D images were obtained with a gradient echo-planar sequence using axial slice orientation (36 slices; voxel size, 3.2 × 3.2 × 3.2 mm; repetition time (TR) = 2100 ms; echo time (TE) = 30 ms; flip angle (FA) = 80°, FOV = 205 mm).
A whole-brain structural image was acquired at the end of the test part with a T1-weighted 3D sequence (192 contiguous sagittal slices; voxel size, 1.0 × 1.0 × 1.0 mm; TR = 1900 ms; TE = 2.27 ms; FA = 9°). An additional structural image was acquired with a proton-density weighted sequence (20 axial slices; voxel size, 0.8 × 0.8 × 3.0 mm; TR = 6000 ms; TE = 8.4 ms; FA = 149°). This acquisition served for the localization of the VTA (D'Ardenne et al., 2008). All stimuli for fMRI were designed and delivered using a MATLAB Toolbox (Cogent 2000, http://www.vislab.ucl.ac.uk/cogent_2000.php).
Functional images were analyzed using SPM8 (Wellcome Department of Imaging Neuroscience, London, UK). This analysis included standard preprocessing procedures: realignment, slice timing to correct for differences in slice acquisition time, normalization (images were normalized to an EPI template), and smoothing (with an isotropic 8-mm FWHM Gaussian kernel). A general linear model (GLM) approach was then used to compare conditions of interest at the individual level and then these contrasts from each participant entered a second-level random-effects analysis. All group comparisons were performed using ANOVAs. Correction for multiple comparisons was performed by submitting all reported activations to small-volume correction (SVC) for familywise error (p<0.05) using regions of interest based on the Anatomy toolbox of SPM8 for the hippocampus (SPM Anatomy toolbox 2.1, Forschungszentrum Jülich GmbH), the automated anatomical labeling (aal) atlas for the caudate nucleus, the parahippocampus and the putamen (Tzourio-Mazoyer et al., 2002), and using the coordinates from (Bunzeck and Düzel, 2006) for VTA-compatible midbrain regions and from (Düzel et al., 1999) for the medial prefrontal cortex. Coordinates of brain regions are reported in MNI space.
To investigate fMRI responses from the learning session, we first used a general linear model at the single individual level including 3 sessions for the 3 learning blocks. Each session contained 2 regressors for successful trials and 2 regressors for misses according to their reward outcome (HR, LR) and the 6 motion parameters derived from the spatial realignment added as covariate of no interest. We then performed a contrast between HR and LR hits for each participant and entered the resulting statistical maps into a second-level 2-sample t-test which also included the difference in performance between HR and LR series (i.e., HR minus LR performance) as a covariate. This analysis allowed us to identify brain regions selectively contributing to reward-related performance improvement. This analysis revealed increased activation in a midbrain region compatible with the VTA [z-score = 3.71 (-3x, -13y, -20z), p<0.05, small-volume corrected (SVC) for familywise error] using the VTA coordinate from Bunzeck and Duzel (Bunzeck and Düzel, 2006; Figure 2—figure supplement 1B).
Psychophysiological interaction (PPI) analysis was computed to test the hypothesis that functional connectivity between the seed region (the right hippocampus seed from the contrast of the test session, Figure 2C at (30x, -10y, -23z)) (see Results) and the rest of the brain differed for HR vs. LR hits during the retest session. Therefore, we took as psychological factor the contrast between HR and LR hits, irrespective of trial type (direct, inference 1 and inference 2 trials). A new linear model was prepared for PPI analyses at the individual level, using three regressors. The first regressor represented the psychological factor, composed of HR vs. LR hits. The second regressor was the activity in the right hippocampus. The third regressor represented the interaction of interest between the first (psychological) and the second (physiological) regressor. To build this regressor, the underlying neuronal activity was first estimated by a parametric empirical Bayes formulation, combined with the psychological factor and subsequently convolved with the hemodynamic response function (Gitelman et al., 2003). The model also included movement parameters. A significant psychophysiological interaction indicated a change in the regression coefficients between any reported brain area and the reference region, related to the correct retrieval of HR vs. LR trials. Next, individual summary statistic images obtained at the first-level (fixed-effects) analysis were spatially smoothed (6 mm FWHM Gaussian kernel) and entered a second-level (random-effects) analysis using ANOVAs to compare the functional connectivity between groups. Finally, based on existing animal data suggesting a coordinated replay of rewarded associations within striatal and hippocampal regions (Lansink et al., 2009), we tested whether reward-related regions showing increased functional connectivity with the hippocampus as a function of reward level (selectively in the Sleep group) correlated with sleep spindles. We thus extracted the beta values around relevant PPI result peaks using a 10 mm diameter sphere and performed a Spearman’s rank correlation analysis (appropriate for small samples) with the number of spindles detected during the nap for the participants in the Sleep group.
Sleep spindles in humans: insights from intracranial EEG and unit recordingsThe Journal of Neuroscience 31:17821–17834.https://doi.org/10.1523/JNEUROSCI.2604-11.2011
Sleep spindle and slow wave frequency reflect motor skill performance in primary school-age childrenFrontiers in Human Neuroscience, 8, 10.3389/fnhum.2014.00910.
Task-related and item-related brain processes of memory retrievalProceedings of the National Academy of Sciences of the United States of America 96:1794–1799.https://doi.org/10.1073/pnas.96.4.1794
The medial temporal lobe and recognition memoryAnnual Review of Neuroscience 30:123–152.https://doi.org/10.1146/annurev.neuro.30.051606.094328
Anticipated reward enhances offline learning during sleepJournal of Experimental Psychology. Learning, Memory, and Cognition 35:1586–1593.https://doi.org/10.1037/a0017256
The function of the sleep spindle: a physiological index of intelligence and a mechanism for sleep-dependent memory consolidationNeuroscience and Biobehavioral Reviews 35:1154–1165.https://doi.org/10.1016/j.neubiorev.2010.12.003
Sleep transforms the cerebral trace of declarative memoriesProceedings of the National Academy of Sciences of the United States of America 104:18778–18783.https://doi.org/10.1073/pnas.0705454104
The AASM manual for the scoring of sleep and associated events: rules, terminology and technical specifications
Daytime napping: effects on human direct associative and relational memoryNeurobiology of Learning and Memory 93:554–560.https://doi.org/10.1016/j.nlm.2010.02.003
Understanding non rapid eye movement sleep through neuroimagingThe World Journal of Biological Psychiatry 11:9–15.https://doi.org/10.3109/15622971003637736
Grouping of spindle activity during slow oscillations in human non-rapid eye movement sleepThe Journal of Neuroscience 22:10941–10947.
The role of memory reactivation during wakefulness and sleep in determining which memories endureThe Journal of Neuroscience 33:6672–6678.https://doi.org/10.1523/JNEUROSCI.5497-12.2013
The roles of the reward system in sleep and dreamingNeuroscience and Biobehavioral Reviews 36:1934–1951.https://doi.org/10.1016/j.neubiorev.2012.05.010
Developmental aspects of sleep slow waves: linking sleep, brain maturation and behaviorProgress in Brain Research 193:63–82.https://doi.org/10.1016/B978-0-444-53839-0.00005-3
Nocturnal mnemonics: sleep and hippocampal memory processingFrontiers in Neurology, 3, 10.3389/fneur.2012.00059.
Hemodynamic cerebral correlates of sleep spindles during human non-rapid eye movement sleepProceedings of the National Academy of Sciences of the United States of America 104:13164–13169.https://doi.org/10.1073/pnas.0703084104
Encoding difficulty promotes postlearning changes in sleep spindle activity during nappingThe Journal of Neuroscience 26:8976–8982.https://doi.org/10.1523/JNEUROSCI.2464-06.2006
Behavioral theories and the neurophysiology of rewardAnnual Review of Psychology 57:87–115.https://doi.org/10.1146/annurev.psych.56.091103.070229
Hippocampal-cortical interactions and the dynamics of memory trace reactivationProgress in Brain Research 193:163–177.https://doi.org/10.1016/B978-0-444-53839-0.00011-9
Sleep promotes the neural reorganization of remote emotional memoryThe Journal of Neuroscience 29:5143–5152.https://doi.org/10.1523/JNEUROSCI.0561-09.2009
Sleep-dependent memory triage: evolving generalization through selective processingNature Neuroscience 16:139–145.https://doi.org/10.1038/nn.3303
Shift from hippocampal to neocortical centered retrieval network with consolidationThe Journal of Neuroscience 29:10087–10093.https://doi.org/10.1523/JNEUROSCI.0799-09.2009
Sleep spindle activity is associated with the integration of new memories and existing knowledgeThe Journal of Neuroscience 30:14356–14360.https://doi.org/10.1523/JNEUROSCI.3028-10.2010
Sleep and synaptic homeostasis: a hypothesisBrain Research Bulletin 62:143–150.https://doi.org/10.1016/j.brainresbull.2003.09.004
Generalizing memories over time: sleep and reinforcement facilitate transitive inferenceNeurobiology of Learning and Memory 100:70–76.https://doi.org/10.1016/j.nlm.2012.12.006
Sleep selectively enhances memory expected to be of future relevanceThe Journal of Neuroscience 31:1563–1569.https://doi.org/10.1523/JNEUROSCI.3575-10.2011
Reward modulation of hippocampal subfield activation during successful associative encoding and retrievalJournal of Cognitive Neuroscience 24:1532–1547.https://doi.org/10.1126/science.1077775
The hippocampus and inferential reasoning: building memories to navigate future decisionsFrontiers in Human Neuroscience, 6, 10.3389/fnhum.2012.00070.
Heidi Johansen-BergReviewing Editor; University of Oxford, United Kingdom
eLife posts the editorial decision letter and author response on a selection of the published articles (subject to the approval of the authors). An edited version of the letter sent to the authors after peer review is shown, indicating the substantive concerns or comments; minor concerns are not usually shown. Reviewers have the opportunity to discuss the decision before the letter is sent (see review process). Similarly, the author response typically shows only responses to the major concerns raised by the reviewers.
Thank you for submitting your work entitled "A nap to recap or how reward regulates hippocampal-prefrontal memory networks during daytime sleep in humans" for peer review at eLife. Your submission has been favorably evaluated by Eve Marder (Senior Editor), Heidi Johansen-Berg (Reviewing Editor), and two reviewers.
The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.
This paper investigates how high versus low reward affects sleep-dependent memory consolidation using behavioral methods and fMRI imaging in humans. They show that mainly HR memories benefit from a brief nap after learning. This improvement is correlated with an increase in slow sleep spindles and increased hippocampal activity in fMRI. In a surprise retest after three months, they still find behavioral and fMRI differences between sleep and wake conditions.
1) All participants receive the same total payment (first paragraph of the Results section). Thus, the appearance of a reward cue at the onset of learning only provides an indirect predictor of the final outcome, and the final outcome is the same across participants, presumably regardless of performance. Because the total reward amount is presented at the conclusion of the Learning session (Figure 1—figure supplement 1), this post-hoc leveling effect may be apparent to the participants before they go to sleep. This could critically influence the reward effects on subsequent sleep modulation (Figure 1). This needs discussion.
2) In Figure 2A the Group x Reward interaction is not significant, which is a problem for claiming that sleep would selectively enhance high-rewarded memories (see Abstract).
3) Please clarify and justify when correction for multiple comparisons has/has not been applied. For example, in paragraph four of the Results section, the number of spindles correlates with R-hippocampal activation for HR distant associations (P<0.05), but it is unclear whether the authors corrected for multiple comparisons.
4) Claims for specificity need to backed up by direct statistical tests, e.g. in the second and third paragraphs of the Results section, spindles correlate with behavior for HR but not for LR trials. To test whether this relationship is significantly stronger in the HR than the LR trials requires a statistical test such as Fisher’s R to Z.
5) In the Discussion, the conclusion is drawn that slow spindles after learning favor the interplay between HPC and PFC during HR long-term recall, but Figure 3D shows an HPC-lPFC functional connectivity effect without involvement of spindles. Also the PPI analysis (in the subsection “Psychophysiological interaction analysis”) does not include spindles.
6) For interaction effects tested by voxel-wise analyses it is important to clarify what is driving those effects, e.g. Results section, fourth paragraph: the interaction sleep/wake x HR/LR could reflect higher activity in sleep-HR as well as in wake-LR conditions. Please provide bar graphs with actual percent signal changes for all conditions. The same holds for all other interactions (fifth and sixth paragraphs of the Results section).
7) In the Introduction, memory consolidation can also be adaptive if important information is encoded more strongly, and consolidation simply affects everything according to its encoding strength. All results presented in this paper would be similarly predicted if one assumes that strength of memory is determined directly during encoding. The non-significant difference between HR and LR in block 3 seems to come from performance reaching ceiling and does not exclude stronger encoding for HR trials. The Abstract and Discussion should acknowledge that the effects can equally well be explained by stronger encoding of HR items.
8) The paper would benefit from a model or conceptualization in which the functioning of HPC-PFC-VTA networks in the context of the memory task is explained, at least theoretically. An explanatory framework is suggested by the title, but as yet we encounter a number of rather separate findings. As related areas such as N. Accumbens, OFC and Amygdala are part of the same network, how is it explained that no effects were picked up in these areas? Moreover, it remains unclear which mechanisms would account for the fact that sometimes the right hippocampus shows up (e.g. Figure 2C,D), and sometimes the left hippocampus (e.g. 2F – although for Figure 3C, the figure legend states "left" hippocampus whereas the text states "right" hippocampus). Likewise, the origin of the lateralization effects is unclear for the PFC.https://doi.org/10.7554/eLife.07903.017
- Kinga Igloi
- Kinga Igloi
- Sophie Schwartz
- Sophie Schwartz
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
We are grateful to the Brain and Behaviour Laboratory of the University of Geneva (Geneva, Switzerland) for providing help and scanning facilities. We thank Christoph Hofstetter, Hamdi Eryilmaz and Bruno Bonet for help in operating the fMRI. We thank Neil Burgess and Gethin Hughes for useful comments on the manuscript.
Human subjects: All subjects were volunteers, gave written informed consent, consent to publish and received financial compensation for their participation in this study. The study was approved by the Ethics Committee of the Geneva University Hospitals.
- Heidi Johansen-Berg, Reviewing Editor, University of Oxford, United Kingdom
© 2015, Igloi et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.