The role of ventromedial prefrontal cortex in reward valuation and future thinking during intertemporal choice
Abstract
Intertemporal choices require trade-offs between short-term and long-term outcomes. Ventromedial prefrontal cortex (vmPFC) damage causes steep discounting of future rewards (delay discounting [DD]) and impoverished episodic future thinking (EFT). The role of vmPFC in reward valuation, EFT, and their interaction during intertemporal choice is still unclear. Here, 12 patients with lesions to vmPFC and 41 healthy controls chose between smaller-immediate and larger-delayed hypothetical monetary rewards while we manipulated reward magnitude and the availability of EFT cues. In the EFT condition, participants imagined personal events to occur at the delays associated with the larger-delayed rewards. We found that DD was steeper in vmPFC patients compared to controls, and not modulated by reward magnitude. However, EFT cues downregulated DD in vmPFC patients as well as controls. These findings indicate that vmPFC integrity is critical for the valuation of (future) rewards, but not to instill EFT in intertemporal choice.
Introduction
Choices are often intertemporal, requiring trade-offs between short-term and long-term outcomes. Human and non-human animals tend to prefer smaller-immediate over larger-delayed rewards (Green and Myerson, 2004; Rudebeck et al., 2006). This phenomenon reflects delay discounting (DD), the decrease in subjective value of a reward as the delay until its receipt increases. Several clinical conditions, such as drug addiction and obesity, are associated with steep DD (Bickel et al., 2014), a disproportionate prioritization of immediate gratification associated with poor self-control and impulsivity. The neural mechanisms governing DD and its adaptive modulation are thus of theoretical and clinical relevance.
The ventromedial prefrontal cortex (vmPFC) is causally implicated in intertemporal choice. Indeed, patients with damage to the vmPFC (Sellitto et al., 2010; Peters and D'Esposito, 2016; Lq et al., 2020; but see Fellows and Farah, 2005), and animals with lesions in homologous regions (Rudebeck et al., 2006), show abnormally steep DD. The specific role played by vmPFC in DD, however, is still debated. According to a prominent model of intertemporal choice (Hare et al., 2009; Figner et al., 2010; Peters and Büchel, 2011), vmPFC is engaged in reward valuation and integrates different outcome attributes (e.g., amounts, delays), whereas lateral prefrontal cortex modulates vmPFC subjective value signals to promote self-control and future-oriented choice.
In separate work, Peters and Büchel, 2010 (see also Benoit et al., 2011) have shown that cues to imagine personal future events (episodic future thinking [EFT]; Suddendorf and Corballis, 1997; Atance and O'Neill, 2001) during intertemporal choices reduce DD, and the DD reduction relates to functional coupling of medial prefrontal regions and the hippocampus, and to the vividness of imagined events. This finding points to prospection as another component process of DD (Peters and Büchel, 2011). Indeed, EFT effects on DD were not (Palombo et al., 2015) or were inconsistently (Kwan et al., 2015) detected in amnesic patients with medial temporal lobe (MTL) lesions, in line with the evidence that MTL patients cannot imagine detail-rich future events (Race et al., 2011).
In addition to its role in reward valuation (Bartra et al., 2013), the vmPFC is also a crucial substrate of prospection (Schacter et al., 2012), and, accordingly, vmPFC patients are impaired in EFT (Bertossi et al., 2016a; Bertossi et al., 2016b; Bertossi et al., 2017; Verfaellie et al., 2019). Although MTL patients are as well, recent research suggests that the nature of the EFT impairment is different in each case. Whereas constructed experience in hippocampal patients is mainly devoid of spatial references, that of vmPFC patients also lacks relevant contents and sensory details, suggesting that vmPFC plays a more general (upstream) role in event construction (De Luca et al., 2018). McCormick et al., 2018, therefore, have proposed that vmPFC initiates (future) event construction by activating schematic knowledge (e.g., about the self, lifetime periods) that drives the collection of relevant individual details, which the hippocampus then assembles into spatially coherent scenes (see also Ciaramelli et al., 2019; D'Argembeau, 2020; Moscovitch et al., 2016; Ghosh et al., 2014). DD, therefore, could be causally linked to vmPFC through prospection, as well as through its role in reward valuation.
To investigate the specific contributions of vmPFC to both the reward valuation and prospection components of DD, we compared the effects of reward magnitude and EFT on DD on patients with vmPFC damage with their effects on healthy controls. Twelve vmPFC patients (see Figure 1 for the extent and overlap of vmPFC patients’ lesions) and 41 healthy controls matched to patients in age (57.41 vs. 61.09; t51 = 1.61; p = 0.11), education (13.41 vs. 13.19; t51 = −0.22; p = 0.82), and gender balance (8 males, 35 males; χ2 = 2.12; p = 0.14) chose between smaller-immediate and larger-delayed rewards while we manipulated reward magnitude (small magnitude: €80/$100; large magnitude: €1500/$2000) and the availability of EFT cues during intertemporal choices. In the EFT condition, participants were presented with subject-specific cues to imagine personal future events to occur at the delays associated with the larger-delayed rewards (see Figure 2 for an example trial).
A magnitude effect is consistently observed such that people discount larger rewards less steeply than smaller rewards (Green et al., 1997). This effect has been ascribed to self-control mechanisms supported by the lateral prefrontal cortex (e.g., Ballard et al., 2017). However, impaired reward valuation following vmPFC damage should hinder the differential valuation of large vs. small rewards, and prevent the implementation of self-control when large rewards are at stake. Thus, we predict, in addition to steep DD, a smaller magnitude effect in vmPFC patients compared to healthy controls.
Concerning prospection, previous studies have observed an EFT effect on DD, such that people discount future rewards less steeply if cued to imagine personal future events during intertemporal choice (Peters and Büchel, 2010; Benoit et al., 2011). Considering that vmPFC is implicated in prospection (Schacter et al., 2012), and that vmPFC patients are impaired in EFT (Bertossi et al., 2016a; Bertossi et al., 2016b; Bertossi et al., 2017), vmPFC patients’ DD should remain steep even when EFT cues are provided, because patients may nevertheless fail to construct the vivid future events that might be needed to counteract DD. Thus, we predict a reduced EFT effect on DD in vmPFC patients compared to healthy controls.
Results
DD rates
Preliminary fits of the hyperbolic function SV = 1/(1+kD), with SV = subjective value (expressed as a fraction of the delayed amount) and D = delay (in days), to individual participants’ data using a nonlinear least-squares algorithm (implemented in Statistica Statsoft) revealed that subjective preferences were not equally well characterized by hyperbolic functions in the Standard and EFT conditions. This was especially apparent in vmPFC patients in the EFT condition whose discounting curves were not always monotonically decreasing (see Figure 3, and Figure 3—figure supplement 1 for individual patients’ discounting curves).
The degree to which participants discounted delayed rewards (DD rate), therefore, was measured using the area under the curve (AuC), a theoretically neutral, normalized measure of DD that does not depend on theoretical models regarding the shape of the discounting curve (Myerson et al., 2001). Figure 4 displays the AuC by participant group and condition, as well as individual participants’ data. An ANOVA on AuCs with Group (vmPFC patients, healthy controls), Condition (Standard, EFT), and Reward magnitude (small, large) as factors revealed an effect of Reward magnitude (F1,51 = 13.17, p = 0.0007, partial η2 = 0.20), qualified by a Group × Reward magnitude interaction (F1,51 = 9.49, p = 0.003, partial η2 = 0.16). Fisher post hoc tests showed that healthy controls discounted large rewards less steeply than small rewards (i.e., magnitude effect; p < 0.0001), whereas vmPFC patients discounted large and small rewards at similar rates (p = 0.76). Relatedly, vmPFC patients showed steeper DD than controls for the large rewards (p = 0.04), but not for the small rewards (p = 0.67). Crucially, there was a significant effect of Condition (F1,51 = 54.33, p < 0.0001, partial η2 = 0.52), indicating that both healthy controls and vmPFC patients had reduced DD rates in the EFT compared to the Standard condition (EFT effect). There were no other significant effects (p > 0.07 in all cases). In particular, the Group × Condition interaction was not significant (F1,51 = 2.18, p = 0.14, partial η2 = 0.04).
Although the ANOVA failed to reveal a significant Group × Condition interaction, a limitation of classical statistical analyses like ANOVA is that they do not directly assess the evidence for the null hypothesis, which in this case is that there is no difference in the EFT effect between vmPFC patients and controls. We therefore used a Bayesian approach, which, unlike classical null hypothesis significance testing, can directly compare the evidence for the null hypothesis with the evidence for the alternative hypothesis (Wagenmakers et al., 2018). Bayesian-independent samples t-tests were conducted on the EFT effect between vmPFC patients and controls (AuCEFT condition – AuCStandard condition, collapsing across reward magnitudes; vmPFC patients: M = 0.17, SD = 0.21; controls: M = 0.26, SD = 0.17) using the JASP software (Wagenmakers et al., 2018). The results show a Bayes factor of 0.738. This value, which compares the likelihood of the alternative hypothesis to the likelihood of the null hypothesis given the present data, represents what Jeffreys, 1961 termed anecdotal evidence in favor of the null hypothesis. It may be contrasted with the Bayes factor for the group difference in the magnitude effect (AuCLarge reward – AuCSmall reward, collapsing across the Standard and EFT condition; vmPFC patients: M = 0.01, SD = 0.10; controls: 0.14, SD = 0.13), which equals 11.52, representing strong evidence for the alternative hypothesis and against the null (Jeffreys, 1961).
Because previous work has attributed the magnitude effect to processing in the lateral prefrontal cortex (Ballard et al., 2017; Ballard et al., 2018), we re-ran the previous ANOVA excluding patients with damage touching the lateral prefrontal cortex (N = 4) to assure that they were not driving our results. We confirmed our findings. Again, the ANOVA yielded a Reward magnitude effect (F1,47 = 4.80, p = 0.03, partial η2 = 0.09), and, importantly, a Group × Reward magnitude interaction that was even stronger than in the original ANOVA (F1,47 = 13.32, p = 0.0006, partial η2 = 0.22), indicating that controls (0.53 vs. 0.39; p < 0.0001), but not vmPFC patients (0.36 vs. 0.40; p = 0.43), discounted large rewards less than small rewards. Note that the magnitude effect was even smaller in patients with damage confined to the vmPFC than in patients with additional damage to the lateral prefrontal cortex (−0.04 vs. 0.10; t(10) = −2.60; p = 0.03), confirming that the lack of a magnitude effect in vmPFC patients was not driven by damage extending beyond vmPFC (Figure 4). As in the original ANOVA, there was a main effect of Condition (F1,47 = 33.84, p = 0.000001, partial η2 = 0.42), and no Group × Condition interaction (F1,47 = 2.89, p = 0.095, partial η2 = 0.05), confirming reduced DD rates in the EFT compared to the Standard condition in both vmPFC patients and controls. There were no other significant effects (all p’s > 0.23).
Consistency of preference
One possible reason for the poor fit of the hyperbolic function to vmPFC patients’ discounting data in the EFT condition is that the data were not monotonically decreasing (Figure 3). To directly assess this possibility, we counted the number of ‘inconsistent preferences’, that is, data points in which the subjective value of a future outcome (amount = R) at a given delay (R2) was greater than that at the preceding delay (R1) by more than 10% of the amount of the future outcome (i.e., R2 > R1 + R/10, as recommended by Johnson and Bickel, 2008; Sellitto et al., 2010). An ANOVA on the number of inconsistent preferences with Group, Condition, and Reward magnitude as factors revealed a significant Group × Condition interaction (F1,51 = 5.01, p = 0.03, partial η2 = 0.09). Post hoc tests indicated that whereas in the Standard condition the number of inconsistent preferences in vmPFC patients did not differ from that of healthy controls (0.75 vs. 0.94; p = 0.31), replicating previous findings (Sellitto et al., 2010), in the EFT condition vmPFC patients showed more inconsistent preferences than controls (1.12 vs. 0.61; p = 0.007). There were no other significant effects (all p’s > 0.13).
Discussion
The present study investigated the effect of vmPFC damage on DD and its responsivity to reward magnitude and cues to imagine personal future events. Three main findings emerged. Whereas healthy controls showed lower DD rates for large compared to small rewards (magnitude effect), vmPFC patients’ DD was not modulated by reward magnitude and was abnormally steep for large rewards. By contrast, EFT cues effectively decreased DD in vmPFC patients as well as controls (EFT effect), despite the patients’ poor EFT abilities.
Let us first consider the magnitude effect. The tendency to be more likely to choose the delayed option when decisions involve large rewards has been related to self-control mechanisms supported by the lateral prefrontal cortex. This region is more engaged during intertemporal choices between large than small rewards (Ballard et al., 2017), and transient disruption of its activity reduces the magnitude effect (Ballard et al., 2018). Our finding that the magnitude effect is absent in vmPFC patients points to the vmPFC as another crucial substrate of this effect, and makes contact with previous evidence of impaired sensitivity to magnitude following vmPFC damage (Peters and D'Esposito, 2016). These findings support current models of vmPFC as crucially involved in reward valuation during intertemporal choice (Hare et al., 2009; Figner et al., 2010; Peters and Büchel, 2011). We propose that an impaired reward valuation system impeded the (differential) assessment of the utility of large vs. small rewards, interfering with the normal triggering of self-control by the lateral prefrontal cortex for rewards of high perceived value (di Pellegrino et al., 2007; Ballard et al., 2018).
In the present study, steep DD in vmPFC patients was observed only on choice trials with large rewards, on which greater self-control (shallower discounting) was observed in controls than in patients, consistent with Peters and D'Esposito, 2016 view that balanced intertemporal choice relies on vmPFC integrity and crosstalk with the lateral prefrontal cortex. We note that previous studies observed steep DD in vmPFC patients even using reward amounts similar in size to our small reward (Sellitto et al., 2010; Peters and D'Esposito, 2016). The studies, however, had methodological differences from the present effort. Here, we studied DD by sampling delays as long as 10 years, whereas previous studies employed much shorter delays (1 year in Sellitto et al., 2010; 60 days in Peters and D'Esposito, 2016), which likely changed baseline levels of discounting. The AuC scores of the healthy controls in the present study were indeed lower than those in previous studies. However, the higher baseline rates of discounting for small rewards in the present study, if anything, should have favored the detection of reductions in DD rates with rewards of greater magnitude, and yet no such modulation was observed in vmPFC patients.
Despite being steep at baseline and unresponsive to the amount of reward, vmPFC patients’ DD was normally downregulated by cues to imagine the personal future. This finding indicates that vmPFC integrity is not necessary to instill prospection in intertemporal choice with EFT cues. Before discussing this finding further, we note that it rests on accepting the null hypothesis of no group differences in the EFT effect on DD between vmPFC patients and controls. It is unlikely, however, that this null finding simply reflects a lack of statistical power, for example due to a small sample size. First, the null effect on group differences indeed reflects a significant within-participant effect, with greater regard for future amounts in the EFT compared to the Standard condition in vmPFC patients. Second, together with the preservation of the EFT effect, we found a significant reduction of the magnitude effect in the same vmPFC patient sample. Bayesian analyses confirmed greater evidence in favor of the null compared to the alternative hypothesis regarding group differences in the EFT effect on DD.
The finding of a preserved EFT effect on DD in vmPFC patients is surprising in light of previous evidence of impaired EFT in vmPFC patients (Bertossi et al., 2016a; Bertossi et al., 2016b; Bertossi et al., 2017; Verfaellie et al., 2019). In healthy individuals, EFT is thought to reduce DD by promoting self-projection into vivid future experiences, boosting the value of future payoffs (Boyer, 2008). As expected, the EFT effect is not reliably observed in MTL patients (Palombo et al., 2015; Kwan et al., 2015), who cannot imagine detail-rich future events (Race et al., 2011). Considering that EFT is also heavily compromised in vmPFC patients (Bertossi et al., 2016a; Bertossi et al., 2016b; Bertossi et al., 2017; Verfaellie et al., 2019), how might EFT cues exert influence on their choices?
EFT is supported by a distributed neural network, including vmPFC and the hippocampus (Schacter et al., 2012), within which different nodes contribute uniquely to the dynamics of EFT construction. In particular, vmPFC is thought to initiate endogenously the activation of high-level semantic structures (e.g., schemata; Irish and Piguet, 2013; Ghosh et al., 2014; McCormick et al., 2017; McCormick et al., 2018), for example, pertaining to the self, one’s goals, common events (D'Argembeau and Mathy, 2011), around which the hippocampus then builds detail-rich future experiences (McCormick et al., 2018; D'Argembeau, 2020). Indeed, vmPFC (but not MTL) patients are particularly impaired at imagining self-related (as opposed to other-related) future events, suggesting they fail to activate schematic self-knowledge that favors the collection of individual details for EFT (Verfaellie et al., 2019; D'Argembeau and Mathy, 2011). Consistent with this idea, recent magnetoencephalography studies show synchronized engagement of vmPFC and the hippocampus during autobiographical memory retrieval and scene construction, with vmPFC activity driving activity in the hippocampus during both the initiation and elaboration of mental events (Barry et al., 2019; McCormick et al., 2020). Similarly, vmPFC patients are not impaired in constructing future events (Kurczek et al., 2015; Verfaellie et al., 2019) or scenes (De Luca et al., 2019) if the task minimizes the need for self-initiation, whereas the deficit persists in MTL patients (Kurczek et al., 2015; McCormick et al., 2017; Verfaellie et al., 2019). We propose, therefore, that subject-specific event cues, which were self-relevant and familiar to the participants because they had been selected by participants themselves, and were already planned or were plausible in their future, acted as external triggers of self- and situation-relevant schemata, helping to circumvent vmPFC patients’ EFT initiation problems. Their intact MTLs allowed them to construct episodic future events, which were then integrated into intertemporal choice, reducing DD. The same benefit would not be expected, and was not found, in patients with severe episodic amnesia due to extensive MTL lesions (Palombo et al., 2015; Kwan et al., 2015) as their basic deficit in assembling detail-rich experiences cannot be offset by probing semantic structures upstream. An alternative interpretation of the DD modulation is that EFT cues simply shifted attention toward the future, or conferred a positive valence to it, as we encouraged positively valenced EFT. If that were the case, however, one should consistently observe an EFT-induced benefit on DD also in MTL patients, but this is not the case (Kwan et al., 2015; Palombo et al., 2015).
Functional magnetic resonance imaging (fMRI) evidence has related the EFT effect on DD to the crosstalk between the anterior cingulate cortex (ACC, BA 32) and the hippocampus (Peters and Büchel, 2010). Our findings suggest that the ACC is not necessary to update signal values with the EFT output, as this region was lesioned in our vmPFC patients. Our findings are more compatible with the view that in the EFT (vs. Standard) condition, subjective value computation relied on a more distributed network including, in addition to the ACC, the lateral parietal and posterior cingulate cortex (Peters and Büchel, 2010). The parietal cortex mediates shifts of attention to memories (Cabeza et al., 2008) and across subjective time (Nyberg et al., 2010), and the posterior cingulate cortex is implicated in internally directed cognition and EFT (Schacter et al., 2012). These regions were found to form a valuation sub-system dedicated to delayed rewards (Peters and Büchel, 2009), and may have updated reward value based on EFT, overcoming vmPFC patients’ domain-general valuation impairment.
One unexpected finding of our study was that vmPFC patients showed more inconsistent preferences than controls in the EFT condition, while this did not happen in the Standard condition (as in Sellitto et al., 2010). One possibility is that vmPFC patients failed at integrating optimally the attributes of choice options with yet another aspect of the choice context, namely, the products of EFT. This interpretation is in line with the role of vmPFC in weighting multiple aspects of choice options (Pelletier and Fellows, 2019; Vaidya et al., 2018), and in synthetizing the emergent affective quality of a multi-element situation (Benoit et al., 2014). It will be important to confirm the unanticipated finding of an association between EFT cueing and inconsistent preferences in vmPFC patients, and to verify whether it extends to other patient populations, as this aspect of DD has not previously been explored (Kwan et al., 2015; Palombo et al., 2015).
We end by noting some limitations and future directions of our work. Although all 12 patients had lesions centered in the vmPFC, there was some heterogeneity in lesion location, with brain damage extending to the lateral prefrontal cortex in some cases. Our findings held when analyses were restricted to patients with lesions confined to the vmPFC, but future studies including more vmPFC patients, and a control group of brain-damaged patients, would help confirm the findings and possibly relate them to specific subregions within vmPFC.
In the present study, the order of task conditions was fixed, with the Standard condition always run first, serving as the baseline. Presenting the EFT condition first runs the risk of carryover effects of EFT into the Standard condition, leading to spurious DD baseline levels. This design has been used in previous studies of brain-damaged patients (Palombo et al., 2015; Kwan et al., 2015), and we deemed it even more suited in vmPFC patients who tend to perseverate. Although the repeated-measures design we chose raises the possibility of practice effects, studies have demonstrated the relative stability of individual discount rates over repeated testing (Ohmura et al., 2006; Harrison and McKay, 2012).
Finally, our interpretation of vmPFC patients’ preserved EFT effect as due to the external cueing of semantic structures driving EFT is speculative at this point. Indeed, this study does not provide direct insight into the type of future representations underlying the EFT effect on DD in vmPFC patients and in healthy controls. For example, although participants were instructed to take 10-15 seconds to think about a personal future event, we did not collect imagination times and thus do not know if patients differed from controls in this regard. We observed that some of the patients may have taken less time than controls to imagine the events, so it remains possible that the quality of EFT in response to the cues differed between groups. Yet, the EFT condition had an effect on DD in both groups. Therefore, the quality and quantity of future event details that are necessary and sufficient to influence DD in vmPFC patients and in healthy controls remain to be investigated. However, our interpretation is consistent with evidence that vmPFC patients produce few internal (episodic) details but a normal number of external (semantic) details during EFT tasks. It is also consistent with current models of vmPFC that postulate this structure is involved in the self-initiation of event construction (e.g., McCormick et al., 2018; Ciaramelli et al., 2019; Verfaellie et al., 2019). Further work should study EFT performance in vmPFC patients under conditions that (externally) promote the selection of self-relevant cues for EFT (as in the present study) vs. those that do not. In this respect, a study by Kurczek et al., 2015 is worth noting. Unlike previous studies of episodic remembering and EFT (e.g., Bertossi et al., 2016a; Bertossi et al., 2017), vmPFC patients were guided to choose themselves a specific moment from an extended past or future event to narrate in detail. Under these experimental procedures, vmPFC patients’ (re)constructed experience was as context-rich as that of controls, whereas that of MTLs patients remained impoverished nonetheless (Kurczek et al., 2015).
To conclude, the present findings reveal different mechanisms governing DD behavior and its flexibility, which differentially rely on vmPFC integrity. In addition, they may inform the clinical assessment and management of impulsivity in patients with vmPFC damage or dysfunction, delineating the boundary conditions for short-sighted choice to emerge, and the contextual manipulations that are or are not expected to push the reach of patients’ choice into the future.
Materials and methods
Participants
Twelve patients with lesions to vmPFC (8 males; mean age = 57.41 years, SD = 8.20, range = 49–76; mean education = 13.41 years, SD = 3.67; range = 8–20; see Table 1 for individual patients’ demographic and clinical data) and 41 healthy controls (35 males; mean age = 61.09 years, SD = 6.58, range = 49–78; mean education = 13.19 years, SD = 2.82, range = 8–20), matched to patients in age (t51 = 1.61; p = 0.11), education (t51 = −0.22; p = 0.82), and gender balance (χ2 = 2.12; p = 0.14), were recruited at the Centre for Studies and Research in Cognitive Neuroscience, Cesena, Italy, and at Baycrest Health Sciences, Toronto, Canada. Patients were selected on the basis of the location of their lesion evident on MRI or computerized tomography (CT) scans (see Figure 1) and were tested at least 12 months post-lesion (see Appendix 1 for additional information on patients’ recruitment). The lesions of vmPFC patients resulted from rupture of an aneurysm of the anterior communicating artery (in 11 cases) and from stroke of the anterior cerebral artery (in one case). Lesions were bilateral in 10 cases and left-lateralized in the remaining two cases. All participants were screened for any neurological or psychiatric diagnoses likely to affect cognition or interfere with participation. They gave informed consent to participate in the study, which was approved by the ethical committees of the University of Bologna, the Regional Health Service of Emilia Romagna, Baycrest Health Sciences, and York University, and in line with the Declaration of Helsinki (International Committee Of Medical Journal, 1991).
Lesion analysis
Request a detailed protocolIndividual vmPFC lesions were manually drawn by a highly trained neuroscientist directly on each slice of the normalized T1-weighted template MRI scan from the Montreal Neurological Institute using MRIcro software (Rorden and Brett, 2000), based on the most recent MRI or CT scan available. This manual procedure combines segmentation (identification of lesion boundaries) and registration (to a standard template) into a single step, with no additional transformation required (Kimberg et al., 2007). Included patients had lesions mainly affecting Brodmann areas (BAs) 10, 11, 32, 24, and 25, with the region of maximal overlap occurring in BAs 11 (M = 12.50 cc, SD = 10.79), 10 (M = 5.70 cc, SD = 6.46), and 32 (M = 3.71 cc, SD = 3.64) (Figure 1). Four patients had minimal damage to the lateral prefrontal cortex (BAs 9, 46, 47), but this constituted ~ 5% of their lesion volume, while their vmPFC lesions were on average 10 times larger. Two patients had damage to visual cortex (BAs 17, 18, 19, 37) that constituted ~ 41% and ~ 32% of their lesion volume. These patients did not have visual problems precluding their participation in the study. They attained normal scores on the copy of the Rey–Osterrieth Complex Figure (percentile scores: 66 and 68; Spreen and Strauss, 1998) and on the Wechsler Test of Adult Reading (percentile scores: 55 and 47; Holdnack, 2001), and proved able to inspect and comprehend a practice trial of the DD task.
Cognitive profile
Request a detailed protocolThe general cognitive functioning of vmPFC patients was preserved in all cases. Patients’ performance on standardized tests of executive function and short-term memory was also within the normal range in most cases (mean percentile > 5), whereas long-term memory, as assessed with a list-learning task, was weak in 7 of the 12 patients (see Table 1 for individual patients’ neuropsychological data). Moreover, most vmPFC patients showed deficits in episodic remembering and EFT, as assessed with the Galton–Crovitz cue-word test, a long-standing method for eliciting autobiographical memories (Crovitz and Schiffman, 1974), later adapted to the assessment of EFT (Addis et al., 2008; see Appendix 1 for a detailed description of testing procedures in Italy and in Canada). Table 2 reports the mean number of internal and external details for past and future events produced by vmPFC patients tested in Italy and in Canada and their controls. The results of the Italian patients (a subset of those included in Bertossi et al., 2016b) were contrasted with those of the 11 healthy controls from the same study (all males; Bertossi et al., 2016b), who were age-matched to the patients (vmPFC patients: M = 47.75, SD = 5.25; healthy controls: M = 41.63, SD = 11.89, t13 = −0.97, p = 0.34). The results of the Canadian patients (unpublished) were contrasted with those of 18 healthy controls (10 males; a subset of those included in Kwan et al., 2016) age-matched to the patients (vmPFC patients: M = 61.00, SD = 9.83; healthy controls: M = 67.94, SD = 13.57, t22 = 1.15, p = 0.26). As for the Italian sample, an ANOVA on the details produced with Group (vmPFC patients, healthy controls), Time (past, future), and Detail (internal, external) as factors showed a significant effect of Time (F1,13 = 14.66, p = 0.002, partial η2 = 0.53), such that all participants produced more details for past than future events (18.19 vs. 15.37). There were also significant effects of Group (F1,13 = 6.16, p = 0.02, partial η2 = 0.32) and Detail (F1,13 = 9.14, p = 0.009, partial η2 = 0.41), qualified by a Group × Detail interaction (F1,13 = 8.99, p = 0.01, partial η2 = 0.40). Post hoc Fisher tests showed that vmPFC patients produced fewer internal details (11.45 vs. 25.51; p = 0.004) but a similar number of external details than controls (11.39 vs. 11.96; p = 0.89). No other effect was significant (p > 0.31 in all cases). The same ANOVA on the Canadian sample revealed an effect of Group (F1,22 = 17.76, p = 0.0003, partial η2 = 0.44), qualified by a significant Group × Detail interaction (F1,22 = 4.72, p = 0.04, partial η2 = 0.18), again indicating that vmPFC patients produced fewer internal details (10.63 vs. 31.78; p = 0.0003) but a similar number of external details than controls (16.79 vs. 25.65; p = 0.09). No other effect was significant (p > 0.32 in all cases). These findings indicate that the previously reported vmPFC patients’ impairment in episodic remembering and EFT (Bertossi et al., 2016b; Bertossi et al., 2017; Verfaellie et al., 2019) also applies to the patients tested here.
DD task
Request a detailed protocolParticipants completed a DD task under Standard and EFT conditions. In the Standard condition, over a series of trials, participants viewed pairs of monetary amounts and were asked to make hypothetical choices between an immediate reward and a larger reward available after a delay. For each of two delayed amounts (small magnitude: €80/$100; large magnitude: €1500/$2000), participants were asked to make a block of six choices at each of seven delays (1 week, 1 month, 3 months, 6 months, 1 year, 3 years, and 10 years before receiving the reward), with the resulting 14 blocks pertaining to the different reward amounts and delays presented in random order. Thus, participants made 84 choices in total (2 reward amounts × 7 delays × 6 choices).
In each block, the first choice was between the future amount and half that amount to be received immediately. An iterative, adjusting-amount procedure was used in which the amount of the immediate reward was increased or decreased based on a participant’s previous choices, so as to converge on an estimate of the amount of immediate reward that was equivalent in subjective value to the delayed reward (see Kwan et al., 2015). The first adjustment was half of the difference between the immediate and delayed amounts presented on the first trial, with each subsequent adjustment being half of the preceding adjustment, rounded to the nearest €/$. For example, in the condition where a future reward of $2000 could be received in 3 years, the first choice presented to the participants was ‘$1000 right now or $2000 in 3 years’. If the participant chose ‘$2000 in 3 years’, the choice on the second trial would be between ‘$1500 right now’ and ‘$2000 in 3 years’. If the participant then chose ‘$1500 right now’, the choice on the third trial would be ‘$1250 right now or $2000 in 3 years’. Following the sixth and final trial, the subjective value of the delayed reward was estimated as the amount of the immediate reward that would be presented on a seventh trial. Participants were told that the task assessed preferences, therefore there were no correct or incorrect choices.
The DD task in the EFT condition proceeded as in the Standard condition (i.e., with 2 reward amounts × 7 delays × 6 choices), except that each block of choices was preceded by an EFT cue encouraging participants to imagine vividly a personal future event to occur at that delay (Figure 2). In a preliminary session, participants identified planned or plausible personal future events (e.g., appointments, anniversaries, outings) for each of the seven delays in the discounting task. To minimize the possibility of inducing distress, participants were encouraged to include only emotionally neutral or positive future events. If participants encountered difficulties providing an event, the experimenter probed with the following questions: ‘Might there be any events with family or friends that may take place in < delay >?” or ‘Is there something you could possibly see yourself doing in < delay > or want to do in < delay >?” vmPFC patients had greater difficulty generating events in comparison to controls, and, therefore, all participants were allowed to refer to personal calendars and electronic devices, or to consult with their significant others. Once participants had accessed the relevant event, they described it to the experimenter and labeled it with a short tag. These tags were used as future event cues in the EFT condition. During the cued DD task, upon viewing the EFT cue, participants were instructed to imagine the corresponding personal future event in as much detail as possible, and to press a button when they had had the event in mind for approximately 10–15 s. The button press triggered the decision-making screen, where participants completed intertemporal choices as in the Standard condition. The event cue remained at the top of the screen until the end of the delay block, to reduce demands on memory.
The Standard, uncued version of the task provided a baseline for measuring the effect of future cueing on DD and was run first. The EFT condition was run at least 1 month after the Standard condition. The experimental conditions were administered in this fashion to avoid carryover effects of the EFT condition, which would likely contaminate the baseline condition (for a similar approach, see Palombo et al., 2015; Kwan et al., 2015). A growing body of research indicates EFT is an effective strategy to reduce DD (reviewed in Rung and Madden, 2018; Bulley and Schacter, 2020), and, as such, it is expected to have carryover effects. Therefore, participants undergoing an EFT condition first might continue to engage in EFT while making choices in the following Standard condition, especially vmPFC patients who are subject to perseveration.
Assessment of DD rates
Request a detailed protocolPreliminary fits of the hyperbolic function SV = 1/(1+kD), with SV = subjective value (expressed as a fraction of the delayed amount) and D = delay (in days), to individual participants’ data using a nonlinear least-squares algorithm (implemented in Statistica Statsoft) revealed that subjective preferences were not equally well characterized by hyperbolic functions in the Standard and EFT conditions, especially in vmPFC patients, whose discounting curves in the EFT condition were not always monotonically decreasing (see Figure 3 and Figure 3—figure supplement 1). An ANOVA on R2 values with Group (vmPFC patients, healthy controls), Condition (Standard, EFT), and Reward magnitude (small, large) as factors confirmed a significant effect of Condition (F1,51 = 7.20, p = 0.009, partial η2 = 0.12) reflecting the fact that R2 values were lower in the EFT condition than in the Standard condition (0.54 vs. 0.64). The Group × Condition interaction, which just failed to reach statistical significance (F1,51 = 3.99, p = 0.050, partial η2 = 0.07), suggests that the effect of Condition was driven by vmPFC patients (healthy controls: 0.62 vs. 0.58; vmPFC patients: 0.72 vs. 0.41). No other effects were significant (all p’s > 0.09).
Given that subjective preferences were not equally well characterized by hyperbolic functions in the Standard and EFT conditions across groups, the degree to which participants discounted delayed rewards (DD rate) was quantified using the AuC, a measure of DD that does not depend on theoretical assumptions on the shape of the discounting curve (Myerson et al., 2001). Delays and subjective values were normalized. Each delay was expressed as a proportion of maximum delay (120 months) and subjective values were expressed as a proportion of the delayed values. The normalized delays were then plotted on the x axis and the normalized subjective values on the y axis as a function of delay to construct a discounting curve. Vertical lines were drawn from each x value to the curve, subdividing the AuC into a series of trapezoids. The area of each trapezoid was calculated as (x2− x1)(y1 + y2)/2, where x1 and x2 are successive delays, and y1 and y2 are the subjective values associated with those delays (Myerson et al., 2001). The AuC is the sum of the areas of all the trapezoids. The AuC varies between 0 (maximally steep discounting) and 1 (no discounting). The smaller the AuC, the steeper the DD, and the more participants were inclined to choose smaller-immediate rewards over larger-delayed rewards.
Statistical analyses
Request a detailed protocolMeasures of interest were entered in repeated-measures ANOVAs with Group (vmPFC patients, healthy controls) as the between-subject factor and Condition (Standard, EFT) and Reward magnitude (small, large) as within-subject factors (see Source data 1). Post hoc analyses were conducted with the Fisher test. We report results significant at p < 0.05, two-tailed, and partial η2 as measure of effect size.
Appendix 1
Materials and methods
Patient recruitment
Request a detailed protocolPatients were recruited at the Centre for Studies and Research in Cognitive Neuroscience, Cesena, Italy, and at Baycrest Health Sciences, Toronto, Canada, between 2015 and 2019. Patients with relatively restricted lesions to vmPFC are rare, and there are no previous studies on the effect of EFT cueing on DD in these patients. Thus, the number of participants was based on previous studies of DD in vmPFC patients (e.g., Sellitto et al., 2010: 7 vmPFC patients, 20 healthy controls; Peters and D'Esposito, 2016: 9 vmPFC patients, 19 healthy controls; Fellows and Farah, 2005: 12 vmPFC patients, 26 healthy controls). A somewhat larger N (= 41) for healthy participants was chosen based on previous behavioral findings where the influence of EFT on DD was found using a group of 30 healthy adults (Peters and Büchel, 2010).
One of the four Italian patients included in the study had participated in a previous study on uncued DD (Sellitto et al., 2010). All eight Canadian patients had taken part in study on DD and probability discounting (both without cues) conducted shortly before the present experiment (Mok et al., 2021), and their uncued DD data are included in the current Standard condition data. As for EFT, all Italian patients had participated in two EFT studies run between 2013 and 2015 (Bertossi et al., 2016b; Bertossi et al., 2017), whereas all Canadian patients were tested between 2015 and 2019, with results reported for the first time here (see Table 1 and Table 2).
Assessment of EFT
Request a detailed protocolThe Galton–Crovitz cue-word test is a long-standing method for eliciting autobiographical memories (Crovitz and Schiffman, 1974), later adapted to the assessment of EFT (Addis et al., 2008). The same general testing and scoring procedures for the cue-word test were followed in the Italian and Canadian laboratories, with minor differences. Participants were presented with cue words (9/6 cues per condition in Italy/Canada) and were asked to remember past personal events (up to 5 years ago) and to imagine future personal events (up to 5 years into the future). For ‘past’ trials, participants were asked to recall personally experienced events at specific times and places. For ‘future’ trials, participants were asked to imagine specific novel events that they might experience in the future. Remembered/imagined events were to last minutes or hours but not more than a day. Participants recounted the event they had in mind for 3/5 min (in Italy/Canada), followed by a general probe encouraging greater usage of details (‘Is there anything else you can remember/imagine?’). Narratives were scored using the Autobiographical Interview (see Levine et al., 2002; Addis et al., 2008): for each event, narratives were segmented into distinct details, which were categorized as either internal (referring to specific episodic information about the central event) or external (e.g., semantic information, information unrelated to the central event, metacognitive/editorializing statements). Internal and external details were tallied and averaged across trials.
Results
DD rates-control analysis on cultural effects
We tested whether there were cross-cultural differences in the EFT-driven modulation of DD. We repeated our main ANOVA on AuCs with Group (vmPFC patients, healthy controls), Condition (Standard, EFT), and Reward magnitude (small, large) as factors, this type considering Testing site (Italy, Canada) as an additional factor. We confirmed our findings, which held across different testing sites. Again, the ANOVA yielded a Reward magnitude effect (F1,49 = 12.93, p = 0.0007, partial η2 = 0.20) and a Group × Reward magnitude interaction (F1,49 = 7.97, p = 0.006, partial η2 = 0.13), indicating that controls (0.53 vs. 0.39; p = 0.001), but not vmPFC patients (0.37 vs. 0.35; p = 0.70), discounted large rewards less than small rewards. Moreover, there was a main effect of Condition (F1,49 = 45.84, p = 0.00001, partial η2 = 0.48), confirming reduced DD rates in the EFT compared to the Standard condition in both vmPFC patients and controls. The Group × Condition interaction was not significant (F1,49 = 1.44, p = 0.23, partial η2 = 0.03). There were no other significant effects (p > 0.11 in all cases) and, in particular, testing site had no effect and did not figure in any significant interaction (p > 0.14 in all cases).
Data availability
Data that support the findings of this study are available at https://doi.org/10.5061/dryad.w3r2280qf.
-
Dryad Digital RepositoryData from: The role of ventromedial prefrontal cortex in reward valuation and future thinking during intertemporal choice.https://doi.org/10.5061/dryad.w3r2280qf
References
-
Age-related changes in the episodic simulation of future eventsPsychological Science 19:33–41.https://doi.org/10.1111/j.1467-9280.2008.02043.x
-
Episodic future thinkingTrends in Cognitive Sciences 5:533–539.https://doi.org/10.1016/S1364-6613(00)01804-0
-
More is meaningful: the magnitude effect in intertemporal choice depends on Self-ControlPsychological Science 28:1443–1454.https://doi.org/10.1177/0956797617711455
-
The neural dynamics of novel scene imageryThe Journal of Neuroscience 39:4375–4386.https://doi.org/10.1523/JNEUROSCI.2497-18.2019
-
A neural mechanism mediating the impact of episodic prospection on farsighted decisionsJournal of Neuroscience 31:6771–6779.https://doi.org/10.1523/JNEUROSCI.6559-10.2011
-
Evolutionary economics of mental time travel?Trends in Cognitive Sciences 12:219–224.https://doi.org/10.1016/j.tics.2008.03.003
-
Deliberating trade-offs with the futureNature Human Behaviour 4:238–247.https://doi.org/10.1038/s41562-020-0834-9
-
The parietal cortex and episodic memory: an attentional accountNature Reviews Neuroscience 9:613–625.https://doi.org/10.1038/nrn2459
-
What "wins" in VMPFC: Scenes, situations, or schema?Neuroscience & Biobehavioral Reviews 100:208–210.https://doi.org/10.1016/j.neubiorev.2019.03.001
-
Frequency of episodic memories as a function of their ageBulletin of the Psychonomic Society 4:517–518.https://doi.org/10.3758/BF03334277
-
Zooming in and out on one's life: Autobiographical representations at multiple time scalesJournal of Cognitive Neuroscience 32:2037–2055.https://doi.org/10.1162/jocn_a_01556
-
Tracking the construction of episodic future thoughtsJournal of Experimental Psychology: General 140:258–271.https://doi.org/10.1037/a0022581
-
The regulation of cognitive control following rostral anterior cingulate cortex lesion in humansJournal of Cognitive Neuroscience 19:275–286.https://doi.org/10.1162/jocn.2007.19.2.275
-
Lateral prefrontal cortex and self-control in intertemporal choiceNature Neuroscience 13:538–539.https://doi.org/10.1038/nn.2516
-
Schema representation in patients with ventromedial PFC lesionsJournal of Neuroscience 34:12057–12070.https://doi.org/10.1523/JNEUROSCI.0740-14.2014
-
Rate of temporal discounting decreases with amount of rewardMemory & Cognition 25:715–723.https://doi.org/10.3758/BF03211314
-
A discounting framework for choice with delayed and probabilistic rewardsPsychological Bulletin 130:769–792.https://doi.org/10.1037/0033-2909.130.5.769
-
BookWechsler Test of Adult Reading: WTARSan Antonio: The Psychological Corporation.
-
Style matters: Uniform requirements for manuscripts submitted to biomedical journalsBMJ 302:338–341.
-
The Pivotal Role of Semantic Memory in Remembering the Past and Imagining the FutureFrontiers in Behavioral Neuroscience 7:1–11.https://doi.org/10.3389/fnbeh.2013.00027
-
An algorithm for identifying nonsystematic delay-discounting dataExperimental and Clinical Psychopharmacology 16:264–274.https://doi.org/10.1037/1064-1297.16.3.264
-
Power in Voxel-based lesion-symptom mappingJournal of Cognitive Neuroscience 19:1067–1080.https://doi.org/10.1162/jocn.2007.19.7.1067
-
Specific, personally meaningful cues can benefit episodic prospection in medial temporal lobe amnesiaBritish Journal of Clinical Psychology 55:137–153.https://doi.org/10.1111/bjc.12095
-
Aging and autobiographical memory: dissociating episodic from semantic retrievalPsychology and Aging 17:677–689.https://doi.org/10.1037/0882-7974.17.4.677
-
Episodic memory and beyond: the Hippocampus and neocortex in transformationAnnual Review of Psychology 67:105–134.https://doi.org/10.1146/annurev-psych-113011-143733
-
Area under the curve as a measure of discountingJournal of the Experimental Analysis of Behavior 76:235–243.https://doi.org/10.1901/jeab.2001.76-235
-
Three-month stability of delay and probability discounting measuresExperimental and Clinical Psychopharmacology 14:318–328.https://doi.org/10.1037/1064-1297.14.3.318
-
The neural mechanisms of inter-temporal decision-making: understanding variabilityTrends in Cognitive Sciences 15:227–239.https://doi.org/10.1016/j.tics.2011.03.002
-
Stereotaxic display of brain lesionsBehavioural Neurology 12:191–200.https://doi.org/10.1155/2000/421719
-
Separate neural pathways process different decision costsNature Neuroscience 9:1161–1168.https://doi.org/10.1038/nn1756
-
Experimental reductions of delay discounting and impulsive choice: A systematic review and meta-analysisJournal of Experimental Psychology: General 147:1349–1381.https://doi.org/10.1037/xge0000462
-
Myopic discounting of future rewards after medial orbitofrontal damage in humansJournal of Neuroscience 30:16429–16436.https://doi.org/10.1523/JNEUROSCI.2516-10.2010
-
Standardizzazione e taratura italiana di test neuropsicologiciItalian Journal of Neurological Sciences 8:1–120.
-
BookA Compendium of Neuropsychological Tests: Administration, Norms, and CommentaryOxford: Oxford University Press.
-
Mental time travel and the evolution of the human mindGenetic, Social, and General Psychology Monographs 123:133–167.
-
Bayesian inference for psychology. Part II: Example applications with JASPPsychonomic Bulletin & Review 25:58–76.https://doi.org/10.3758/s13423-017-1323-7
Article and author information
Author details
Funding
Ministry of Education, University and Research (20174TPEFJ)
- Elisa Ciaramelli
National Institute on Aging (R01AG058885)
- Leonard Green
- Joel Myerson
Canada First Research Excellence Fund (CFREF-2015-00013)
- Shayna Rosenbaum
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
The authors acknowledge the support of a Progetti di Rilevante Interesse Nazionale (PRIN) grant from the Italian Ministry of Education, University, and Research (#20174TPEFJ) to EC, a York Research Chair and the Canada First Research Excellence Fund to RSR (CFREF-2015-00013), and a grant from the National Institute on Aging of the National Institutes of Health (# R01AG058885) to LG and JM. The authors thank Jake Kurczek and Manuela Sellitto for their suggestions on the paper.
Ethics
Human subjects: Participants gave informed consent to participate in the study, which was approved by the ethical committees of the University of Bologna, the Regional Health Service of Emilia Romagna (#1586), Baycrest Health Sciences (#08-57), and York University, and in line with the Declaration of Helsinki (International Committee of Medical Journal Editors, 1991).
Copyright
© 2021, Ciaramelli et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,815
- views
-
- 213
- downloads
-
- 22
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
- Structural Biology and Molecular Biophysics
More than 20 recurrent missense gain-of-function (GOF) mutations have been identified in the sodium-activated potassium (KNa) channel gene KCNT1 in patients with severe developmental and epileptic encephalopathies (DEEs), most of which are resistant to current therapies. Defining the neuron types most vulnerable to KCNT1 GOF will advance our understanding of disease mechanisms and provide refined targets for precision therapy efforts. Here, we assessed the effects of heterozygous expression of a Kcnt1 GOF variant (Kcnt1Y777H) on KNa currents and neuronal physiology among cortical glutamatergic and GABAergic neurons in mice, including those expressing vasoactive intestinal polypeptide (VIP), somatostatin (SST), and parvalbumin (PV), to identify and model the pathogenic mechanisms of autosomal dominant KCNT1 GOF variants in DEEs. Although the Kcnt1Y777H variant had no effects on glutamatergic or VIP neuron function, it increased subthreshold KNa currents in both SST and PV neurons but with opposite effects on neuronal output; SST neurons became hypoexcitable with a higher rheobase current and lower action potential (AP) firing frequency, whereas PV neurons became hyperexcitable with a lower rheobase current and higher AP firing frequency. Further neurophysiological and computational modeling experiments showed that the differential effects of the Kcnt1Y777H variant on SST and PV neurons are not likely due to inherent differences in these neuron types, but to an increased persistent sodium current in PV, but not SST, neurons. The Kcnt1Y777H variant also increased excitatory input onto, and chemical and electrical synaptic connectivity between, SST neurons. Together, these data suggest differential pathogenic mechanisms, both direct and compensatory, contribute to disease phenotypes, and provide a salient example of how a pathogenic ion channel variant can cause opposite functional effects in closely related neuron subtypes due to interactions with other ionic conductances.
-
- Neuroscience
Errors in stimulus estimation reveal how stimulus representation changes during cognitive processes. Repulsive bias and minimum variance observed near cardinal axes are well-known error patterns typically associated with visual orientation perception. Recent experiments suggest that these errors continuously evolve during working memory, posing a challenge that neither static sensory models nor traditional memory models can address. Here, we demonstrate that these evolving errors, maintaining characteristic shapes, require network interaction between two distinct modules. Each module fulfills efficient sensory encoding and memory maintenance, which cannot be achieved simultaneously in a single-module network. The sensory module exhibits heterogeneous tuning with strong inhibitory modulation reflecting natural orientation statistics. While the memory module, operating alone, supports homogeneous representation via continuous attractor dynamics, the fully connected network forms discrete attractors with moderate drift speed and nonuniform diffusion processes. Together, our work underscores the significance of sensory-memory interaction in continuously shaping stimulus representation during working memory.