Abstract
Humans and animals can flexibly choose their actions based on different information, ranging from objective states of the environment (e.g., apples are bigger than cherries) to subjective preferences (e.g., cherries are tastier than apples). Whether the brain instantiates these different choices by recruiting either specialised or shared neural circuitry remains debated. Specifically, domain-general accounts of prefrontal cortex (PFC) function propose that prefrontal areas flexibly process either perceptual or value-based evidence depending on what is required for the present choice, whereas domain-specific theories posit that PFC sub-areas, such as the left superior frontal sulcus (SFS), selectively integrate evidence relevant for perceptual decisions. Here we comprehensively test the functional role of the left SFS for choices based on perceptual and value-based evidence, by combining fMRI with a behavioural paradigm, computational modelling, and transcranial magnetic stimulation. Confirming predictions by a sequential sampling model, we show that TMS-induced excitability reduction of the left SFS selectively changes the processing of decision-relevant perceptual information and associated neural processes. In contrast, value-based decision making and associated neural processes remain unaffected. This specificity of SFS function is evident at all levels of analysis (behavioural, computational, and neural, including functional connectivity), demonstrating that the left SFS causally contributes to evidence integration for perceptual but not value-based decisions.
Introduction
Humans and animals alike perform a mélange of goal-directed decisions that require the accumulation of different types of information. If the goal, for example, is to accurately determine whether an apple is bigger than a cherry (perceptual choice), the decision-maker accumulates size information of each fruit; or, the decision-maker may draw out information from personal taste profiles if the goal is to determine whether consuming a cherry over an apple maximises their subjective preferences (value-based choice). Previous studies have shown that different brain circuitries are recruited to accumulate evidence that would instantiate such distinct goal-directed decisions (Summerfield and Tsetsos, 2012; Polanía et al., 2014, 2015; Grueschow et al., 2015); thus, it remains debated to what degree certain decision-making processes share neural circuitry or whether these processes operate under specialised systems. However, prior studies were largely correlational (Heekeren et al. 2004, 2008; Polanía et al., 2014; Grueschow et al., 2015), and most causal studies were only limited to one type of choice (Philiastides et al., 2011; Rahnev et al., 2016) and performed in animals (Ding and Gold, 2012b; Erlich et al., 2015; Hanks et al., 2015).
In the absence of a comparison choice task, it is impossible to ascertain whether neural circuitry is domain-specific to a particular process, or domain-general that it may be involved across many types of choices. Very few studies (Polanía et al., 2014, 2015; Grueschow et al., 2015) have carefully matched perceptual and value-based decisions in terms of evidence strength, stimulus display, and response modality, and compare them through the lens of a common sequential-sampling framework of evidence accumulation (Dutilh and Rieskamp, 2016; Gold and Shadlen, 2007; Krajbich, 2019), which has long been applied to both perceptual (Ratcliff and Mckoon, 1988) as well as value-based (Busemeyer and Townsend, 1993; Usher and McClelland 2001) decisions. Such studies were able to identify common and specialised circuitries and mechanisms associated to perceptual or value-based decisions or both (Polanía et al., 2014; Grueschow et al., 2015).
But unless causality is established, it is even more difficult to attribute the circuitry’s role in evidence accumulation for one or several choice domains, or whether its involvement is peripheral and merely functionally supporting a larger system. Given task complexity, such studies of observing causal neural effects in healthy human populations using non-invasive brain stimulation are incredibly sparse. One previous study has, at least, shown that causally de-synchronising frontoparietal connectivity specifically increased choice variability during value-based choice, but had no effect on perceptual decisions (Polanía et al., 2015); thus, establishing the causal role of the frontoparietal network during value-based choice. But while indeed causal, the study was limited, relative to the standards of evidence in animal studies (Erlich et al., 2015; Hanks et al., 2015; Piet et al., 2017), since its results, as in many causal stimulation studies in humans (Philiastides et al., 2011; Rahnev et al., 2016), showed behavioural, but no neural effects. Furthermore, we only have evidence of a single dissociation that shows a causal stimulation effect specific to value-based, and not perceptual choice. What candidate region would show a causal effect that is specific to perceptual, not value-based decisions in a way that would demonstrate a double dissociation?
Seminal human imaging studies have repeatedly implicated the superior frontal sulcus (SFS), a posterior portion of the dorsolateral prefrontal cortex (dlPFC), during perceptual decision-making (Heekeren et al., 2004, 2008; Mulder et al., 2014). Moreover, disruption of human left SFS with non-invasive stimulation had impacted behavioural performance and response speed in a dynamic face-house classification task, in a manner consistent with reduction of evidence accumulation processes as defined in sequential sampling models (Philiastides et al., 2011). This has been taken as causal evidence that the left SFS supports perceptual evidence accumulation during decision-making. However, the domain-specificity of SFS contribution is unclear. Some studies have shown that dlPFC activity may reflect value-based evidence integration (Basten et al., 2010; Sokol-Hessner et al., 2012), suggesting the domain-generality of prefrontal function (Owen, 1997; Petrides, 2005). However, it is hard to directly compare the implicated neural processes to those that underlie perceptual decision-making processes, due to major differences in the stimuli and experimental approaches classically used in each domain (Gold and Shadlen, 2007; Heekeren et al., 2004), and that direct and principled comparisons with other decision-making domains, in general, are largely missing.
Here, we test the domain-specificity of the left SFS, and address the crucial double-dissociation gap in the literature by applying continuous theta-burst transcranial magnetic stimulation (cTBS) followed by functional magnetic resonance imaging (fMRI) while human participants alternated between matched perceptual and value-based choices (Polanía et al., 2014, 2015). We modelled the observed behavioural changes with the DDM, allowing us to causally associate the stimulated SFS region to specific underlying latent subprocesses of the unfolding decision (Mulder et al., 2014; Polania et al., 2015) as well as BOLD activation. Thus, this common evidence accumulation framework provides us with clear testable hypotheses regarding possible effect patterns across behavioural, computational, and neural levels.
Results
The experiment
We recorded functional magnetic resonance imaging (fMRI) data from hungry, healthy participants (n = 20) performing perceptual- and value-based choice-tasks in alternation (Methods and Fig. 1b). For perceptual decisions, participants chose the larger food item, while for value-based decisions, participants chose the food item that they would preferably receive and consume by the end of the experiment. The stimuli and motor responses were identical for both tasks, as in previous experiments (Polanía et al., 2014, 2015). Choice pairings were predetermined based on participant’s individual subjective perceptual- and value-based ratings of the food items, obtained just prior to the scanning session. Perceptual evidence was defined as the size difference (SD) between the food items, whereas value evidence was defined as the difference in value ratings (VD) between the choice alternatives (see Methods and Fig. 1b). A choice was classified as correct when it was consistent with the previously acquired ratings regarding size and preference respectively, i.e., when the larger-rated item was chosen for perceptual decisions or the higher-valued item was chosen for value-based decisions (Polanía et al., 2014, 2015). Our sample size is well within acceptable range, similar to that of previous TMS studies (Philiastides et al., 2011; Rahnev et al., 2016; Jackson et al., 2021; van der Plas et al., 2021; Murd et al., 2021).
Our experiment was divided into pre- and post-stimulation blocks. After participants had performed four pre-stimulation session-blocks inside the scanner, they received continuous theta burst stimulation (cTBS) (Huang et al., 2005; Di Lazzaro et al., 2005, 2008) over the left SFS (MNI coordinates, x = −24, y = 24, z = 36; Heekeren et al., 2004; Philiastides et al., 2011; Grueschow et al., 2018). Following this intervention, participants completed four post-stimulation fMRI blocks. By comparing the effects of stimulation on both types of behaviour and brain activity between post- and pre-stimulation blocks, we identify the role of SFS for either type of decision making. In particular, we examined whether the SFS is indeed selectively involved in perceptual decisions as previously suggested (Heekeren et al., 2004, 2006; Rahnev et al., 2016; Philiastides et al., 2011).
Study hypotheses
Previous studies have identified the causal mechanistic role of the SFS in evidence accumulation during perceptual decision-making (Heekeren et al., 2004, 2006; Rahnev et al., 2016), and its effect on stimulation may arise from one of either two channels. That is, one study reported that SFS disruption during a speeded perceptual categorisation task reduced accuracy and increased response times (Philiastides et al., 2011) and found associated decreases in drift rate, the DDM parameter describing the efficiency of sensory evidence integration. In contrast, another human brain stimulation study suggested that behavioural changes due to SFS disruption during a perceptual two-alternative-forced-choice (2AFC) task reflect decreased in the decision threshold, characterised by faster response speed but decreased choice precision. Simulations with the same DDM modelling framework (Rahnev et al., 2016) suggested that the decision threshold parameter could account for individual behavioural changes. Simultaneously acquired fMRI data suggested that SFS does not code the rate of integration but rather the necessary amount of evidence to be accumulated for the perceptual choice at hand (Rahnev et al., 2016).
To this end, we hypothesise that if SFS neurons indeed selectively accumulate perceptual evidence, we should find that their inhibition by cTBS leads to decreases in choice precision and increases in reaction times, a behavioural pattern that corresponds to a decrease in the DDM drift-rate parameter, and to concurrent increases in BOLD signals (caused by prolonged neural evidence accumulation; Fig 2a-c). Critically, a different pattern can be expected when SFS neurons are involved in setting the criterion, i.e., determining the amount of evidence that needs to be accumulated for a perceptual choice to be taken. In this case, SFS inhibition should result in decreases in both choice precision and reaction times, a decrease in the DDM boundary parameter (Rahnev et al., 2016), and a reduction in associated neural activity due to the lower amount of evidence accumulated during the shorter response time (Fig. 2d-f). Here we directly test these two contrasting scenarios, by characterising the behavioural, neural, and neuro-computational consequences of cTBS to the left superior frontal sulcus (SFS). Crucially, we also investigate for both possible outcomes whether the functional contribution of the SFS during decision making is indeed specific for perceptual choices, by comparing the results between the two matched types of choices.
Behaviour: validity of task-relevant pre-requisites
Before scrutinising the role of the left SFS for either type of choice, we first behaviourally and neurally confirmed the validity of our task paradigm. To establish a fair comparison between perceptual (PDM) and value-based decision-making (VDM), we must necessarily show that we can distinctly identify the brain regions associated for each type of choice, and that behaviour is systematically a function of their respective evidence measures. Initial visual inspection show that choice accuracy/consistency systematically increases (Fig. 2a) and RTs become faster (Fig. 2b) the larger the evidence difference, and this holds across tasks and stimulation conditions. Behavioural regressions confirmed that our task design allowed for a clear computational separation of both choice types: during perceptual decisions, participants relied exclusively on perceptual evidence, as reflected in both increased choice accuracy (main effect SD, β = 0.560, p < 0.001 and VD, β = 0.023, p = 0.178; Fig. 1c) and faster reaction times (RTs) with larger perceptual evidence, but not value-based evidence (main effect SD, β = −0.057, p < 0.001 and VD, β = −0.002, p = 0.281; Fig. 1c). Conversely, participants relied only on value evidence during VDM, as evident from both choice consistency (main effect VD, β = 0.245, p < 0.001 and SD, β = −0.254, p = 0.123; Fig. 1c) and RTs (main effect VD, β = −0.016, p = 0.011 and SD, β = −0.003, p = 0.419; Fig. 1c) irrespective of the items’ size difference. Thus, our results replicate previous findings obtained with a similar paradigm (Polanía et al., 2014, 2015; Grueschow et al., 2015) that participants can use exclusively task-relevant evidence to make choices, and they confirm the suitability of our paradigm for directly comparing perceptual and value-based decisions with matched stimuli and motor responses.
In line with the behavioural results that participants depended on different evidence for the two types of choices, initial fMRI analysis revealed that neural activations strongly differed between choice types (despite the fact that participants saw the same images and gave the same motor responses). We found that while visual and motor areas were jointly activated for both types of choices (p < 0.05, FWE-corrected with cluster forming thresholds at T(19) > 2.9; Supplementary Fig 1a. and Supplementary Table 1), PDM led to stronger recruitment of the posterior parietal cortex whereas VDM led to stronger activations of the medial prefrontal cortex and posterior cingulate cortex (Supplementary Fig 1b. and Supplementary Table 2), all in line with previous findings (Grueschow et al., 2015). Thus, these choice-type-specific brain activations, in response to identical visual input and motor output, ascertain that participants recruit task-specific brain regions depending on the choice domain.
Behaviour: theta-burst stimulation reduces choice accuracy for perceptual decisions only
Our results support the hypothesis that the SFS has a specific role for perceptual decision-making, on several experimental levels. Behaviourally, we found that SFS-cTBS led to a significant decrease from pre- to post-cTBS blocks in accuracy for PDM (main stimulation effect, β = −0.465 ± 0.342, p = 0.008; Fig. 3a and Supplementary Fig. 2a), while VDM choice consistency remained unaffected by SFS stimulation (β = −0.042 ± 0.205, p = 0.691; Fig. 3a and Supplementary Fig. 2a). These differences were significant in direct comparison (stimulation × task interaction, β = −0.094 ± 0.087, p = 0.034; Fig. 3a; Supplementary Fig. 2c and Supplementary Table 2). We rule out fatigue or habituation effects after checking that the average accuracies in PDM were actually recovering in the second post-stimulation session while there was no change in choice consistency at all during VDM (Supplementary Fig. 2a). Interestingly, SFS-cTBS had comparable effects on reaction times in both tasks: faster RTs were observed after SFS-cTBS for both PDM (main stimulation effect, β = −0.116 ± 0.067, p = 0.003; Fig. 3b and Supplementary Fig. 2b) and VDM (main stimulation effect, β = −0.125 ± 0.063, p = 0.001; Fig. 3b and Supplementary Fig. 2b), with no significant difference between these two effects (stimulation × task interaction, β = 0.009 ± 0.069, p = 0.795; Fig. 3b; Supplementary Fig. 2c and Supplementary Table 2). Overall, the specific changes in choice accuracy indeed reflect cTBS disruption in left SFS in perceptual decisions. At the same time, the common changes in RTs from the first to the second half of the experiment may not necessarily reflect TMS-related changes in SFS function but rather general training effects common to both tasks (Mawase et al., 2018), but this possibility can only be examined in more detail with computational modelling.
Modelling: SFS-TMS reduces decision boundary only for perceptual decisions
To examine in detail which specific latent decision process was affected by SFS-cTBS, we fit the hierarchical drift diffusion model (HDDM) simultaneously to the accuracy and RT data of our participants. This canonical model of choices allowed us to identify and disentangle the effect of stimulation on various latent variables representing distinct components of the choice mechanism (Ratcliff and Smith, 2004; Ratcliff and McKoon, 2008; Polania et al., 2015; Supplementary Fig. 3 and see Methods). A specific focus of this analysis was on whether SFS-cTBS would change the way participants set the choice criterion (decision threshold; Rahnev et al., 2016; Bogacz et al., 2010; Domenech and Dreher, 2010; Herz et al., 2016) or the efficiency with which choice-relevant evidence is accumulated (drift-rate, Philiastides et al., 2011; Basten et al., 2010) (see Methods for more details and Figure 1b,e).
Our results are consistent with a causal role for the left SFS in setting the decision threshold of perceptual choices: for PDM, our computational analysis reveals a significant post-cTBS decrease in boundary (see Methods; pmcmc = 0.003; Fig. 3c and Supplementary Fig. 5a) but no such effect for any of the other parameters (pmcmc = 0.822 for drift rate; Fig 3d and Supplementary Fig. 5b,c). For VDM, by contrast, no effect of cTBS was observed for either of the two decision-relevant parameters (pmcmc = 0.115 for boundary and pmcmc = 0.758 for drift rate; Fig. 3c,d and Supplementary Fig. 5a,b,c), supporting the specificity of the SFS involvement in perceptual decisions. This conclusion was further corroborated by direct comparison of these effects, which showed that SFS-cTBS had a significantly stronger impact on the boundary parameter for PDM compared to VDM (stimulation × task interaction for the decision threshold, pmcmc = 0.045; Supplementary Fig. 5a; there were no such differences for drift-rate; pmcmc = 0.685; Supplementary Fig. 5b).
Modelling: faster RTs during value-based decisions is related to non-decision-related sensorimotor processes
To address the underlying latent process driving RT effects in both choices, we examined other DDM parameters and measurements. The DDM assumes that RTs can be disentangled into a non-decision-related (nDT) component as well as decision times (DT). The nDT is a DDM parameter that indexes constant latencies associated with sensory and motor preparation processes that are invariant across trials with different choice evidence (Verdonck and Tuerlinckx, 2016; Starns and Ma, 2018); in other words, this parameter forms no part of the evidence accumulation process (Feltgen and Daunizeau, 2020; White et al., 2018) and may therefore reflect task learning processes (Mawase et al., 2018). In contrast, decision times is the component of RT where evidence accumulation actually takes place, and we can measure and derive DT using the evidence-dependent DDM parameters (see Methods for more details).
Our results showed that the faster RTs observed for value-based decisions after the stimulation indeed did not reflect evidence-dependent choice processes, but rather a change in non-decision-related sensorimotor processes (nDT) (see Methods; Supplementary Fig. 3): this parameter was decreased after stimulation for VDM (pMCMC = 0.062) but not PDM (pmcmc = 0.707) (Supplementary Fig. 4b and 5c), with a significant difference between these effects (pmcmc= 0.041; Supplementary Fig. 5c). In contrast, estimated decision times was smaller after stimulation during PDM (pmcmc = 0.003; Supplementary Fig. 6a, left), but not VDM (pmcmc = 0.100; Supplementary Fig. 6a, right). Taken together, these results suggest that the simultaneous change in RT reveal completely different computational processes, whereby faster RTs during value-based choice is simply a by-product of task-related learning that may perhaps be unrelated to stimulation, while faster RTs during perceptual choice is actually related to decision-relevant, evidence-dependent latent choice processes. However, completely ascertaining whether such effect from stimulation is due to SFS inhibition, we need clear causal evidence of changes from neural processing.
fMRI: SFS activation changes for perceptual choices in line with model predictions
To investigate whether our behavioural and computational results directly relate to task-specific disruption of neural activity in left SFS, we investigated BOLD response changes in this brain area after stimulation. We exploited the fact that our fitted DDM and its latent parameters make clear predictions about how BOLD responses in this area should change if the stimulation affects the neural computations involved in setting the boundary for the necessary amount of evidence accumulation. Importantly, these predictions translate to clear parametric regressors that we can use for trialwise analysis of fMRI data (Basten et al., 2010; Domenech et al., 2017; Liu and Pleskac, 2011). More specifically, we expected that the BOLD signal level is proportional to the DDM’s accumulated evidence (aE), defined as the area below the modelled evidence accumulation curve up until the accumulator reaches the decision boundary (Liu and Pleskac, 2011; Domenech et al., 2017; Basten et al., 2010). Using subject-wise DDM latent parameters, the average area below the decision boundary for each evidence level can be computed as a function of each participant’s decision boundary divided by the mean drift rate (see Fig. 1c and 1f and Methods for more details). Using the more detailed trialwise measures, however, the same area can be computed as a function of each trial’s RTs divided by the evidence level, since according to the DDM, the duration of response times is directly proportional to the decision boundary, and the evidence level is directly proportional to the slope of the drift rate (Ratcliff and Rouder, 1998; Ratcliff and McKoon, 2008; see Methods for more details). Exploiting these two known facts from the DDM thus allows us to extend our test of the stimulation effect from individual-specific latent parameters to trialwise regressors and behavioural measures. Higher SFS BOLD signals are associated with higher aE and vice versa (Basten et al., 2010; Liu and Pleskac, 2011; Filimon et al, 2013; Tosoni et al., 2008), implying that a TMS intervention lowering the decision boundary should lower aE and therefore BOLD signals. Crucially, these latent changes predicted by the DDM should also be reflected in the subject-level simulations of accumulated evidence constructed from the DDM parameters.
Thus, we first tested whether our neural hypotheses would already be evident in the simulated trial-wise aE regressors. We used individual parameters identified by fitting our computational framework to simulate expected neural activity on a trial-wise basis across participants. To this end, we derived the predicted aE from the model parameters for each participant. A comparison across cTBS and task conditions confirmed the predicted cTBS-related decrease in accumulated perceptual evidence for PDM (pmcmc = 0.003; Fig. 4a and Supplementary Fig. 6b), the corresponding null effect for VDM (pmcmc = 0.100; Fig. 4b and Supplementary Fig. 6b), and a significant difference for this effect between both choice types (one-sided pmcmc = 0.048; Supplementary Fig. 6b).
In the next step, we used the trial-by-trial accumulated evidence as a regressor in the statistical analysis of the BOLD signals, allowing us to test whether the left SFS shows the predicted changes in neural response to varying levels of perceptual evidence. First, we tested whether our predictor of neural accumulated evidence was represented in BOLD signals of similar task-specific areas as reported previously for PDM in SFS (Heekeren et al., 2004, 2006) and for VDM in vmPFC (De Martino et al, 2013; Grueschow et al., 2015). This was confirmed by the data: During PDM, trialwise aE correlated with BOLD activity in the left SFS (peak at x = −21, y = 26, z = 37; SVC < 0.05; Supplementary Fig. 7b and Supplementary Table 3) whereas during VDM, it related to BOLD activity in the ventromedial prefrontal cortex (vmPFC) (peak at x = 3, y = 38, z = −17; SVC < 0.05; Supplementary Fig. 7e) and the nucleus accumbens (peak at x = 9, y = 11, z = −11; p < 0.05, FWE-corrected with cluster-forming thresholds at T(19) > 2.9; Supplementary Fig. 7e). For both types of choices, domain-general representations of aE were also evident (see Supplementary Fig. 7 and Supplementary Table 3).
We then tested whether the cTBS specifically reduced the neural representation of accumulated perceptual evidence in the left SFS for PDM, as predicted by the behavioural and modelling results. In line with these predictions, comparison of the post − pre trial-aE regressor showed a lower BOLD response in left SFS to the trialwise perceptual evidence during PDM (SVC < 0.05; Fig. 4c, green patch). This effect was significantly stronger than the corresponding effect on evidence representations in this area during VDM (SVC < 0.05; Fig. 4c, blue patch). No effect was found for VDM alone. Convergent evidence for the specificity of this effect was provided by an alternative hypothesis-guided region-of-interest (ROI) analysis of the regression weights extracted from an a priori ROI-mask of the SFS (see Methods). This showed lower post-stimulation beta values for the trial-aE regressor during PDM (main stimulation effect, β = −0.153 ± 0.054, p = 0.004; Fig. 4a) but not VDM (main stimulation effect, β = 0.078 ± 0.053, p = 0.140; Fig. 4b) and a significant difference in these effects (stimulation × task interaction, β = −0.232 ± 0.075, p = 0.002; Fig, 4a,b). Thus, the fMRI results show that cTBS of the left SFS indeed affects neural processing in this brain structure selectively during perceptual choices, in a way that is consistent with a lowering of the boundary and less accumulated evidence as predicted by the fitted DDM model. This remarkable convergence between the behavioural, modelling, and fMRI results suggests that the left SFS is indeed causally involved in setting decision criteria for choices based on perceptual evidence, but not based on subjective values.
fMRI and modelling: neural-HDDM shows that perceptual-choice accuracy and boundary setting reflect trial-by-trial changes in SFS activity
If perceptual-decision performance depends specifically on activity in the left SFS, then trial-wise choice accuracy should relate to trial-wise BOLD activity in the SFS during perceptual decisions, over and above the mean effects of evidence level. To test this, we regressed choice accuracy/consistency on trial-by-trial BOLD activity extracted from the left SFS ROI, choice type, and TMS, while controlling for the evidence provided by the stimulus pairs on each trial (see Methods for details). In line with our prediction, we observed that the relation between perceptual-choice accuracy and trial-by-trial SFS activity was significantly decreased by TMS (SFS × stimulation interaction, β = −0.196 ± 0.128, p = 0.003; Fig 4d), independently of the corresponding effects for choice evidence (SD main effect, β = 0.524 ± 0.082, p < 0.001, VD main effect, β = 0.197 ± 0.012, p = 0.001, SFS × SD interaction, β = −0.041 ± 0.046, p = 0.365, SFS × VD interaction, β = 0.055 ± 0.041, p = 0.183). This effect was clearly specific for PDM, since no such effects were observed for VDM (SFS × stimulation interaction β = 0.099 ± 0.242, p = 0.422; SFS × stimulation × task interaction, β = −0.072 ± 0.051, p = 0.005; Fig 4d) and for RTs during both types of choices (SFS × stimulation interaction, perceptual: β = −0.031 ± 0.053, p = 0.367; Fig 4d; accuracy: SFS × stimulation interaction, β = −0.012 ± 0.050, p = 0.650; Fig 4d).
We further investigated whether the relation between trialwise SFS activity and choice outcome indeed reflected an SFS role for perceptual boundary setting, as suggested by the DDM results presented above. To confirm this neurally, we set up several DDMs with trialwise SFS activity as an additional modulator for DDM parameters (on top of choice evidence; see methods and Herz et al., 2016, 2017; Turner et al., 2015). More specifically, we tested several neural-DDMs in which trialwise SFS activity either modulated the decision threshold only (Model 1; Supplementary Fig. 8a), the drift rate only (Model 2; Supplementary Fig. 8b), or both parameters separately (Model 3; Supplementary Fig. 8c) or jointly (Model 4; Supplementary Fig. 8d). We compared these neural HDDMs to our baseline HDDM without neural inputs (see Methods for more details and Supplementary Fig. 3), allowing us to test across all conditions and choice types whether model evidence was enhanced when adding a potential trial-by-trial influences of SFS activity to the experimental inputs. Thus, the reported model evidence criterion (DIC) provides an additional formal test of whether the cTBS-influenced SFS activity relates selectively to the decrease of the decision boundary for perceptual choices only. Consistent with this prediction, Model 1 where SFS activity modulated the decision threshold only, outperformed all other models and model evidence showed improvements versus the baseline model (relative DIC = −28.65; Fig. 4b). These results provide direct evidence that neural computations in the left SFS support criterion setting for perceptual evidence accumulation.
fMRI and connectivity: TMS affects SFS functional connectivity during perceptual choices
Overall, our results clearly indicate that cTBS to the left SFS disrupts selectively a neural process related to setting the criterion for perceptual evidence accumulation. At this point, we consider the possibility that cTBS may conceivably change the functional communication of the SFS with other brain areas involved in initial processing of the perceptual information necessary to make a choice. We explored this possibility by investigating whether cTBS affected functional coupling of the SFS. A psychophysiological interaction (PPI) analysis seeded in left SFS and modulated by aE indeed revealed stronger coupling with occipital cortex (OCC) after cTBS (peak at x = −28, y = −85, z = −2; p < 0.05, FWE-cluster-forming thresholds at T(19) > 2.9; Fig. 5a). Interestingly, the activity peak in visual cortex showing evidence-dependent coupling with SFS, overlaps with the spatiotopic neural representation of the stimulus items in the visual field during decision making. We identified this overlap using a conjunction analysis of the PPI result and a contrast regressing BOLD signal on trial-by-trial stimulus onsets of both choice types (at familywise-error-corrected thresholds). Moreover, we used the latter contrast to define fully independent regions-of-interest (ROIs) in occipital cortex processing the visual stimuli independent of task type and performed an ROI analysis on the individual SFS-OCC-PPI betas extracted for each participant. This confirmed that evidence-related functional coupling is increased by stimulation during PDM (main stimulation effect, β = 0.330 ± 0.284, p = 0.022) but not VDM (main stimulation effect, β = −0.186 ± 0.247, p = 0.139; Fig. 5b; stimulation × task interaction, β = 0.517 ± 0.44, p = 0.021; Fig. 5a). Thus, our exploratory analysis shows that cTBS to the left SFS leads to stronger functional coupling with occipital areas involved in processing the visual stimuli, perhaps consistent with increased downstream demand on visual-related resources when upstream evidence accumulation regions are impaired.
We further explored whether this TMS-induced increase in functional coupling between the left SFS and OCC is related to changes in behaviour and specific neural computations during perceptual decisions. To test this, we related these effects to individual measures of choice behaviour and latent DDM parameters for each participant. This revealed that stimulation-induced increases in SFS-OCC coupling were associated with lower accuracy (OCC × stimulation × task interaction, β = −0.225 ± 0.142, p = 0.002; Fig. 5c) and shorter RTs (OCC × stimulation × task interaction, β = −0.325 ± 0.238, p = 0.007; Fig. 5c) for PDM, but not VDM. Taken together, these results show that the causal behavioural and computational changes during perceptual decision-making due to left SFS-TMS may relate not just to local neural changes in SFS, but also to the way this brain structure communicates with visual cortex.
Discussion
Our study shows that the left SFS serves a domain-specific causal role in the accumulation of perceptual evidence, and particularly, the underlying computations affected by non-invasive brain stimulation is the setting of the choice criterion during perceptual, but not value-based choice. Our findings, in a way, contribute in closing the double dissociation gap left by previous work (Polanía et al., 2015), where it was shown that frontoparietal connectivity is causally specific to the precision of value-based, not perceptual choice using the same matched perceptual- and value-based choice task. More importantly, our study provided results above and beyond current standards of causal studies in humans (Philiastides et al., 2011; Rahnev et al., 2016; Polanía et al., 2015; Murd et al., 2020), that was only observed in animal studies (Ding and Gold, 2012b; Erlich et al., 2015; Hanks et al., 2015). Here, we simultaneously showed that causal TMS effects affected behaviour, latent computations, and more crucially, neural circuitry, as observed by changes in fMRI-BOLD activation after stimulation.
Many human decision neuroscience studies have employed model-based approaches to identify BOLD signals that correspond to computational processes (Forstmann et al., 2011; Palmeri et al., 2017; Wijeakumar et al., 2017). However, the links between neural and latent computational processing established by these studies is largely correlational (Logothetis, 2008; Poldrack, 2006; Ramsey et al., 2010), and there are many model alternatives that could possibly account for BOLD signals. Our study illustrates that causal manipulations induced by targeted functional inhibition of brain areas can provide decisive information and provide more direct support for neurocomputational mechanisms posited by cognitive models. Specifically, our study underlines that the DDM provides a plausible mechanistic account of the decision process (Herz et al., 2016, 2017; Turner et al., 2015), by showing that left SFS inhibition by cTBS affects the evidence representation posited by the model consistently across behavioural, computational, neural, neural-behavioural levels. Importantly, our results directly link changes in behaviour to changes in both latent computations and neural processing, by demonstrating how raw trialwise neural signals from the left SFS can augment the DDM to explain behaviour. This suggests that once brain stimulation studies have established (causal) correspondence between neural activity and latent variables in decision models, such models can be fruitfully extended by neural measures to provide a more complete characterisation and prediction of choice behaviour and potentially its malfunctions.
Specificity of the SFS during perceptual decisions – only in humans?
To this end, our study reinforces already established findings by showing that the causal role of SFS during perceptual decisions (Heekeren et al., 2004, 2006; Philiastides et al., 2011; Rahnev et al., 2016) is a specialised function of evidence integration. Furthermore, our finding of a selective role of left SFS in perceptual evidence accumulation is particularly intriguing. The area appears to be uniquely developed in the human brain, with no close anatomical homologue in other species. In the animal literature, most prefrontal disruption studies in non-human primates have focused on the frontal eye fields (FEF) (Ding and Gold, 2012a; Hanks and Summerfield, 2017; Shadlen and Newsome, 1996) and in rodents on the frontal orienting fields (FOF) (Erlich et al., 2015; Hanks et al., 2015). While we and others observed disruption of the evidence accumulation process after interfering with SFS function in humans (Philiastides et al., 2011; Rahnev et al., 2016), disruption of the FOF in rodents has not affected behaviour at all or in a qualitatively different manner (Brody and Hanks, 2016; Erlich et al., 2015; Hanks et al., 2015). However, the results of electrical stimulation of the FEF in monkeys (Ding and Gold, 2012a; Hanks and Summerfield, 2017) cannot necessarily be directly compared with TMS studies of human SFS, since FEF and SFS in humans are both structurally and functionally distinct (Murd et al., 2020; Rahnev et al., 2016). Thus, while it is tempting to speculate that the SFS perceptual evidence accumulation process identified here may be specific to humans, it is possible that researchers may have to further consider other putative homologues across species that may truly correspond to the SFS area stimulated here (Brunton et al., 2013; Hanks and Summerfield, 2017).
Do value-based decisions also rely on distinct PFC areas?
At the same time, our findings do not rule out the possibility of SFS involvement during value-based choice, where it may perhaps have a secondary function (but one that does not involve evidence accumulation) or even other specialised functions in decision-making. For example, previous work has suggested that during value-based decisions, the dlPFC overall interacts with the vmPFC in modulating the value signal to facilitate self-control (Hare et al., 2009). Moreover, value-based decision-making entails a large array of choice types with varying degrees of complexity. For instance, more complex types of value-based decisions entail decisions under risk (Glickman et al., 2019), intertemporal choice (Peters and D’Esposito, 2020), and strategic and social decisions (Hutcherson et al., 2015), which may plausibly recruit the PFC due to working memory demands (Barbey et al., 2013), adjustment of decision time (Sokol-Hessner et al., 2012), or cost-benefit computations (Basten et al., 2010). In light of these many additional decision types based on preferences in the value-based choice domain, the functional specificity of SFS to perceptual decisions we claim here may have to be viewed with caution. Future studies should consider exploring the comparison between more complex types of value-based decisions with perceptual decisions, while taking great care in matching the degree of complexity between the two choice domains to avoid confounds induced by context or task difficulty.
The role of SFS in choice criterion setting during perceptual decisions
That being said, the same holds true with the varying degrees of complexity across perceptual decision-making processes. Our findings show that the mechanism of which the left SFS is causally involved is modulating the decision threshold, with clearly consistent results across behavioural, computational, neural, and neural-behavioural levels. Our findings are more in line with that of Rahnev et al. (2016), who also suggested that SFS disruption leads to lower threshold setting. In contrast, previous work has also shown that SFS activity correlates with the evidence strength in the accumulation process, as reflected by the drift rate (Basten et al., 2010; Heekeren et al., 2004, 2006). In support of this notion, cortical activity disruption with repetitive transcranial magnitude stimulation (rTMS) resulted in lower choice accuracy and slower RTs (Philiastides et al., 2011). However, it is important to note that these results are not at all incompatible, but reflect the interlinked computational mechanisms of the SFS in perceptual evidence accumulation. All these studies, including ours, point out that the DDM’s drift rate and decision boundary are both decision-relevant latent mechanisms with distinct as well as overlapping implications on choice behaviour: impairments in both boundary and drift lead to lower choice consistency (Cavanagh et al., 2011; Green et al., 2012; Herz et al., 2016; Philiastides et al., 2011; Rahnev et al., 2016). The main difference in fact concerns reaction times: lower drift rate implies slower RTs while a lower boundary implies faster RTs. One may speculate that the difference in RT-TMS effects of our study and that of Philiastides et al. (2011) may simply reveal the differences in task design and the nature of the stimuli, such that SFS flexibly requires specialised computational features to accumulate evidence. For instance, the study by Philiastides et al. (2016) had dynamic series of briefly presented sequential face-house stimuli, varying the strength of each stimulus within noise to vary the evidence levels. By contrast, our study and that by Rahnev et al. (2016) presented a static stimulus pair simultaneously during a 2AFC task and varied evidence not with noise but by stimulus difference.
We speculate that the goals of these tasks (i.e., discriminability from noisy dynamic stimuli versus stimulus size difference between static stimuli) may sensitively affect different latent processes. Previous studies have shown that different tasks can produce proximally similar behaviour but may involve different goal functions and therefore, computationally distinct processes (Heng et al., 2020). For instance, noisy dynamic stimuli entail the accumulation of sensory evidence until the decision-maker can form representations suitable for choice discrimination (Ratcliff and McKoon, 2008); thus, such stimuli are sensitively modulated by evidence strength, and reflected by a lower drift-rate when SFS is impaired (Philiastides et al., 2011) and where consequently, the circuitry takes more time to form perceptual representations. In contrast, evidence in the form of size difference may depend on the sensitivity to which SFS can detect the difference, and this is modulated by the decision threshold (Herz et al., 2016; Cavanagh et al., 2011; Green et al., 2012, 2013). Here, SFS impairment to accumulate evidence in the context of static, simultaneously presented stimuli may result in the inability of the circuitry to reliably discriminate size differences, resulting in the early termination of the accumulation process, which is behaviourally reflected as lower choice accuracy and faster RTs and computationally as lower thresholds. While a common evidence framework can plausibly reconcile our findings and that of previous studies, future studies should consider addressing this issue directly, by comparing the different goal functions and stimulus displays within perceptual decision-making tasks.
Functional coupling between left SFS and visual cortex
Furthermore, our study further expands our understanding of SFS function vis-à-vis other brain regions. It is well-established that the prefrontal cortex is structurally connected with many other brain regions (Wycoco et al., 2013) and may flexibly interact functionally with different areas depending on choice demands. Our exploratory connectivity results suggest that the SFS role for domain-specific accumulation of perceptual evidence is not just a local phenomenon but extends to functional communication with visual areas. Inhibition of this area’s functional contribution to evidence accumulation led to an increase in its functional coupling with areas in occipital cortex representing the stimuli visually upon which choices were based. The changes in functional coupling strength between the two cortical regions also corresponded to observed behavioural and latent computational changes. This suggests that perceptual choices rely not only on local processing in SFS but on an integrated functional circuit, comprising both SFS and occipital cortex, at least for decisions based on visual stimuli as studied here. Though exploratory, our results are generally consistent with an occipito-frontal information exchange but extend it specifically to the SFS during perceptual evidence accumulation (Bullier et al., 1996).
We can speculate why the occipital cortex may have been recruited after inhibition of the left SFS via cTBS stimulation. For example, it is possible that cTBS-related impairments in the accumulation mechanism implemented by the SFS biases the system to rely on second-best suboptimal mechanisms for solving the tasks, such as template matching from working memory. Previous work has provided converging evidence that maintenance of visual information in working memory enhances coupling between sensory processing in visual cortex and information storage in lateral prefrontal cortex (Gazzaley et al., 2007; Serences et al., 2009). In fact, it has been suggested that SFS is canonically organised in “memory receptive fields” (Postle, 2016) that may be more heavily taxed when direct accumulation mechanisms for sensory input are impaired, as in the case of cTBS manipulations. Of course, there are many other candidate mechanisms, such as attention or working memory, that may be more heavily taxed to compensate for the excitability manipulation of the SFS area specialised for processing the sensory evidence, as suggested by previous work on prefontal-occipital interactions during various attention and working memory tasks (Zanto et al., 2011). Overall, the exploratory nature of our analysis warrants future investigation on the directionality of information flow between occipital cortex and SFS. Additionally, future studies should also test whether perceptual choices based on other sensory modalities (e.g., touch, audition) lead to a flexible coupling of SFS with the specific sensory areas processing these stimuli. In any case, our study shows clearly that in the healthy, undisrupted human brain, left SFS plays a key role in transforming perceptual evidence into choices.
Implications for theories of PFC organisation
Our study also contributes to our understanding of prefrontal cortex (PFC) functional organisation, given the considerable debates surrounding its organising principles (Owen, 1997). Previous studies have posited that different PFC regions contribute to specific aspects of information processing, in a manner that that can be flexibly applied to all types of information, be it from different sensory modalities or in different cognitive formats (Petrides, 2005). Prevailing perspectives have also proposed an anterior-to-posterior hierarchy in PFC for the purpose of general cognitive control and executive function (Nee and D’Esposito, 2016), suggesting that the main role of the PFC is largely in the domain of higher-order cognitive and abstract operations that transcend specific functional domains (Domenech and Koechlin, 2015; Koechlin and Summerfield, 2007). In contrast, our finding of a domain-specific causal role of SFS in evidence accumulation for perceptual decision-making suggests that the PFC is organised as a collection of fractionated sub-regions, such that each region processes different types of information (Goldman-Rakic and Leung, 2002), as opposed to a systematic hierarchy. Moreover, the fact that the SFS is even involved in the integration of low-level perceptual evidence (Heekeren et al., 2004, 2006, 2008; Philiastides et al., 2011; Rahnev et al., 2016) implies that the PFC’s role is not limited to higher-order cognitive function. Overall, our findings are in no position of proposing an overarching framework of overall PFC organisation, given the limited area in posterior dlPFC targeted by our study, but rather a call to consider alternative views where the underlying organisational principles are more fractionated and less hierarchical.
Implications for computational psychiatry
Finally, our finding of SFS causal involvement in decision-threshold-setting during perceptual decision-making may offer clinical implications. Particularly, manifestations of impulsive behaviour (Heyes et al., 2012) are largely apparent in clinical populations with aberrations in decision threshold setting (Herz et al., 2016). However, most studies of these disorders have focused on impulsive behaviour induced by reward or preferences (Glimcher et al., 2007). It is important to note here that reward impulsivity is only one of the many domains of aberrant behaviour in clinical populations. Perceptual impulsivity is also important, since many of the behavioural and cognitive deficits are closely linked to impairments in perceptual function (Fuermaier et al., 2018). For instance, impulsive behaviour can also arise in non-reward-related settings, such as when perceptually discriminating size differences where less accurate and faster responses have been observed in people with addiction disorders (Banca et al., 2016) and borderline personality disorder (Berlin and Rolls, 2004). Perceptual deficiencies are also prevalent in clinical populations with attention-deficit hyperactivity disorder (ADHD) or Parkinson’s disease, and thought to be linked to impairments in the dopaminergic system (Fuermaier et al., 2018). Prior causal evidence from deep-brain stimulation (DBS), in particular, has shown that disrupting the STN lowered decision thresholds, thus increasing this perceptual impulsivity among Parkinson’s patients (Herz et al., 2016, 2017). Our findings that TMS of the left SFS causally and selectively lowered the decision boundary during perceptual decisions suggest that the lateral prefrontal cortex may be functionally integrated with these cortico-striatal and cortico-subthalamic nuclei (STN) pathways (Bogacz et al., 2010; Green et al., 2012, 2013).
Overall, impulsive behaviour is not exclusive to the reward domain, and our results suggest that there is something to gain from understanding impulsive behaviour in non-reward settings requiring decisions on perceptual information. Maladaptive behaviour may not only reflect individual wants or likings, often assumed by addiction studies, but could also be a function of low-level sensory or higher-order cognitive processes that have so far not fully been accounted for (Fuermaier et al., 2018). This may have serious implications for how cognitive therapies or interventions are designed, and our findings may provide useful insights in guiding such future work. Particularly, it is worth exploring to what degree the left SFS and its connections are structurally or functionally different in clinical populations, and whether these impulsive tendencies can be captured by sequential sampling models, such as the DDM.
Materials and methods
Participants
Twenty healthy right-handed volunteers (ages 20-30; 8 female) with normal or corrected-to-normal vision participated in the study. Participants were fully informed about the features of the experiment. No participant suffered from any neurological or psychological disorder or took medication that interfered with their participation in the study. Participants received monetary compensation for participation and performance of the perceptual choices, as well as a one food item to consume after the experiment depending on a random value-based choice trial. The experiments conformed to the Declaration of Helsinki and the experimental protocol was approved by the Ethics Committee of the Canton of Zurich.
Experimental paradigm
We asked participants to refrain from eating for 3 hours before the start of the experiment. Our experiments took place between 0800 and 1900 hr during the day. The experiment consisted of two steps: (1) a rating task outside the scanner and (2) a decision-making task inside the scanner. During the rating task, we asked participants to provide perceptual- and value-based ratings of the same set of 61 food images using an on-screen slider scale. All of the food items were in stock in our lab and participants were informed about this via visual inspection. For perceptual ratings, participants rated—on a scale from 5 to 100 percent in steps of 5 percent— how much of the black background within the white square perimeter was occupied by the food item. For value-based ratings, participants rated—on a scale from 5 to 100 in steps of 5—how much they wanted to eat the presented food item at the end of the experiment. We instructed participants that the midpoint of the scale in value-based ratings indicated indifference. The ratings phase required participants to rate the same food items twice for each task.
After rating the food items, an algorithm selected a balanced set of perceptual and value-based trials divided into four evidence levels, E. The evidence levels are based on the absolute difference between the average ratings of the food items paired in each trial. We define perceptual evidence as the absolute size difference between the two food items. On the other hand, we define value-based evidence as the absolute value difference between the two food items. In particular, the evidence levels for perceptual trials, Ep, are:
while the evidence levels for value-based trials, Ev, are:
where is the average food item from the two ratings while rbiggest − rsmallest and rbest − rworst represent the ratings’ difference for the pairs presented for perceptual and value-based choices, respectively.
Inside the scanner, participants performed the decision-making task for which they chose between two food items, based on whether they were accumulating perceptual or value-based evidence. We matched the visual sensory stimuli of the food items as well as their motor outputs across the two choice types. The only difference was the type of evidence participants had to accumulate to make a choice. Each trial started with presentation of a central fixation marker (length ∼ 0.8°, height ∼ 0.3°). Next, a centrally presented word indicated whether participants would perform a perceptual (word ‘AREA’) or value-based (word ‘LIKE’) choice. On the subsequent screen, the task cue was replaced by either the letter ‘A’ or ‘L’ (∼ 0.2°) to remind participants that they were in a perceptual or value-based block, respectively. Two food items were simultaneously displayed, one above and one below the screen (y eccentricity 3.6°; a white square of 6° width surrounded each food item). Blocks alternated between perceptual and value-based choices in a given session (7-9 trials per task block). Participants pressed one of two buttons on a keypad with their right middle finger (upper item) or right index finger (lower item) to indicate their choice. On a given trial, participants had 3 seconds for their choice; otherwise, the trial would be regarded as a ‘missed trial’ and would not enter the analysis. Participants made correct or consistent choices when they chose the food item with the higher rating as indicated in the double ratings task prior to entering the scanner. After the experiment, participants stayed in the room with the experimenter while they ate the food that was selected based on the participants choice in one randomly selected VDM trial. During perceptual decisions-making blocks, participants were rewarded with 0.5 CHF every time they correctly discriminated between the size difference of the two food items presented on the monitor screen.
The experiment had a total of 256 trials divided into 8 sessions of 32 trials each. The first 4 sessions were pre-stimulation sessions where participants performed the task without stimulation. The last 4 sessions were post-stimulation sessions during which participants performed the choices with decreased neural excitability in the SFS due to the preceding continuous theta-burst stimulation. The 256 trials were fully balanced across all factors (trial type: perceptual or value-based; evidence levels: 1 to 4; correct response: up or down).
Stimulation protocol
We applied continuous theta-burst stimulation (cTBS) (Huang et al., 2005; di Lazzaro et al., 2005, 2008) to exogenously induce cortical inhibition of our region of interest (ROI), an area in the left superior frontal sulcus (SFS) (MNI coordinates: x = −24, y = 24, z = 36) (Heekeren et al., 2004; Philiastides et al., 2011). Before the main fMRI experiment, we identified the stimulation site over the left SFS as well as each individual’s stimulation intensity. In an initial fMRI session, we acquired high-resolution T1-weighted 3D fast-field echo anatomical scans used for subsequent neuro-navigation (181 sagittal slices, matrix size = 256 × 256, voxel size = 1 mm3, TR/TE/TI = 8.3/2.26/181 ms, 3T Philips Achieva). The hand area of the left M1 (motor hotspot) was determined by identifying the first dorsal interosseous (FDI) movement-evoked potentials (MEPs) induced by transcranial magnetic stimulation (TMS) pulses. We delivered single monophasic TMS pulses using a figure-of-eight coil attached to the TMS stimulator. We then marked an equidistant circular grid on each individual’s anatomical MRI scan using a neuro-navigation system over the hand motor region, located at the anterior portion of the central sulcus. We localised the optimal motor hotspot as the point in the grid that elicited the strongest FDI MEPs from TMS pulses. Once we selected the motor hotspot, we asked participants to activate their FDI by pressing their thumb and index finger at about 20% maximum force in order to obtain their active motor threshold (AMT). We defined the AMT as the minimal TMS intensity required to produce MEPs of ≥ 200 mV amplitude (measured with Magventure MRi-B91) in ≥ 5– 10 consecutive pulses. We retested the AMT by visually inspecting the FDI twitches triggered by TMS pulses over the marked optimal hotspot. The average AMT outside the scanner was 52.35 ± 6.27 percent while the AMT inside the scanner was 52.91 ± 6.18 percent. We applied cTBS at an intensity of 80% of the individual’s AMT. The cTBS protocol contained bursts of 3 pulses at 50 Hz. This protocol has been shown to reduce cortical excitability for at least 30 minutes (Huang et al., 2005). Every burst was repeated at a rate of 5 Hz, resulting in 200 bursts with a total of 600 pulses delivered within 40 seconds.
Before moving our participant into the scanner, we marked the motor hotspot as well as the stimulation site on a swimming cap fixed in position by straps. Participants wore this cap while they were inside the scanner. Before the start of the fifth session, participants received cTBS over the left SFS. We used a figure-of-eight MR-compatible TMS coil (MRi-B91) attached to a TMS stimulator. Participants returned to the scanner after receiving stimulation and proceeded to complete the last four sessions. On average, the post-TMS fMRI task started 228 ± 41 sec after the end of theta-burst stimulation following established protocols from previous studies (Knecht et al., 2003; Philiastides et al., 2011; Thut and Pascual-Leone, 2010). Given the established timeline of cTBS effects (Huang et al., 2005), we expected the stimulation effects to weaken over time due to neural recovery. In line with established procedures, we treated the first two post-stimulation sessions as the actual post-cTBS period and the last two post-stimulation sessions as a recovery period (Philiastides et al., 2011).
Differences-in-differences
We implemented a differences-in-differences (DID) regression analysis to identify the causal relationships based on stimulation-induced neural inhibition in SFS. We used the identical DID for behavioural, computational, neuroimaging and connectivity analyses. Here, we use the following notation: task conditions Task (perceptual, Task = 1; value-based, Task = 0); stimulation conditions TMS (pre- TMS = 0 and post- TMS = 1); V is our variable of interest, which may be behavioural or neural; and, the causal treatment effect, ϕ(V|Task, TMS), takes the following form:
where 𝔼(V|Task, TMS) is the expected value of the variable of interest, V, given task and TMS condition. The first difference on the right-hand side captures the average stimulation effect for PDM while the second difference captures the average stimulation effect for VDM. The overall difference assumes that if behaviour will be the same after stimulation, then there is no effect, ϕ = 0 (Angrist and Pischke, 2009; Bertrand et al., 2004). But if there is a stimulation effect and it impairs behaviour or neural activity, then ϕ < 0.
Behavioural analyses for choice
We analysed the influence of continuous theta-burst stimulation on choice using a logit regression on choices, ρ (correct = 1, incorrect = 0) over various regressors of interest, such as TMS condition, TMS (pre-cTBS = 0, post-cTBS = 1); task, Task (perceptual = 1, value-based = 0); its interaction (Task × TMS), which measures the causal stimulation effect, ϕ; and, other regressors, Xk that we use as controls. This includes task-relevant evidence (SD for perceptual and VD for value-based, 1 to 4), response times (RTs), and task-irrelevant evidence (i.e. VD for perceptual and SD for value-based, 1 to 4). The full model is,
where t indexes Task, c for TMS, s for subject, and i for trial. Since our model contains a DID interaction term, nonlinearity of the logit regression results is a non-zero estimate even if the true causal effect is zero, ϕ = 0. To remove nonlinearity bias and isolate the true causal effect, we ran another logit regression without the interaction term,
and we take the difference between the two logits (Ai and Norton, 2003; Karaca-Mandic et al., 2012; Puhani, 2012),
We also ran variations of the model to test for robustness, particularly GLMs with or without control variables, and we also tested robustness using various stimulation runs (see Supplementary Table 5). We used cluster-robust standard errors at the subject level under the assumption that each individual performance is independent across participants. We implemented this analysis using STATA/SE 13.1.
Behavioural analyses for response times
We similarly used DID regressions to analyse the influence of cTBS on response times (rt). Here, we simply ran a general linear model (GLM) for our regression,
and we also ran variations of the model (see also Supplementary Table 5). We similarly used cluster-robust standard errors at the subject level.
Hierarchical Bayesian DDM
We analysed the effect of cTBS on PDM and VDM using hierarchical drift diffusion model (HDDM). The model assumes a evidence is accumulated through a one-dimensional Wiener process, whereby the state of evidence, xt at time t evolves through a stochastic differential equation,
Here, δ is the amount of evidence being accumulated at time t,
where E represents the evidence level and κ is the drift-rate that linearly scales the evidence and this is typically interpreted as quality of information processing. The model assumes evidence is accumulated at the starting point, β, and the accumulation process continues until a choice, ρ, is made at time td at a given threshold, α. Once the accumulation process terminates, the state of evidence is either xt> α (a correct decision) or xt ≤ 0 (an incorrect decision). We also accounted for visual sensory processing and motor response delays with the non-decision time parameter (nDT), r.
The hierarchical Bayesian model is implemented whereby each observed choice, yc,s,i(ρ, rt), follows a Wiener distribution, ω,
where c indexes task (c = p for perceptual, c = v for value-based), s for participants (s = 1, …, Nsubjects), and i for trials (i = 1, …, Ntrials). Furthermore, the hierarchical structure contains three random variations at the trial, subject, and condition levels. We treated all interindividual differences per stimulation condition level as random effects:
where N(μ, σ) is a normal distribution with mean, μ and standard deviation, σ. Here, E represents the trial-by-trial evidence levels, which we measure in absolute terms; and we fix the starting point, βc,s,i = 0.5. We used Bayesian hypothesis testing to compare posterior probability densities.
Measure of accumulated evidence
We computed estimates for decision times (td(c,s)) and accumulated evidence (aEc,s) to test whether aE is a plausible representation of the accumulation process at the neural level. Following the literature (Bogacz et al., 2006, 2010), we define mean decision time as the ratio between the decision threshold and the drift rate shaped by a hyperbolic tangent function,
It is important to note that reaction time, rt, is the sum of both decision and non-decision times, rt = td + τ.
We define accumulated evidence (aE) as the area below the drift process up until the accumulator reaches the decision boundary:
Here, we derive aE using the area equation of a triangle, where decision time td(c,s) is the base and the decision boundary, αc,s, is the height,
MCMC sampling
To estimate all parameters, we performed Gibbs sampling via Markov Chain Montecarlo (MCMC) in JAGS (Plummer, 2016) to generate parameter posterior inferences. We drew a total of 10,000 samples from an initial burn-in step and subsequently drew a total of new 10,000 samples with three chains each. We derived each chain based on different random number generator engines with different seeds. We applied a thinning of 10 to this final sample, resulting in a final set of 1,000 samples for each parameter. This thinning assured auto-decorrelation for all latent variables of interest. We conducted Gelman-Rubin tests for each parameter to confirm chain convergence. All latent parameters in our Bayesian model had suggesting that all three chains converged to a target posterior distribution. We compared the difference in posterior population distributions estimated for each parameter between the stimulation conditions as well as the differences-in-differences (DID), which included differences between tasks. We tested whether the resulting distribution (i.e., the causal stimulation effect) is significantly different from zero (i.e., the null hypothesis) using the cumulative function up to or from 0 depending on the direction of the effect. We refer to this probability as Bayesian “p-values,” pmcmc.
fMRI data analysis
Participants performed eight choice-task sessions while BOLD images were recorded with a Philips Achieva 3T whole-body scanner. We used statistical parametric mapping (SPM8, Wellcome Trust Center for Neuroimaging) for image pre-processing and analysis. In particular, images were slice-time corrected (to the acquisition time of the middle slice) and realigned to account for subject’s head motion. Each participant’s T1-weighted structural image was co-registered with the mean functional image and normalised to the standard T1 MNI template using the new-segment procedure in SPM8. The functional images were normalised to the standard MNI template using the same transformation, spatially resampled to 3mm isotropic voxels, and smoothed using a Gaussian kernel (FWHM, 8mm).
We estimated two general linear models (GLM), constructed by convolving a series of appropriately placed indicator functions with the default model of the BOLD response embedded in SPM8. GLM1 contained only two indicator functions for the onsets of PDM or VDM trials. On the other hand, GLM2 contained four indicator functions for the onsets of task (PDM and VDM trials) and stimulation (pre- or post-TMS) runs, coupled with one regressor each for parametric modulation of the BOLD response by the trialwise accumulated evidence (aE). We earlier demonstrated that the theoretical average accumulated evidence is derived from population-level as well as subject-level latent DDM parameters, by dividing the estimated decision boundary by the estimated drift rate. To construct a trialwise measure of aE, we exploit the fact that the length of the RTs is directly proportional to the size of the decision boundary while the evidence level, E, is directly proportional to the drift rate (Basten et al., 2010; Domenech et al., 2017; Kiani et al., 2014). With this mapping, we can then construct a parametric trialwise measure of accumulated evidence, aEt,c,s,i,
where the square root function accounts for the concave nonlinearity in accumulated evidence. Previous work (Tajima et al., 2016) has shown theoretically that the shape of the accumulated evidence is indeed concave, where it suggests that the rate of accumulating evidence is decreasing as the decision process continues to accumulate. This concavity in aE is consistent with DDM predictions where evidence accumulation is steeper during earlier responses and begins to plateau at later responses (Ratcliff and McKoon, 2008; Ratcliff and Smith, 2004).
We convolved our GLMs with a canonical haemodynamic response function (HRF), modelled MR image autocorrelations with first-order autoregressive model, and included 6 motion parameters (obtained during realignment) as regressors of no interest. After fitting the model to the BOLD data, we tested regressors for statistical significance at the second-level, in random-effects group one-sample t-tests of the corresponding single-subject contrast images. We performed statistical inference at the cluster level, using whole-brain family-wise-error-corrected (FWE-corrected) statistical threshold of p < 0.05, based on a cluster-forming voxel cutoff at p < 0.005 (or T(19) = 2.9). For hypothesis-guided region-of-interest (ROI) analysis (i.e., left SFS stimulation site, MNI coordinates: x = −24, y = 24, z = 36), we corrected for multiple comparisons using small-volume correction (SVC, p < 0.05) restricted within a 10 mm sphere around the target coordinates. We extracted neural betas from this spherical SFS ROI for each participant to perform hypothesis testing and correlational analysis.
Functional connectivity
We ran a psychophysiological interaction (PPI) analysis (Friston et al., 1997) to investigate the changes in functional connectivity between the left SFS and other brain regions due to cTBS. Here, we extracted physiological time series in the SFS seed region, which corresponds to the time-course of the first eigenvariate across all voxels in the region using principal component analysis (Friston et al., 1993). The psychological regressor corresponded to the difference in accumulated evidence, aE (as described in GLM2) between PDM and VDM. We generated a PPI estimates from the psychological regressors and the time series from the left SFS, and we then computed the PPI contrasts-of-interest for PDM and VDM. Statistical inference on subject-specific PPI maps was performed using second-level random-effects analysis across participants to allow for group-level inferences. For each participant, we also extracted PPI neural betas, which measures the degree of functional coupling between the left SFS, and we then performed hypothesis testing and correlational analysis.
Hierarchical Bayesian neural-DDM
We also analysed whether the inclusion of raw trial-by-trial BOLD response extracted from left SFS and attach it to any of the DDM parameters can improve model evidence. Such a result would suggest that neural activity in the left SFS directly related to the model’s latent decision-relevant parameters. We used z-scored single-trial neural beta estimates extracted from the left SFS target site. We implemented four a-priori models regarding the role of the left SFS on the decision parameters: Model 1 assumes that the left SFS modulated the decision threshold (Supplementary Fig. 8a), while Model 2 assumes that left SFS modulated the drift rate (Supplementary Fig. 8b):
where γ is the scale parameter for trial-by-trial left SFS activity, θ. On the other hand, Models 3 and 4 assume that the left SFS modulates both boundary and drift: Model 3 assumes separate scale parameters for each latent process (see Supplementary Fig. 8c) while Model 4 assumes a common scale parameter for both boundary and drift (see Supplementary Fig. 8d). We compared our models’ deviance information criterion (DIC) relative to the model without any neural data. Already accounting for model complexity, the smaller the DIC, the better model performance. We then used the best model to re-estimate our latent parameters and to perform Bayesian post-hoc inferences.
Correlating causal changes between neural, latent, and behavioural variables
We tested whether there were any correlational changes between neural, v, and behavioural, π, measures after stimulation. The marginal effect, r, measures the correlational change in neural measure, ᴠ, given behavioural measure, π,
We test the marginal effect, r, of the correlational change between our neural and behavioral measures using our DID regression at trial and subject levels. With trialwise data, we used logit regression to test whether the marginal effect of trialwise changes in left SFS, Neur, will affect choices, ρ. Similar to previous models, we included various regressors of interest, especially the triple interaction (Neur × Task × TMS), which accounts for the causal TMS effect, ϕ, as well as other regressors, Xk. The full model is,
To remove nonlinearity bias and isolate the true causal effect, we ran another logit regression without ϕ,
and then we took the difference between the two logit models,
We similarly ran a DID-GLM to test whether the marginal effect of trialwise left SFS neural betas will causally affect RTs,
We also used cluster-robust standard errors at the subject level in all of our analysis.
With subject-level data, we similarly used linear mixed-effects regression models to test whether the marginal effect of subject-level neural betas (left SFS or PPI) ᴠ, will affect behavioural outcomes or DDM-latent parameters, π. Similarly, we estimated the marginal effect, ϕ, with a three-way interaction, (ᴠ × Task × TMS),
This three-way interaction measures whether the correlations between neural activity (left SFS, PPI betas) and behaviour (choice, DDM parameters) are causally affected by stimulation, TMS, and whether the effect is specific only during the perceptual task.
Data and code availability
Behavioural and neuroimaging data and the code for data analysis are available at 10.17605/OSF.IO/3DMH9.
Supplementary material
References
- 1Interaction terms in logit and probit modelsEconomics Letters 80:123–129
- 2Mostly Harmless Econometrics: An Empiricist’s CompanionPrinceton, NJ: Princeton University Press
- 3Functional Magnetic Resonance Imaging Evidence for a Hierarchical Organization of the Prefrontal CortexJournal of Cognitive Neuroscience 19:2082–2099
- 4Reflection impulsivity in binge drinking: Behavioural and volumetric correlatesAddiction Biology 21:504–515
- 5Dorsolateral prefrontal contributions to human working memoryCortex 49:1195–1205
- 6How the brain integrates costs and benefits during decision makingProceedings of the National Academy of Sciences 107:21767–21772
- 7Time Perception, Impulsivity, Emotionality, and Personality in Self-Harming Borderline Personality Disorder PatientsJournal of Personality Disorders 18:358–378
- 8How Much Should We Trust Differences-In-Differences Estimates?The Quarterly Journal of Economics 119:249–275
- 9The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasksPsychological Review 113:700–765
- 10The neural basis of the speed-accuracy tradeoffTrends in Neurosciences 33:10–16
- 11Neural underpinnings of the evidence accumulatorCurrent Opinion in Neurobiology 37:149–157
- 12Rats and Humans Can Optimally Accumulate Evidence for Decision-MakingScience 340:95–98
- 13Functional streams in occipito-frontal connections in the monkeyBehavioural Brain Research 76:89–97
- 14Decision Field-Theory - a Dynamic Cognitive Approach to Decision-Making in an Uncertain EnvironmentPsychological Review 100:432–59
- 15Subthalamic nucleus stimulation reverses mediofrontal influence over decision thresholdNature Neuroscience 14:1462–1467
- 16Confidence in value-based choiceNature Neuroscience 16:105–110
- 17Theta-burst repetitive transcranial magnetic stimulation suppresses specific excitatory circuits in the human motor cortexThe Journal of Physiology 565:945–950
- 18State of the art: Physiology of transcranial motor cortex stimulationBrain Stimulation 1:345–362
- 19Neural Correlates of Perceptual Decision Making before, during, and after Decision Commitment in Monkey Frontal Eye FieldCerebral Cortex 22:1052–1067
- 20Separate, Causal Roles of the Caudate in Saccadic Choice and Execution in a Perceptual Decision TaskNeuron 75:865–874
- 21Decision Threshold Modulation in the Human BrainJournal of Neuroscience 30:14305–14317
- 22Executive control and decision-making in the prefrontal cortexCurrent Opinion in Behavioral Sciences 1:101–106
- 23The Neuro-Computational Architecture of Value-based Selection in the Human BrainCerebral Cortex :1–17
- 24Comparing perceptual and preferential decision makingPsychon Bull Rev 23:723–37
- 25Distinct effects of prefrontal and parietal cortex inactivations on an accumulation of evidence task in the ratELife 4
- 26Fitting drift-diffusion decision models to trial-by-trial dataBioRxiv
- 27How Embodied Is Perceptual Decision Making? Evidence for Separate Processing of Perceptual and Motor DecisionsJournal of Neuroscience 33:2121–2136
- 28Reciprocal relations between cognitive neuroscience and formal cognitive models: opposites attract?Trends in Cognitive Sciences 15:272–279
- 29Functional Connectivity: The Principal-Component Analysis of Large (PET) Data SetsJournal of Cerebral Blood Flow & Metabolism 13:5–14
- 30Psychophysiological and Modulatory Interactions in NeuroimagingNeuroImage 6:218–229
- 31Perception in attention deficit hyperactivity disorderADHD Attention Deficit and Hyperactivity Disorders 10:21–47
- 32Functional Interactions between Prefrontal and Visual Association Cortex Contribute to Top-Down Modulation of Visual ProcessingCerebral Cortex 17:i125–i135
- 33The formation of preference in risky choicePLoS Computational Biology 15
- 34Neuroeconomic Studies of Impulsivity: Now or Just as Soon as Possible?American Economic Review 97:142–147
- 35The neural basis of decision makingAnnual Review of Neuroscience 30:535–74
- 36Functional Architecture of the Dorsolateral Prefrontal Cortex in Monkeys and HumansOxford University Press
- 37Changes in Neural Connectivity Underlie Decision Threshold Modulation for Reward MaximizationJournal of Neuroscience 32:14942–14950
- 38Reduction of influence of task difficulty on perceptual decision making by stn deep brain stimulationCurrent Biology 23:1681–1684
- 39Automatic versus Choice-Dependent Value Representations in the Human BrainNeuron 85:874–885
- 40Arousal Optimizes Neural Evidence Representation for Human Decision-MakingSSRN Electronic Journal
- 41Perceptual Decision Making in Rodents, Monkeys, and HumansNeuron 93:15–31
- 42Distinct relationships of parietal and prefrontal cortices to evidence accumulationNature 520:220–223
- 43Self-Control in Decision-Making Involves Modulation of the vmPFC Valuation SystemScience 324:646–648
- 44A general mechanism for perceptual decision-making in the human brainNature 431:859–862
- 45Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modalityProceedings of the National Academy of Sciences 103:10023–10028
- 46The neural systems that mediate human perceptual decision makingNature Reviews Neuroscience 9:467–479
- 47Efficient sampling and noisy decisionsElife 9
- 48Neural Correlates of Decision Thresholds in the Human Subthalamic NucleusCurrent Biology 26:916–920
- 49Distinct mechanisms mediate speed-accuracy adjustments in cortico-subthalamic networksELife 6:1–25
- 50Impulsivity and rapid decision-making for rewardFrontiers in Psychology 3:1–11
- 51Theta burst stimulation of the human motor cortexNeuron 45:201–206
- 52A Neurocomputational Model of Altruistic Choice and Its ImplicationsNeuron 87:451–462
- 53Interaction terms in nonlinear modelsHealth Services Research 47:255–274
- 54Choice certainty is informed by both evidence and decision timeNeuron 84:1329–1342
- 55Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaqueNature Neuroscience 2:176–85
- 56Changing cortical excitability with low-frequency transcranial magnetic stimulation can induce sustained disruption of tactile perceptionBiological Psychiatry 53:175–179
- 57An information theoretical approach to prefrontal executive functionTrends in Cognitive Sciences 11:229–235
- 58Accounting for attention in sequential sampling models of decision makingCurr Opin Psychol 29:6–11
- 59Liu, T., and Pleskac, T.J. (2011). Neural correlates of evidence accumulation in a perceptual decision task. 48824, 2383–2398.Neural correlates of evidence accumulation in a perceptual decision task 48824:2383–2398
- 60What we can do and what we cannot do with fMRINature 453:869–878
- 61Movement repetition facilitates response preparationCell Reports 24:801–808
- 62Perceptual decision neurosciences - a model-based reviewNeuroscience 277:872–84
- 63Causal contributions of human frontal eye fields to distinct aspects of decision formationScientific Reports 10
- 64The hierarchical organization of the lateral prefrontal cortexELife 5
- 65The Functional Organization of Working Memory Processes Within Human Lateral Frontal Cortex: The Contribution of Functional NeuroimagingEuropean Journal of Neuroscience 9:1329–1339
- 66Model-based cognitive neuroscienceJournal of Mathematical Psychology 76
- 67The drift diffusion model as the choice rule in inter-temporal and risky choice: a case study in medial orbitofrontal cortex lesion patients and controlsPLoS Computational Biology 16
- 68Lateral prefrontal cortex: architectonic and functional organizationPhilosophical Transactions of the Royal Society B: Biological Sciences 360:781–795
- 69Causal role of dorsolateral prefrontal cortex in human perceptual decision makingCurrent Biology 21:980–983
- 70Rat Prefrontal Cortex Inactivations during Decision Making Are Explained by Bistable Attractor DynamicsNeural Comput 29:2861–86
- 71rjags: Bayesian graphical models using MCMCR package version 4
- 72Neural Oscillations and Synchronization Differentially Support Evidence Accumulation in Perceptual and Value-based Decision MakingNeuron 82:709–720
- 73The precision of value-based choices depends causally on fronto-parietal phase couplingNat Commun
- 74Can cognitive processes be inferred from neuroimaging data?Trends in Cognitive Sciences 10:59–63
- 75How Does the Brain Keep Information “in Mind”?Current Directions in Psychological Science 25:151–156
- 76The treatment effect, the cross difference, and the interaction term in nonlinear “difference-in-differences” modelsEconomics Letters 115:85–87
- 77Causal evidence for frontal cortex organization for perceptual decision makingProceedings of the National Academy of Sciences 113:6059–6064
- 78Six problems for causal inference from fMRINeuroImage 49:1545–1558
- 79Modeling response times for two-choice decisionsPsychol Sci 9:347–56
- 80A comparison of sequential sampling models for two-choice reaction timePsychological Review 111:333–367
- 81The diffusion decision model: theory and data for two choice-decision tasksNeural Computation 20:873–922
- 82The Diffusion Decision Model: Theory and Data for Two-Choice Decision TasksNeural Computation 20:873–922
- 83Stimulus-Specific Delay Activity in Human Primary Visual CortexPsychological Science 20:207–214
- 84Motion perception: seeing and decidingProceedings of the National Academy of Sciences 93:628–633
- 85Decision value computation in DLPFC and VMPFC adjusts to the available decision timeEuropean Journal of Neuroscience 35:1065–1074
- 86Psychology and neurobiology of simple decisionsTrends Neurosci 27:161–68
- 87Response biases in simple decision making: Faster decision making, faster response execution, or both?Psychonomic Bulletin & Review 25:1535–1541
- 88Building bridges between perceptual and economic decision-making: neural and computational mechanismFront Neurosci-Switz
- 89Optimal policy for value-based decision-makingNat Commun 7
- 90A review of combined TMS-EEG studies to characterize lasting effects of repetitive TMS and assess their usefulness in cognitive and clinical neuroscienceBrain Topography 22:219–232
- 91Sensory-motor mechanisms in human parietal cortex underlie arbitrary visual decisionsNature Neuroscience 11:1446–1453
- 92Informing cognitive abstractions through neuroimaging: the neural drift diffusion modelPsychological Review 122:312–336
- 93The time course of perceptual choice: The leaky, competing accumulator modelPsychological Review 108:550–92
- 94Hierarchical diffusion models for two-choice response timesPsychological Methods 16:44–62
- 95Testing the validity of conflict drift-diffusion models for use in estimating cognitive processes: A parameter-recovery studyPsychonomic Bulletin & Review 25:286–301
- 96White Matter AnatomyNeuroimaging Clinics of North America 23
- 97Model-based functional neuroimaging using dynamic neural fields: An integrative cognitive neuroscience approachJournal of Mathematical Psychology 76:212–235
- 98Causal role of the prefrontal cortex in top-down modulation of visual processing and working memoryNature Neuroscience 14:656–661
Article and author information
Author information
Version history
- Preprint posted:
- Sent for peer review:
- Reviewed Preprint version 1:
Copyright
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Metrics
- views
- 219
- downloads
- 26
- citations
- 0
Views, downloads and citations are aggregated across all versions of this paper published by eLife.