Neural representation of abstract task structure during generalization
- Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, United States
- Department of Psychology, Stanford University, Stanford, United States
- Department of Psychology and Brain Sciences, University of Massachusetts Amherst, United States
- Carney Institute for Brain Science, Brown University, United States
Figures
Figure 1 with 1 supplement
Schematic of the experimental task, and its design and logic.
(a) In each trial of the training and generalization phases, participants were asked to make a decision to sell or pass on an image, the value of which depended on contexts shown above the image. …
Figure 1—figure supplement 1
Schematic showing design of whole experiment over multiple sessions.
Note that contexts seen in new category training and held out of generalization were not necessarily from Initial Training 3, but these are shown only as an example here. The mixed generalization …
Figure 2 with 2 supplements
Learning curves and repetition effects from training and generalization phases for fMRI participants in session 2.
(a) Mean accuracy across participants for first six trials of the first nine mini-blocks of initial and new category training, as well as blocked generalization phase. Dashed line indicates …
Figure 2—figure supplement 1
Accuracy in all sessions of the experiment for behavioral and fMRI groups.
No statistical comparison between groups was made in the mini-blocked generalization phase of session 1 as accuracy in this phase was used to define these groups. Each point represents a single …
Figure 2—figure supplement 2
Learning curves and repetition effects from training and generalization phases for behavioral participants who passed the accuracy criterion for generalization in session 2 (N = 9).
(a) Mean accuracy across participants for first six trials of the first nine mini-blocks of initial and new category training, as well as blocked generalization phase. Dashed line indicates …
Figure 3 with 1 supplement
Reaction times (RT) for fMRI participants in mini-blocks during generalization in session 2, organized by the presentation of latent states (LS 1, 2, 3) and contexts (first and second).
Participants were significantly slower on the first trial of mini-blocks when encountering the first context in a LS compared to the second context in the same LS, but not in subsequent trials. (a) …
Figure 3—figure supplement 1
Reaction times (RT) for participants in the behavioral group who passed the generalization criterion in session 2 (N = 9) during mini-blocks during generalization in session 2, organized by the presentation of latent states (LS 1, 2, 3) and contexts (first and second).
Participants were significantly slower on the first trial of mini-blocks when encountering the first context in a LS compared to the second context in the same LS, but not in subsequent trials. (a) …
Figure 4 with 1 supplement
Computational modeling of reaction times (RT) during generalization phase for fMRI participants in session 2.
Each panel shows simplified schematics for spreading activation in four alternative model networks for a trial involving a decision about an image of an object in context A1 (i.e. A1-O-). (a) …
Figure 4—figure supplement 1
Supplementary analyses for computational modeling of reaction times (RTs).
Data are from session 2 of the mini-blocked generalization phase for participants in the fMRI group. (a) Root-mean squared deviation between data simulated from each model and participants’ z-scored …
Figure 5 with 5 supplements
Whole-brain representational similarity searchlight analysis for main effects of interest.
Each upper panel shows hypothesis representational dissimilarity matrix (RDM) for task factors. Lower panels show t-statistic map from a searchlight analysis testing these predictions in pattern …
Figure 5—figure supplement 1
Percentage overlap of latent state (LS) statistical map from Figure 5a with 17 network parcellation of functional connectivity networks from Yeo et al., 2011 based on the data of 1000 participants.
Numbers correspond to network identifications from the same study with percentage of voxels within each network shown in parentheses and represented by the pie chart. Surface renderings of the three …
Figure 5—figure supplement 2
Whole brain searchlight analysis for image categories.
Left panel shows hypothesis representational dissimilarity matrix for categories (based on animacy). Right panel shows the cluster corrected t-statistic map from a searchlight analysis projected …
Figure 5—figure supplement 3
Statistical maps for main effects of multiple regression model from searchlight representational similarity analyses (RSAs) estimated separately for data from sessions 2 and 3 and projected onto inflated cortical surfaces.
All statistical maps were thresholded with a cluster forming threshold of p<0.001 and corrected for multiple comparisons using permutation tests to find a cluster extent threshold (k) at p<0.05, …
Figure 5—figure supplement 4
Whole-brain searchlight analyses for interaction terms.
(a) Results showing where pattern activity was modulated by the negative interaction of latent state and value. Nuisance regressors for interactions between contexts and (b) value and (c) categories.…
Figure 5—figure supplement 5
Hypothesis representational dissimilarity matrices (RDMs).
(a) All hypothesis RDMs included in the multiple regression analysis for searchlight and ROI-based representational similarity analyses (RSA). Color bar indicates dissimilarity. A, B, C refer to …
Figure 6 with 1 supplement
Representational similarity analysis results from all voxels included in regions of interest (ROIs).
Plots show distribution of beta coefficients across participants from multiple linear regression analyses comparing hypothesis representational dissimilarity matrices (RDMs) with empirical RDMs …
Figure 6—figure supplement 1
Results of representational similarity analysis searchlight results with explicit mask in orbitofrontal cortex.
Maps of t-statistics have been projected onto an inflated cortical surface to show effects for (a) latent states and (b) value. Both maps were defined with a cluster forming threshold of p<0.001 and …
Figure 7
Univariate whole-brain contrast of correct and erroneous responses projected onto inflated cortical surfaces and on a single axial slice showing orbitofrontal cortex and hippocampus.
This statistical map was defined with a cluster forming threshold of p<0.001 and corrected for multiple comparisons with permutation tests for defining a cluster extent threshold at p<0.05. Cluster …
Author response image 1
Author response image 2
Author response image 3
Tables
Table 1
Sum of negative log-likelihood for four alternative models across participants and fraction of participants where each model was lowest in this measure in parentheses, for each group and session.
| Conjunctive associative retrieval | Independent associative retrieval | Latent state | Hierarchical latent state | |
|---|---|---|---|---|
| fMRI group – session 1 | 3537.78 (1/16) | 3227.38 (2/16) | 3428.23 (0/16) | 3061.04 (13/16) |
| fMRI group – session 2 | 3849.60 (0/16) | 3413.20 (4/16) | 3569.10 (0/16) | 3264.13 (12/16) |
| Behavioral group – session 2 | 2063.65 (0/9) | 1851.76 (0/9) | 1921.61 (0/9) | 1713.73 (9/9) |
-
Table 1—source data 1
Sum of negative log-likelihoods for individual participants in fMRI and behavioral groups for each model in each session.
- https://cdn.elifesciences.org/articles/63226/elife-63226-table1-data1-v2.zip
Additional files
-
Supplementary file 1
Activations passing permutation-based cluster correction for whole-brain representational similarity analysis.
All reported clusters were significant at the p<0.05, corrected for multiple comparisons after peak thresholding at p<0.001 and permutation-based cluster correction. The critical cluster extent threshold for each contrast is given by the value of k.
- https://cdn.elifesciences.org/articles/63226/elife-63226-supp1-v2.docx
-
Supplementary file 2
Activations passing permutation-based cluster correction for representational similarity analysis constrained to orbitofrontal cortex region of interest.
All reported clusters were significant at the p<0.05, corrected for multiple comparisons after peak thresholding at p<0.001 and permutation-based cluster correction within an explicit mask defining orbitofrontal cortex. The critical cluster extent threshold for each contrast is given by the value of k.
- https://cdn.elifesciences.org/articles/63226/elife-63226-supp2-v2.docx
-
Supplementary file 3
Activations passing permutation-based cluster correction for univariate contrast of correct and erroneous responses.
All reported clusters were significant at the p<0.05, corrected for multiple comparisons after peak thresholding at p<0.001 and permutation-based cluster correction. The critical cluster extent threshold for each contrast is given by the value of k.
- https://cdn.elifesciences.org/articles/63226/elife-63226-supp3-v2.docx
-
Transparent reporting form
- https://cdn.elifesciences.org/articles/63226/elife-63226-transrepform-v2.docx
