Figures and data in The interpretation of computational model parameters depends on the context

Figures
Tables
Additional files

16 figures, 14 tables and 1 additional file

Figures

Figure 1

Download asset Open asset

Overview of the experimental paradigm.

(A) Participant sample. Left: Number of participants in each age group, broken up by sex (self-reported). Age groups were determined by within-sex age quartiles for participants between 8–17 years (see Eckstein et al., 2022 for details) and 5 year bins for adults. Right: Number of participants whose data were excluded because they failed to reach performance criteria in at least one task. (B) Task A procedure of (‘Butterfly task’). Participants saw one of four butterflies on each trial and selected one of two flowers in response, via button press on a game controller. Each butterfly had a stable preference for one flower throughout the task, but rewards were delivered stochastically (70% for correct responses, 30% for incorrect). For details, see section 'Task design' and the original publication (Xia et al., 2021). (C) Task B Procedure (‘Stochastic Reversal’). Participants saw two boxes on each trial and selected one with the goal of finding gold coins. At each point in time, one box was correct and had a high (75%) probability of delivering a coin, whereas the other was incorrect (0%). At unpredictable intervals, the correct box switched sides. For details, see section 'Task design' and Eckstein et al., 2022. (D) Task C procedure (‘Reinforcement learning-working memory’). Participants saw one stimulus on each trial and selected one of three buttons ( $A_{1} - A_{3}$ ) in response. All correct and no incorrect responses were rewarded. The task contained blocks of 2–5 stimuli, determining its ‘set size’. The task was designed to disentangle set size-sensitive working memory processes from set size-insensitive RL processes. For details, see section 'Task design' and Master et al., 2020. (E) Pairwise similarities in terms of experimental design between tasks A (Xia et al., 2021), B (Eckstein et al., 2022), and C (Master et al., 2020). Similarities are shown on the arrows connecting two tasks; the lack of a feature implies a difference. E.g., a ‘Stable set size’ on tasks A and B implies an unstable set size in task C. Overall, task A shared more similarities with tasks B and C than these shared with each other. (F) Summary of the computational models for each task (for details, see section 'Computational models' and original publications). Each row shows one model, columns show model parameters. ‘Y’ (yes) indicates that a parameter is present in a given model, ‘—’ indicates that a parameter is not present. ‘ $\frac{1}{β}$ and $ϵ$ ’ refer to exploration / noise parameters; $α_{+}$ ( $α_{-}$ ) to learning rate for positive (negative) outcomes; ‘Persist. P’ to persistence; ‘WM pars’. to working memory parameters.

Figure 2

Download asset Open asset

Generalizability of absolute parameter values (**A–B**) and of parameter age trajectories / z-scored parameters (**C–D**).

(A) Fitted parameters over participant age (binned) for all three tasks (A: green; B: orange; C: blue). Parameter values differed significantly between tasks; significance stars show the p-values of the main effects of task on parameters (Table 1; * $p < .05$ ; ** $p < .01$ ; *** $p < .001$ ). Dots indicate means of the participants in each age group (for n’s, see Figure 1A), error bars specify the confidence level (0–1) for interval estimation of the population mean. (B) Summary of the main results of part A. Double-sided arrows connecting tasks are replicated from Figure 1E and indicate task similarity (dotted arrow: small similarity; full arrow: large similarity). Lines connecting parameters between tasks show test statistics (Table 1). Dotted lines indicate significant task differences in Bonferroni-corrected pairwise t-tests (full lines would indicate the lack of difference). All t-tests were significant, indicating that absolute parameter values differed between each pair of tasks. (C) Parameter age trajectories, that is, within-task z-scored parameters over age. Age trajectories reveal similarities that are obscured by differences in means or variances in absolute values (part A). Significance stars show significant effects of task on age trajectories (Table 2). (D) Summary of the main results of part C. Lines connecting parameters between tasks show statistics of regression models predicting each parameter from the corresponding parameter in a different task (Table 4). Full lines indicate significant predictability and dotted lines indicate a lack thereof. In contrast to absolute parameter values, age trajectories were predictive in several cases, especially for tasks with more similarities (A and B; A and C), compared to tasks with fewer (B and C).

Figure 3

Download asset Open asset

Identifying the major axes of variation in the dataset.

A PCA was conducted on the entire dataset (39 behavioral features and 15 model parameters). The figure shows the factor loadings (y-axis) of of all dataset features (x-axis) for the first three PCs (panels A, B, and C). Features that are RL model parameters are bolded and in purple. Behavioral features are explained in detail in Appendix 1 and Appendix 3 (note that behavioral features differed between tasks). Dotted lines aid visual organization by grouping similar features across tasks (e.g. missed trials of all three tasks) or within tasks (e.g. working-memory-related features for task C). (A) PC1 captured broadly-defined task engagement, with negative loadings on features that were negatively associated with performance (e.g. number of missed trials) and positive loadings on features that were positively associated with performance (e.g. percent correct trials). (**B–C**) PC2 (B) and PC3 (C) captured task contrasts. PC2 loaded positively on features of task B (orange box) and negatively on features of task C (purple box). PC3 loaded positively on features of task A (green box) and negatively on features of tasks B and C. Loadings of features that are negative on PC1 are flipped in PC2 and PC3 to better visualize the task contrasts (section 'Principal component analysis (PCA)').

Figure 4

Download asset Open asset

Assessing parameter interpretability by analyzing shared variance.

(A) Parameter variance that is shared between tasks. Each arrow shows a significant regression coefficient when predicting a parameter in one task (e.g. $α_{+}$ in task A) from all parameters of a different task (e.g. $P$ , $α_{-}$ , $α_{+}$ , and $\frac{1}{β}$ in task B). The predicted parameter is shown at the arrow head, predictors at its tail. Full lines indicate positive regression coefficients, and are highlighted in purple when connecting two identical parameters; dotted lines indicate negative coefficients; non-significant coefficients are not shown. Table 5 provides the full statistics of the models summarized in this figure. (B) Amount of variance of each parameter that was captured by parameters of other models. Each bar shows the percentage of explained variance ( $R^{2}$ ) when predicting one parameter from all parameters of a different task/model, using Ridge regression. Part (A) of this figure shows the coefficients of these models. The x-axis shows the predicted parameter, and colors differentiate between predicting tasks. Three models were conducted to predict each parameter: One combined the parameters of both other tasks (pink), and two kept them separate (green, orange, blue). Larger amounts of explained variance (e.g., Task A $\frac{1}{β}$ and $α_{-}$ ) suggest more shared processes between predicted and predicting parameters; the inability to predict variance (e.g. Task B $α_{+}$ ; Task C working memory parameters) suggests that distinct processes were captured. Bars show mean $R^{2}$ , averaged over $k$ data folds ( $k$ was chosen for each model based on model fit, using repeated cross-validated Ridge regression; for details, see section 'Ridge regression'); error bars show standard errors of the mean across folds. (C) Relations between parameters and behavior. The arrows visualize Ridge regression models that predict parameters (bottom row) from behavioral features (top row) within tasks (full statistics in Table 6). Arrows indicate significant regression coefficients, colors denote tasks, and line types denote the sign of the coefficients, like before. All significant within-task coefficients are shown. Task-based consistency (similar relations between behaviors and parameters across tasks) occurs when arrows point from the same behavioral features to the same parameters in different tasks (i.e. parallel arrows). (D) Variance of each parameter that was explained by behavioral features; corresponds to the behavioral Ridge models shown in part (C).

Figure 5

Download asset Open asset

What do model parameters measure? (A) View based on generalizability and interpretability.

In this view, which is implicitly endorsed by much current computational modeling research, models are fitted in order to reveal individuals’ intrinsic model parameters, which reflect clearly delineated, separable, and meaningful (neuro)cognitive processes, a concept we call *interpretability*. Interpretability is the assumption that every model parameter captures a specific cognitive process (bidirectional arrows between each parameter and process), and that cognitive processes are separable from each other (no connections between processes). Task characteristics are treated as irrelevant, a concept we call *generalizability*, such that parameters of any learning task (within reason) are expected to capture similar cognitive processes. (B) Updated view, based on our results, that acknowledges the role of context (e.g. task characteristics, model parameterization, participant sample) in computational modeling. Which cognitive processes are captured by each model parameter is influenced by context (green, orange, blue), as shown by distinct connections between parameters and cognitive processes. Different parameters within the same task can capture overlapping cognitive processes (not interpretable), and the same parameters can capture different processes depending on the task (not generalizable). However, parameters likely capture consistent behavioral features across tasks (thick vertical arrows).

© 2021, Elsevier. Figure 5 is reprinted from Figure 3 from Eckstein et al., 2021, with permission from Current Opinion in Behavioral Sciences. It is not covered by the CC-BY 4.0 license and further reproduction of this panel would need permission from the copyright holder.

Appendix 3—figure 1

Download asset Open asset

Main results of tasks A, B, and C.

(A) Top: In task A, performance increased with age and plateaued in early adulthood, as captured in decreases in decision temperature $\frac{1}{β}$ and increases in learning rate $α$ (Xia et al., 2021). Performance also increased over task time (blocks). Middle: In task B, performance showed a remarkable inverse U-shaped age trajectory: Performance increased markedly from early childhood (8–10 years) to mid-adolescence (13-15), but decreased in late adolescence (15-17) and adulthood (18-30) (Rosenbaum et al., 2020). Bottom: Task C showed that the effect of set size on performance (regression coefficient) decreased with age, which was captured by increases in RL learning rate, but stable WM limitations (Master et al., 2020). (B) Main behavioral features over age; colors denote task; all features are z-scored. Some measures (e.g. response times [RT], win-stay choices) were consistent across tasks, while others (e.g. accuracy [Acc.], lose-stay choices) showed significant differences (see Table Appendix 6—table 1).

Appendix 4—figure 1

Download asset Open asset

Behavioral validation of the winning model for each task.

(A) Task A. The left figure shows performance (y-axis; probability of correct choice) over time on the task (x-axis; trial number). The right figure shows the average performance for each age group (in years). Red indicates human data, and blue indicates simulations from the winning model, based on best-fitting parameters. The close match between the red and blue datapoints indicates good model fit. (A) is reproduced from Figure 2 from Xia et al., 2021. (B) Task B. The top figure shows performance (y-axis; percentage of correct choices) aligned to switch trials (x-axis; i.e., trial on which the correct box switches sides), separately for male and female participants. The bottom figure shows another behavioral measures, the probability of repeating the same choice (y-axis; ‘% stay’) based on the previous outcome history (x-axis; ‘+ +’: two rewards in a row; ‘- +’: no reward followed by reward; etc.), separately for male and female participants. Colors indicate participant age. The columnwise panels compare human behavior (left) to simulated behavior of the winning RL model (right). The close correspondence between human and simulated model behavior indicates good model fit. (B) is reproduced from Figure 4 from Eckstein et al., 2022. (C) Task C. Each figure shows human performance (y-axis; percentage of correct trials) over time (x-axis; number of trials for each stimulus), with colors differentiating age groups. The two rows show blocks of different set sizes (top: set size of two stimuli per block; bottom: set size of five). The left two figures show human behavior, the right two show model simulations. (C) is reproduced from Figure 3C from Master et al., 2020.

© 2022, Eckstein et al. Appendix 4- Figure 1B is reproduced from Figure 4 from Eckstein et al., 2022. The image is published under the terms of the CC BY-NC-ND 4.0 license.

© 2020, Master et al. Appendix 4 - Figure 1C is reproduced from Figure 3C from Master et al., 2020. The image is published under the terms of the CC BY-NC-ND 4.0 license.

Appendix 5—figure 1

Download asset Open asset

Comparison of human parameter correlations to generalization ceiling.

(**A–B**) Same as Figure 2A and B, but for simulated agents with perfect generalization, rather than humans. (C) Parameter correlations (dots) for each pair of tasks (x-axis), with bootstrapped 95% confidence intervals (error bars). Stars indicate significance at the level of $p = 0.05$ , that is, the human correlation coefficient is not contained within the confidence interval of the corresponding simulated correlation coefficient.

Appendix 8—figure 1

Download asset Open asset

Between-task parameter correlations.

(A) Parameter $α_{+}$ across tasks ( $l o g (α_{+})$ in task C). (B) Parameters $\frac{1}{β}$ (task A, B) and $ϵ$ (task C). (C) Parameter $α_{-}$ across tasks ( $l o g (α_{-})$ in task C). Same conventions as in Fig. Appendix 8—figure 2.

Appendix 8—figure 2

Download asset Open asset

Within-task parameter correlations, focusing on learning rates (x-axes) and exploration / noise parameters (y-axes).

Each column shows one task. Each dot in the scatter plots refers to a participant, colors indicates age. Inserted are Spearman correlation statistics.

Appendix 8—figure 3

Download asset Open asset

Full Spearman correlation matrix of all features in the dataset.

Feature order is the same as in Figure 3. Deeper red (blue) colors indicate stronger positive (negative) correlations in terms of Spearman’s $ρ$ (see color legend). Only correlations with p-values are shown; remaining squares are left blank.

Appendix 8—figure 4

Download asset Open asset

Additional PCA results.

(A) Cumulative variance explained by all PCs of the PCA (Figure 3; 2.2.1). The smooth, non-stepped function does not provide evidence for lower-dimensional structure within the dataset. (B) Feature loadings (weights) of PC4-PC9. Loadings are flipped based on their relation to task performance, like for PC2-PC3 in Figure 3. (C) Age trajectories of the top 8 PCs, by age group. Corresponding statistics in Appendix 8—table 1.

Author response image 1

Download asset Open asset

Author response image 2

Download asset Open asset

Author response image 3

Download asset Open asset

Author response image 4

Download asset Open asset

Tables

Table 1

Statistics of ANOVAs predicting raw parameter values from task (A, B, C).

When an ANOVA showed a significant task effect, we followed up with post-hoc, Bonferroni-corrected t-tests. * $p < .05$ ; ** $p < .01$ ; *** $p < .001$ .

Parameter	Model	Tasks	F / t	df	$p$	sig.
$\frac{1}{β}$	ANOVA	A, B	830	1	$p < 0.001$	***
	t-test	A vs B	25	246	$p < 0.001$	***
$α_{+}$	ANOVA	A, B, C	2,018	2	$p < 0.001$	***
	t-test	A vs B	66	246	$p < 0.001$	***
	t-test	A vs C	12	246	$p < 0.001$	***
	t-test	B vs C	51	246	$p < 0.001$	***
$α_{-}$	ANOVA	B, C	2,357	1	$p < 0.001$	***
	t-test	B vs C	49	246	$p < 0.001$	***
Forgetting	ANOVA	A, C	161	1	$p < 0.001$	***
	t-test	A vs C	49	246	$p < 0.001$	***

Table 2

Assessing task effects on parameter age trajectories.

Model fits (AIC scores) of regression models predicting parameter age trajectories, comparing the added value of including (‘AIC with task’) versus excluding (‘AIC without task’) task as a predictor. Differences in AIC scores were tested statistically using F-tests. Better (smaller) model fits are highlighted in bold. The coefficients of the winning models (simpler model ‘without task’ unless adding task predictor leads to significantly better model fit) are shown in Table 3.

Parameter	AIC without task	AIC with task	F(df)	p	sig.
$\frac{1}{β} / ϵ$	2,044	2,054	NA	NA	–
$α_{+}$	2,044	2,042	$F (4, 245) = 2.34$	$p = 0.056$	–
$α_{-}$	1,395	1,373	$F (2, 245) = 6.99$	$p = 0.0011$	**
Forgetting	1,406	1,411	NA	NA	–

Table 3

Statistical tests on age trajectories: mixed-effects regression models predicting z-scored parameter values from task (A, B, C), age, and squared age (months).

When the task-less model fitted best, the coefficients of this (‘grand’) model are shown, reflecting shared age trajectories (Table 2; $\frac{1}{β} / ϵ$ , $α_{+}$ , forgetting). When the age-based model fitted better, pairwise follow-up models are shown ( $α_{-}$ ), reflecting task differences. p-Values of follow-up models were corrected for multiple comparison using the Bonferroni correction. * $p < .05$ ; ** $p < .01$ , *** $p < .001$ .

Parameter	Tasks	Predictor	$β$	$p$ (Bonf.)	sig.
$\frac{1}{β} / ϵ$	A, B, C	Intercept	1.86	$< 0.001$	***
		Age (linear)	–0.17	0.003	**
		Age (quadratic)	0.004	$< 0.001$	***
$α_{+}$	A, B, C	Intercept	–2.10	$< 0.001$	***
		Age (linear)	0.20	$< 0.001$	***
		Age (quadratic)	–0.004	$< 0.001$	***
$α_{-}$	B, C	Task (main effect)	4.15	$< 0.001$	***
		Task * linear age (interaction)	0.43	$< 0.001$	***
		Task * quadratic age (interaction)	–0.010	$< 0.001$	***
Forgetting	A, C	Intercept	0.37	0.44
		Age (linear)	–0.034	0.53
		Age (quadratic)	0.001	0.63

Table 4

Statistics of the regression models predicting each parameter from the corresponding parameter in a different task, while controlling for age.

Results were identical when predicting task A from B and task B from A, for all pairs of tasks. Therefore, only one set of results is shown, and predictor and outcome task are not differentiated. Stars indicate significance as before; ‘$’ indicates $p < 0.1$ .

Parameter	Tasks	$β$	p	sig.
$\frac{1}{β}$ , $ϵ$	A & B	0.28		***
	A & C	0.19	0.0022	**
	B & C	0.039	0.54
$α_{+}$	A & B	0.13	0.035	*
	A & C	0.23		***
	B & C	–0.073	0.25
$α_{-}$	B & C	–0.12	0.058	$
Forgetting	A & C	0.097	0.13

Table 5

Selected coefficients of the repeated, k-fold cross-validated Ridge regression models predicting one parameter from all parameters of a different task.

The table includes all significant coefficients and selected non-significant coefficients.

Predicted parameter (Task)	Predicting parameter (Task)	Coefficient	$p$	sig.
Noise/exploration (A)	Exploration $\frac{1}{β}$ (B)	0.14	0.031	*
	$α_{-}$ (B)	0.14	0.032	*
	Persistence (B)	–0.19	0.0029	**
	Noise $ϵ$ (C)	0.12	0.038	*
	$α_{-}$ (C)	–0.18	0.045	*
		–0.19	0.023	*
Noise/exploration (B)	Noise/exploration (A)	0.09	0.27	–
Noise/exploration (C)	Noise/exploration (A)	0.04	0.63	–
$α_{+}$ (A)	$α_{-}$ (C)	0.22	0.011	*
	$ρ$ (C)	0.16	0.050	*
	$K$ (C)	0.15	0.020	*
	Exploration $\frac{1}{β}$ (B)	0.19	0.0026	**
	$α_{-}$ (B)	–0.21	$< 0.001$	***
	$α_{+}$ (B)	0.0042	0.94	–
	Persistence (B)	0.23	$< 0.001$	***
$α_{+}$ (B)	$\frac{1}{β}$ (A)	–0.077	0.37	–
	$α_{+}$ (A)	0.058	0.48	–
	$α_{+}$ (C)	–0.00018	0.99	–
	$α_{-}$ (C)	–0.000055	1.00	–
	Forgetting (A)	0.015	0.82	–
$α_{+}$ (C)	$α_{+}$ (A)	0.20	0.013	*
$α_{-}$ (B)	$α_{+}$ (A)	–0.25	0.0018	**
$α_{-}$ (C)(C)	$α_{+}$ (A)	0.24	0.0022	**

Table 6

Statistics of selected coefficients in the repeated, k-fold cross-validated Ridge regression models predicting each model parameter from all behavioral features of all three tasks.

The table includes all significant coefficients of within-task predictors, and a selected number of non-significant and between-task coefficients.

Predicted parameter (Task)	Predicting parameter (Task)	coefficient	$p$	sig.
Noise/exploration (A)	Win-stay (A)	–0.30	<0.001	***
	Lose-stay (A)	–0.23	<0.001	***
	Accuracy (A)	–0.19	0.0076	**
	Response times (A)	0.092	0.029	*
	Delay (A)	0.25	<0.001	***
Noise/exploration (B)	Win-stay (B)	–0.58	<0.001	***
	Lose-stay (B)	0.091	0.0034	**
	Accuracy (B)	–0.36	<0.001	***
	Win-stay (A)	–0.12	0.032	*
	Response times (A)	0.059	0.051	–
$α_{+}$ (A)	Win-stay (A)	0.74	<0.001	***
$α_{+}$ (B)	Win-stay (B)	0.27	<0.001	***
$α_{+}$ (C)	Accuracy (C)	0.24	0.033	*
$α_{-}$ (B)	Win-stay (B)	0.29	<0.001	***
	Lose-stay (B)	–0.71	<0.001	***
	Accuracy (B)	–0.28	<0.001	***
$α_{-}$ (C)	Win-stay (C)	0.16	0.009	**
	Lose-stay (C)	–0.41	<0.001	***

Appendix 2—table 1

Task descriptions in the Markov decision process framework.

POMDP: Partially-observable Markov Decision Process. ‘Pos. stochastic’: positive outcomes are delivered stochastically. ‘Neg. deterministic’: negative outcomes are delivered deterministically.

	Number of States	Number of Actions	Reward function
Task A	4 (1 per trial)	2 (visible on screen)	Stable, stochastic
Task B	Stateless / POMDP	2 (visible on screen)	Volatile, pos. stochastic, neg. deterministic
Task C	2/3/4/5 (1 per trial)	3 (not visible)	Stable, deterministic

Appendix 5—table 1

Same as Table 1, but for simulated agents with perfect generalization, rather than humans.

Parameter	Model	Tasks	F / t	df	$p$	sig.
$\frac{1}{β}$	ANOVA	A, B	2629	1	$p < 0.001$	***
	t-test	A vs B	49	246	$p < 0.001$	***
$α_{+}$	ANOVA	A, B, C	3753	2	$p < 0.001$	***
	t-test	A vs B	189	246	$p < 0.001$	***
	t-test	A vs C	13	246	$p < 0.001$	***
	t-test	B vs C	67	246	$p < 0.001$	***
$α_{-}$	ANOVA	B, C	6608	1	$p < 0.001$	***
	t-test	B vs C	81	246	$p < 0.001$	***
Forgetting	ANOVA	A, C	185	1	$p < 0.001$	***
	t-test	A vs C	14	246	$p < 0.001$	***

Appendix 5—table 2

Same as Table 2, but for simulated agents with perfect generalization, rather than humans.

Parameter	AIC without task	AIC with task	F(df)	p	sig.
$\frac{1}{β} / ϵ$	1,938	1,937	NA	NA	–
$α_{+}$	1,992	1,996	NA	NA	–
$α_{-}$	1,350	1,355	NA	NA	–
Forgetting	1,345	1,344	$F (2, 245) = 4.42$	$p = 0.013$	*

Appendix 5—table 3

Same as Table 3, but for simulated agents with perfect generalization, rather than humans.

Parameter	Tasks	Predictor	$β$	$p$ (Bonf.)	sig.
$\frac{1}{β} / ϵ$	A, B, C	Intercept	2.55	$< 0.001$	***
		Age (linear)	–0.25	$< 0.001$	***
		Age (quadratic)	0.005	$< 0.001$	***
$α_{+}$	A, B, C	Intercept	–2.27	$< 0.001$	***
		Age (linear)	0.22	$< 0.001$	***
		Age (quadratic)	–0.004	$< 0.001$	***
$α_{-}$	A, B, C	Intercept	–1.03	0.055
		Age (linear)	0.06	0.12
		Age (quadratic)	–0.002	0.25
Forgetting	A, C	Intercept	0.57	0.29
		Age (linear)	–0.045	0.47
		Age (quadratic)	0.001	0.70

Appendix 5—table 4

Same as Table 4, but for simulated agents with perfect generalization, rather than humans.

Parameter	Tasks	$β$	p	sig.
$\frac{1}{β}$ , $ϵ$	A & B	3.04	$< 0.001$	***
	A & C	0.72	$< 0.001$	***
	B & C	0.44	$< 0.001$	***
$α_{+}$	A & B	0.34	0.002	**
	A & C	0.01	$< 0.001$	***
	B & C	0.008	0.009	**
$α_{-}$	B & C	0.018	$< 0.001$	***
Forgetting	A & C	0.023	$< 0.001$	***

Appendix 6—table 1

Statistics of mixed-effects regression models predicting z-scored behavioral features from task (task A, task B, task C), age, and squared age (months).

The task-less grand model is reported when it had the best model fit (win-stay, Delay). Otherwise, pairwise follow-up models are shown (RT, ACC, lose-stay), with p-values corrected for multiple comparison using the Bonferroni correction. * $p < .05$ ; ** $p < .01$ , *** $p < .001$ .

Parameter	Tasks	Predictor	$β$	$p$ (Bonf.)	sig.
RT	task B & task A	Task (main effect)	2.15	0.006	**
		Linear age	–0.23	0.003	**
		Task * linear age (interaction)	–0.25	0.003	**
		Task * quadratic age (interaction)	0.007	0.003	**
	task B & task C	Task (main effect)	–0.76	0.69
		Linear age	–0.48	$< 0.001$	***
		Task * linear age (interaction)	0.10	0.45
		Task * quadratic age (interaction)	–0.003	0.288
	task A & task C	Task (main effect)	1.40	0.63
		Linear age	–0.23	0.003	**
		Task * linear age (interaction)	–0.15	0.084
		Task * quadratic age (interaction)	0.004	0.129
ACC	task B & task A	Task (main effect)	1.27	0.36
		Linear age	0.27	$< 0.001$	***
		Task * linear age (interaction)	–0.10	0.87
		Task * quadratic age (interaction)	0.001	1
	task B & task C	Task (main effect)	–2.15	0.033	*
		Linear age	0.17	0.036	*
		Task * linear age (interaction)	0.20	0.118
		Task * quadratic age (interaction)	–0.004	0.33
	task A & task C	Task (main effect)	–0.88	0.60
		Linear age	0.27	$< 0.001$	***
		Task * linear age (interaction)	0.10	0.57
		Task * quadratic age (interaction)	–0.003	0.57
WS	—–	Intercept	–3.05	$< 0.001$	***
		Age (linear)	0.31	$< 0.001$	***
		Age (quadratic)	–0.007	$< 0.001$	***
LS	task B & task A	Task (main effect)	–0.90	0.42
		Linear age	0.075	0.87
		Task * linear age (interaction)	0.12	0.42
		Task * quadratic age (interaction)	–0.004	0.29
	task B & task C	Task (main effect)	4.84	$< 0.001$	***
		Linear age	0.20	0.015	*
		Task * linear age (interaction)	–0.51	$< 0.001$	***
		Task * quadratic age (interaction)	0.012	$< 0.001$	***
	task A & task C	Task (main effect)	3.94	$< 0.001$	***
		Linear age	0.075	0.54
		Task * linear age (interaction)	–0.39	$< 0.001$	***
		Task * quadratic age (interaction)	0.008	0.003	**
Delay	—–	Intercept	0.95	0.035	*
		Age (linear)	–0.09	0.07
		Age (quadratic)	0.002	0.14

Appendix 8—table 1

Statistics of regular regression models predicting each PC from two age predictors (linear and quadratic).

PC	Effect	$β$	t	p	sig.
1	age (linear)	1.56	6.56		***
	age (quadratic)	0.035	5.61		***
2	age (linear)	0.34	2.17	0.031	*
	age (quadratic)	0.007	1.64	0.10	—
3	age (linear)	0.46	3.27	0.001	**
	age (quadratic)	–0.011	–3.13	0.002	**

Appendix 8—table 2

Statistics of mixed-effects regression models predicting parameter values from task (A, B, and C), age, and squared age (months).

Only effects including task are reported. * $p < .05$ ; ** $p < .01$ , *** $p < .001$ .

Parameter	Tasks	Predictor		p	sig.
$α_{+}$	task B & task A	Task (main effect)	0.79	$< 0.001$	***
		Task * linear age (interaction)	–0.025	0.009	**
		Task * quadratic age (interaction)	0.001	0.021	*
	task B & task C	Task (main effect)	0.84	$< 0.001$	***
		Task * linear age (interaction)	–0.012	0.41
		Task * quadratic age (interaction)	$< 0.001$	0.55
	task A & task C	Task (main effect)	0.048	0.70
		Task * linear age (interaction)	–0.12	0.37
		Task * quadratic age (interaction)	$< 0.001$	0.36
$\frac{1}{β}$	task B & task A	Task (main effect)	0.49	$< 0.001$	***
		Task * linear age (interaction)	–0.026	0.046	*
		Task * quadratic age (interaction)	0.001	$< 0.001$	***
$α_{-}$	task B & task C	Task (main effect)	11.70	$< 0.001$	***
		Task * linear age (interaction)	0.58	$< 0.001$	***
		Task * quadratic age (interaction)	–0.013	$< 0.001$	***
Forgetting	task B & task C	Task (main effect)	0.10	0.36
		Task * linear age (interaction)	0.005	0.70
		Task * quadratic age (interaction)	$< 0.001$	0.67

Additional files

MDAR checklist: https://cdn.elifesciences.org/articles/75474/elife-75474-mdarchecklist1-v1.pdf
Download elife-75474-mdarchecklist1-v1.pdf

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Article PDF

Open citations (links to open the citations from this article in various online reference manager services)

Mendeley

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

Maria Katharina Eckstein
Sarah L Master
Liyu Xia
Ronald E Dahl
Linda Wilbrecht
Anne GE Collins

(2022)

The interpretation of computational model parameters depends on the context

eLife 11:e75474.

https://doi.org/10.7554/eLife.75474

Figures

Overview of the experimental paradigm.

Generalizability of absolute parameter values (A–B) and of parameter age trajectories / z-scored parameters (C–D).

Identifying the major axes of variation in the dataset.

Assessing parameter interpretability by analyzing shared variance.

What do model parameters measure? (A) View based on generalizability and interpretability.

Main results of tasks A, B, and C.

Behavioral validation of the winning model for each task.

Comparison of human parameter correlations to generalization ceiling.

Between-task parameter correlations.

Within-task parameter correlations, focusing on learning rates (x-axes) and exploration / noise parameters (y-axes).

Full Spearman correlation matrix of all features in the dataset.

Additional PCA results.

Tables

Statistics of ANOVAs predicting raw parameter values from task (A, B, C).

Assessing task effects on parameter age trajectories.

Statistical tests on age trajectories: mixed-effects regression models predicting z-scored parameter values from task (A, B, C), age, and squared age (months).

Statistics of the regression models predicting each parameter from the corresponding parameter in a different task, while controlling for age.

Selected coefficients of the repeated, k-fold cross-validated Ridge regression models predicting one parameter from all parameters of a different task.

Statistics of selected coefficients in the repeated, k-fold cross-validated Ridge regression models predicting each model parameter from all behavioral features of all three tasks.

Task descriptions in the Markov decision process framework.

Same as Table 1, but for simulated agents with perfect generalization, rather than humans.

Same as Table 2, but for simulated agents with perfect generalization, rather than humans.

Same as Table 3, but for simulated agents with perfect generalization, rather than humans.

Same as Table 4, but for simulated agents with perfect generalization, rather than humans.

Statistics of mixed-effects regression models predicting z-scored behavioral features from task (task A, task B, task C), age, and squared age (months).

Statistics of regular regression models predicting each PC from two age predictors (linear and quadratic).

Statistics of mixed-effects regression models predicting parameter values from task (A, B, and C), age, and squared age (months).

Additional files

MDAR checklist

Download links

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

Be the first to read new articles from eLife

Share this article

Cite this article

Overview of the experimental paradigm.

Generalizability of absolute parameter values (A–B) and of parameter age trajectories / z-scored parameters (C–D).

Identifying the major axes of variation in the dataset.

Assessing parameter interpretability by analyzing shared variance.

What do model parameters measure? (A) View based on generalizability and interpretability.

Main results of tasks A, B, and C.

Behavioral validation of the winning model for each task.

Comparison of human parameter correlations to generalization ceiling.

Between-task parameter correlations.

Within-task parameter correlations, focusing on learning rates (x-axes) and exploration / noise parameters (y-axes).

Full Spearman correlation matrix of all features in the dataset.

Additional PCA results.

Statistics of ANOVAs predicting raw parameter values from task (A, B, C).

Assessing task effects on parameter age trajectories.

Statistical tests on age trajectories: mixed-effects regression models predicting z-scored parameter values from task (A, B, C), age, and squared age (months).

Statistics of the regression models predicting each parameter from the corresponding parameter in a different task, while controlling for age.

Selected coefficients of the repeated, k-fold cross-validated Ridge regression models predicting one parameter from all parameters of a different task.

Statistics of selected coefficients in the repeated, k-fold cross-validated Ridge regression models predicting each model parameter from all behavioral features of all three tasks.

Task descriptions in the Markov decision process framework.

Same as Table 1, but for simulated agents with perfect generalization, rather than humans.

Same as Table 2, but for simulated agents with perfect generalization, rather than humans.

Same as Table 3, but for simulated agents with perfect generalization, rather than humans.

Same as Table 4, but for simulated agents with perfect generalization, rather than humans.

Statistics of mixed-effects regression models predicting z-scored behavioral features from task (task A, task B, task C), age, and squared age (months).

Statistics of regular regression models predicting each PC from two age predictors (linear and quadratic).

Statistics of mixed-effects regression models predicting parameter values from task (A, B, and C), age, and squared age (months).

MDAR checklist

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)