1. Neuroscience

Paranoia as a deficit in non-social belief updating

  1. Erin J Reed
  2. Stefan Uddenberg
  3. Praveen Suthaharan
  4. Christoph H Mathys
  5. Jane R Taylor
  6. Stephanie Mary Groman
  7. Philip R Corlett  Is a corresponding author
  1. Interdepartmental Neuroscience Program, Yale School of Medicine, United States
  2. Yale MD-PhD Program, Yale School of Medicine, United States
  3. Princeton Neuroscience Institute, Princeton University, United States
  4. Department of Psychiatry, Connecticut Mental Health Center, Yale University, United States
  5. Scuola Internazionale Superiore di Studi Avanzati (SISSA), Italy
  6. Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Switzerland
https://doi.org/10.7554/eLife.56345
Share this article
Cite this article
  1. Erin J Reed
  2. Stefan Uddenberg
  3. Praveen Suthaharan
  4. Christoph H Mathys
  5. Jane R Taylor
  6. Stephanie Mary Groman
  7. Philip R Corlett
(2020)
Paranoia as a deficit in non-social belief updating
eLife 9:e56345.
https://doi.org/10.7554/eLife.56345
  2. Download BibTeX
  3. Download .RIS
9 figures, 11 tables and 1 additional file

Figures

Figure 1
Download asset Open asset
Probabilistic reversal learning task.

(a) Human paradigm: participants choose between three decks of cards with different colored backs (Blue, Red, and Green) with different, unknown probabilities of reward and loss. (b) Reward contingency schedule for in laboratory experiment (Reward probabilities associated with the different colored decks, Blue, Red, Green, across trials and blocks). On trial 81, the probability context shifted from 90%, 50%, and 10% (dark grey) to 80%, 40%, and 20% without warning (light grey). (c), Reward contingency schedules for online experiment. (d) Rat paradigm: subjects choose between three noseports (Blue, Red, Green, for illustrative puposes) with different probabilities of sucrose pellet reward. (e) Reward contingency schedule for rat experiment (Groman et al., 2018). Performance dependent reversals occur after a certain number of choices of the high reward deck. Performance independent reversals occur regardless of participant behavior.

Figure 2
Download asset Open asset
Hierarchical Gaussian Filter (HGF) model parameters.

(a) 3-level HGF perceptual model (blue) with a softmax decision model (green). Level 1 (x1): trial-by-trial perception of win or loss feedback. Level 2 (x2): stimulus-outcome associations (i.e., deck values). Level 3 (x3): perception of the overall reward contingency context. The impact of phasic volatility upon x2 is captured by κ (i.e., coupling). Tonic volatility modulates x3 and x2 via ω3 and ω2, respectively. μ30 is the initial value of the third level volatility belief. (b) HGF model parameter estimates from each of our three studies (in laboratory, online, rat - columns), ω3, μ30, κ, and ω2, displayed hierarchically, in rows, in parallel with the position of the particular parameter in the model depiction in a). Parameters replicate across high paranoia groups in the in-laboratory experiment (n = 21 low paranoia [gray], 11 high paranoia [orange]; dark bars are initial task blocks, lighter bars follow the contingency transition); the analogous online task (version 3, n = 56 low paranoia [gray], 16 high paranoia [orange]; dark bars are initial task blocks, lighter bars follow the contingency transition); and rats exposed to chronic, escalating saline or methamphetamine (n = 10 per group, Pre-Rx [dark gray]; Post-Rx, n = 10 saline [light gray], seven methamphetamine [orange]). Center lines depict medians; box limits indicate the 25th and 75th percentiles; whiskers extend 1.5 times the interquartile range from the 25th and 75th percentiles, outliers are represented by dots; crosses represent sample means; data points are plotted as open circles. *p≤0.05, **p≤0.01, ***p≤0.001.

Figure 3
Download asset Open asset
Paranoia effects across task versions.

(a) Estimated model parameters derived from participant choices in response to the tasks. Low paranoia is shown in gray, high paranoia is shown in orange. μ30, κ, and ω2 are shown in separate panels (top, middle, and bottom panels, respectively; y-axes). X-axes depict each separate online task version from Experiment 2 (version 1: Easy-Easy, version 2: Hard-Hard, version 3: Easy-Hard, version 4: Hard-Easy). (b) Behavior. Win-switch rate (top): paranoid participants switched between decks more frequently after positive feedback. Rates are collapsed across all task versions and blocks (paranoia group effect; n = 234 low paranoia [gray], 73 high paranoia [orange]). U-value (bottom): a measure of choice stochasticity, calculated for low (gray) and high (orange) paranoia participants and collapsed across task blocks. U-values are shown separately for each online task version (1 through 4, as in part a). In versions 3 and 4 only (the versions containing unsignaled contingency transitions), paranoid participants showed higher U-values, suggesting increasingly stochastic switching rather than perseverative returns to a previously rewarding option. Center lines show the medians; box limits indicate the 25th and 75th percentiles; whiskers extend 1.5 times the interquartile range from the 25th and 75th percentiles, outliers are represented by dots; crosses represent sample means; data points are plotted as open circles. P-values correspond to estimated marginal means post-hoc comparisons: *p≤0.05, **p≤0.01, ***p≤0.001.

Figure 4
Download asset Open asset
Correlations between κ and symptoms, with and without paranoia scores of zero.

Paranoia (SCID-II, top), depression (BDI, middle), and anxiety (BAI, bottom). (a) Among all 72 subjects from online version 3, κ correlates with paranoia (r = 0.30, p=0.011, top) and depression (r = 0.250, p=0.034, middle), but not anxiety (r = 0.210, p=0.077, bottom). (b) Among participants who endorse at least one paranoia item (SCID-II paranoia >0, n = 39), κ correlates with paranoia (r = 0.588, p=8.1E-5, top), depression (r = 0.427, p=0.007, middle), and anxiety (r = 0.367, p=0.021, bottom). All correlations are two-tailed.

Figure 5
Download asset Open asset
Dimensionality reduction analysis.

Principal component analysis (PCA) was performed on behavioral data to explain the relationship between κ and the rating scales - paranoia (SCID), depression (BDI) and anxiety (BAI). (a) Scree plot of PCA illustrates percent of variance for each component explained by SCID, BDI and BAI. (b) Principal component 1 (PC1) plotted against κ values. κ correlates with PC1 (r = 0.272, p=0.021).

Figure 6
Download asset Open asset
Parameter effects on simulated task performance.

We simulated behavior from low paranoia participants (online Version 3, n = 54) to evaluate the effects of κ,μ30, ω2, and ω3 on win-shift and lose-stay rates. Estimated perceptual parameters were averaged across subjects to create a single set of baseline parameters. Additional parameter sets were created by doubling or halving one parameter at a time (e.g., 2 κ or 0.5 κ), while the others were held constant (n.b., 2 ω2 violated model assumptions and was excluded from analysis). We also included the average parameter values of rats exposed to methamphetamine (Meth). Ten simulations were run per subject for each condition (i.e., parameter set). Win-shift and lose-stay rates were calculated, then averaged across simulations and subjects. Rates from each condition were divided by the baseline condition rate to generate relative win-shift and lose-stay rates. We compared relative rates for each condition to the baseline (relative rate of 1, depicted as the dotted line; paired t-tests, Bonferroni-corrected p-values). Of note, baseline parameters were positive for κ and ω2, and negative for μ30 and ω3. Consequently, the doubled (2x) condition makes μ30 and ω3 more negative (lower). (n = 54). Box-plots: center lines show the medians; box limits indicate the 25th and 75th percentiles; whiskers extend 1.5 times the interquartile range from the 25th and 75th percentiles, outliers are represented by dots; crosses represent sample means; data points are plotted as open circles; *p≤0.05, **p≤0.01, ***p≤0.001.

Figure 7
Download asset Open asset
Parameter recovery.

(a) Actual subject trajectory: this is an example choice trajectory from one participant (top). The layers correspond to the three layers of belief in the HGF model (depicted in Figure 2a). Focusing on the low-level beliefs (yellow box): The purple line represents the subject’s estimated first-level belief about the value of choosing deck 1; blue, their belief about the value of choosing deck 2; and red, their belief about the value of choosing deck 3. Simulated subject trajectory represents the estimated beliefs from choices simulated from estimated perceptual parameters from that participant (middle), and Recovered subject trajectory represents what happens when we re-estimate beliefs from the simulated choices (bottom). Crucially, Simulated trajectories closely align with real trajectories (the increases and decreased in estimated beliefs about the values of each deck [purple, blue, red lines] align with each other across actual, simulated and recovered trajectories), although trial-by-trial choices (colored dots and arrow) occasionally differ. Outcomes (1 or 0; black dots and arrows) remain the same. (b) Actual versus Recovered: these data represent the belief parameters estimated from the participant’s responses (Actual) compared to those estimated from the choices simulated with the participant’s perceptual parameters (Recovered). Actual and Recovered values significantly correlate for ω2 (r = 0.702, p=2.52E-11) and κ (r = 0.305, p=0.011) but not ω3 (r = 0.172, p=0.16) or µ30 (r = 0.186, p=0.13). Box plots: gray indicates low paranoia, orange designates high paranoia; center lines depict medians; box limits indicate the 25th and 75th percentiles; whiskers extend 1.5 times the interquartile range from the 25th and 75th percentiles, outliers are represented by dots; crosses represent sample means; data points are plotted as open circles. Online version three dataset.

Figure 8
Download asset Open asset
Behavioral data and simulations.

(a) Plots of in laboratory and online behavioral metrics. Win-switch rate (switching after positive feedback), U-value (behavioral stochasticity) and Lose-stay rate (perseverating after a loss). Low paranoia participants are shown in gray, High paranoia in orange. Win-switch rates and U-values are collapsed across blocks. For Lose-stay rates, darker colors are block one data and lighter colors are block two data. Behavioral switching patterns replicate across in laboratory and online version three experiments. Perseveration after negative feedback (lose-stay behavior) did not significantly differ between paranoia groups or task block. (b) Simulated data generated from HGF perceptual parameters (version 3). Win-switch rate, U-value and Lose-stay rate of the simulated data are depicted. The model simulated data replicate the win-switch and U-value behavioral differences between high and low paranoia participants presented in panel a. Like the real participants, there was no difference in lose-stay rates in the simulated data. Center lines show the medians; box limits indicate the 25th and 75th percentiles; whiskers extend 1.5 times the interquartile range from the 25th and 75th percentiles, outliers are represented by dots; crosses represent sample means; data points are plotted as open circles.*p≤0.05, **p≤0.01, ***p≤0.001. Plots of participant behavioral metrics (a) are presented side by side with simulated data (b).

Figure 9
Download asset Open asset
Cluster analysis of HGF parameters.

Two-step cluster analysis of model parameters (ω3, μ30, κ , ω2) across rat and human data sets (rat, post-Rx; in laboratory and online version 3, block 1). Automated clustering yielded an optimal two clusters with good cohesion and separation (average silhouette coefficient = 0.7; cluster size ratio = 2.46). (a) Density plots for μ30, κ, ω2, and ω3 (light pink) depict cluster-specific distributions for each parameter (red). Unlike frequency histograms (that depict the number of data points in bins), density plots employ smoothing to prioritize distribution shape and are not restricted by bin size. Beneath each density plot, box-plots of overall median, 25th quartile, and 75th quartile for each parameter are aligned (pink), with cluster medians and quartiles superimposed (red). Relative to the overall distribution, Cluster 1 (n = 35) medians are elevated for μ30 and κ, decreased for ω2 and ω3. Cluster 2 (n = 86) falls within each overall distribution. (b) Predictor importance of included parameters. Consistent with the color scheme in Figure 2a, Uncertainty weighting parameters (κ, ω2, ω3 ) are depicted in purple and μ30 the prior is in blue. (c) Distribution of cluster identities within groups. Black bars signify the proportion of group members assigned to Cluster one and gray bars represent the proportion of group members assigned to Cluster 2. Cluster one membership is significantly associated with paranoia and methamphetamine groups (χ2(1, n = 121)=29.447, p=5.75E-8). Columns display means [standard error] or percentage of participants within the described category, test-statistics, and p-values. †Independent samples t-test: t-value (df). Two-tailed P-values reported. ‡Chi square coefficient (df). §Fisher’s exact test, exact significance (2-sided). Equal variances not assumed. #Not significant (Bonferonni correction). ††Data presented in Figure 8; repeated measures ANOVA, paranoia group trend or effect: F(df), P; estimated marginal means and standard error. ‡‡Data presented in Figure 2; repeated measures ANOVA, F(df), P. In laboratory: paranoia x block interactions for ω3, μ30; paranoia group effects for κ, ω2. Version 3: paranoia group effects reported. See Table 3 for complete ANOVA. results. Version columns display means [standard error] or percentage of participants within the described category. ††Univariate analysis, F(df). ‡Exact test, chi-square coefficient (df). § Exact significance (2-sided). ||Monte Carlo significance (2-sided). ‡‡Data presented in Figure 3; repeated measures ANOVA, F(df), P. Mean values collapsed across blocks.

Tables

Table 1
In Lab vs. Online Version 3.
In LabOnline Version 3
Low Paranoia (n=21)High Paranoia (n=11)Statisticp-valueLow Paranoia (n=56)High Paranoia (n=16)Statisticp-value
Demographics
Age (years)36.0 [3.2]38.9 [3.9]-0.531 (27)†0.638.6 [1.6]32.9 [1.7]2.441 (41.8)†0.019
Gender0.006 (1)‡1§.780 (1)‡0.410
% Female71.4%72.7%n/an/a50.0%62.5%n/an/a
% Male28.6%27.3%n/an/a50.0%37.5%n/an/a
% Other or not specified0%0%n/an/a0%0%n/an/a
Education4.972 (6)‡0.638§5.351 (6)‡0.549§
% High school degree or equivalent 19.0%45.5%n/an/a16.1%6.3%n/an/a
% Some college or university, no degree14.3%0%n/an/a17.9%25.0%n/an/a
% Associate degree 9.5%9.1%n/an/a12.5%12.5%n/an/a
% Bachelor's degree 23.8%27.3%n/an/a35.7%56.3%n/an/a
% Master's degree 9.5%0%n/an/a14.3%0%n/an/a
% Doctorate or professional degree 4.8%0%n/an/a1.8%0%n/an/a
% Completed some postgraduate0%0%n/an/a1.8%0%n/an/a
% Other / not specified19.0%18.2%n/an/a0%0%n/an/a
Ethnicity.134 (1)‡1§.117 (1)‡1§
% Hispanic, Latino, or Spanish origin23.8%18.2%n/an/a8.9%6.3%n/an/a
% Not of Hispanic, Latino, or Spanish origin76.2%81.8%n/an/a91.1%93.8%n/an/a
Race6.250 (4)‡0.186§5.368 (4)‡0.229§
% White61.9%36.4%n/an/a85.7%75.0%n/an/a
% Black or African American19.0%36.4%n/an/a0%12.5%n/an/a
% Asian14.3%9.1%n/an/a3.6%6.3%n/an/a
% American Indian or Alaska Native4.8%0%n/an/a1.8%6.3%n/an/a
% Multiracial0%0%n/an/a3.6%0%n/an/a
% Other / not specified0%18.2%n/an/a5.4%0%n/an/a
Mental Health
Psychiatric diagnosis12.329 (2)‡0.002§7.850 (3)‡0.039§
% No psychiatric diagnosis71.4%9.1%adj. residuals0.00471.4%50.0%adj. residuals0.465
% Schizophrenia spectrum19.0%36.4%adj. residuals0.5460%6.3%adj. residuals0.307
% Mood disorder9.5%54.5%adj. residuals0.020#21.4%43.8%adj. residuals0.356
% Not specified0%0%adj. residualsn/a7.1%0%adj. residuals0.751
% Medicated23.8%81.8%9.871 (1)‡0.003§7.1%31.3%8.730 (2)‡0.023§
Beck's Anxiety Inventory0.27 [0.08]0.85 [0.17]-3.453 (30)†0.0020.24 [0.04]0.90 [0.20]-3.303 (16.179)†0.004
Beck's Depression Inventory0.23 [0.05]0.66 [0.15]-2.67 (11.854)†0.0210.25 [0.04]1.03 [0.19]-3.951 (16.659)†0.001
SCID Paranoia Personality Score0.09 [0.02]0.63 [0.04]-13.476 (30)†2.92E-140.1 [0.02]0.72 [0.04]-16.551 (70)†6.712E-26
Reversal Learning Performance
Total points earned7061.9 [286.9]6290.9 [372.2]1.608 (30)†0.1187533.0 [143.8]6503.1 [340.6]3.177 (70)†0.002
Total reversals achieved4.8 [0.7]2.5 [0.8]2.145 (30)†0.046.3 [0.3]4.9 [0.8]1.758 (20.14)†0.094
% Achieving reversals90.5%72.7%1.407 (1)‡0.327§100%87.5%7.200 (1)‡0.047§
Trials to first reversal29.2 [4.5]27.9 [11]0.136 (25)†0.89320.0 [1.7]13.7 [1.8]1.774 (68)†0.081
% Recovering post-reversal81.0%54.5%2.490 (1)‡0.213§91.1%69.0%3.482 (1)‡0.097§
Trials to switch1.68 [0.22]1.43 [0.20]0.671 (24)†0.5092.1 [0.2]2.6 [0.6]-1.088 (64)†0.280
Trials to recovery3.75 [0.51]4 [0.93]-0.285 (21)†0.7792.9 [0.3]4.9 [0.8]-2.694 (60)†0.009
Win-switch rate, block 1 (90-50-10)0.08 [0.03]0.24 [0.09]-1.742 (12.379)†0.1060.04 [0.01]0.13 [0.05]-1.906 (15.762)†0.075
Win-switch rate, block 2 (80-40-20)0.07 [0.04]0.21 [0.1]-1.601 (30)†0.120.02 [0.01]0.12 [0.05]-2.02 (15.915)†0.061
Lose-stay rate, block 1 (90-50-10)0.19 [0.03]0.13 [0.06]0.919 (30)†0.3650.30 [0.03]0.39 [0.06]-1.425 (70)†0.158
Lose-stay rate, block 2 (80-40-20)0.26 [0.05]0.12 [0.05]1.817 (30)†0.0790.33 [0.03]0.37 [0.06]-0.554 (70)†0.581
Null trials8.5 [2.8]10.4 [3.7]-0.391 (30)†0.699n/an/an/an/a

  1. † Independent samples t-test: t-value (df). Two-tailed p-values reported ‡ Exact test, chi-square coefficient (df)§ Exact significance (2-sided)¶ Equal variances not assumed # Not significant (bonferonni correction).

Table 2
Online experiment.
Version 1Version 2Version 3Version 4Version EffectParanoia EffectInteraction
 Low Paranoia (n=45)High Paranoia (n=20)Low Paranoia (n=69)High Paranoia (n=18)Low Paranoia (n=56)High Paranoia (n=16)Low Paranoia (n=64)High Paranoia (n=19)Statisticp-valueStatisticp-valueStatisticp-value
Demographics
Age (years)36.5 [1.5]35.4 [2.4]36.2 [1.4]39.5 [2.8]38.6 [1.6]32.9 [1.7]37.6 [1.3]30.7 [1.6]1.12 (3)††0.3423.202 (1)††0.0752.619 (3)††0.051
Gender7.29 (6)‡0.238§1.373 (2)‡0.503§n/an/a
% Female44.4%45.0%47.8%50.0%50.0%62.5%57.8%73.7%n/an/an/an/an/an/a
% Male55.6%55.0%50.7%50.0%50.0%37.5%42.2%26.3%n/an/an/an/an/an/a
% Other or not specified0%0%1.4%0%0%0%0%0%n/an/an/an/an/an/a
Education15.9 (21)‡0.812||7.326 (7)‡0.4§n/an/a
% High school degree or equivalent 17.8%20.0%13.0%16.7%16.1%6.3%25.0%10.5%n/an/an/an/an/an/a
% Some college or university, no degree22.2%30.0%24.6%22.2%17.9%25.0%25.0%26.3%n/an/an/an/an/an/a
% Associate degree 13.3%15.0%17.4%22.2%12.5%12.5%9.4%21.1%n/an/an/an/an/an/a
% Bachelor's degree 33.3%35.0%40.6%22.2%35.7%56.3%28.1%31.6%n/an/an/an/an/an/a
% Master's degree 8.9%0%2.9%0%14.3%0%7.8%10.5%n/an/an/an/an/an/a
% Doctorate or professional degree 4.4%0%0%5.6%1.8%0%1.6%0%n/an/an/an/an/an/a
% Completed some postgraduate0%0%1.4%5.6%1.8%0%3.1%0%n/an/an/an/an/an/a
% Other / not specified0%0%0%5.6%0%0%0%0%n/an/an/an/an/an/a
Income14.961 (18)‡.671||1.177 (6)‡0.981§n/an/a
Less than $20,00024.4%25.0%24.6%33.3%17.9%37.5%23.4%15.8%n/an/an/an/an/an/a
$20,000 to $34,99940.0%25.0%20.3%22.2%33.9%31.3%28.1%31.6%n/an/an/an/an/an/a
$35,000 to $49,99915.6%15.0%18.8%16.7%12.5%6.3%18.8%15.8%n/an/an/an/an/an/a
$50,000 to $74,99913.3%35.0%20.3%5.6%21.4%12.5%18.8%21.1%n/an/an/an/an/an/a
$75,000 to $99,9994.4%0%7.2%11.1%8.9%6.3%7.8%15.8%n/an/an/an/an/an/a
Over $100,0000%0%5.8%5.6%3.6%6.3%1.6%0%n/an/an/an/an/an/a
Not specified2.2%0%2.9%5.6%1.8%0%1.6%0%n/an/an/an/an/an/a
Cognitive Reflection11.922 (9)‡0.223||7.002 (3)‡0.071§n/an/a
% Answering 0/3 correctly11.1%25.0%10.1%11.1%17.9%25.0%15.6%26.3%n/an/an/an/an/an/a
% Answering 1/3 correctly4.4%5.0%15.9%11.1%8.9%25.0%14.1%15.8%n/an/an/an/an/an/a
% Answering 2/3 correctly13.3%25.0%15.9%16.7%19.6%25.0%21.9%31.6%n/an/an/an/an/an/a
% Answering 3/3 correctly71.1%45.0%58.0%61.1%53.6%25.0%48.4%26.3%n/an/an/an/an/an/a
Ethnicity5.162 (3)‡0.157§3.715 (1)‡0.069§n/an/a
% Hispanic, Latino, or Spanish origin4.4%15.0%1.4%0%8.9%6.3%1.6%15.8%n/an/an/an/an/an/a
% Not of Hispanic, Latino, or Spanish origin95.6%85.0%98.6%100.0%91.1%93.8%98.4%84.2%n/an/an/an/an/an/a
Race19.559 (15)‡.173||9.626 (5)‡0.084§n/an/a
% White82.2%75.0%84.1%88.9%85.7%75.0%85.9%73.7%n/an/an/an/an/an/a
% Black or African American6.7%15.0%5.8%11.1%0%12.5%4.7%10.5%n/an/an/an/an/an/a
% Asian8.9%10.0%7.2%0%3.6%6.3%7.8%0%n/an/an/an/an/an/a
% American Indian or Alaska Native0%0%0%0%1.8%6.3%0%0%n/an/an/an/an/an/a
% Multiracial2.2%0%1.4%0%3.6%0%1.6%15.8%n/an/an/an/an/an/a
% Other / not specified0%0%1.4%0%5.4%0%0%0%n/an/an/an/an/an/a
Mental Health
Psychiatric diagnosis10.783 (9)‡0.292||2.960 (3)‡0.361§n/an/a
% No psychiatric diagnosis73.3%80.0%60.9%55.6%71.4%50.0%65.6%42.1%n/an/an/an/an/an/a
% Schizophrenia spectrum2.2%0%0%0%0%6.3%0%0%n/an/an/an/an/an/a
% Mood disorder13.3%15.0%27.5%22.2%21.4%43.8%26.6%31.6%n/an/an/an/an/an/a
% Not specified11.1%5.0%11.6%22.2%7.1%0%7.8%26.3%n/an/an/an/an/an/a
% Medicated8.9%10.0%13.0%22.2%7.1%31.3%14.1%10.5%3.575 (6)‡0.744§4.164 (2)‡0.121§n/an/a
Beck's Anxiety Inventory0.34 [0.06]0.52 [0.14]0.31 [0.04]0.6 [0.13]0.24 [0.04]0.90 [0.20]0.33 [0.06]0.79 [0.18]1.244 (3)†0.294138.752 (1)††1.63E-092.577 (3)††0.0539
Beck's Depression Inventory0.36 [0.07]0.86 [0.15]0.32 [0.05]0.79 [0.13]0.25 [0.04]1.03 [0.19]0.38 [0.07]1.06 [0.20]1.023 (3)†0.382774.528 (1)††3.62E-161.089 (3)††0.3542
SCID Paranoia Personality Score0.11 [0.02]0.67 [0.04]0.11 [0.02]0.61 [0.03]0.1 [0.02]0.72 [0.04]0.11 [0.02]0.65 [0.03]1.297 (3)†0.2756879.379 (1)††4.81E-912.018 (3)††0.1114
Reversal Learning Performance
Total points earned8656.7 [182.9]8372.5 [405.2]6045.7 [135.7]6266.7 [288.0]7533.0 [143.8]6503.1 [340.6]7171.1 [175.6]6510.5 [403.6]32.288 (3)†4.16E-186.175 (1)††0.01352.258 (3)††0.0818
Total reversals achieved7.2 [0.3]6.5 [0.5]5.5 [0.3]5.7 [0.5]6.3 [0.3]4.9 [0.8]5.9 [0.3]4.8 [0.6]4.329 (3)†0.0055.762 (1)††0.0171.101 (3)††0.349
% Achieving reversals100%100%98.6%94.4%100%87.5%96.9%94.7%2.26 (3)‡0.598§4.4 (1)‡0.058§n/an/a
Win-switch rate, block 1 (90-50-10)0.09 [0.03]0.09 [0.04]0.07 [0.01]0.11 [0.05]0.04 [0.01]0.13 [0.05]0.1 [0.03]0.21 [0.06]2.284 (3)†0.0797.117 (1)††0.0081.15 (3)††0.329
Win-switch rate, block 2 (80-40-20)0.05 [0.02]0.08 [0.03]0.04 [0.01]0.05 [0.04]0.02 [0.01]0.12 [0.05]0.06 [0.02]0.15 [0.05]2.067 (3)†0.1059.918 (1)††0.0021.174 (3)††0.32
Lose-stay rate, block 1 (90-50-10)0.27 [0.03]0.34 [0.05]0.37 [0.03]0.34 [0.04]0.3 [0.03]0.39 [0.06]0.32 [0.03]0.34 [0.04]0.561 (3)†0.6411.834 (1)††0.1770.754 (3)††0.521
Lose-stay rate, block 2 (80-40-20)0.28 [0.03]0.23 [0.05]0.4 [0.03]0.32 [0.05]0.33 [0.03]0.37 [0.06]0.29 [0.03]0.33 [0.06]2.47 (3)†0.0620.177 (1)††0.6740.834 (3)††0.476
Reaction time, block 1433.6 [28.8]789.3 [282.7]548.1 [77.8]365.6 [26.4]448 [60.1]442.1 [59.5]557.2 [108.2]530 [130.2]0.793 (3)†0.4990.161 (1)††0.6891.727 (3)††0.161
Reaction time, block 2370.7 [23.3]494.3 [88.6]465.3 [61.6]331.4 [22.9]391.7 [52.3]555.9 [121.2]385.4 [29.2]504.1 [82.7]0.394 (3)†0.7571.92 (1)††0.1671.949 (3)††0.122

  1. † Univariate analysis, F(df) with df error = 306 Exact test, ‡chi-square coefficient (df), § Exact significance (2-sided), || Monte Carlo significance (2-sided).

Table 3
ANOVA results for HGF parameters.
Block effect †Group effect‡Interaction effect
Statistic§p-valueStatistic§p-valueStatistic§p-value
Experiment 1
ω311.672 (1)0.0021.294 (1)0.2646.948 (1)0.013
µ3025.904 (1)1.809E-57.063 (1)0.0125.344 (1)0.028
κ7.768 (1)0.0097.599 (1)0.0100.003 (1)0.960
ω22.182 (1)0.1504.186 (1)0.0500.058 (1)0.811
µ204.831 (1)0.0361.261 (1)0.2700.370 (1)0.547
BIC0.061 (1)0.8078.801 (1)0.0061.7 (1)0.202
Experiment 2, Version 3
ω314.932 (1)0.00021.128 (1)0.2921.406 (1)0.240
µ3064.651 (1)1.54E-116.366 (1)0.0140.003 (1)0.959
κ15.53 (1)0.000213.521 (1)0.00050.011 (1)0.916
ω20.027 (1)0.8698.70 (1)0.0040.090 (1)0.765
µ2011.432 (1)0.0010.030 (1)0.8640.203 (1)0.653
BIC1.110E-5 (1)0.99716.336 (1)0.00011.678 (1)0.199
Experiment 3: Rats
ω330.086 (1)6.2785E-54.579 (1)0.0499.058 (1)0.009
µ3031.416 (1)5.0188E-58.454 (1)0.0115.159 (1)0.038
κ9.132 (1)0.00913.356 (1)0.0022.644 (1)0.125
ω232.192 (1)4.4173E-522.344 (1)0.000318.454 (1)0.001
µ205.226 (1)0.0370.368 (1)0.5532.087 (1)0.169
BIC5.052 (1)0.0401.890 (1)0.1890.331 (1)0.573

  1. Block refers to first versus second half in human studies, Pre-Rx vs Post-Rx in rat studies.‡ Group refers to low versus high paranoia in humans, saline versus methamphetamine in rats §F-statistic (degrees of freedom); df error = 30 in Experiment 1, 70 in Experiment 2, Version 3, and 50 in Experiment 3: Rats; split-plot ANOVA (i.e., repeated measures with between-subjects factor).

Table 4
Corrections for multiple comparisons.
Group effect †Interaction effect‡
Survives bonferroni?§Survives FDR?Critical valueBenjamini-Hochberg p-valueSurvives bonferroni?§Survives FDR?Critical valueBenjamini-Hochberg p-value
Experiment 1
ω3N/AN/A0.050.264NoNo0.01250.052
µ30YesYes0.0250.024NoNo0.0250.056
κYesYes0.01250.04N/AN/A0.050.96
ω2NoNo0.03750.0667N/AN/A0.03751.081
Experiment 2, Version 3
ω3N/AN/A0.050.292N/AN/A0.01250.96
µ30NoYes3.75E-020.0187N/AN/A0.050.959
κYesYes0.01250.002N/AN/A0.03751.221
ω2YesYes0.0250.008N/AN/A0.0251.53
Experiment 3: Rats
ω3NoYes5.00E-020.049YesYes0.0250.018
µ30YesYes3.75E-020.0147NoNo0.03750.0507
κYesYes0.0250.004N/AN/A0.050.125
ω2YesYes0.01250.0012YesYes0.01250.004

  1. N/A denotes to p-values that were not significant before corrections. † Low versus high paranoia in humans, saline versus methamphetamine in rats. ‡ Group by time (i.e., first versus second half in human studies, Pre-Rx vs Post-Rx in rat studies). § p-value < 0.0125.

Table 5
Experiment 2 effects across block, paranoia group, and task version.
BlockGroupVersionBlock*group*
Version		Group*versionBlock*groupBlock*version
F
(df)†		PF
(df)†		PF
(df)†		PF
(df)†		PF
(df)†		PF
(df)†		PF
(df)†		P
ω33.722 (1)0.0550.499 (1)0.4812.061 (3)0.1050.415 (3)0.7421.005 (3)0.3910.145 (1)0.7047.0155 (3)1.42E-4
µ30288.1 (1)1.01E-452.604 (1)0.1082.321 (3)0.0750.261 (3)0.8532.329 (3)0.0750.281 (1)0.5970.061 (3)0.98
κ120.9 (1)7.65E-243.602 (1)0.0595.06
(3)		0.0020.08 (3)0.9714.178 (3)0.0061.028 (1)0.3122.559 (3)0.055
ω235.3 (1)7.92E-94.435 (1)0.0364.155 (3)0.0070.166 (3)0.9192.809 (3)0.042.387 (1)0.1238.697 (3)1.5E-5
µ2071.3 (1)1.33E-150.242 (1)0.6230.616 (3)0.6051.081 (3)0.3580.412 (3)0.7440.057 (1)0.8121.505 (3)0.213
BIC56.6 (1)6.23E-138.073 (1)0.0055.385 (3)0.0010.262 (3)0.8534.927 (3)0.0020.451 (1)0.50211.905 (3)2.19E-07

  1. † F-statistic (degrees of freedom); df error = 299; split-plot ANOVA (i.e., repeated measures with two between-subjects factors).

    N/A denotes to p-values that were not significant before corrections. † Low versus high paranoia in humans, saline versus methamphetamine in rats. ‡ Group by time (i.e., first versus second half in human studies, Pre-Rx vs Post-Rx in rat studies). § p-value < 0.0125.

Table 6
Experiment 2 ANCOVAs.
ω3µ30κω2
EffectDfFp-valueFp-valueFp-valueFp-value
Demographics (age, gender, ethnicity, and race)
Block1, 2940.3280.56810.8350.0013.4250.0662.7110.101
Block * Age1, 2940.6590.4182.0350.1552.1950.140.2120.646
Block * Gender1, 2940.3630.5470.1050.7464.0420.0460.0960.757
Block * Ethnicity1, 2940.0160.9010.0420.8370.2680.6050.0240.876
Block * Race1, 2943.2440.0730.2790.5980.0820.7751.3860.24
Block * Paranoia Group1, 2940.0010.9690.1620.6870.7380.3911.1890.277
Block * Version3, 2947.617.25E-050.5610.6412.5680.0558.6131.97E-05
Block * Paranoia Group * Version3, 2940.4510.7170.1350.9390.1190.9490.10.96
Age1, 2943.0540.0822.9740.0862.1010.1492.3390.128
Gender1, 2940.4380.5090.020.8860.0050.9410.0140.905
Ethnicity1, 2940.0290.8650.0590.8080.0870.7680.2210.639
Race1, 2940.0720.7892.2180.1380.3730.5420.3330.564
Paranoia Group1, 2944.71E-040.9830.7410.391.7950.1823.3020.071
Version3, 2941.8450.141.9140.1284.9750.0023.7860.011
Paranoia Group * Version3, 2940.9350.4241.9110.1293.5990.0141.9190.127
Mental health factors (medication usage, diagnostic category, BAI score, and BDI score)
Block1, 2573.3330.06995.7533.12E-1925.4988.78E-078.3410.004
Block * BAI1, 2570.260.6111.5320.2172.8520.0930.3940.531
Block * BDI1, 2570.0090.9260.2080.6496.550.0110.5970.441
Block * Medication Usage1, 2570.0270.871.2880.2580.6910.4070.8710.352
Block * Diagnostic Category1, 2571.3660.2441.7850.1830.0630.8030.2080.649
Block * Paranoia Group1, 2570.0680.7950.2980.5860.2980.5860.0070.935
Block * Version3, 2575.8720.0010.5310.6620.9060.4396.160.0005
Block * Paranoia Group * Version3, 2571.0240.3830.8690.4580.2660.850.0950.963
BAI1, 2571.1080.2940.0120.9130.9540.330.9210.338
BDI1, 2570.0370.8480.5740.4491.3430.2482.3720.125
Medication Usage1, 2570.3270.5680.0580.810.0020.9660.4670.495
Diagnostic Category1, 2574.2520.040.0040.9491.4430.2311.7430.188
Paranoia Group1, 2570.0570.8110.2330.631.0320.3111.6950.194
Version3, 2573.1830.0252.730.0455.2740.0024.4680.004
Paranoia Group * Version3, 2570.3110.8182.3070.0774.5560.0043.3970.019
Global cognitive ability (educational attainment, income, and cognitive reflection)
Block1, 2901.19E-040.99151.2647.60E-1228.6751.83E-0718.3882.51E-05
Block * Education1, 2900.6030.4380.0010.9750.0330.8560.2580.612
Block * Income1, 2901.2110.2722.8740.0913.4830.0632.4210.121
Block * Cognitive Reflection1, 2901.830.1770.7090.4011.2210.274.6670.032
Block * Paranoia Group1, 2900.0050.9460.3590.550.2630.6080.8850.348
Block * Version3, 2908.8611.27E-050.1820.9092.3250.0758.8151.35E-05
Block * Paranoia Group * Version3, 2900.8260.480.4780.6980.150.9290.30.825
Education1, 2900.1110.7390.5780.4481.3950.2390.6080.436
Income1, 2902.7630.0981.3820.2410.0550.8141.0350.31
Cognitive Reflection1, 2900.1640.68612.8070.00040.2240.6360.8070.37
Paranoia Group1, 2900.0690.7930.5550.4572.4770.1174.7150.031
Version3, 2902.1040.12.550.0565.530.0013.7990.011
Paranoia Group * Version3, 2901.2880.2792.5680.0554.4690.0042.7930.041
Table 7
Modified Cognitive Reflection Questionnaire Items.
ItemPrompt
1A folder and a paper clip cost $1.10 in total. The folder costs $1.00 more than the paper clip.
How much does the paper clip cost?
2If it takes 5 clerks 5 min to review five applications, how long would it take 100 clerks to review 100 applications?
3In a garden, there is a cluster of weeds. Every day, the cluster doubles in size. If it takes 48 days for the cluster to cover the entire garden, how long would it take for the cluster to cover half of the garden?
Table 8
Simulations and behavior.
Win-switch rateU-valueLose-stay rate
EffectDfFp-valueFp-valueFp-value
Experiment 1
Block1, 301.4650.23616.9990.00031.3340.257
Block*Paranoia Group1, 300.6020.4442.3930.1322.5750.119
Paranoia Group1, 303.5790.0683.3120.0792.2830.141
Experiment 2, Version 3
Block1, 700.9350.33710.1530.0020.1220.728
Block*Paranoia Group1, 700.0010.9820.0030.9581.930.169
Paranoia Group1, 7012.6980.00119.2094.03E-051.0950.299
Simulations†
Block1, 700.1760.6763.3350.0725.0730.027
Block*Paranoia Group1, 702.0390.1582.6240.110.0360.85
Paranoia Group1, 7015.3940.000213.3620.00050.0420.839

  1. †Simulated data from experiment 2, Version 3.

Table 9
Alternative models fail to capture paranoia group differences.
Low Paranoia (n=56)†High Paranoia (n=16)†Paranoia Group Effect‡Paranoia x Block Effect‡
MeanSEM95% CIMeanSEM95% CIF(df)PF(df)P
Q-learning with learning rates for positive and negative prediction errors
Positive prediction error (α+)
1st half0.4630.038[0.388, 0.538]0.4750.071[0.335, 0.616]0.243 (1, 70)0.6230.118 (1, 70)0.732
2nd half0.4760.039[0.398, 0.555]0.5350.074[0.379, 0.672]
Negative prediction error (α-)
1st half0.4210.022[0.377, 0.464]0.3650.041[0.284, 0.446]1.292 (1, 70)0.2600.320 (1, 70)0.573
2nd half0.3860.021[0.344, 0.427]0.3640.039[0.285,0.442]
Inverse temperature (β )
1st half27174.0[126, 416]147133[-114, 408]1.626 (1, 70)0.2070.043 (1, 70)0.837
2nd half31682.3[155, 477]145132[-114, 403]
2-level HGF with softmax decision model

µ2
1st half-0.0590.081[-0.218, 0.100]-0.3030.157[-0.611, 0.005]3.039 (1, 70)0.0860.385 (1, 70)0.537
2nd half-0.2440.082[-0.405, -0.082]-0.5660.155[-0.869, -0.262]
Inverse temperature (β)
1st half13130.6[71.3, 191]35.36.20[23.2, 47.5]2.665 (1, 70)0.1070.250 (1, 70)0.619
2nd half11930.6[58.7, 179]52.112.1[28.3, 75.9]     

  1. † Online version 3 data ‡ Repeated measures ANOVA.

Table 10
Summary of paranoia/methamphetamine effects on belief-updating.
In labOnlineRats
ω3↓†⇣⬇
µ30⬆⬆‡§⬆
κ⬆⬆‡⬆
ω2⬇⬇‡¶⬇
µ02---

  1. ⇡ ⇣ Non-significant increase/decrease in high paranoia or meth, relative to low paranoia or saline ↑ ↓ Trend-level increase/decrease in high paranoia or meth, relative to low paranoia or saline ⬆⬇ Significantly higher/lower in high paranoia or meth, relative to low paranoia or saline - - No significant findings or trends † Baseline trend; parameter decreases in second block for low but not high paranoia ‡ Version 3 only § Trend-level significance disappears with inclusion of demographic covariates ¶ Significance reduced to trend with inclusion of demographic covariates.

Table 11
Questionnaire item completion (% responses).
Questionnaire/subscaleExperiment 1Experiment 2
Age90.6%99.7%
Gender100.0%100.0%
Ethnicity100.0%100.0%
Race100.0%100.0%
Education100.0%99.7%
Meds100.0%90.6%
Dx100.0%94.1%
IncomeN/A98.0%
SCID-II Paranoia - all items96.9%94.1%
 SCID-II Paranoia - one item missing3.1%5.5%
 SCID-II Paranoia - three items missing0.0%0.3%
Cognitive reflection - all itemsN/A97.7%
Beck's Anxiety Inventory (BAI) - all items90.6%96.7%
 BAI - one item missing3.1%2.9%
 BAI - two items missing6.3%0.3%
Beck's Depression Inventory (BDI) - all items100.0%99.0%
 BDI - one item missing0.0%1.0%

Additional files

Transparent reporting form
https://cdn.elifesciences.org/articles/56345/elife-56345-transrepform-v3.docx

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Erin J Reed
  2. Stefan Uddenberg
  3. Praveen Suthaharan
  4. Christoph H Mathys
  5. Jane R Taylor
  6. Stephanie Mary Groman
  7. Philip R Corlett
(2020)
Paranoia as a deficit in non-social belief updating
eLife 9:e56345.
https://doi.org/10.7554/eLife.56345