Evidence for embracing normative modeling
Abstract
In this work, we expand the normative model repository introduced in (Rutherford, Fraza, et al., 2022) to include normative models charting lifespan trajectories of structural surface area and brain functional connectivity, measured using two unique resting-state network atlases (Yeo-17 and Smith-10), and an updated online platform for transferring these models to new data sources. We showcase the value of these models with a head-to-head comparison between the features output by normative modeling and raw data features in several benchmarking tasks: mass univariate group difference testing (schizophrenia versus control), classification (schizophrenia versus control), and regression (predicting general cognitive ability). Across all benchmarks, we show the advantage of using normative modeling features, with the strongest statistically significant results demonstrated in the group difference testing and classification tasks. We intend for these accessible resources to facilitate wider adoption of normative modeling across the neuroimaging community.
Data availability
Pre-trained normative models are available on GitHub (https://github.com/predictive-clinical-neuroscience/braincharts) and Google Colab (https://colab.research.google.com/github/predictive-clinical-neuroscience/braincharts/blob/master/scripts/apply_normative_models_yeo17.ipynb). Scripts for running the benchmarking analysis and visualizations are available on GitHub (https://github.com/saigerutherford/evidence_embracing_nm). An online portal for running models without code is available (https://pcnportal.dccn.nl).
Article and author information
Author details
Funding
European Research Council (10100118)
- Andre F Marquand
European Research Council (802998)
- Andre F Marquand
Wellcome Trust (215698/Z/19/Z)
- Andre F Marquand
Wellcome Trust (098369/Z/12/Z)
- Andre F Marquand
National Institute of Mental Health (R01MH122491)
- Ivy F Tso
National Institute of Mental Health (R01MH123458)
- Chandra Sripada
National Institute of Mental Health (R01MH130348)
- Chandra Sripada
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Ethics
Human subjects: Secondary data analysis was conducted in this work. Data were pooled from multiple data sources described in the supplemental tables. All subjects provided informed consent. Subject recruitment procedures and informed consent forms, including consent to share de-identified data, were approved by the corresponding university institutional review board where data were collected. Human subjects: Ethical approval for the public data were provided by the relevant local research authorities for the studies contributing data. For full details, see the main study publications in the main text. For all clinical studies, approval was obtained via the local ethical review authorities, i.e., Delta: The local ethics committee of the Academic Medical Center of the University of Amsterdam (AMC-METC) Nr.:11/050, UMich_IMPS: University of Michigan Institution Review Board HUM00088188, UMich_SZG: University of Michigan Institution Review Board HUM00080457.
Copyright
© 2023, Rutherford et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Social animals, including both humans and mice, are highly motivated to engage in social interactions. Short-term social isolation promotes social behavior, but the neural circuits through which it does so remain incompletely understood. Here, we sought to identify neurons that promote social behavior in single-housed female mice, which exhibit increased rates of social investigation, social ultrasonic vocalizations (USVs), and mounting during same-sex interactions that follow a period of short-term (3 days) isolation. We first used immunostaining for the immediate early gene Fos to identify a population of neurons in the preoptic hypothalamus (POA) that increase their activity in single-housed females following same-sex interactions (POAsocial neurons) but not in single-housed females that did not engage in social interactions. TRAP2-mediated chemogenetic silencing of POAsocial neurons in single-housed females significantly attenuates the effects of short-term isolation on social investigation, USV production, and mounting. In contrast, caspase-mediated ablation of POAsocial neurons in single-housed females robustly attenuates mounting but does not decrease social investigation or USV production. Optogenetic activation of POAsocial neurons in group-housed females promotes social investigation and USV production but does not recapitulate the effects of short-term isolation on mounting. To understand whether a similar population of POAsocial neurons promotes social behavior in single-housed males, we performed Fos immunostaining in single-housed males following either same-sex or opposite-sex social interactions. These experiments revealed a population of POA neurons that increase Fos expression in single-housed males following opposite-sex, but not same-sex, interactions. Chemogenetic silencing of POAsocial neurons in single-housed males during interactions with females reduces mounting but does not affect social investigation or USV production. These experiments identify a population of hypothalamic neurons that promote social behavior following short-term isolation in a sex- and social context-dependent manner.
-
- Neuroscience
Recognizing and responding to threat cues is essential to survival. Freezing is a predominant threat behavior in rats. We have recently shown that a threat cue can organize diverse behaviors beyond freezing, including locomotion (Chu et al., 2024). However, that experimental design was complex, required many sessions, and had rats receive many foot shock presentations. Moreover, the findings were descriptive. Here, we gave female and male Long Evans rats cue light illumination paired or unpaired with foot shock (8 total) in a conditioned suppression setting, using a range of shock intensities (0.15, 0.25, 0.35, or 0.50 mA). We found that conditioned suppression was only observed at higher foot shock intensities (0.35 mA and 0.50 mA). We constructed comprehensive temporal ethograms by scoring 22,272 frames across 12 behavior categories in 200-ms intervals around cue light illumination. The 0.50 mA and 0.35 mA shock-paired visual cues suppressed reward seeking, rearing, and scaling, as well as light-directed rearing and light-directed scaling. The shock-paired visual cue further elicited locomotion and freezing. Linear discriminant analyses showed that ethogram data could accurately classify rats into paired and unpaired groups. Using complete ethogram data produced superior classification compared to behavior subsets, including an Immobility subset featuring freezing. The results demonstrate diverse threat behaviors – in a short and simple procedure – containing sufficient information to distinguish the visual fear conditioning status of individual rats.