Evidence for embracing normative modeling

  1. Saige Rutherford  Is a corresponding author
  2. Pieter Barkema
  3. Ivy F Tso
  4. Chandra Sripada
  5. Christian Beckmann
  6. Henricus G Ruhe
  7. Andre F Marquand
  1. Radboud University Nijmegen Medical Centre, Netherlands
  2. Radboud University Nijmegen, Netherlands
  3. University of Michigan-Ann Arbor, United States

Abstract

In this work, we expand the normative model repository introduced in (Rutherford, Fraza, et al., 2022) to include normative models charting lifespan trajectories of structural surface area and brain functional connectivity, measured using two unique resting-state network atlases (Yeo-17 and Smith-10), and an updated online platform for transferring these models to new data sources. We showcase the value of these models with a head-to-head comparison between the features output by normative modeling and raw data features in several benchmarking tasks: mass univariate group difference testing (schizophrenia versus control), classification (schizophrenia versus control), and regression (predicting general cognitive ability). Across all benchmarks, we show the advantage of using normative modeling features, with the strongest statistically significant results demonstrated in the group difference testing and classification tasks. We intend for these accessible resources to facilitate wider adoption of normative modeling across the neuroimaging community.

Data availability

Pre-trained normative models are available on GitHub (https://github.com/predictive-clinical-neuroscience/braincharts) and Google Colab (https://colab.research.google.com/github/predictive-clinical-neuroscience/braincharts/blob/master/scripts/apply_normative_models_yeo17.ipynb). Scripts for running the benchmarking analysis and visualizations are available on GitHub (https://github.com/saigerutherford/evidence_embracing_nm). An online portal for running models without code is available (https://pcnportal.dccn.nl).

Article and author information

Author details

  1. Saige Rutherford

    Department of Cognitive Neuroscience, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    For correspondence
    saige.rutherford@donders.ru.nl
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3006-9044
  2. Pieter Barkema

    Donders Institute, Radboud University Nijmegen, Nijmegen, Netherlands
    Competing interests
    No competing interests declared.
  3. Ivy F Tso

    Department of Psychiatry, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    No competing interests declared.
  4. Chandra Sripada

    Department of Psychiatry, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-9025-6453
  5. Christian Beckmann

    Department of Cognitive Neuroscience,, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    Competing interests
    Christian Beckmann, is director and shareholder of SBGNeuro Ltd..
  6. Henricus G Ruhe

    Department of Psychiatry, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    Competing interests
    Henricus G Ruhe, received speaker's honorarium from Lundbeck and Janssen..
  7. Andre F Marquand

    Department of Cognitive Neuroscience, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    Competing interests
    No competing interests declared.

Funding

European Research Council (10100118)

  • Andre F Marquand

European Research Council (802998)

  • Andre F Marquand

Wellcome Trust (215698/Z/19/Z)

  • Andre F Marquand

Wellcome Trust (098369/Z/12/Z)

  • Andre F Marquand

National Institute of Mental Health (R01MH122491)

  • Ivy F Tso

National Institute of Mental Health (R01MH123458)

  • Chandra Sripada

National Institute of Mental Health (R01MH130348)

  • Chandra Sripada

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Secondary data analysis was conducted in this work. Data were pooled from multiple data sources described in the supplemental tables. All subjects provided informed consent. Subject recruitment procedures and informed consent forms, including consent to share de-identified data, were approved by the corresponding university institutional review board where data were collected. Human subjects: Ethical approval for the public data were provided by the relevant local research authorities for the studies contributing data. For full details, see the main study publications in the main text. For all clinical studies, approval was obtained via the local ethical review authorities, i.e., Delta: The local ethics committee of the Academic Medical Center of the University of Amsterdam (AMC-METC) Nr.:11/050, UMich_IMPS: University of Michigan Institution Review Board HUM00088188, UMich_SZG: University of Michigan Institution Review Board HUM00080457.

Copyright

© 2023, Rutherford et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 4,276
    views
  • 470
    downloads
  • 39
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Saige Rutherford
  2. Pieter Barkema
  3. Ivy F Tso
  4. Chandra Sripada
  5. Christian Beckmann
  6. Henricus G Ruhe
  7. Andre F Marquand
(2023)
Evidence for embracing normative modeling
eLife 12:e85082.
https://doi.org/10.7554/eLife.85082

Share this article

https://doi.org/10.7554/eLife.85082

Further reading

    1. Neuroscience
    Serena Notartomaso, Nico Antenucci ... Volker Neugebauer
    Research Article

    We used light-sensitive drugs to identify the brain region-specific role of mGlu5 metabotropic glutamate receptors in the control of pain. Optical activation of systemic JF-NP-26, a caged, normally inactive, negative allosteric modulator (NAM) of mGlu5 receptors, in cingulate, prelimbic, and infralimbic cortices and thalamus inhibited neuropathic pain hypersensitivity. Systemic treatment of alloswitch-1, an intrinsically active mGlu5 receptor NAM, caused analgesia, and the effect was reversed by light-induced drug inactivation in the prelimbic and infralimbic cortices, and thalamus. This demonstrates that mGlu5 receptor blockade in the medial prefrontal cortex and thalamus is both sufficient and necessary for the analgesic activity of mGlu5 receptor antagonists. Surprisingly, when the light was delivered in the basolateral amygdala, local activation of systemic JF-NP-26 reduced pain thresholds, whereas inactivation of alloswitch-1 enhanced analgesia. Electrophysiological analysis showed that alloswitch-1 increased excitatory synaptic responses in prelimbic pyramidal neurons evoked by stimulation of presumed BLA input, and decreased BLA-driven feedforward inhibition of amygdala output neurons. Both effects were reversed by optical silencing and reinstated by optical reactivation of alloswitch-1. These findings demonstrate for the first time that the action of mGlu5 receptors in the pain neuraxis is not homogenous, and suggest that blockade of mGlu5 receptors in the BLA may limit the overall analgesic activity of mGlu5 receptor antagonists. This could explain the suboptimal effect of mGlu5 NAMs on pain in human studies and validate photopharmacology as an important tool to determine ideal target sites for systemic drugs.

    1. Neuroscience
    Charles R Heller, Gregory R Hamersky, Stephen V David
    Research Article

    Categorical sensory representations are critical for many behaviors, including speech perception. In the auditory system, categorical information is thought to arise hierarchically, becoming increasingly prominent in higher-order cortical regions. The neural mechanisms that support this robust and flexible computation remain poorly understood. Here, we studied sound representations in the ferret primary and non-primary auditory cortex while animals engaged in a challenging sound discrimination task. Population-level decoding of simultaneously recorded single neurons revealed that task engagement caused categorical sound representations to emerge in non-primary auditory cortex. In primary auditory cortex, task engagement caused a general enhancement of sound decoding that was not specific to task-relevant categories. These findings are consistent with mixed selectivity models of neural disentanglement, in which early sensory regions build an overcomplete representation of the world and allow neurons in downstream brain regions to flexibly and selectively read out behaviorally relevant, categorical information.