Evidence for embracing normative modeling

  1. Saige Rutherford  Is a corresponding author
  2. Pieter Barkema
  3. Ivy F Tso
  4. Chandra Sripada
  5. Christian Beckmann
  6. Henricus G Ruhe
  7. Andre F Marquand
  1. Radboud University Nijmegen Medical Centre, Netherlands
  2. Radboud University Nijmegen, Netherlands
  3. University of Michigan-Ann Arbor, United States

Abstract

In this work, we expand the normative model repository introduced in (Rutherford, Fraza, et al., 2022) to include normative models charting lifespan trajectories of structural surface area and brain functional connectivity, measured using two unique resting-state network atlases (Yeo-17 and Smith-10), and an updated online platform for transferring these models to new data sources. We showcase the value of these models with a head-to-head comparison between the features output by normative modeling and raw data features in several benchmarking tasks: mass univariate group difference testing (schizophrenia versus control), classification (schizophrenia versus control), and regression (predicting general cognitive ability). Across all benchmarks, we show the advantage of using normative modeling features, with the strongest statistically significant results demonstrated in the group difference testing and classification tasks. We intend for these accessible resources to facilitate wider adoption of normative modeling across the neuroimaging community.

Data availability

Pre-trained normative models are available on GitHub (https://github.com/predictive-clinical-neuroscience/braincharts) and Google Colab (https://colab.research.google.com/github/predictive-clinical-neuroscience/braincharts/blob/master/scripts/apply_normative_models_yeo17.ipynb). Scripts for running the benchmarking analysis and visualizations are available on GitHub (https://github.com/saigerutherford/evidence_embracing_nm). An online portal for running models without code is available (https://pcnportal.dccn.nl).

Article and author information

Author details

  1. Saige Rutherford

    Department of Cognitive Neuroscience, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    For correspondence
    saige.rutherford@donders.ru.nl
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3006-9044
  2. Pieter Barkema

    Donders Institute, Radboud University Nijmegen, Nijmegen, Netherlands
    Competing interests
    No competing interests declared.
  3. Ivy F Tso

    Department of Psychiatry, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    No competing interests declared.
  4. Chandra Sripada

    Department of Psychiatry, University of Michigan-Ann Arbor, Ann Arbor, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-9025-6453
  5. Christian Beckmann

    Department of Cognitive Neuroscience,, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    Competing interests
    Christian Beckmann, is director and shareholder of SBGNeuro Ltd..
  6. Henricus G Ruhe

    Department of Psychiatry, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    Competing interests
    Henricus G Ruhe, received speaker's honorarium from Lundbeck and Janssen..
  7. Andre F Marquand

    Department of Cognitive Neuroscience, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands
    Competing interests
    No competing interests declared.

Funding

European Research Council (10100118)

  • Andre F Marquand

European Research Council (802998)

  • Andre F Marquand

Wellcome Trust (215698/Z/19/Z)

  • Andre F Marquand

Wellcome Trust (098369/Z/12/Z)

  • Andre F Marquand

National Institute of Mental Health (R01MH122491)

  • Ivy F Tso

National Institute of Mental Health (R01MH123458)

  • Chandra Sripada

National Institute of Mental Health (R01MH130348)

  • Chandra Sripada

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Secondary data analysis was conducted in this work. Data were pooled from multiple data sources described in the supplemental tables. All subjects provided informed consent. Subject recruitment procedures and informed consent forms, including consent to share de-identified data, were approved by the corresponding university institutional review board where data were collected. Human subjects: Ethical approval for the public data were provided by the relevant local research authorities for the studies contributing data. For full details, see the main study publications in the main text. For all clinical studies, approval was obtained via the local ethical review authorities, i.e., Delta: The local ethics committee of the Academic Medical Center of the University of Amsterdam (AMC-METC) Nr.:11/050, UMich_IMPS: University of Michigan Institution Review Board HUM00088188, UMich_SZG: University of Michigan Institution Review Board HUM00080457.

Copyright

© 2023, Rutherford et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 5,535
    views
  • 590
    downloads
  • 70
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Saige Rutherford
  2. Pieter Barkema
  3. Ivy F Tso
  4. Chandra Sripada
  5. Christian Beckmann
  6. Henricus G Ruhe
  7. Andre F Marquand
(2023)
Evidence for embracing normative modeling
eLife 12:e85082.
https://doi.org/10.7554/eLife.85082

Share this article

https://doi.org/10.7554/eLife.85082

Further reading

    1. Neuroscience
    Christine Ahrends, Mark W Woolrich, Diego Vidaurre
    Tools and Resources

    Predicting an individual’s cognitive traits or clinical condition using brain signals is a central goal in modern neuroscience. This is commonly done using either structural aspects, such as structural connectivity or cortical thickness, or aggregated measures of brain activity that average over time. But these approaches are missing a central aspect of brain function: the unique ways in which an individual’s brain activity unfolds over time. One reason why these dynamic patterns are not usually considered is that they have to be described by complex, high-dimensional models; and it is unclear how best to use these models for prediction. We here propose an approach that describes dynamic functional connectivity and amplitude patterns using a Hidden Markov model (HMM) and combines it with the Fisher kernel, which can be used to predict individual traits. The Fisher kernel is constructed from the HMM in a mathematically principled manner, thereby preserving the structure of the underlying model. We show here, in fMRI data, that the HMM-Fisher kernel approach is accurate and reliable. We compare the Fisher kernel to other prediction methods, both time-varying and time-averaged functional connectivity-based models. Our approach leverages information about an individual’s time-varying amplitude and functional connectivity for prediction and has broad applications in cognitive neuroscience and personalised medicine.

    1. Neuroscience
    Simonas Griesius, Amy Richardson, Dimitri Michael Kullmann
    Research Article

    Non-linear summation of synaptic inputs to the dendrites of pyramidal neurons has been proposed to increase the computation capacity of neurons through coincidence detection, signal amplification, and additional logic operations such as XOR. Supralinear dendritic integration has been documented extensively in principal neurons, mediated by several voltage-dependent conductances. It has also been reported in parvalbumin-positive hippocampal basket cells, in dendrites innervated by feedback excitatory synapses. Whether other interneurons, which support feed-forward or feedback inhibition of principal neuron dendrites, also exhibit local non-linear integration of synaptic excitation is not known. Here, we use patch-clamp electrophysiology, and two-photon calcium imaging and glutamate uncaging, to show that supralinear dendritic integration of near-synchronous spatially clustered glutamate-receptor mediated depolarization occurs in NDNF-positive neurogliaform cells and oriens-lacunosum moleculare interneurons in the mouse hippocampus. Supralinear summation was detected via recordings of somatic depolarizations elicited by uncaging of glutamate on dendritic fragments, and, in neurogliaform cells, by concurrent imaging of dendritic calcium transients. Supralinearity was abolished by blocking NMDA receptors (NMDARs) but resisted blockade of voltage-gated sodium channels. Blocking L-type calcium channels abolished supralinear calcium signalling but only had a minor effect on voltage supralinearity. Dendritic boosting of spatially clustered synaptic signals argues for previously unappreciated computational complexity in dendrite-projecting inhibitory cells of the hippocampus.