Empirical examination of the replicability of associations between brain structure and psychological variables

Abstract

Linking interindividual differences in psychological phenotype to variations in brain structure is an old dream for psychology and a crucial question for cognitive neurosciences. Yet, replicability of the previously-reported 'structural brain behavior' (SBB)-associations has been questioned, recently. Here, we conducted an empirical investigation, assessing replicability of SBB among heathy adults. For a wide range of psychological measures, the replicability of associations with gray matter volume was assessed. Our results revealed that among healthy individuals 1) finding an association between performance at standard psychological tests and brain morphology is relatively unlikely 2) significant associations, found using an exploratory approach, have overestimated effect sizes and 3) can hardly be replicated in an independent sample. After considering factors such as sample size and comparing our findings with more replicable SBB-associations in a clinical cohort and replicable associations between brain structure and non-psychological phenotype, we discuss the potential causes and consequences of these findings.

Data availability

All data used in this study, are openly available (eNKI, ADNI). The eNKI Rockland cohort data were downloaded from http://fcon_1000.projects.nitrc.org/indi/enhanced/. Users are first required to complete a Data Usage Agreement document before access to these data is granted (further details here http://fcon_1000.projects.nitrc.org/indi/enhanced/phenotypicdata.html). The ADNI data were downloaded from http://adni.loni.usc.edu/about/. Users must first request access before they can log in to the data archive and access is contingent on adherence to the ADNI Data Use Agreement (further details here http://adni.loni.usc.edu/data-samples/access-data/).

Article and author information

Author details

  1. Shahrzad Kharabian Masouleh

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    For correspondence
    s.kharabian@fz-juelich.de
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-4810-9542
  2. Simon B Eickhoff

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-6363-2759
  3. Felix Hoffstaedter

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    Competing interests
    The authors declare that no competing interests exist.
  4. Sarah Genon

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    For correspondence
    s.genon@fz-juelich.de
    Competing interests
    The authors declare that no competing interests exist.
  5. Alzheimer’s Disease Neuroimaging Initiative

Funding

Deutsche Forschungsgemeinschaft

  • Shahrzad Kharabian Masouleh
  • Sarah Genon

Helmholtz-Gemeinschaft

  • Shahrzad Kharabian Masouleh
  • Simon B Eickhoff
  • Felix Hoffstaedter
  • Sarah Genon

Horizon 2020 Framework Programme

  • Shahrzad Kharabian Masouleh
  • Simon B Eickhoff
  • Felix Hoffstaedter
  • Sarah Genon

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Institutional Review Board Approval (IRBA) was obtained for this project at the Nathan Kline Institute (Phase I #226781 and Phase II #239708) and at Montclair State University (Phase I #000983A and Phase II #000983B). Written informed consent was obtained for all study participants.For ADNI data, IRBA was also obtained within each participating institute as well as informed consent forms were signed by each participant (see https://adni.loni.usc.edu/wp-content/uploads/2017/09/ADNID_Approved_Protocol_11.19.14.pdf for detailed information about ethical procedures for ADNI).Additionally, analysis of the data from both eNKI (Study No. 4039) and ADNI (Registration No. 2018114856) received ethical approval from the ethics committee of medical faculty at the University of Düsseldorf.

Reviewing Editor

  1. Thomas E Nichols, University of Oxford, United Kingdom

Version history

  1. Received: November 7, 2018
  2. Accepted: March 8, 2019
  3. Accepted Manuscript published: March 13, 2019 (version 1)
  4. Version of Record published: April 25, 2019 (version 2)

Copyright

© 2019, Kharabian Masouleh et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 6,228
    Page views
  • 716
    Downloads
  • 104
    Citations

Article citation count generated by polling the highest count across the following sources: Scopus, Crossref, PubMed Central.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Shahrzad Kharabian Masouleh
  2. Simon B Eickhoff
  3. Felix Hoffstaedter
  4. Sarah Genon
  5. Alzheimer’s Disease Neuroimaging Initiative
(2019)
Empirical examination of the replicability of associations between brain structure and psychological variables
eLife 8:e43464.
https://doi.org/10.7554/eLife.43464

Share this article

https://doi.org/10.7554/eLife.43464

Further reading

    1. Developmental Biology
    2. Neuroscience
    Wen Wang, Xiao Zhang ... Zi-Bing Jin
    Research Article Updated

    Chimeric RNAs have been found in both cancerous and healthy human cells. They have regulatory effects on human stem/progenitor cell differentiation, stemness maintenance, and central nervous system development. However, whether they are present in human retinal cells and their physiological functions in the retinal development remain unknown. Based on the human embryonic stem cell-derived retinal organoids (ROs) spanning from days 0 to 120, we present the expression atlas of chimeric RNAs throughout the developing ROs. We confirmed the existence of some common chimeric RNAs and also discovered many novel chimeric RNAs during retinal development. We focused on CTNNBIP1-CLSTN1 (CTCL) whose downregulation caused precocious neuronal differentiation and a marked reduction of neural progenitors in human cerebral organoids. CTCL is universally present in human retinas, ROs, and retinal cell lines, and its loss-of-function biases the progenitor cells toward retinal pigment epithelial cell fate at the expense of retinal cells. Together, this work provides a landscape of chimeric RNAs and reveals evidence for their critical role in human retinal development.

    1. Neuroscience
    Peibo Xu, Jian Peng ... Yuejun Chen
    Research Article

    Deciphering patterns of connectivity between neurons in the brain is a critical step toward understanding brain function. Imaging-based neuroanatomical tracing identifies area-to-area or sparse neuron-to-neuron connectivity patterns, but with limited throughput. Barcode-based connectomics maps large numbers of single-neuron projections, but remains a challenge for jointly analyzing single-cell transcriptomics. Here, we established a rAAV2-retro barcode-based multiplexed tracing method that simultaneously characterizes the projectome and transcriptome at the single neuron level. We uncovered dedicated and collateral projection patterns of ventromedial prefrontal cortex (vmPFC) neurons to five downstream targets and found that projection-defined vmPFC neurons are molecularly heterogeneous. We identified transcriptional signatures of projection-specific vmPFC neurons, and verified Pou3f1 as a marker gene enriched in neurons projecting to the lateral hypothalamus, denoting a distinct subset with collateral projections to both dorsomedial striatum and lateral hypothalamus. In summary, we have developed a new multiplexed technique whose paired connectome and gene expression data can help reveal organizational principles that form neural circuits and process information.