Empirical examination of the replicability of associations between brain structure and psychological variables

Abstract

Linking interindividual differences in psychological phenotype to variations in brain structure is an old dream for psychology and a crucial question for cognitive neurosciences. Yet, replicability of the previously-reported 'structural brain behavior' (SBB)-associations has been questioned, recently. Here, we conducted an empirical investigation, assessing replicability of SBB among heathy adults. For a wide range of psychological measures, the replicability of associations with gray matter volume was assessed. Our results revealed that among healthy individuals 1) finding an association between performance at standard psychological tests and brain morphology is relatively unlikely 2) significant associations, found using an exploratory approach, have overestimated effect sizes and 3) can hardly be replicated in an independent sample. After considering factors such as sample size and comparing our findings with more replicable SBB-associations in a clinical cohort and replicable associations between brain structure and non-psychological phenotype, we discuss the potential causes and consequences of these findings.

Data availability

All data used in this study, are openly available (eNKI, ADNI). The eNKI Rockland cohort data were downloaded from http://fcon_1000.projects.nitrc.org/indi/enhanced/. Users are first required to complete a Data Usage Agreement document before access to these data is granted (further details here http://fcon_1000.projects.nitrc.org/indi/enhanced/phenotypicdata.html). The ADNI data were downloaded from http://adni.loni.usc.edu/about/. Users must first request access before they can log in to the data archive and access is contingent on adherence to the ADNI Data Use Agreement (further details here http://adni.loni.usc.edu/data-samples/access-data/).

Article and author information

Author details

  1. Shahrzad Kharabian Masouleh

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    For correspondence
    s.kharabian@fz-juelich.de
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-4810-9542
  2. Simon B Eickhoff

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-6363-2759
  3. Felix Hoffstaedter

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    Competing interests
    The authors declare that no competing interests exist.
  4. Sarah Genon

    Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
    For correspondence
    s.genon@fz-juelich.de
    Competing interests
    The authors declare that no competing interests exist.
  5. Alzheimer’s Disease Neuroimaging Initiative

Funding

Deutsche Forschungsgemeinschaft

  • Shahrzad Kharabian Masouleh
  • Sarah Genon

Helmholtz-Gemeinschaft

  • Shahrzad Kharabian Masouleh
  • Simon B Eickhoff
  • Felix Hoffstaedter
  • Sarah Genon

Horizon 2020 Framework Programme

  • Shahrzad Kharabian Masouleh
  • Simon B Eickhoff
  • Felix Hoffstaedter
  • Sarah Genon

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Institutional Review Board Approval (IRBA) was obtained for this project at the Nathan Kline Institute (Phase I #226781 and Phase II #239708) and at Montclair State University (Phase I #000983A and Phase II #000983B). Written informed consent was obtained for all study participants.For ADNI data, IRBA was also obtained within each participating institute as well as informed consent forms were signed by each participant (see https://adni.loni.usc.edu/wp-content/uploads/2017/09/ADNID_Approved_Protocol_11.19.14.pdf for detailed information about ethical procedures for ADNI).Additionally, analysis of the data from both eNKI (Study No. 4039) and ADNI (Registration No. 2018114856) received ethical approval from the ethics committee of medical faculty at the University of Düsseldorf.

Reviewing Editor

  1. Thomas E Nichols, University of Oxford, United Kingdom

Publication history

  1. Received: November 7, 2018
  2. Accepted: March 8, 2019
  3. Accepted Manuscript published: March 13, 2019 (version 1)
  4. Version of Record published: April 25, 2019 (version 2)

Copyright

© 2019, Kharabian Masouleh et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 5,886
    Page views
  • 669
    Downloads
  • 85
    Citations

Article citation count generated by polling the highest count across the following sources: Scopus, Crossref, PubMed Central.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Shahrzad Kharabian Masouleh
  2. Simon B Eickhoff
  3. Felix Hoffstaedter
  4. Sarah Genon
  5. Alzheimer’s Disease Neuroimaging Initiative
(2019)
Empirical examination of the replicability of associations between brain structure and psychological variables
eLife 8:e43464.
https://doi.org/10.7554/eLife.43464

Further reading

    1. Neuroscience
    Andrea Alamia, Lucie Terral ... Rufin VanRullen
    Research Article Updated

    Previous research has associated alpha-band [8–12 Hz] oscillations with inhibitory functions: for instance, several studies showed that visual attention increases alpha-band power in the hemisphere ipsilateral to the attended location. However, other studies demonstrated that alpha oscillations positively correlate with visual perception, hinting at different processes underlying their dynamics. Here, using an approach based on traveling waves, we demonstrate that there are two functionally distinct alpha-band oscillations propagating in different directions. We analyzed EEG recordings from three datasets of human participants performing a covert visual attention task (one new dataset with N = 16, two previously published datasets with N = 16 and N = 31). Participants were instructed to detect a brief target by covertly attending to the screen’s left or right side. Our analysis reveals two distinct processes: allocating attention to one hemifield increases top-down alpha-band waves propagating from frontal to occipital regions ipsilateral to the attended location, both with and without visual stimulation. These top-down oscillatory waves correlate positively with alpha-band power in frontal and occipital regions. Yet, different alpha-band waves propagate from occipital to frontal regions and contralateral to the attended location. Crucially, these forward waves were present only during visual stimulation, suggesting a separate mechanism related to visual processing. Together, these results reveal two distinct processes reflected by different propagation directions, demonstrating the importance of considering oscillations as traveling waves when characterizing their functional role.

    1. Developmental Biology
    2. Neuroscience
    Kenneth Kin Lam Wong, Tongchao Li ... Liqun Luo
    Research Article

    How does wiring specificity of neural maps emerge during development? Formation of the adult Drosophila olfactory glomerular map begins with patterning of projection neuron (PN) dendrites at the early pupal stage. To better understand the origin of wiring specificity of this map, we created genetic tools to systematically characterize dendrite patterning across development at PN type-specific resolution. We find that PNs use lineage and birth order combinatorially to build the initial dendritic map. Specifically, birth order directs dendrite targeting in rotating and binary manners for PNs of the anterodorsal and lateral lineages, respectively. Two-photon- and adaptive optical lattice light-sheet microscope-based time-lapse imaging reveals that PN dendrites initiate active targeting with direction-dependent branch stabilization on the timescale of seconds. Moreover, PNs that are used in both the larval and adult olfactory circuits prune their larval-specific dendrites and re-extend new dendrites simultaneously to facilitate timely olfactory map organization. Our work highlights the power and necessity of type-specific neuronal access and time-lapse imaging in identifying wiring mechanisms that underlie complex patterns of functional neural maps.