Design issues and solutions for stop-signal data from the Adolescent Brain Cognitive Development [ABCD] study

Abstract

The Adolescent Brain Cognitive Development (ABCD) study is an unprecedented longitudinal neuroimaging sample that tracks the brain development of over 10,000 9-10 year olds through adolescence. At the core of this study are the three tasks that are completed repeatedly within the MRI scanner, one of which is the stop-signal task. In analyzing the available stopping experimental code and data, we identified a set of design issues that we believe significantly compromise its value. These issues include but are not limited to: variable stimulus durations that violate basic assumptions of dominant stopping models, trials in which stimuli are incorrectly not presented, and faulty stop-signal delays. We present eight issues, show their effect on the existing ABCD data, suggest prospective solutions including task changes for future data collection and preliminary computational models, and suggest retrospective solutions for data users who wish to make the most of the existing data.

Data availability

The ABCD dataset is openly available through the NIH Data Archive (https://nda.nih.gov/abcd). Analysis code is available at: http://doi.org/10.5281/zenodo.4458428 and http://doi.org/10.5281/zenodo.4458767.

The following previously published data sets were used

Article and author information

Author details

  1. Patrick G Bissett

    Department of Psychology, Stanford University, Stanford, United States
    For correspondence
    pbissett@stanford.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-0854-9404
  2. McKenzie P Hagen

    Psychology, Stanford University, Stanford, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Henry M Jones

    Department of Psychology, Stanford University, Stanford, United States
    Competing interests
    The authors declare that no competing interests exist.
  4. Russell A Poldrack

    Psychology, Stanford University, Stanford, United States
    Competing interests
    The authors declare that no competing interests exist.

Funding

The authors declare that there was no funding for this work.

Copyright

© 2021, Bissett et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,428
    views
  • 223
    downloads
  • 28
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Patrick G Bissett
  2. McKenzie P Hagen
  3. Henry M Jones
  4. Russell A Poldrack
(2021)
Design issues and solutions for stop-signal data from the Adolescent Brain Cognitive Development [ABCD] study
eLife 10:e60185.
https://doi.org/10.7554/eLife.60185

Share this article

https://doi.org/10.7554/eLife.60185

Further reading

    1. Neuroscience
    Marine Schimel, Ta-Chu Kao, Guillaume Hennequin
    Research Article

    During delayed ballistic reaches, motor areas consistently display movement-specific activity patterns prior to movement onset. It is unclear why these patterns arise: while they have been proposed to seed an initial neural state from which the movement unfolds, recent experiments have uncovered the presence and necessity of ongoing inputs during movement, which may lessen the need for careful initialization. Here, we modeled the motor cortex as an input-driven dynamical system, and we asked what the optimal way to control this system to perform fast delayed reaches is. We find that delay-period inputs consistently arise in an optimally controlled model of M1. By studying a variety of network architectures, we could dissect and predict the situations in which it is beneficial for a network to prepare. Finally, we show that optimal input-driven control of neural dynamics gives rise to multiple phases of preparation during reach sequences, providing a novel explanation for experimentally observed features of monkey M1 activity in double reaching.

    1. Neuroscience
    Jing Jun Wong, Alessandro Bongioanni ... Bolton KH Chau
    Research Article

    Humans make irrational decisions in the presence of irrelevant distractor options. There is little consensus on whether decision making is facilitated or impaired by the presence of a highly rewarding distractor, or whether the distractor effect operates at the level of options’ component attributes rather than at the level of their overall value. To reconcile different claims, we argue that it is important to consider the diversity of people’s styles of decision making and whether choice attributes are combined in an additive or multiplicative way. Employing a multi-laboratory dataset investigating the same experimental paradigm, we demonstrated that people used a mix of both approaches and the extent to which approach was used varied across individuals. Critically, we identified that this variability was correlated with the distractor effect during decision making. Individuals who tended to use a multiplicative approach to compute value, showed a positive distractor effect. In contrast, a negative distractor effect (divisive normalisation) was prominent in individuals tending towards an additive approach. Findings suggest that the distractor effect is related to how value is constructed, which in turn may be influenced by task and subject specificities. This concurs with recent behavioural and neuroscience findings that multiple distractor effects co-exist.