Derivation and external validation of clinical prediction rules identifying children at risk of linear growth faltering

  1. Sharia M Ahmed  Is a corresponding author
  2. Ben J Brintz
  3. Patricia B Pavlinac
  4. Lubaba Shahrin
  5. Sayeeda Huq
  6. Adam C Levine
  7. Eric J Nelson
  8. James A Platts-Mills
  9. Karen L Kotloff
  10. Daniel T Leung  Is a corresponding author
  1. University of Utah, United States
  2. University of Washington, United States
  3. International Centre for Diarrhoeal Disease Research, Bangladesh
  4. Brown University, United States
  5. University of Florida, United States
  6. University of Virginia, United States
  7. University of Maryland, Baltimore, United States

Abstract

Background: Nearly 150 million children under-5 years of age were stunted in 2020. We aimed to develop a clinical prediction rule (CPR) to identify children likely to experience additional stunting following acute diarrhea, to enable targeted approaches to prevent this irreversible outcome.

Methods: We used clinical and demographic data from the Global Enteric Multicenter Study (GEMS) study to build predictive models of linear growth faltering (decrease of 0.5 or 1.0 in height-for-age z-score [HAZ] at 60 day follow-up) in children ≤59 months presenting with moderate-to-severe diarrhea (MSD), and community controls, in Africa and Asia. We screened variables using random forests, and assessed predictive performance with random forest regression and logistic regression using 5-fold cross-validation. We used the Etiology, Risk Factors, and Interactions of Enteric Infections and Malnutrition and the Consequences for Child Health and Development (MAL-ED) study to A) re-derive, and B) externally validate our GEMS-derived CPR.

Results: Of 7639 children in GEMS, 1744 (22.8%) experienced severe growth faltering (≥0.5 decrease in HAZ). In MAL-ED, we analyzed 5683 diarrhea episodes from 1322 children, of which 961(16.9%) episodes experienced severe growth faltering. Top predictors of growth faltering in GEMS were: age, HAZ at enrollment, respiratory rate, temperature, and number of people living in the household. The maximum AUC was 0.75 (95% CI: 0.75, 0.75) with 20 predictors, while 2 predictors yielded an AUC of 0.71 (95% CI: 0.71, 0.72). Results were similar in the MAL-ED re-derivation. A 2-variable CPR derived from children 0-23 months in GEMS had an AUC=0.63 (95% CI 0.62, 0.65), and AUC=0.68 (95% CI: 0.63, 0.74) when externally validated in MAL-ED.

Conclusions:; Our findings indicate that use of prediction rules could help identify children at risk of poor outcomes after an episode of diarrheal illness. They may also be generalizable to all children, regardless of diarrhea status.

Funding: This work was supported by the National Institutes of Health under Ruth L. Kirschstein National Research Service Award NIH T32AI055434 and by the National Institute of Allergy and Infectious Diseases (R01AI135114).

Data availability

This submitted manuscript is a secondary analysis of the GEMS and MAL-ED datasets. These data are available to the public through the following website https://clinepidb.org/ce/app/. Data requests are submitted through the website listed, and requests are reviewed and approved by the investigators of those original studies consistent with their protocols and data sharing policies.As of the time of submission of this manuscript, the GEMS Data Access Request asked for purpose, hypothesis/research question, analysis plan, dissemination plan, and if anyone from the GEMS study team had already been approached regarding this request. The MAL-ED data was available for download without submitting a Data Access Request.Data cleaning and statistical code needed to reproduce all parts of this analysis are available from the corresponding author's GitHub page: https://github.com/LeungLab/CPRgrowthfaltering.The following previously published datasets were used:Dataset 1: Gates Enterics Project, Levine MM, Kotloff K, Nataro J, Khan AZA, Saha D, Adegbola FR, Sow S, Alonso P, Breiman R, Sur D, Faruque A. 2018. Study GEMS1 Case Control. https://clinepidb.org/ce/app/record/dataset/DS_841a9f5259#Contacts. Database and Identifier: ClinEpiDB, DS_841a9f5259Dataset 2: The Etiology, Risk Factors, and Interactions of Enteric Infections and Malnutrition and the Consequences for Child Health (MAL-ED). Primary Contact: David Spiro, Fogarty International Center, National Institutes of Health, Bethesda, MD, USA. https://clinepidb.org/ce/app/workspace/analyses/DS_5c41b87221/new/details

Article and author information

Author details

  1. Sharia M Ahmed

    Division of Infectious Diseases, University of Utah, Salt lake City, United States
    For correspondence
    sharia.m.ahmed@utah.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-4060-5712
  2. Ben J Brintz

    Division of Epidemiology, University of Utah, Salt Lake City, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-4695-0290
  3. Patricia B Pavlinac

    Department of Global Health, University of Washington, Seattle, United States
    Competing interests
    The authors declare that no competing interests exist.
  4. Lubaba Shahrin

    International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
    Competing interests
    The authors declare that no competing interests exist.
  5. Sayeeda Huq

    International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
    Competing interests
    The authors declare that no competing interests exist.
  6. Adam C Levine

    Department of Emergency Medicine, Brown University, Providence, United States
    Competing interests
    The authors declare that no competing interests exist.
  7. Eric J Nelson

    Department of Pediatrics, University of Florida, Gainesville, United States
    Competing interests
    The authors declare that no competing interests exist.
  8. James A Platts-Mills

    Division of Infectious Diseases and International Health, University of Virginia, Charlottesville, United States
    Competing interests
    The authors declare that no competing interests exist.
  9. Karen L Kotloff

    Department of Pediatrics, University of Maryland, Baltimore, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  10. Daniel T Leung

    Division of Infectious Diseases, University of Utah, Salt Lake City, United States
    For correspondence
    daniel.leung@utah.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8401-0801

Funding

National Institute of Allergy and Infectious Diseases (R01AI135114)

  • Sharia M Ahmed
  • Ben J Brintz
  • Daniel T Leung

National Institutes of Health (T32AI055434)

  • Sharia M Ahmed

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Parents or caregivers of participants provided informed consent, either in writing or witnessed if parents or caregivers were illiterate. The GEMS study protocol was approved by ethical review boards at each field site and the University of Maryland, Baltimore, USA.Parents or caregivers of participants provided informed consent. This analysis utilized publicly available data, see Data Availability statement, and as such is non-human subjects research. The MAL-ED study protocol was approved by ethical review boards at each field site and the Johns Hopkins Institutional Review Board, Baltimore, USA. This analysis utilized publicly available data, see Data Availability statement, and as such is non-human subjects research.

Copyright

© 2023, Ahmed et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 518
    views
  • 75
    downloads
  • 4
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Sharia M Ahmed
  2. Ben J Brintz
  3. Patricia B Pavlinac
  4. Lubaba Shahrin
  5. Sayeeda Huq
  6. Adam C Levine
  7. Eric J Nelson
  8. James A Platts-Mills
  9. Karen L Kotloff
  10. Daniel T Leung
(2023)
Derivation and external validation of clinical prediction rules identifying children at risk of linear growth faltering
eLife 12:e78491.
https://doi.org/10.7554/eLife.78491

Share this article

https://doi.org/10.7554/eLife.78491

Further reading

    1. Epidemiology and Global Health
    Riccardo Spott, Mathias W Pletz ... Christian Brandt
    Research Article

    Given the rapid cross-country spread of SARS-CoV-2 and the resulting difficulty in tracking lineage spread, we investigated the potential of combining mobile service data and fine-granular metadata (such as postal codes and genomic data) to advance integrated genomic surveillance of the pandemic in the federal state of Thuringia, Germany. We sequenced over 6500 SARS-CoV-2 Alpha genomes (B.1.1.7) across 7 months within Thuringia while collecting patients’ isolation dates and postal codes. Our dataset is complemented by over 66,000 publicly available German Alpha genomes and mobile service data for Thuringia. We identified the existence and spread of nine persistent mutation variants within the Alpha lineage, seven of which formed separate phylogenetic clusters with different spreading patterns in Thuringia. The remaining two are subclusters. Mobile service data can indicate these clusters’ spread and highlight a potential sampling bias, especially of low-prevalence variants. Thereby, mobile service data can be used either retrospectively to assess surveillance coverage and efficiency from already collected data or to actively guide part of a surveillance sampling process to districts where these variants are expected to emerge. The latter concept was successfully implemented as a proof-of-concept for a mobility-guided sampling strategy in response to the surveillance of Omicron sublineage BQ.1.1. The combination of mobile service data and SARS-CoV-2 surveillance by genome sequencing is a valuable tool for more targeted and responsive surveillance.

    1. Epidemiology and Global Health
    2. Microbiology and Infectious Disease
    Felix Lankester, Tito J Kibona ... Sarah Cleaveland
    Research Article

    Lack of data on the aetiology of livestock diseases constrains effective interventions to improve livelihoods, food security and public health. Livestock abortion is an important disease syndrome affecting productivity and public health. Several pathogens are associated with livestock abortions but across Africa surveillance data rarely include information from abortions, little is known about aetiology and impacts, and data are not available to inform interventions. This paper describes outcomes from a surveillance platform established in Tanzania spanning pastoral, agropastoral and smallholder systems to investigate causes and impacts of livestock abortion. Abortion events were reported by farmers to livestock field officers (LFO) and on to investigation teams. Events were included if the research team or LFO could attend within 72 hr. If so, samples and questionnaire data were collected to investigate (a) determinants of attribution; (b) patterns of events, including species and breed, previous abortion history, and seasonality; (c) determinants of reporting, investigation and attribution; (d) cases involving zoonotic pathogens. Between 2017–2019, 215 events in cattle (n=71), sheep (n=44), and goats (n=100) were investigated. Attribution, achieved for 19.5% of cases, was significantly affected by delays in obtaining samples. Histopathology proved less useful than PCR due to rapid deterioration of samples. Vaginal swabs provided practical and sensitive material for pathogen detection. Livestock abortion surveillance, even at a small scale, can generate valuable information on causes of disease outbreaks, reproductive losses and can identify pathogens not easily captured through other forms of livestock disease surveillance. This study demonstrated the feasibility of establishing a surveillance system, achieved through engagement of community-based field officers, establishment of practical sample collection and application of molecular diagnostic platforms.