Derivation and external validation of clinical prediction rules identifying children at risk of linear growth faltering

  1. Sharia M Ahmed  Is a corresponding author
  2. Ben J Brintz
  3. Patricia B Pavlinac
  4. Lubaba Shahrin
  5. Sayeeda Huq
  6. Adam C Levine
  7. Eric J Nelson
  8. James A Platts-Mills
  9. Karen L Kotloff
  10. Daniel T Leung  Is a corresponding author
  1. University of Utah, United States
  2. University of Washington, United States
  3. International Centre for Diarrhoeal Disease Research, Bangladesh
  4. Brown University, United States
  5. University of Florida, United States
  6. University of Virginia, United States
  7. University of Maryland, Baltimore, United States

Abstract

Background: Nearly 150 million children under-5 years of age were stunted in 2020. We aimed to develop a clinical prediction rule (CPR) to identify children likely to experience additional stunting following acute diarrhea, to enable targeted approaches to prevent this irreversible outcome.

Methods: We used clinical and demographic data from the Global Enteric Multicenter Study (GEMS) study to build predictive models of linear growth faltering (decrease of 0.5 or 1.0 in height-for-age z-score [HAZ] at 60 day follow-up) in children ≤59 months presenting with moderate-to-severe diarrhea (MSD), and community controls, in Africa and Asia. We screened variables using random forests, and assessed predictive performance with random forest regression and logistic regression using 5-fold cross-validation. We used the Etiology, Risk Factors, and Interactions of Enteric Infections and Malnutrition and the Consequences for Child Health and Development (MAL-ED) study to A) re-derive, and B) externally validate our GEMS-derived CPR.

Results: Of 7639 children in GEMS, 1744 (22.8%) experienced severe growth faltering (≥0.5 decrease in HAZ). In MAL-ED, we analyzed 5683 diarrhea episodes from 1322 children, of which 961(16.9%) episodes experienced severe growth faltering. Top predictors of growth faltering in GEMS were: age, HAZ at enrollment, respiratory rate, temperature, and number of people living in the household. The maximum AUC was 0.75 (95% CI: 0.75, 0.75) with 20 predictors, while 2 predictors yielded an AUC of 0.71 (95% CI: 0.71, 0.72). Results were similar in the MAL-ED re-derivation. A 2-variable CPR derived from children 0-23 months in GEMS had an AUC=0.63 (95% CI 0.62, 0.65), and AUC=0.68 (95% CI: 0.63, 0.74) when externally validated in MAL-ED.

Conclusions:; Our findings indicate that use of prediction rules could help identify children at risk of poor outcomes after an episode of diarrheal illness. They may also be generalizable to all children, regardless of diarrhea status.

Funding: This work was supported by the National Institutes of Health under Ruth L. Kirschstein National Research Service Award NIH T32AI055434 and by the National Institute of Allergy and Infectious Diseases (R01AI135114).

Data availability

This submitted manuscript is a secondary analysis of the GEMS and MAL-ED datasets. These data are available to the public through the following website https://clinepidb.org/ce/app/. Data requests are submitted through the website listed, and requests are reviewed and approved by the investigators of those original studies consistent with their protocols and data sharing policies.As of the time of submission of this manuscript, the GEMS Data Access Request asked for purpose, hypothesis/research question, analysis plan, dissemination plan, and if anyone from the GEMS study team had already been approached regarding this request. The MAL-ED data was available for download without submitting a Data Access Request.Data cleaning and statistical code needed to reproduce all parts of this analysis are available from the corresponding author's GitHub page: https://github.com/LeungLab/CPRgrowthfaltering.The following previously published datasets were used:Dataset 1: Gates Enterics Project, Levine MM, Kotloff K, Nataro J, Khan AZA, Saha D, Adegbola FR, Sow S, Alonso P, Breiman R, Sur D, Faruque A. 2018. Study GEMS1 Case Control. https://clinepidb.org/ce/app/record/dataset/DS_841a9f5259#Contacts. Database and Identifier: ClinEpiDB, DS_841a9f5259Dataset 2: The Etiology, Risk Factors, and Interactions of Enteric Infections and Malnutrition and the Consequences for Child Health (MAL-ED). Primary Contact: David Spiro, Fogarty International Center, National Institutes of Health, Bethesda, MD, USA. https://clinepidb.org/ce/app/workspace/analyses/DS_5c41b87221/new/details

Article and author information

Author details

  1. Sharia M Ahmed

    Division of Infectious Diseases, University of Utah, Salt lake City, United States
    For correspondence
    sharia.m.ahmed@utah.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-4060-5712
  2. Ben J Brintz

    Division of Epidemiology, University of Utah, Salt Lake City, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-4695-0290
  3. Patricia B Pavlinac

    Department of Global Health, University of Washington, Seattle, United States
    Competing interests
    The authors declare that no competing interests exist.
  4. Lubaba Shahrin

    International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
    Competing interests
    The authors declare that no competing interests exist.
  5. Sayeeda Huq

    International Centre for Diarrhoeal Disease Research, Dhaka, Bangladesh
    Competing interests
    The authors declare that no competing interests exist.
  6. Adam C Levine

    Department of Emergency Medicine, Brown University, Providence, United States
    Competing interests
    The authors declare that no competing interests exist.
  7. Eric J Nelson

    Department of Pediatrics, University of Florida, Gainesville, United States
    Competing interests
    The authors declare that no competing interests exist.
  8. James A Platts-Mills

    Division of Infectious Diseases and International Health, University of Virginia, Charlottesville, United States
    Competing interests
    The authors declare that no competing interests exist.
  9. Karen L Kotloff

    Department of Pediatrics, University of Maryland, Baltimore, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  10. Daniel T Leung

    Division of Infectious Diseases, University of Utah, Salt Lake City, United States
    For correspondence
    daniel.leung@utah.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8401-0801

Funding

National Institute of Allergy and Infectious Diseases (R01AI135114)

  • Sharia M Ahmed
  • Ben J Brintz
  • Daniel T Leung

National Institutes of Health (T32AI055434)

  • Sharia M Ahmed

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Parents or caregivers of participants provided informed consent, either in writing or witnessed if parents or caregivers were illiterate. The GEMS study protocol was approved by ethical review boards at each field site and the University of Maryland, Baltimore, USA.Parents or caregivers of participants provided informed consent. This analysis utilized publicly available data, see Data Availability statement, and as such is non-human subjects research. The MAL-ED study protocol was approved by ethical review boards at each field site and the Johns Hopkins Institutional Review Board, Baltimore, USA. This analysis utilized publicly available data, see Data Availability statement, and as such is non-human subjects research.

Copyright

© 2023, Ahmed et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 477
    views
  • 65
    downloads
  • 3
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Sharia M Ahmed
  2. Ben J Brintz
  3. Patricia B Pavlinac
  4. Lubaba Shahrin
  5. Sayeeda Huq
  6. Adam C Levine
  7. Eric J Nelson
  8. James A Platts-Mills
  9. Karen L Kotloff
  10. Daniel T Leung
(2023)
Derivation and external validation of clinical prediction rules identifying children at risk of linear growth faltering
eLife 12:e78491.
https://doi.org/10.7554/eLife.78491

Share this article

https://doi.org/10.7554/eLife.78491

Further reading

    1. Epidemiology and Global Health
    2. Microbiology and Infectious Disease
    Patrick E Brown, Sze Hang Fu ... Ab-C Study Collaborators
    Research Article Updated

    Background:

    Few national-level studies have evaluated the impact of ‘hybrid’ immunity (vaccination coupled with recovery from infection) from the Omicron variants of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2).

    Methods:

    From May 2020 to December 2022, we conducted serial assessments (each of ~4000–9000 adults) examining SARS-CoV-2 antibodies within a mostly representative Canadian cohort drawn from a national online polling platform. Adults, most of whom were vaccinated, reported viral test-confirmed infections and mailed self-collected dried blood spots (DBSs) to a central lab. Samples underwent highly sensitive and specific antibody assays to spike and nucleocapsid protein antigens, the latter triggered only by infection. We estimated cumulative SARS-CoV-2 incidence prior to the Omicron period and during the BA.1/1.1 and BA.2/5 waves. We assessed changes in antibody levels and in age-specific active immunity levels.

    Results:

    Spike levels were higher in infected than in uninfected adults, regardless of vaccination doses. Among adults vaccinated at least thrice and infected more than 6 months earlier, spike levels fell notably and continuously for the 9-month post-vaccination. In contrast, among adults infected within 6 months, spike levels declined gradually. Declines were similar by sex, age group, and ethnicity. Recent vaccination attenuated declines in spike levels from older infections. In a convenience sample, spike antibody and cellular responses were correlated. Near the end of 2022, about 35% of adults above age 60 had their last vaccine dose more than 6 months ago, and about 25% remained uninfected. The cumulative incidence of SARS-CoV-2 infection rose from 13% (95% confidence interval 11–14%) before omicron to 78% (76–80%) by December 2022, equating to 25 million infected adults cumulatively. However, the coronavirus disease 2019 (COVID-19) weekly death rate during the BA.2/5 waves was less than half of that during the BA.1/1.1 wave, implying a protective role for hybrid immunity.

    Conclusions:

    Strategies to maintain population-level hybrid immunity require up-to-date vaccination coverage, including among those recovering from infection. Population-based, self-collected DBSs are a practicable biological surveillance platform.

    Funding:

    Funding was provided by the COVID-19 Immunity Task Force, Canadian Institutes of Health Research, Pfizer Global Medical Grants, and St. Michael’s Hospital Foundation. PJ and ACG are funded by the Canada Research Chairs Program.

    1. Epidemiology and Global Health
    Sean V Connelly, Nicholas F Brazeau ... Jeffrey A Bailey
    Research Article

    Background:

    The Zanzibar archipelago of Tanzania has become a low-transmission area for Plasmodium falciparum. Despite being considered an area of pre-elimination for years, achieving elimination has been difficult, likely due to a combination of imported infections from mainland Tanzania and continued local transmission.

    Methods:

    To shed light on these sources of transmission, we applied highly multiplexed genotyping utilizing molecular inversion probes to characterize the genetic relatedness of 282 P. falciparum isolates collected across Zanzibar and in Bagamoyo district on the coastal mainland from 2016 to 2018.

    Results:

    Overall, parasite populations on the coastal mainland and Zanzibar archipelago remain highly related. However, parasite isolates from Zanzibar exhibit population microstructure due to the rapid decay of parasite relatedness over very short distances. This, along with highly related pairs within shehias, suggests ongoing low-level local transmission. We also identified highly related parasites across shehias that reflect human mobility on the main island of Unguja and identified a cluster of highly related parasites, suggestive of an outbreak, in the Micheweni district on Pemba island. Parasites in asymptomatic infections demonstrated higher complexity of infection than those in symptomatic infections, but have similar core genomes.

    Conclusions:

    Our data support importation as a main source of genetic diversity and contribution to the parasite population in Zanzibar, but they also show local outbreak clusters where targeted interventions are essential to block local transmission. These results highlight the need for preventive measures against imported malaria and enhanced control measures in areas that remain receptive to malaria reemergence due to susceptible hosts and competent vectors.

    Funding:

    This research was funded by the National Institutes of Health, grants R01AI121558, R01AI137395, R01AI155730, F30AI143172, and K24AI134990. Funding was also contributed from the Swedish Research Council, Erling-Persson Family Foundation, and the Yang Fund. RV acknowledges funding from the MRC Centre for Global Infectious Disease Analysis (reference MR/R015600/1), jointly funded by the UK Medical Research Council (MRC) and the UK Foreign, Commonwealth & Development Office (FCDO), under the MRC/FCDO Concordat agreement and is also part of the EDCTP2 program supported by the European Union. RV also acknowledges funding by Community Jameel.