Derivation and external validation of clinical prediction rules identifying children at risk of linear growth faltering

  1. Sharia M Ahmed  Is a corresponding author
  2. Ben J Brintz
  3. Patricia B Pavlinac
  4. Lubaba Shahrin
  5. Sayeeda Huq
  6. Adam C Levine
  7. Eric J Nelson
  8. James A Platts-Mills
  9. Karen L Kotloff
  10. Daniel T Leung  Is a corresponding author
  1. Division of Infectious Diseases, University of Utah School of Medicine, United States
  2. Division of Epidemiology, University of Utah School of Medicine, United States
  3. Department of Global Health, Global Center for Integrated Health of Women, Adolescents and Children (Global WACh), University of Washington, United States
  4. International Centre for Diarrhoeal Disease Research, Bangladesh
  5. Department of Emergency Medicine, Warren Alpert Medical School of Brown University, United States
  6. Department of Pediatrics and Environmental and Global Health, Emerging Pathogens Institute, University of Florida, United States
  7. Division of Infectious Diseases and International Health, University of Virginia, United States
  8. Department of Pediatrics, Center for Vaccine Development, University of Maryland School of Medicine, United States
  9. Division of Microbiology & Immunology, University of Utah School of Medicine, United States
3 figures, 2 tables and 2 additional files

Figures

Flow diagram of study inclusion.
Figure 2 with 1 supplement
Area under the curves (AUCs).

Cross-validated AUC achieved by number of predictive variables included in random forest regression and logistic regression models predicting growth faltering (≥0.5 decrease in height-for-age z-score [HAZ]) in children 0–59 months of age presenting with diarrhea in the Global Enteric Multicenter Study (GEMS).

Figure 2—figure supplement 1
Receiver operating characteristic (ROC) curves: average ROC curves from the cross-validated logistic regression models predicting growth faltering with 2, 5, and 10 predictors.

The faded dashed lines represent specificity (1 − false positive rate) achievable with a sensitivity (true positive rate) of 0.80 for prediction of the outcome.

Figure 3 with 5 supplements
2-Variable clinical prediction rule (CPR) for growth faltering: calibration curve and discriminative ability of 2-varaible (age, height-for-age z-score [HAZ] at enrollment) model predicting growth faltering (≥0.5 decrease in HAZ) in children presenting for acute diarrhea in LMICs.
Figure 3—figure supplement 1
Calibration curve of 5- and 10-variable model predicting growth faltering (≥0.5 decrease in height-for-age z-score [HAZ]) in children 0–59 months of age presenting for acute diarrhea in the Global Enteric Multicenter Study (GEMS).
Figure 3—figure supplement 2
Area under the curves (AUCs): cross-validated AUC achieved by number of predictive variables included in random forest regression and logistic regression models predicting growth faltering (≥0.5 decrease in height-for-age z-score [HAZ]) in children 0–23 months of age presenting with diarrhea in the MAL-ED (the Etiology, Risk Factors, and Interactions of Enteric Infections and Malnutrition and the Consequences for Child Health and Development) study.
Figure 3—figure supplement 3
Calibration curves of 5- and 10-variable model predicting growth faltering (≥0.5 decrease in height-for-age z-score [HAZ]) in children 0–23 months of age presenting for acute diarrhea in the MAL-ED (the Etiology, Risk Factors, and Interactions of Enteric Infections and Malnutrition and the Consequences for Child Health and Development) study.
Figure 3—figure supplement 4
Area under the curves (AUCs): cross-validated AUC achieved by number of predictive variables included in random forest regression and logistic regression models predicting growth faltering (≥0.5 decrease in height-for-age z-score [HAZ]) in children 0–59 months of age without diarrhea in the Global Enteric Multicenter Study (GEMS).
Figure 3—figure supplement 5
Histogram comparing baseline height-for-age z-score (HAZ) between children who did and did not experience growth faltering (≥0.5 decrease in HAZ) in Global Enteric Multicenter Study (GEMS) data.

Tables

Table 1
Growth faltering.

Variable importance ordering and cross-validated average overall area under the curve (AUC) and AUC by patient subset and 95% confidence intervals for a 5 (bold) and 10 (italicized) variable logistic regression model for predicting growth faltering in children in 7 LMICs(Low- and middle-income countries) derived from Global Enteric Multicenter Study (GEMS) data (≥0.5 decrease in height-for-age z-score [HAZ] in children with acute diarrhea).

GEMSMAL-ED
Patient subset0–59 months (main text model)0–59 months
(limit to only those NOT stunted at beginning (HAZ ≥−2)
5659/7639 (74.1%))
0–59 months
limited to only those NOT stunted at beginning
outcome is ANY stunting at follow-up (HAZ <−2)
0–23 months (for external validation)Healthy controls0–23 months
AUCs0.72 (0.72, 0.72)0.71 (0.70, 0.72)0.90 (0.89, 0.91)0.64 (0.63, 0.65)0.79 (0.78, 0.79)0.67 (0.67, 0.68)
0.72 (0.72, 0.72)0.71 (0.70, 0.72)0.90 (0.89, 0.90)0.64 (0.64, 0.64)0.79 (0.79, 0.79)0.68 (0.67, 0.69)
1Age (months)Age (months)HAZHAZAge (months)HAZ
2HAZHAZAgeAge (months)HAZAge (days)
3Respiratory rateRespiratory rateRespiratory rateTemperatureRespiratory rateTotal days breastfeeding
4TemperatureTemperatureTemperatureRespiratory rateTemperatureTotal days in all diarrheal episodes to date
5Num. people living in householdNum. people living in householdNum. people living in householdNum. people living in householdNum. people living in householdMean number of people per room
6Num. rooms used for sleepingNum. rooms used for sleepingNum. days of diarrhea at presentationNum. rooms used for sleepingBreastfedDays with diarrhea so far in this episode
7Num. days of diarrhea at presentationNum. days of diarrhea at presentationNum. other households that share same fecal waste facilityNum. days of diarrhea at presentationNum. rooms used for sleepingMaternal education (years)
8Num. other households that share same fecal waste facilityBreastfedNum. rooms used for sleepingNum. other households that share same fecal waste facilityNum. children <60 months live in householdDays since last diarrhea episode
9BreastfedNum. other households that share same fecal waste facilityNum. children <60 months live in householdNum. children <60 months live in householdCaregiver educationPeople sleeping in house
10Num. children <60 months live in householdNum. children <60 months live in householdCaregiver educationCaregiver educationNum. other households share latrineMax loose stools in this episode
Table 2
Calibration intercept and slope.
Number of predictor variablesGEMS 0–59 monthsIntercept (95% CI)Slope (95% CI)GEMS 0–23 months (for external validation)Intercept (95% CI)Slope (95% CI)MAL-ED 0–23 months Rederivationintercept (95% CI)Slope (95% CI)GEMS-derived model applied to MAL-ED dataIntercept (95% CI)Slope (95% CI)
12.9 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.82, 1.2)
−1.0 × 10−2
(−0.14, 0.12)
0.97
(0.62, 1.3)
9.6 × 10−3
(−0.32, 0.32)
1.0
(0.35, 1.7)
23.6 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.84, 1.2)
−1.1 × 10−2
(−0.14, 0.12)
0.98
(0.70, 1.3)
1.1 × 10−2
(−0.33, 0.33)
1.0
(0.51, 1.5)
−0.32
(−0.54, −0.11)
1.5
(1.0, 2.1)
33.6 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.84, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.97
(0.70, 1.2)
1.1 × 10−2
(−0.33, 0.33)
0.99
(0.51, 1.5)
44.1 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.84, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.97
(0.71, 1.2)
1.1 × 10−2
(−0.33, 0.33)
0.97
(0.49, 1.5)
54.2 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.83, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.96
(0.70, 1.2)
1.1 × 10−2
(−0.33, 0.33)
0.95
(0.48, 1.5)
64.2 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.83, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.96
(0.70, 1.2)
1.2 × 10−2
(−0.33, 0.33)
0.94
(0.47, 1.5)
74.3 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.83, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.96
(0.70, 1.2)
1.2 × 10−2
(−0.33, 0.33)
0.92
(0.47, 1.4)
84.4 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.83, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.95
(0.69, 1.2)
1.2 × 10−2
(−0.33, 0.33)
0.92
(0.47, 1.4)
94.7 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.83, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.95
(0.69, 1.2)
1.2 × 10−2
(−0.33, 0.33)
0.91
(0.47, 1.4)
104.8 × 10−3
(−1.2 × 10−1,
1.3 × 10−1)
1.0
(0.83, 1.2)
−1.2 × 10−2
(−0.14, 0.12)
0.93
(0.69, 1.2)
1.2 × 10−2
(−0.33, 0.33)
0.89
(0.46, 1.4)

Additional files

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Sharia M Ahmed
  2. Ben J Brintz
  3. Patricia B Pavlinac
  4. Lubaba Shahrin
  5. Sayeeda Huq
  6. Adam C Levine
  7. Eric J Nelson
  8. James A Platts-Mills
  9. Karen L Kotloff
  10. Daniel T Leung
(2023)
Derivation and external validation of clinical prediction rules identifying children at risk of linear growth faltering
eLife 12:e78491.
https://doi.org/10.7554/eLife.78491