Relationship between changing malaria burden and low birth weight in subSaharan Africa: A differenceindifferences study via a pairofpairs approach
Abstract
Background:
According to the World Health Organization (WHO), in 2018, an estimated 228 million malaria cases occurred worldwide with most cases occurring in subSaharan Africa. Scaleup of vector control tools coupled with increased access to diagnosis and effective treatment has resulted in a large decline in malaria prevalence in some areas, but other areas have seen little change. Although interventional studies demonstrate that preventing malaria during pregnancy can reduce the rate of low birth weight (i.e. child’s birth weight <2500 g), it remains unknown whether natural changes in parasite transmission and malaria burden can improve birth outcomes.
Methods:
We conducted an observational study of the effect of changing malaria burden on low birth weight using data from 18,112 births in 19 countries in subSaharan African countries during the years 2000–2015. Specifically, we conducted a differenceindifferences study via a pairofpairs matching approach using the fact that some subSaharan areas experienced sharp drops in malaria prevalence and some experienced little change.
Results:
A malaria prevalence decline from a high rate (Plasmodium falciparum parasite rate in children aged 2upto10 (i.e. PfPR_{210}) > 0.4) to a low rate (PfPR_{210} < 0.2) is estimated to reduce the rate of low birth weight by 1.48 percentage points (95% confidence interval: 3.70 percentage points reduction, 0.74 percentage points increase), which is a 17% reduction in the low birth weight rate compared to the average (8.6%) in our study population with observed birth weight records (1.48/8.6 ≈ 17%). When focusing on first pregnancies, a decline in malaria prevalence from high to low is estimated to have a greater impact on the low birth weight rate than for all births: 3.73 percentage points (95% confidence interval: 9.11 percentage points reduction, 1.64 percentage points increase).
Conclusions:
Although the confidence intervals cannot rule out the possibility of no effect at the 95% confidence level, the concurrence between our primary analysis, secondary analyses, and sensitivity analyses, and the magnitude of the effect size, contribute to the weight of the evidence suggesting that declining malaria burden can potentially substantially reduce the low birth weight rate at the community level in subSaharan Africa, particularly among firstborns. The novel statistical methodology developed in this article–a pairofpairs approach to a differenceindifferences study–could be useful for many settings in which different units are observed at different times.
Funding:
Ryan A. Simmons is supported by National Center for Advancing Translational Sciences (UL1TR002553). The funder had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
eLife digest
Malaria infects around 230 million people each year, mostly in subSaharan Africa, and causes more than 400,000 deaths. Pregnant women are particularly susceptible to malaria. The parasite that causes malaria can sap the mother’s iron stores and may starve the baby of nutrients. Babies born to infected mothers often have low birth weights, which can have lasting effects on their health and brain development.
Previous studies suggest that preventing malaria in pregnant women using insecticidetreated bed nets or medications may improve birth outcomes. Successful efforts to prevent malaria have led to substantially fewer infections in subSaharan Africa. But success has been uneven with some communities continuing to have high rates of infection. These differences may allow scientists to better understand the communitylevel impact of falling rates of malaria on pregnancy outcomes in the real world.
Heng et al. estimated that reducing malaria transmission minimises the number of infants born with low birth weights in communities in subSaharan Africa. In an observational study, they used data on more than 18,000 births in 19 countries in this region between 2000 and 2015 to assess the effects of declining malaria rates on birth weights. They found that a decrease of malaria prevalence is estimated to reduce the rate of low birth weight by 1.48%, which is a 17% reduction in the number of observed newborns with low birth weight in the study population. Firstborn infants appeared to benefit the most.
This highlights that malaria interventions are beneficial for pregnant women and their newborns. Most analyses of the impact and costbenefit of malaria control have ignored the potential advantages of malaria control on birth weight, and may thus undermine the benefits of malaria control. The approach used by Heng et al. may further be useful for other epidemiologists studying global health.
Introduction
In 2018, according to the WHO, 2019 published by the WHO, an estimated 228 million malaria cases occurred worldwide, with an estimated 405,000 deaths from malaria globally (WHO, 2019). Dellicour et al., 2010 estimated that around 85 million pregnancies occurred in 2007 in areas with stable Plasmodium falciparum (one of the most prevalent malaria parasites) transmission and therefore were at risk of malaria. Pregnant women are particularly susceptible to malaria, even if they have developed immunity from childhood infections, in part because parasitized cells in the placenta express unique variant surface antigens (Rogerson et al., 2007). Women who are infected during pregnancy may or may not experience symptoms, but the presence of parasites has grave consequences for both mother and unborn baby. Parasites exacerbate maternal anemia and they also sequester in the placenta, leading to intrauterine growth restriction, low birth weight (i.e. birth weight <2500 g), preterm delivery and even stillbirth and neonatal death. Preventing malaria during pregnancy with drugs or insecticide treated nets has a significant impact on pregnancy outcomes (Eisele et al., 2012; Kayentao et al., 2013; RadevaPetrova et al., 2014).
Observational and interventional studies of malaria in pregnant women are complicated by the difficulty of enrolling women early in their pregnancy. However, in one study, early exposure to Plasmodium falciparum (before 120 days gestation), prior to initiating malaria prevention measures, was associated with a reduction in birth weight of more than 200 g and reduced average gestational age of nearly 1 week (Schmiegelow et al., 2017). For other representative studies on the negative influence of malaria infection during early pregnancy on birth outcomes, see Menendez et al., 2000, Ross and Smith, 2006, Huynh et al., 2011, Valea et al., 2012, Walker et al., 2014, and Huynh et al., 2015. These results suggest the impact of malaria infection on stillbirths, perinatal, and neonatal mortality may be substantial and needs more careful examination (Fowkes et al., 2020; Gething et al., 2020).
In the last few decades, malaria burden has declined in many parts of the world. Although the magnitude of the decline is difficult to estimate precisely, some reports suggest that the global cases of malaria declined by an estimated 41% between 2000 and 2015 (WHO, 2016) and the clinical cases of Plasmodium falciparum malaria declined by 40% in Africa between 2000 and 2015 (Bhatt et al., 2015). However, estimates of changing morbidity and mortality do not account for the effects of malaria in pregnancy. In the context of global reductions in malaria transmission, we expect fewer pregnancies are being exposed to infection and/or exposed less frequently. This should result in a significant reduction in preterm delivery, low birth weight and stillbirths. However, declining transmission will also lead to reductions in maternal immunity to malaria. Maternal immunity is important in mitigating the effects of malaria infection during pregnancy as is evidenced by the reduced impact of malaria exposure on the second, third and subsequent pregnancies. Thus, we anticipate a complex relationship between declining exposure and pregnancy outcomes that depends on both current transmission and historical transmission and communitylevel immunity (Mayor et al., 2015).
Understanding the potential causal effect of a reduction in malaria burden on the low birth weight rate is crucial as low birth weight is strongly associated with poor cognitive and physical development of children (McCormick et al., 1992; Avchen et al., 2001; Guyatt and Snow, 2004). Although we know from previous interventional studies that preventing malaria in pregnancy is associated with higher birth weight (Eisele et al., 2012; RadevaPetrova et al., 2014), we do not know whether natural changes in malaria transmission intensity are similarly associated with improved birth outcomes. To address this question, we make use of the fact that while the overall prevalence of malaria has declined in subSaharan Africa, the decline has been uneven, with some malariaendemic areas experiencing sharp drops and others experiencing little change. We use this heterogeneity to assess whether reductions in malaria prevalence reduce the proportion of infants born with low birth weight in subSaharan African countries. Our approach conducts a differenceindifferences study (Card and Krueger, 2000; Angrist and Pischke, 2008; St. Clair and Cook, 2015) by leveraging recent developments in matching, a nonparametric statistical analysis approach that can make studies more robust to bias that can arise from statistical model misspecification (Rubin, 1973; Rubin, 1979; Hansen, 2004; Ho et al., 2007).
Materials and methods
Overview
In this analysis, we combine two rich data sources: (1) rasters of annual malaria prevalence means (Bhatt et al., 2015) and (2) the Demographic and Health Surveys (DHS) (ICF, 2019), and we marry two powerful statistical analysis methods of adjusting for covariates – differenceindifferences (Card and Krueger, 2000; Abadie, 2005; Athey and Imbens, 2006; Angrist and Pischke, 2008; Dimick and Ryan, 2014; St. Clair and Cook, 2015) and matching (Rubin, 1973; Rubin, 2006; Rosenbaum, 2002; Hansen, 2004; Stuart, 2010; Zubizarreta, 2012; Pimentel et al., 2015). We match geographically proximal DHS clusters that were collected in different time periods (early vs. late) and then identify pairs of early/late clusters that have either maintained high malaria transmission intensity or experienced substantial declines in malaria transmission intensity. We then match pairs of clusters that differ in their malaria transmission intensity (maintained high vs. declined) but are similar in other key characteristics. Once these quadruples (pairs of pairs) have been formed, our analysis moves to the individual births within these clusters. We use multiple imputation to categorize missing children’s birth weight records as either low birth weight or not, relying on the size of the child at birth reported subjectively by the mother and other demographic characteristics of the mother. Finally, we estimate the effect of declined malaria transmission intensity on the low birth weight rate by looking at the coefficient of the malaria prevalence indicator (low vs. high) contributing to the low birth weight rate in a mixedeffects linear probability model adjusted for covariates that are potential confounding variables, the group indicator (individual being within a cluster with declined vs. maintained high malaria transmission intensity), and the time indicator (late vs. early).
Data resources
Request a detailed protocolThe data we use in this work comes from the following three sources:
Rasters of annual malaria prevalence: These image data, constructed by the Malaria Atlas Project (MAP) (Hay and Snow, 2006; MAP, 2020), estimate for subSaharan Africa the spatial distribution of the Plasmodium falciparum parasite rate (i.e. the proportion of the population that carries asexual bloodstage parasites) in children from 2 to 10 years old (${\text{\mathit{P}\mathit{f}PR}}_{210}$) for each year between 2000 and 2015 (Bhatt et al., 2015). ${\text{\mathit{P}\mathit{f}PR}}_{210}$ has been widely used for measuring malaria transmission intensity (Metselaar and Van Thiel, 1959; Smith et al., 2007; Bhatt et al., 2015; WHO, 2019) and we use it in this work. The value in each pixel indicates the estimated annual ${\text{\mathit{P}\mathit{f}PR}}_{210}$ (ranging from 0 to 1) with a resolution of 5 km by 5 km.
Demographic and Health Surveys (DHS): The DHS are nationallyrepresentative household surveys mainly conducted in low and middle income countries that contain data with numerous health and sociodemographic indicators (Corsi et al., 2012; ICF, 2019). We used the Integrated Public Use Microdata Series’ recoding of the DHS variables (IPUMSDHS) which makes the DHS variables consistent across different years and surveys (Boyle et al., 2019).
Cluster Global Positioning System (GPS) data set: This data set contains the geographical information (longitude, latitude and the indicator of urban or rural) of each cluster in the DHS data. In order to maintain respondent confidentiality, the DHS program randomly displaces the GPS latitude/longitude positions for all surveys, while ensuring that the positional error of the clusters is at most 10 kilometers (at most 5 km for over 99% of clusters) and all the positions stay within the country and DHS survey region (DHS, 2019).
Data selection procedure
Request a detailed protocolIn this article, we set the study period to be the years 2000–2015, and correspondingly, all the results and conclusions obtained in this article are limited to the years 2000–2015. We set the year 2000 as the starting point of the study period for two reasons. First, the year 2000 is the earliest year in which the estimated annual ${\text{\mathit{P}\mathit{f}PR}}_{210}$ is published by MAP, 2020. Second, according to Bhatt et al., 2015, ‘the year 2000 marked a turning point in multilateral commitment to malaria control in subSaharan Africa, catalysed by the Roll Back Malaria initiative and the wider development agenda around the United Nations Millennium Development Goals'. We set the year 2015 as the ending point based on two considerations. First, when we designed our study in the year 2017, the year 2015 was the latest year in which the estimated annual ${\text{\mathit{P}\mathit{f}PR}}_{210}$ was available to us. We became aware after starting our outcome analysis that MAP has published some post2015 estimated annual ${\text{\mathit{P}\mathit{f}PR}}_{210}$ data since then, but, following Rubin, 2007’s advice to design observational studies before seeing and analyzing the outcome data, we felt it was best to stick with the design of our original study for this report and consider the additional data in a later report. Second, the year 2015 was set as a target year by a series of international goals on malaria control. For example, the United Nations Millennium Development Goals set a goal to ‘halt by 2015 and begin to reverse the incidence of malaria’ and `the more ambitious target defined later by the World Health Organization (WHO) of reducing case incidence by 75% relative to 2000 levels.’ (WHO, 2008; Bhatt et al., 2015). It is worth emphasizing that although we set the years 2000–2015 as the study period and did not investigate any post2015 MAP data because of the above considerations, those published or upcoming post2015 MAP data should be considered or leveraged for future related research or followup studies.
After selecting 2000–2015 as our study period, we take the middle point years 2007 and 2008 as the cutoff and define the years 2000–2007 as the ‘early years’ and the years 2008–2015 as the ‘late years.’ We include all the subSaharan countries that satisfy the following two criteria: (1) The rasters of estimated annual ${\text{\mathit{P}\mathit{f}PR}}_{210}$ between 2000 and 2015 created by the Malaria Atlas Project include that country. (2) For that country, IPUMSDHS contains at least one standard DHS between 2000 and 2007 (‘early year’) and at least one standard DHS between 2008 and 2015 (‘late year’), and both surveys include the cluster GPS coordinates. If there is more than one early (late) years for which the above data are all available, we chose the earliest early year (latest late year). This choice was made to maximize the time interval for the decrease of malaria prevalence, if any, to have an effect on the birth weight of infants. For those countries that have at least one standard DHS with available cluster GPS data in the late year (2008–2015), but no available standard DHS or GPS data in the early year (2000–2007), we still include them if they have a standard DHS along with its GPS data for the year 1999 (with a possible overlap into 1998). In this case, we assign MAP annual ${\text{\mathit{P}\mathit{f}PR}}_{210}$ estimates from 2000 to the 1999 DHS data. This allows us to include two more countries, Cote d’Ivoire and Tanzania. The 19 subSaharan African countries that meet the above eligibility criteria are listed in Table 1.
From Table 1, we can see that among the 19 countries, only two countries (Congo Democratic Republic and Zambia) happen to take the margin year 2007 as the early year and no countries take the margin year 2008 as the late year. This implies that our study is relatively insensitive to our way of defining the early years (2000–2007) and the late years (2008–2015) as most of the selected early years and late years in Table 1 do not fall near the margin years 2007 and 2008.
Statistical analysis
Motivation and overview of our approach: differenceindifferences via pairofpairs
Request a detailed protocolOur approach to estimating the causal effect of reduced malaria burden on the low birth weight rate is to use a differenceindifferences approach (Card and Krueger, 2000; Abadie, 2005; Athey and Imbens, 2006; Angrist and Pischke, 2008; Dimick and Ryan, 2014; St. Clair and Cook, 2015) combined with matching (Rubin, 1973; Rosenbaum, 2002; Hansen, 2004; Stuart, 2010; Zubizarreta, 2012; Pimentel et al., 2015). In a differenceindifferences approach, units are measured in both an early (before treatment) and late (after treatment) period. Ideally, we would like to observe how the low birth weight rate changes with respect to malaria prevalence within each DHS cluster, so that the DHS clusters themselves could be the units in a differenceindifferences approach. However, this is not feasible because within each country over time the DHS samples different locations (clusters) as the representative data of that country. We use optimal matching (Rosenbaum, 1989; Hansen and Klopfer, 2006) to pair two DHS clusters, one in the early year and one in the late year as closely as possible, mimicking a single DHS cluster measured twice in two different time periods. After this firststep matching, we define the treated units as the highlow pairs of clusters, meaning that the early year cluster has high malaria prevalence (i.e. ${\text{\mathit{P}\mathit{f}PR}}_{210}$ > 0.4) while the late year cluster has low malaria prevalence (i.e. ${\text{\mathit{P}\mathit{f}PR}}_{210}$ < 0.2), and define the control units as the highhigh pairs of clusters, meaning that both the early year and late year clusters have high malaria prevalence (i.e. ${\text{\mathit{P}\mathit{f}PR}}_{210}$ > 0.4) and the absolute difference between their two values of ${\text{\mathit{P}\mathit{f}PR}}_{210}$ (one for the early year and one for the late year) is less than 0.1. The differenceindifferences approach (Card and Krueger, 2000; Angrist and Pischke, 2008; Dimick and Ryan, 2014; St. Clair and Cook, 2015) compares the changes in the low birth weight rate over time for treated units (i.e. highlow pairs of clusters) compared to control units (i.e. highhigh pairs of clusters) adjusted for observed covariates. The differenceindifferences approach removes bias from three potential sources (Volpp et al., 2007):
A difference between treated units and control units that is stable over time cannot be mistaken for an effect of reduced malaria burden because each treated or control unit is compared with itself before and after the time at which reduced malaria burden takes place in the treated units.
Changes over time in subSaharan Africa that affect all treated or control units similarly cannot be mistaken for an effect of reduced malaria burden because changes in low birth weight over time are compared between the treated units and control units.
Changes in the characteristics (i.e. observed covariates) of the populations (e.g. age of mother at birth) in treated or control units over time cannot be mistaken for an effect of reduced malaria burden as long as those characteristics are measured and adjusted for.
The traditional differenceindifferences approach requires a parallel trend assumption, which states that the path of the outcome (e.g. the low birth weight rate) for the treated unit is parallel to that for the control unit (Card and Krueger, 2000; Angrist and Pischke, 2008; Dimick and Ryan, 2014; St. Clair and Cook, 2015). One way the parallel trend assumption can be violated is if there are events in the late period whose effect on the outcome differs depending on the level of observed covariates and those observed covariates are unbalanced between the treated and control units across time (Shadish et al., 2002). For example, suppose that there are advances in prenatal care in the late year that tend to be available more in urban areas, then the parallel trends assumption could be violated if there are more treated units (i.e. highlow pairs of clusters) in urban areas than control units (i.e. highhigh pairs of clusters). To make the parallel trend assumption more likely to hold, instead of conducting a differenceindifferences study simply among all the treated and control units, we use a secondstep matching to pair treated units with control units on the observed covariates trajectories (from the early year to the late year) to make the treated units and control units similar in the observed covariates trajectories as they would be under randomization (Rosenbaum, 2002; Stuart, 2010), and discard those treated or control units that cannot be paired with similar observed covariates trajectories. For example, by matching on the urban/rural indicator trajectories between the treated and control units, we adjust for the potential source of bias resulting from the possibility that there may be advances in prenatal care in the late year that are available more in urban areas.
Another perspective on how our secondstep matching helps to improve a differenceindifferences study is through the survey location sampling variability (Fakhouri et al., 2020). Recall that when constructing representative samples, the DHS are sampled at different locations (i.e. clusters) across time (ICF, 2019; Boyle et al., 2019). Therefore, if we simply implemented a differenceindifferences approach over all the highlow and highhigh pairs of survey clusters and did not use matching to adjust for observed covariates, this survey location sampling variability may generate imbalances (i.e. different trajectories) of observed covariates across the treated and control groups, and therefore may bias the differenceindifferences estimator (Heckman et al., 1997). Imbalances of observed covariates caused by the survey location sampling variability may occur in the following three cases: (1) The survey location sampling variability is affecting the treated and control groups in the opposite direction. Specifically, there is some observed covariate for which the difference between the highlow pairs of sampled clusters tends to be larger (or smaller) than the country’s overall difference between the high malaria prevalence regions in the early years and the low malaria prevalence regions in the late years and conversely, the difference in that observed covariate between the highhigh pairs of sampled clusters tends to be smaller (or larger) than the country’s overall difference between the high malaria prevalence regions in the early years and the high malaria prevalence regions in the late years. (2) The survey location sampling variability is affecting the treated and control groups in the same direction but to different extents. (3) The survey location sampling variability only happened in the treated or control group. Specifically, there is some observed covariate for which the difference between the highlow (or highhigh) pairs of sampled clusters tends to differ from the country’s overall difference between the high malaria prevalence regions in the early years and the low (or high) malaria prevalence regions in the late years, but this is not the case for the highhigh (or highlow) pairs of sampled clusters. Using matching as a nonparametric data preprocessing step in a differenceindifferences study can remove this type of bias because the observed covariates trajectories are forced to be common among the matched treated and control groups (St. Clair and Cook, 2015; Basu and Small, 2020).
An additional important aspect of our approach is that we use multiple imputation to address missingness in the birth weight records. The fraction of missingness in birth weight in the IPUMSDHS data set is nonnegligible and previous studies have noted that failing to carefully and appropriately address the missing data issue with the birth weight records can significantly bias the estimates of the low birth weight rate derived from surveys in developing countries (Boerma et al., 1996; Robles and Goldman, 1999). We address the missing data issue by using multiple imputation with carefully selected covariates. Multiple imputation constructs several plausible imputed data sets and appropriately combines results obtained from each of them to obtain valid inferences under an assumption that the data is missing at random conditional on measured covariates (Rubin, 1987). Our workflow is summarized in Figure 1, in which we indicate both the data granularity (countrylevel, clusterlevel, and individuallevel) and the corresponding steps of our statistical methodology (including the data selection procedure described in the previous section and the Steps 1–4 of the statistical analysis listed below).
Step 1: Proximity prioritized in the matching of highhigh and highlow clusters
Request a detailed protocolThe DHS collects data from different clusters within the same country in different survey years. To construct pairs of early year and late year clusters which are geographically close such that each pair of clusters can mimic a single cluster measured twice in two different time periods to serve as the unit of a differenceindifferences study, we use optimal matching (Rosenbaum, 1989; Hansen and Klopfer, 2006) to pair clusters within the same country, one from the early year and one from the late year, based on the geographic proximity of their locations. Specifically, we minimize the total rankbased Mahalanobis distance based on the latitude and longitude of the cluster with a propensity score caliper to pair clusters so that the total distance between the paired early year cluster and late year cluster is as small as possible (Rosenbaum, 1989; Hansen and Klopfer, 2006). The number of clusters to pair for each country is set to be the minimum of the number of clusters in the early year and the number of clusters in the late year of that country.
Step 2: Matching on sociodemographic similarity is emphasized in second matching
Request a detailed protocolWe first divide malaria prevalence into three levels with respect to the estimated Plasmodium falciparum parasite rates ${\text{\mathit{P}\mathit{f}PR}}_{210}$ (ranging from 0 to 1): high (${\text{\mathit{P}\mathit{f}PR}}_{210}$ > 0.4), medium (${\text{\mathit{P}\mathit{f}PR}}_{210}$ lies in [0.2, 0.4]), and low (${\text{\mathit{P}\mathit{f}PR}}_{210}$ < 0.2). For clusters in the year 1999, we use the ${\text{\mathit{P}\mathit{f}PR}}_{210}$ in the nearest year in which it is available, that is, the year 2000. We select the pairs of the early year and late year clusters as formed in Step 1 described above that belong to either one of the following two categories: (1) Highhigh pairs: both of the estimated parasite rates of the early year and late year clusters within that pair are high (>0.4), and the absolute difference between the two rates is less than 0.1. (2) Highlow pairs: the estimated parasite rate of the early year cluster within that pair is high (>0.4), while the estimated parasite rate of the late year cluster within that pair is low (<0.2). A total of 950 out of 6812 pairs of clusters met one of these two criteria with 540 being highhigh pairs and 410 highlow pairs. We removed one highlow pair in which the late year cluster had an estimated parasite rate value (i.e. ${\text{\mathit{P}\mathit{f}PR}}_{210}$) of zero for every year between 2000 and 2015; this cluster was in a high altitude area with temperature unsuitable for malaria transmission and thus was not comparable in malaria transmission intensity to its paired early year cluster with high malaria transmission intensity. Since we would like to study the effect of reduced malaria burden on the low birth weight rate of infants, we consider highlow pairs of clusters as treated units and highhigh pairs of clusters as control units, and conduct a matched study by matching each highlow pair with a highhigh pair that is similar with respect to covariates that might be correlated with either the treatment (changes in malaria prevalence) or the outcome (low birth weight). We allow matches across different countries. The covariates we match on are cluster averages of the following individuallevel covariates, where we code the individuallevel covariates as quantitative variables with higher values suggesting higher sociodemographic status:
Household electricity: 0 – dwelling has no electricity; 1 – otherwise.
Household main material of floor: 1 – natural or earthbased; 2 – rudimentary; 3 – finished.
Household toilet facility: 0 – no facility; 1 – with toilet.
Urban or rural: 0 – rural; 1 – urban.
Mother’s education level: 0 – no education; 1 – primary; 2 – secondary or higher.
Indicator of whether the woman is currently using a modern method of contraception: 0 – no; 1 – yes.
The above six sociodemographic covariates were chosen by looking over the variables in the Demographic and Health Surveys (DHS) and choosing those which we thought met the following criteria: (1) The above six covariates are potentially strongly correlated with both the risk of malaria (Baragatti et al., 2009; Krefis et al., 2010; Ayele et al., 2013; Roberts and Matthews, 2016; Sulyok et al., 2017) and birth outcomes (Sahn and Stifel, 2003; Gemperli et al., 2004; Chen et al., 2009; Grace et al., 2015; Padhi et al., 2015), and therefore may be important confounding variables that need to be adjusted for via statistical matching (Rosenbaum and Silber, 2009; Rosenbaum, 2010; Stuart, 2010). (2) The records of the above six covariates are mostly available for all the countries and the survey years in our study samples. Specifically, for the above six covariates, the percentages of missing data (missingness can arise either because the question was not asked or the individual was asked the question but did not respond) among the total individual records from IPUMSDHS among the 6812 pairs of clusters remaining after Step 1 are all less than 0.3%.
For each cluster, we define the corresponding six clusterlevel covariates by taking the average value for each of the six covariates among the individual records from IPUMSDHS which are in that cluster, leaving out all missing data. This method of building up clusterlevel data from individuallevel records from DHS has been commonly used (Kennedy et al., 2011; Larsen et al., 2017). We form quadruples (pairs of pairs) by pairing one highlow pair of clusters (a ‘treated’ unit) with one highhigh pair of clusters (a ‘control’ unit), such that all the six clusterlevel observed covariates are balanced between both the early and late year clusters for the paired highlow and highhigh pairs. We use optimal cardinality matching to form these quadruples (Zubizarreta et al., 2014; Visconti and Zubizarreta, 2018). Optimal cardinality matching is a flexible matching algorithm which forms the largest number of pairs of treated and control units with the constraint that the absolute standardized differences (absolute value of difference in means in standard deviation units; see Rosenbaum, 2010) are less than a threshold; we use a threshold of 0.1, which is commonly used to classify a match as adequate (Neuman et al., 2014; Silber et al., 2016). After implementing the optimal cardinality matching, 219 matched quadruples (pairs of highlow and highhigh pairs of clusters) remain. See Figure 2 for illustration of the process of forming matched quadruples (pairs of pairs).
Step 3: Low birth weight indicator with multiple imputation to address missingness
Request a detailed protocolWe then conduct statistical analysis at the individual child level. Among all the 19,310 children’s records from the quadruples formed above, we exclude multiple births (i.e. twins, triplets etc), leaving 18,499 records. The outcome variable is the indicator of low birth weight, which is defined as child’s birth weight less than 2500 g. However, 48% of the birth weight records of children among these 18,499 records are missing. To handle this, we perform multiple imputation, under the assumption of missing at random (Heitjan and Basu, 1996), with 500 replications. An important predictor that is available for imputing the missing low birth weight indicator is the mother’s subjective reported size of the child. The mother’s reported size of the child is relatively complete in the IPUMSDHS data set and has been shown to be a powerful tool to handle the missing data problem with birth weight (Blanc and Wardlaw, 2005). We exclude the small number of records with missing mother’s subjective reported size of the child, leaving 18,112 records, 47% of which (8509 records) have missing low birth weight indicator. Among the 9603 records with observed birth weight, 825 (8.6%) had low birth weight. We first use the bayesglm function (part of the arm package in R) to fit a Bayesian logistic regression for the outcome of the low birth weight indicator among those children for whom low birth weight is not missing. To make it more plausible that the missing at random assumption holds, the following covariates are included as predictors in this regression because they might affect both missingness and the low birth weight rate:
The size of the child at birth reported subjectively by the mother: 1 – very small or smaller than average; 2 – average; 3 – larger than average or very large.
Mother’s age in years.
Child’s birth order number: 1 – the first child born to a mother; 2 – the second, third or fourth child born to a mother; 3 – otherwise.
Household wealth index: 1 – poorest; 2 – poorer; 3 – middle; 4 – richer; 5 – richest.
Urban or rural: 0 – rural; 1 – urban.
Mother’s education level: 0 – no education; 1 – primary; 2 – secondary or higher.
Child’s sex: 0 – female; 1 – male.
Mother’s current marital or union status: 0 – never married or formerly in union; 1 – married or living together.
Indicator of whether the child’s mother received any antenatal care while the child was in utero: 0 – no or missing; 1 – yes.
We also include quadratic terms for mother’s age in years and child’s birth order in the regression since according to Selvin and Janerich, 1971, the influences of mother’s age and child’s birth order on the birth weight do not follow a linear pattern. Note that among the remaining 18,112 records, there are no missing data for all of the above covariates. The prior distributions for the regression coefficients follow the default priors of the bayesglm function, that is, independent Cauchy distributions with center 0 and scale set to 10 for the regression intercept term, 2.5 for binary predictors, and 2.5/(2 $\times \text{sd}$) for other numerical predictors, where sd is the standard deviation of the predictor in the data used for fitting the regression (i.e. the 9603 records with observed birth weight). This default weakly informative prior has been shown to outperform Gaussian and Laplacian priors in a wide variety of settings (Gelman et al., 2008). After fitting this Bayesian logistic regression model, we get the posterior distribution of the regression coefficient associated with each predictor; see Table 2. From Table 2, we can see that in the imputation model, mother’s age, child’s birth order, mother’s education level, and the mother’s reported birth size are significant predictors, which agrees with the previous literature (e.g. Fraser et al., 1995; Strobino et al., 1995; Richards et al., 2001; Valero De Bernabé et al., 2004).
We then conduct the following procedure in each run of multiple imputation. For each individual with missing birth weight, we first draw from the posterior distribution of the regression coefficients in Table 2, we then use these regression coefficients and the individual’s covariates (as predictors) to find the probability of the individual having low birth weight and then we use this probability to randomly draw a low birth weight indicator for the individual. We conduct this procedure 500 times, getting 500 independent data sets with imputed low birth weight indicators.
Step 4: Estimation of causal effect of reduced malaria burden on the low birth weight rate
Request a detailed protocolFor each of the 500 imputed data sets, we then fit a mixedeffects linear probability model (using the lmer function in the R package lme4) where there is a random effect (random intercept) for each cluster to account for the potential correlations between the outcomes among the individual records within the same cluster (Gałecki and Burzykowski, 2013). We include in the model the covariates which might be related to both whether an individual is in a highlow vs. highhigh pair of clusters and the low birth weight rate. Specifically we include the predictors from the Bayesian logistic regression for multiple imputation as covariate regressors in the mixedeffects linear probability model (listed in Table 2), except for the mother’s reported birth size. We do not include reported birth size because it is not a pretreatment variable and is a proxy for the outcome (Rosenbaum, 1984). In addition to the above covariates, we include in the model the following three indicators: (1) Low malaria prevalence indicator: indicates whether the individual is from a cluster with a low malaria prevalence (${\text{\mathit{P}\mathit{f}PR}}_{210}$ < 0.2). (2) Time indicator: 0 – if the individual is from a early year cluster; 1 – if the individual is from a late year cluster. (3) Group indicator: 0 – if the individual is from a cluster in a highhigh pair of clusters; 1 – if the individual is from a cluster in a highlow pair of clusters. Through adjusting for the time varying covariates via matching and including the above three indicators in the regression, our study uses a differenceindifferences approach for a matched observational study (Wing et al., 2018). Note that even though we do not explicitly incorporate matching into the final model (i.e. the mixedeffects linear probability model [1]), matching still reduces the bias due to potential statistical model misspecification in our analysis by being a nonparametric data preprocessing step which makes the distributions of the observed covariates of the selected treated and control units identical or similar, lessening the dependence of the results on the model used to adjust for the observed covariates (Hansen, 2004; Ho et al., 2007). Let $\mathrm{\U0001d7d9}(A)$ be the indicator function of event $A$ such that $\mathrm{\U0001d7d9}(A)=1$ if $A$ is true and $\mathrm{\U0001d7d9}(A)=0$ otherwise. To conclude, we consider the following mixedeffects linear probability model for the individual $j$ in cluster $i$:
In Model (1), ${Y}_{ij}$ is the observed outcome (i.e. the low birth weight indicator) and ${\mathbf{\mathbf{X}}}_{ij}$ the covariate regressors (including the quadratic terms of mother’s age and child’s birth order) of the individual $j$ in cluster $i$, and ${\alpha}_{i}$ is the random effect for cluster $i$. See Table 3 for an interpretation of the coefficients of the three indicators and the intercept term (i.e. the ${k}_{0},{k}_{1},{k}_{2},{k}_{3}$) within each matched quadruple. The estimated causal effect of reduced malaria burden (low vs. high malaria prevalence) on the low birth weight rate is the mean value of the 500 estimated coefficients on the low malaria prevalence indicator obtained (i.e. the k_{1}) from 500 runs of the mixedeffects linear regression described above. See Appendix 2 for more details on the statistical inference procedure with multiple imputation, which are also referred to as Rubin’s rules (Carpenter and Kenward, 2012).
It is worth clarifying that although we take a Bayesian approach when imputing (i.e. predicting) the missing low birth weight indicators in Step 3 (i.e. imputation model) and then take a frequentist approach when conducting the 500 separate outcome analyses with the 500 imputed data sets in Step 4 (i.e. substantive model), these two different statistical perspectives (i.e. Bayesian and frequentist) do not conflict with each other when we apply Rubin’s rules to combine these 500 separate outcome analyses as the single estimator and inference reported in Table 6. This is because the frequentist validity of applying Rubin’s rules to combine separate outcome analyses with multiple imputed data sets only explicitly depends on the asymptotic normal approximation assumption for each coefficient estimator in Model (1) (see Appendix 2 for more details), and does not directly depend on how the multiple imputed data sets are generated (e.g. either using a Bayesian imputation model as in Step 3 or using a frequentist imputation model instead). Using a Bayesian imputation model followed by a frequentist substantive model is one of the most common strategies when applying Rubin’s rules to conduct statistical inference with multiple imputation; see Rubin, 1996, Chapter 3 of Rubin, 1987, and Chapter 2 of Carpenter and Kenward, 2012. For representative works on justifying the advantages of using a Bayesian imputation model in multipleimputation inferences, see Meng, 1994 and Chapter 2 of Carpenter and Kenward, 2012.
Secondary analyses
Request a detailed protocolWe also conducted the following four secondary analyses (SA1) – (SA4) which examine the causal hypothesis that reduced malaria transmission intensity cause reductions in the low birth weight rate in various ways.
(SA1) In the first secondary analysis, we fit the mixedeffects linear probability model with multiple imputation only on the children whose age at the corresponding survey is no older than one year old (7156 out of 18,112 records) to mitigate the potential bias resulting from the births that did not occur in exactly the same year as the year of the corresponding malaria prevalence measurement.
(SA2) In the second secondary analysis, we fit the mixedeffects linear probability model with multiple imputation over first born children only (3890 out of 18,112 records) to check if the potential effect of reduced malaria burden on the low birth weight rate is especially substantial/weak for first born children or not.
(SA3) In the third secondary analysis, we make the difference between high malaria prevalence and low prevalence more extreme. Specifically, we redefine the malaria prevalence levels (ranging from 0 to 1) as: high (${\text{\mathit{P}\mathit{f}PR}}_{210}$ > 0.45), medium (${\text{\mathit{P}\mathit{f}PR}}_{210}$ lies in [0.15, 0.45]), and low (${\text{\mathit{P}\mathit{f}PR}}_{210}$ < 0.15). We then conduct the same statistical analysis procedure as in the primary analysis to check if a moderately greater reduction in malaria burden would lead to more of a decrease in the low birth weight rate or not.
(SA4) In the fourth secondary analysis, we conduct the same procedure as in (SA3), but making the highmediumlow malaria prevalence cutoffs even more extreme: high (${\text{\mathit{P}\mathit{f}PR}}_{210}$ > 0.5), medium (${\text{\mathit{P}\mathit{f}PR}}_{210}$ lies in [0.1, 0.5]), and low (${\text{\mathit{P}\mathit{f}PR}}_{210}$ < 0.1) to check if a substantially more dramatic reduction in malaria burden would cause a more dramatic decrease in the low birth weight rate or not.
Sensitivity analyses
Request a detailed protocolAs discussed in the ‘Motivation and overview of our approach’ section, using matching as a data preprocessing step in a differenceindifferences study can reduce the potential bias that may result from a violation of the parallel trend assumption arising from failing to adjust for observed covariates and the survey location sampling variability when using the survey data to conduct a differenceindifferences study. However, neither matching nor differenceindifferences can directly adjust for unobserved covariates (i.e. unmeasured confounders or events). The estimated treatment effect (i.e. the estimated coefficient of the low malaria prevalence indicator contributing to the low birth weight rate) from our primary analysis can be biased by failing to adjust for any potential unobserved covariates. How potential unobserved covariates may bias the estimated effect in a differenceindifferences study has been understood from various alternative perspectives in the previous literature. These alternative perspectives are intrinsically connected and we briefly list three of them here (for more detailed descriptions, see Appendix 3):
Perspective 1: The potential violation of the unconfoundedness assumption (Rosenbaum and Rubin, 1983b; Heckman and Robb, 1985; Heckman et al., 1997).
Perspective 2: The potential violation of the parallel trend assumption in a differenceindifferences study (Card and Krueger, 2000; Angrist and Pischke, 2008; Hasegawa et al., 2019; Basu and Small, 2020).
Perspective 3: The differenceindifferences estimator may be biased if there is an event that is more (or less) likely to occur as the intervention happens and the occurrence probability of this event cannot be fully captured by observed covariates (Shadish, 2010; West and Thoemmes, 2010).
To assess the robustness of the results of our primary analysis to potential hidden bias, we adapt an omitted variable sensitivity analysis approach (Rosenbaum and Rubin, 1983a; Imbens, 2003; Ichino et al., 2008; Zhang and Small, 2020). Specifically, our sensitivity analysis model (i.e. Model (3) in Appendix 3) extends Model (1) by including a hypothetical unobserved covariate $U$ that is correlated with both the low malaria prevalence indicator and the low birth weight indicator. Specifically, let ${U}_{ij}$ denote the value of $U$ of individual $j$ in cluster $i$, we consider the following data generating process for ${U}_{ij}$:
where $p}_{1$ and $p}_{2$ are prespecified sensitivity parameters of which the unit is a percentage point. Our sensitivity analyses investigate how the estimated treatment effect varies over a range of prespecified values for $({p}_{1},{p}_{2})$. See Appendix 3 for the details of the design of the sensitivity analyses and on how our proposed sensitivity analysis model helps to address the concerns about the hidden bias from Perspectives 1–3 listed above.
Results
In this section, we report and interpret the results of matching, primary analysis, secondary analyses, and sensitivity analyses relating changes in malaria burden to changes in the birth weight rate between 2000–2015 in subSaharan Africa. The R (R Development Core Team, 2020) code for producing all the main results and tables of this article is posted on GitHub (https://github.com/siyuheng/MalariaandLowBirthWeight, Heng, 2021a, copy archived at swh:1:rev:faf6455f95bca6bab364ab95699ea7cd81af1061 Heng, 2021b).
Matching
We first evaluate the performance of the firststep matching where we focus on the geographical closeness of paired early year and late year clusters from the following three perspectives: (1) the geographic proximity of the early year and the late year clusters within each pair, which is evaluated through the mean distance of two paired clusters, the withinpair longitude’s correlation and latitude’s correlation between the paired early year and late year clusters, and the mean values of the longitudes and the latitudes of the paired early year and late year clusters; (2) the closeness of the mean annual malaria prevalence (${\text{\mathit{P}\mathit{f}PR}}_{210}$) of the early year and late year clusters at the early year (i.e. the early malaria prevalence year in Table 1); (3) the closeness of the mean annual malaria prevalence of the early year and the late year clusters at the late year (i.e. the late malaria prevalence year in Table 1). We report the results in Table 4, which indicate that the first step of our matching produced pairs of clusters which are close geographically and in their malaria prevalence at a given time. Of note, the mean Haversine distance of the early year clusters and late year clusters is 24.1 km among the 219 highlow pairs of clusters, and 28.7 km among the 219 highhigh pairs of clusters. The withinpair longitudes’ and latitudes’ correlations between the paired early year and late year clusters among the highlow and highhigh pairs are all nearly one.
We then evaluate the performance of the secondstep matching, where we focus on the closeness of the sociodemographic status of paired highlow and highhigh pairs of clusters, by examining the balance of each covariate among highlow and highhigh pairs of early year and late year clusters before and after matching. Recall that for each cluster, we calculate the six clusterlevel covariates (i.e. urban or rural, toilet facility, floor facility, electricity, mother’s education level, contraception indicator) by averaging over all available individuallevel records in that cluster. In each highlow or highhigh pair of clusters, there are 12 associated covariates, six for the early year cluster in that pair and six for the late year cluster in that pair. Table 5 reports the mean of each covariate among highlow pairs of clusters and highhigh pairs of clusters before and after matching, along with the absolute standardized differences before and after matching. From Table 5, we can see that before matching, the highhigh pairs are quite different from the highlow pairs, all absolute standardized differences are greater than 0.2. The highlow pairs tend to be sociodemographically better off than the highhigh pairs (higher prevalence of improved toilet facilities and floor material facilities, higher prevalence of domestic electricity, higher levels of mother’s education, higher rate of contraceptive use, and more urban households). To reduce the bias from these observed covariates, we leverage optimal cardinality matching, as described above, to pair a highlow pair of clusters with a highhigh pair and throw away the pairs of clusters for which the associated covariates cannot be balanced well. After matching, we can see that all 12 covariates are balanced well – all absolute standardized differences after matching are less than 0.1.
Effect of reduced malaria burden on the low birth weight rate
Appendix 1—table 3 summarizes the low malaria prevalence indicators, the time indicators, the group indicators, the covariates, and the birth weights of the 18,112 births in the matched clusters. Table 6 reports the estimated causal effect of reduced malaria burden (low vs. high malaria prevalence) on the rate of births with low birth weight, which is represented as the coefficient on the malaria prevalence indicator (diagnostics for the multiple imputation that was used in generating the estimates in Table 6 are shown in Appendix 2—table 1). We estimate that a decline in malaria prevalence from ${\text{\mathit{P}\mathit{f}PR}}_{210}$ > 0.40 to less than 0.20 reduces the rate of low birth weight by 1.48 percentage points (95% confidence interval: 3.70 percentage points reduction, 0.74 percentage points increase). A reduction in the low birth weight rate of 1.48 percentage points is substantial; recall that among the study individuals with nonmissing birth weight, the low birth weight rate was 8.6%, so a 1.48 percentage points reduction corresponds to a 17% reduction in the low birth weight rate. The results in Table 6 also show that there is strong evidence that mother’s age, child’s birth order, mother’s education level and child’s sex are also associated with the low birth weight rate. For example, mothers with higher education level are less likely to deliver a child with low birth weight, and boys are less likely to have low birth weight than girls, which agrees with the previous literature (e.g. Brooke et al., 1989; Valero De Bernabé et al., 2004; Zeka et al., 2008). Our estimated reduction in the low birth weight rate of 1.48 percentage points from reducing malaria prevalence from high to low is similar to that from a naive differenceindifferences estimator that ignores covariates and missingness of birth weight records. The observed low birth weight rates among the records with observed birth weight within the early year clusters in highlow pairs is 9.33%, in the late year clusters in highlow pairs is 7.52%, in the early year clusters in highhigh pairs is 9.18%, and in the late year clusters in highhigh pairs is 9.06%. Therefore, the naive differenceindifferences estimator for the effect of reduced malaria burden without adjusting for covariates and missingness of birth weight records is (7.52% $$ 9.33%) $$ (9.06% $$ 9.18%) = $$ 1.69% (i.e. 1.69 percentage points reduction on the low birth weight rate).
Among all the highlow pairs of clusters in our sample, there has been a decrease in the low birth weight rate from the early years to the late years of 1.81 percentage points (from 9.33% to 7.52%) for records with observed birth weight and an estimated decrease of 2.04 percentage points (from 10.48% to 8.44%) when multiple imputation is used to impute missing birth weight records. We now explore how much of this decrease can be attributed to reduced malaria burden over time. The estimated effect in Table 6 of the time indicator (late year vs. early year) is a 0.06 percentage points reduction, which is much less than that of the low malaria prevalence indicator. Moreover, the estimated change in the low birth weight rate over time among highlow pairs that comes from changes in the covariates over time is a 0.52 percentage points reduction. This is calculated by looking at the difference between ${\widehat{\beta}}^{T}{\overline{\mathbf{\mathbf{x}}}}_{\text{early}}$ and ${\widehat{\beta}}^{T}{\overline{\mathbf{\mathbf{x}}}}_{\text{late}}$, where ${\widehat{\beta}}^{T}$ is the estimated coefficients of the covariate regressors listed in Table 6, and ${\overline{\mathbf{\mathbf{x}}}}_{\text{early}}$ and ${\overline{\mathbf{\mathbf{x}}}}_{\text{late}}$ are the average values in highlow pairs of the covariate regressors of the individuals within the early year clusters and those within the late year clusters respectively. These results suggest that after adjusting for the observed covariates listed in Table 6 and missingness of birth weight records, the observed decrease in the low birth weight rate over time in highlow pairs comes mainly from reduced malaria burden over time instead of changes over time in the low birth weight rate that affect both highlow and highhigh pairs of clusters. To illustrate this point and further verify the potentially substantial effect of reduced malaria burden on the low birth weight rate, we also plot the estimated low birth weight rate of each cluster among the highhigh pairs and highlow pairs in our study sample in Figure 3. From Figure 3, we can see that although in general, for both highhigh pairs and highlow pairs, the birth weight rates of the late year clusters are lower than those of the early year clusters, it is clear that the reductions in low birth weight rate from early year to late year among the highlow pairs are considerably greater than those among highhigh pairs, suggesting that reducing communitylevel malaria burden can potentially substantially reduce the low birth weight rate.
Results of secondary analyses
The results of our secondary analyses support the interpretation of our primary analysis:
(SA1) In the first secondary analysis, when only conducting statistical analysis among children whose age at the survey year is no older than 1 year, the point estimate of the coefficient of the low malaria prevalence indicator (1 if ${\text{\mathit{P}\mathit{f}PR}}_{210}$ < 0.2) is −1.31 percentage points (95% CI: [−4.70, 2.08]), which in general agrees with the result of our primary analysis and implies that our causal conclusion drawn from the primary analysis is relatively robust to the potential hidden bias caused by the births that occurred in different years from the years of the malaria prevalence measurement.
(SA2) In the second secondary analysis, performing our statistical analysis among first born children only, the estimated coefficient of the low malaria prevalence indicator is −3.73 percentage points (95% CI: [−9.11, 1.64]). This implies that the effect of reduced malaria burden on the low birth weight rate may be especially substantial among first born children.
(SA3) In the third secondary analysis, after slightly enlarging the difference between high malaria prevalence and low prevalence and repeating the twostage matching procedure described above, there remain 100 highhigh pairs of clusters and 100 highlow pairs, with 8611 individual records remaining in the final model. In (SA3), the point estimate of the coefficient of low malaria prevalence indicator is −1.48 percentage points (95% CI: [−4.44, 1.48]). In this case, slightly enlarging the gap between the cutoffs for high/low malaria prevalence did not result in an obvious additional reduction in the low birth weight rate. A possible reason is that the new cutoffs are just slightly different from the previous ones and the changes may still lie within the margin of error of measuring the ${\text{\mathit{P}\mathit{f}PR}}_{210}$ or there may not be enough power. In thinking about the results of (SA3), it is useful to also consider the results from (SA4).
(SA4) In the fourth secondary analysis, after making the high prevalence and low prevalence cutoffs quite extreme and repeating the twostage matching procedure, there remain 35 highhigh pairs of clusters and 35 highlow pairs, with 3135 individual records remaining in the final model. In (SA4), the point estimate of the coefficient of low malaria prevalence indicator is −3.04 percentage points (95% CI: [−8.50, 2.41]). This implies that a more dramatic reduction in malaria burden can potentially lead to a more dramatic decrease in the low birth weight rate and supports the above hypothesis that the fact that slightly enlarging the gap between the high/low malaria prevalence cutoffs in (SA3) did not result in an evident additional reduction in the low birth weight rate may be due to the potential measurement error of the ${\text{\mathit{P}\mathit{f}PR}}_{210}$ or lack of power.
Results of the sensitivity analyses
Recall that in the ‘Sensitivity analyses’ section and Appendix 3, our sensitivity analyses consider a hypothetical unobserved covariate $U$ that is correlated with both the low malaria prevalence indicator and the low birth weight indicator. For various values of the sensitivity parameters $({p}_{1},{p}_{2})$, we report the corresponding point estimates and 95% CIs of the estimated treatment effect (i.e. the coefficient of the low malaria prevalence indicator contributing to the low birth weight rate) in Appendix 3—table 1. The results from Appendix 3—table 1 show that the estimated treatment effect ranges from 1.13 percentage points reduction to 1.83 percentage points reduction (on the low birth weight rate) if both $p}_{1$ and $p}_{2$ are between −10 and 10. Recall that $p}_{1$ (or $p}_{2$) equals 10 (or −10) means that the probability of the $U$ taking value one increases (or decreases) by 10 percentage points if the individual’s low malaria prevalence indicator (or the low birth weight rate indicator) equals 1. That is, allowing both the magnitude of $p}_{1$ and the magnitude of $p}_{2$ can be up to 10 means that we allow the existence of a nontrivial magnitude of unmeasured confounding in our sensitivity analyses. Therefore, the estimated treatment effect ranging from 1.13 percentage points reduction to 1.83 percentage points reduction when both $p}_{1$ and $p}_{2$ are between −10 and 10 means that the magnitude of the estimated treatment effect is still evident (no less than 1.13 percentage points) even if the magnitude of unmeasured confounding is nontrivial (both ${p}_{1}$ and ${p}_{2}$ can be up to 10). See Appendix 3 for the detailed results and interpretations of the sensitivity analyses.
To conclude, although the confidence intervals of the coefficient of the low malaria prevalence indicator on the low birth weight rate presented in the ‘Results’ section cannot exclude a possibility of no effect at level 95% based on our proposed study sample selection procedure and statistical approach, the results and the corresponding interpretations of the primary analysis, the secondary analyses, and the sensitivity analyses have contributed to the weight of the evidence that reduced malaria burden has an important influence on the low birth weight rate in subSaharan Africa at the community level.
Discussion
We have developed a pairofpairs matching approach to conduct a differenceindifferences study to examine the causal effect of a reduction in malaria prevalence on the low birth weight rate in subSaharan Africa during the years 2000–2015. Although we cannot rule out no effect at a 95% confidence level, the magnitude of the estimated effect of a reduction from high malaria prevalence to low malaria prevalence on the low birth weight rate (1.48 percentage points) is even greater than the estimated effect of a factor thought to be important, antenatal care during pregnancy (0.96 percentage points). In a secondary analysis, we find that reduction in malaria burden from high to low is estimated to be especially crucial for reducing the low birth weight rate of first born children, reducing it by 3.73 percentage points (95% CI: 9.11 percentage points reduction, 1.64 percentage points increase). This agrees with previous studies which demonstrate that the effects of malaria on birth outcomes are most pronounced in the first pregnancy (e.g. McGregor et al., 1983).
Previous studies have shown that individual malaria prevention during pregnancy reduces the chances of the woman’s baby having low birth weight (Kayentao et al., 2013). In this paper, we examine the communitylevel effect of reductions in malaria on pregnancy outcomes as opposed to the individuallevel effect of malaria prevention interventions during pregnancy. Our results support extrapolation of studies of antenatal malaria interventions on birth weight to populations experiencing declining malaria burden. Furthermore, we conclude that reports of declining malaria mortality underestimate the contribution of reduced malaria exposure during pregnancy on pregnancy outcomes and neonatal survival. Although some studies have documented higher rates of adverse pregnancy outcomes in malariainfected women with declining antimalarial immunity, such as may be seen in communities with declining malaria exposure (Mayor et al., 2015), our study demonstrates that overall reduction in exposure to infection, including during pregnancy, outweighs these individual changes in risk once infected.
Strengths of our study include that we use stateoftheart causal inference methods on a large representative data set. We develop a novel pairofpairs matching approach to conduct a differenceindifferences study to estimate the real world effectiveness of public health interventions by combining DHS data with other data sources. There are two major difficulties when using the DHS data to conduct a differenceindifferences study. The first major difficulty is that within each country the DHS samples different locations (clusters) over different survey years. Our firststep matching handles this difficulty through using optimal matching to pair the early year DHS clusters and the late year DHS clusters within the same country based on the geographic proximity of their locations. Then each formed pair of clusters can mimic a single cluster measured twice in two different survey years, which serves as the foundation of a differenceindifferences study. The second major difficulty is that although an advantage of the DHS data is that they contain many potentially important clusterlevel and individuallevel covariates, it may be difficult to come up with a statistical model that is both efficient and robust to adjust for these covariates. A traditional approach to estimating the real world effectiveness of an intervention in such settings is to run a regression of an outcome of interest on a measure of adherence to the treatment (zero if in the period before the intervention was available and ranging from 0 to 1 after the intervention was available), covariates (individuallevel and clusterlevel covariates) and a random effect for the cluster (Goetgeluk and Vansteelandt, 2008). This regression approach relies heavily on correct specification of the model by which the covariates affect the outcome (e.g. linear, quadratic, cubic), therefore the result can be severely biased by model misspecification (Rubin, 1973; Hansen, 2004; Ho et al., 2007). We instead use a secondstep matching to first optimally select and match the treated units (i.e. highlow pairs of clusters) and control units (i.e. highhigh pairs of clusters) to ensure that they have balanced distributions of covariates across time and then run the regression with the dummy variables for the matched sets. Such a nonparametric data preprocessing step before running a regression can potentially reduce bias due to model misspecification (Rubin, 1973; Hansen, 2004; Ho et al., 2007).
Our merged study data set makes use of two aspects of the richness of the relevant data resources. First, from the perspective of sample size and length of time span, the data set includes over 18,000 births in 19 countries in subSaharan Africa and describes changes in the low birth weight rate over a 15year period. Some of the studied regions had substantial changes in malaria parasite prevalence during this time period, whereas others did not, which provides us ample heterogeneity necessary for conducting a differenceindifferences study. Second, from the perspective of the comprehensiveness of information, our merged data set includes various types of information: from clusterlevel to individuallevel records; from geographic to sociodemographic characteristics; from surveyed data to predicted data.
Some potential limitations of our study should be considered. First, we discretized the mean malaria prevalence (i.e. ${\text{\mathit{P}\mathit{f}PR}}_{210}$ from 0 to 1) into high (${\text{\mathit{P}\mathit{f}PR}}_{210}$ > 0.4), medium (${\text{\mathit{P}\mathit{f}PR}}_{210}$ lies in [0.2, 0.4]), and low (${\text{\mathit{P}\mathit{f}PR}}_{210}$ < 0.2), which means that the magnitude of the estimated causal effect depends on how we define these cutoffs. Our primary analysis suggests that reducing the malaria burden from high to low may substantially help control the low birth weight rate, and our secondary analyses suggest that a more dramatic reduction in malaria prevalence can lead to a more dramatic drop in the low birth weight rate. More research needs to be done on the minimum magnitude of the reduction in malaria prevalence that is needed to cause a substantial drop in the low birth weight rate. Second, we assigned the malaria prevalence (i.e. ${\text{\mathit{P}\mathit{f}PR}}_{210}$) data to children’s records based on the DHS survey years which may not be exactly the same years as children’s actual birth years. For example, a child whose age is three years at the corresponding DHS survey year should have been born three years earlier before that DHS survey year, in which case we might have assigned the wrong ${\text{\mathit{P}\mathit{f}PR}}_{210}$ to that child’s gestational period. We examined this issue via SA1 and the result suggested that this did not induce much bias to the results of our primary analysis.
The novel designbased causal inference approach developed in this work, a pairofpairs matching approach to conduct a differenceindifferences study (i.e. the twostep matching procedure to form matched pairs of pairs as a nonparametric data preprocessing step in a differenceindifferences study), is potentially useful for researchers who would like to reduce the estimation bias due to potential model misspecification in the traditional differenceindifferences approach. Moreover, the general statistical methodology developed in this work can be applied beyond the malaria settings to handle the heterogeneity of survey time points and locations in data sets such as the Demographic and Health Surveys (DHS).
In summary, the contribution of malaria to stillbirth and neonatal mortality, for which low birth weight is a proxy, are currently not accounted for in global estimates of malaria mortality. Using a large representative data set and innovative statistical evidence, we found point estimates that suggested that reductions in malaria burden at the community level substantially reduce the low birth weight rate. To our knowledge, this is the first study of its kind to evaluate the causal effects of malaria control on birth outcomes using a causal inference framework. Although our confidence intervals do include a possibility of no effect, the evidence from our primary analysis and secondary analyses is strong enough to merit further study and motivate further investments in mitigating the intolerable burden of malaria.
Appendix 1
More details on the data selection procedure
We give more details on how we select the study countries (among all subSaharan African countries) and their corresponding late year and early year for each of the three data sets: malaria prevalence data (MAP data), IPUMSDHS data, and DHS cluster GPS data. We define ‘early year’ as 2000–2007 and ‘late year’ as 2008–2015. We first select countries that have both IPUMSDHS data and DHS GPS data for at least one year between 2000–2007 and one year between 2008–2015. If there are more than one early (late) years available, we choose the earliest early year and latest late year. Note that some DHS can span over two years. In this case, we stick to the way how IPUMSDHS codes the year of that DHS data set. For example, both Malawi and Tanzania have a standard DHS with GPS data that spans over 2015–2016. We call them Malawi 2015–2016 DHS and Tanzania 2015–2016 DHS respectively. In IPUMSDHS, the year for Malawi 2015–2016 DHS is coded as 2016, and that for Tanzania 2015–2016 DHS is coded as 2015. Therefore, for Malawi, we use Malawi 2010 DHS as the study sample for the late year and exclude Malawi 2015–2016 DHS. While for Tanzania, we use Tanzania 2015 DHS for the late year. As we have mentioned in the main text, if a country has at least one year between 2008–2015 with available IPUMSDHS data of which the GPS data is also available, but no available IPUMSDHS data or the corresponding GPS data between 2000–2007, we still include that country if it has IPUMSDHS data along with the corresponding GPS data for the year 1999 (possibly with overlap into 1998). This selection procedure results in 19 study countries in total. Note that for the DHS that span over two successive years, sometimes IPUMSDHS and the GPS data code their years in different ways. In these cases, when attaching the malaria prevalence data to each cluster, we stick to the year which is used by the GPS data; see Appendix 1—table 1. For example, for Benin 2011–2012 DHS, IPUMSDHS codes its year as 2011 while the GPS data codes its year as 2012. In these cases, we use the malaria prevalence data for 2012 for the clusters within Benin 2011–2012; see the row ‘Benin (BJ)’ in Appendix 1—table 1.
Country summary
Some remarks on the IPUMSDHS data used in this article
There are different units of analysis for data browsing in IPUMSDHS (Boyle et al., 2019). In ‘Step 2: Matching on sociodemographic similarity is emphasized in second matching,’ for the covariates ‘Household electricity,’ ‘Household main material of floor,’ and ‘Household toilet facility,’ the IPUMSDHS data we used is at the household members level (each record is a household member). For the covariates ‘Mother’s education level’ and ‘Indicator of whether the woman is currently using a modern method of contraception,’ the IPUMSDHS data we used is at the birth level (each record is a birth reported by a woman of childbearing age). The covariate ‘Urban or rural’ obtained from the DHS GPS data is at the DHS clusters level. In ‘Step 3: Low birth weight indicator with multiple imputation to address missingness’ and ‘Step 4: Estimation of causal effect of reduced malaria burden on the low birth weight rate,’ the IPUMSDHS data we used is at the child level (each record is a child under age 5).
More details on the final study population
Appendix 2
Statistical inference with multiple imputation applying Rubin’s rules
We apply Rubin’s rules (Rubin, 1987; Schafer, 1999; Carpenter and Kenward, 2012) to combine all the imputed data sets to obtain the point estimate, the pvalue, and the 95% confidence interval for each coefficient in the mixedeffects linear probability model (1) summarized in Table 6 of the main text. Suppose that there are $M$ imputed data sets ($M=500$ in our study). Suppose that for the $m$th imputed data set, $m=1,\mathrm{\dots},500$, the estimate for the coefficient of the $i$th regressor ${\gamma}_{i}$ (including the intercept term), $i=1,\mathrm{\dots},14$, is ${\widehat{\gamma}}_{m,i}$, and let ${V}_{i}$ be its squared standard error and ${\widehat{V}}_{m,i}$ be the estimated squared standard error from the $m$th imputed data set. Suppose that the following normal approximations hold
According to Rubin’s rules (Rubin, 1987; Schafer, 1999; Carpenter and Kenward, 2012), we estimate ${\gamma}_{i}$ with ${\overline{\gamma}}_{i}={M}^{1}{\sum}_{m=1}^{M}{\widehat{\gamma}}_{m,i}$. Consider the corresponding betweenimputation variance ${B}_{i}={(M1)}^{1}{\sum}_{m=1}^{M}{({\widehat{\gamma}}_{m,i}{\overline{\gamma}}_{i})}^{2}$ and the withinimputation variance ${\overline{V}}_{i}={M}^{1}{\sum}_{m=1}^{M}{\widehat{V}}_{m,i}$. Then the estimated total variance is
Then we can get the corresponding twosided pvalues and 95% confidence intervals based on a Student’s $t$approximation
$({\overline{\gamma}}_{i}{\gamma}_{i})/\sqrt{{T}_{i}}\sim {t}_{{v}_{i}},\phantom{\rule{1em}{0ex}}i=1,\dots ,14,$ with degrees of freedom ${v}_{i}=(m1){\left[1+\frac{{\overline{V}}_{i}}{(1+{M}^{1}){B}_{i}}\right]}^{2}.$
Multiple imputation diagnostics
Note that in our multiple imputation procedure, the variance ratios are all less than 0.5, indicating that for each regressor the variance due to missing data (betweenimputation variance) is much less than the average estimated squared standard error over the 500 imputed data sets. More replications of imputation (larger $M$) will more sufficiently reduce the variation due to missingness and therefore lead to more reliable estimation (Rubin, 1987; Schafer, 1999). We take a sufficiently large number of replications $M=500$ to ensure that the variance due to missingness has been sufficiently controlled.
Appendix 3
Design of the sensitivity analyses
In Section ‘Sensitivity analyses’ of the main text, we very briefly described three perspectives on how potential unobserved covariates that cannot be adjusted by matching may bias the estimated effect in a differenceindifferences study. Here we give more detailed descriptions of them with connections to our study for reference:
Perspective 1: The potential violation of the unconfoundedness assumption (Rosenbaum and Rubin, 1983b; Heckman and Robb, 1985). Roughly speaking, the unconfoundedness assumption states that, after adjusting for observed covariates (measured confounders), there are no differential trends over time of any characteristics, other than the intervention itself, between the treated group and the control group, that may be correlated with their outcomes. This assumption may be violated if there is selection bias on unobserved covariates across time (Heckman and Robb, 1985; Heckman et al., 1997) such that there are differences in these observed covariates of the treated group and the control group which impact their trends in the outcome (Ashenfelter and Card, 1985; Doyle et al., 2018). For example, in our study, the unconfoundedness assumption can be violated if the sharp drops in malaria prevalence experienced by some areas could be explained by the changes of some unobserved characteristics over time that could also predict the low birth weight rate.
Perspective 2: The potential violation of the parallel trend assumption in a differenceindifferences study (Card and Krueger, 2000; Angrist and Pischke, 2008; Hasegawa et al., 2019; Basu and Small, 2020). Recall that the parallel trend assumption behind a differenceindifferences study states that, in the absence of the treatment (i.e. intervention), after adjusting for relevant covariates, the outcome trajectory of the treated group would follow a parallel trend with that of the control group. Therefore, to make the parallel trend assumption more likely to hold, ideally each observed or unobserved covariate should be well balanced (i.e. follow a common trajectory) between the treated group and the control group, before and after the intervention. Matching can balance observed covariates by ensuring each covariate follows a common trajectory in the treated and control groups. However, matching cannot directly adjust for unobserved covariates and their trajectories among the treated and control groups may differ and correspondingly the parallel trend assumption may not hold.
Perspective 3: A differenceindifferences study may be biased if there is an event that is more (or less) likely to occur as the treatment (i.e. intervention) happens in the treated group, but, unlike the case discussed in Section ‘Motivation and overview of our approach’ of the main text, the occurrence probability of this event cannot be fully captured by observed covariates. In this case, if this event can affect the outcome, its contribution to the outcome will be more (or less) substantial within the treated group after the treatment (i.e. intervention) than that within the control group (Shadish, 2010; West and Thoemmes, 2010). For example, areas experiencing sharp drops in malaria prevalence might also be more likely to experience other events (e.g. sharp drops in the prevalence of other infectious diseases) that can contribute to decreasing the low birth weight rate.
We use an omitted variable sensitivity analysis approach (Rosenbaum and Rubin, 1983a; Imbens, 2003; Ichino et al., 2008; Zhang and Small, 2020) to evaluate the sensitivity of the results of our primary analysis to potential hidden bias caused by unobserved covariates. Specifically, we propose the following sensitivity analysis model (3) which extends Model (1) by considering a hypothetical unobserved covariate (unmeasured confounding variable or event) $U$ that is correlated with both the low malaria prevalence indicator and the low birth weight indicator. Let ${U}_{ij}$ denote the exact value of $U$ for individual $j$ in cluster $i$, we consider:
with two error terms ${\alpha}_{i}\sim \mathcal{N}(0,{\sigma}_{0})$ and ${\u03f5}_{ij}\sim \mathcal{N}(0,{\sigma}_{1})$. We assume that ${U}_{ij}$ follows a Bernoulli distribution (taking value 0 or 1) with
In Model (3) along with the corresponding data generating model (4) of the unobserved covariate $U$, the $({p}_{1},{p}_{2})$ are sensitivity parameters of which the unit is a percentage point. Prespecifying a positive (or negative) $p}_{1$ corresponds to a positive (or negative) correlation between the unobserved covariate $U$ and the low malaria prevalence indicator, and prespecifying a positive (or negative) $p}_{2$ corresponds to a positive (or negative) correlation between the unobserved covariate $U$ and the low birth weight indicator. It is clear that a larger magnitude of $p}_{1$ (or $p}_{2$) corresponds to a larger magnitude of correlation between $U$ and the low malaria prevalence indicator (or the low birth weight indicator). We now discuss how the proposed sensitivity analysis model helps to address concerns about the potential hidden bias from Perspectives 1–3 listed above:
For Perspective 1: The proposed sensitivity analysis model covers Perspective 1 by considering a hypothetical unobserved covariate $U$ such that it is correlated with both the low malaria prevalence indicator (i.e. the indicator for units who have experienced sharp drops in malaria prevalence) (by prespecifying various $p}_{1$) and the low birth weight indicator (by prespecifying various $p}_{2$). With the unobserved covariate $U$, the unconfoundedness assumption may be violated as matching can only adjust for observed covariates but cannot directly adjust for unobserved covariates.
For Perspective 2: The proposed sensitivity analysis model also covers Perspective 2 by including the unobserved covariate $U$ in the final outcome model. This is because by setting a nonzero $p}_{1$, the distributions of $U$ between highlow and highhigh pairs of clusters will be imbalanced (i.e. will not follow a common trajectory). Meanwhile, by setting a nonzero $p}_{2$ (corresponds to a nonzero $\lambda $ in Model (3)), the imbalances of $U$ across the treated and controls will make the outcome trend of the highlow pairs of clusters (i.e. the treated group) in the absence of the treatment deviate from a parallel trend with that of the highhigh pairs (i.e. the control group).
For Perspective 3: When setting ${p}_{1}\ne 0$, the hypothetical unobserved covariate $U$ in our sensitivity analysis model can also be regarded as some event of which the occurrence probability varies across the treated group and the control group and is not directly associated with observed covariates. Meanwhile, by setting some ${p}_{2}\ne 0$, the contribution of that event to the low birth weight rate differs across the treated group and the control group as that event occurs more (or less) frequently in the treated group. Therefore, our sensitivity analyses also cover Perspective 3 of the potential hidden bias.
After setting up the sensitivity analysis model (3), the detailed sensitivity analysis procedure is as follows. For each pair of prespecified sensitivity parameters $({p}_{1},{p}_{2})$ and for each imputed data set (500 in total) obtained from Step 3 (the multiple imputation stage), we generate the value of ${U}_{ij}$ for each individual $j$ in cluster $i$ according to Model (4) and calculate the corresponding point estimate and estimated standard error of the coefficient of the low malaria prevalence indicator under Model (3). Similarly to the primary analysis, for each pair of prespecified $({p}_{1},{p}_{2})$, the corresponding estimated causal effect of reduced malaria burden on the low birth weight rate is the mean value of the 500 estimated coefficients on the low malaria prevalence indicator obtained from 500 runs of Model (3). The corresponding pvalue and 95% CIs can also be obtained via applying Rubin’s rules with treating the imputed $U$ as an usual regressor in Model (3). We conduct the above procedure for various $({p}_{1},{p}_{2})$ and examine how the results differ from those in the primary analysis.
Detailed results of the sensitivity analyses
When reporting the sensitivity analyses for the coefficient of the low malaria prevalence indicator under the sensitivity analysis model (3) with various prespecified values of the sensitivity parameters $({p}_{1},{p}_{2})$, we divide the results into the following four cases:
Case 1: ${p}_{1}>0,{p}_{2}>0$. That is, the hypothetical unobserved covariate $U$ is positively correlated with both the low malaria prevalence indicator (i.e., the indicator for units who have experienced sharp drops in malaria prevalence) and the low birth weight indicator (i.e., the outcome variable).
Case 2: ${p}_{1}>0,{p}_{2}<0$. That is, the hypothetical unobserved covariate $U$ is positively correlated with the low malaria prevalence indicator while it is negatively correlated with the low birth weight indicator.
Case 3: ${p}_{1}<0,{p}_{2}>0$. That is, the hypothetical unobserved covariate $U$ is negatively correlated with the low malaria prevalence indicator while it is positively correlated with the low birth weight indicator.
Case 4: ${p}_{1}<0,{p}_{2}<0$. That is, the hypothetical unobserved covariate $U$ is negatively correlated with both the low malaria prevalence indicator and the low birth weight indicator.
We report the results of the sensitivity analyses in Appendix 3—table 1. Specifically, for each $({p}_{1},{p}_{2})$, we report the point estimate, the 95% CI, and the pvalue (under null effect) of the low malaria prevalence indicator under Model (3) in which the hypothetical unobserved covariate ${U}_{ij}$ is generated from Model (4) within each imputed data set.
We list the interpretations of the results in Appendix 3—table 1 case by case:
Cases 1 and 4: In these two cases, the magnitude of the estimated treatment effect obtained from the primary analysis assuming no observed covariates (1.48 percentage points reduction, listed in Table 6 of the main text) is smaller than that obtained from the sensitivity analyses in which the unobserved covariate $U$ is taken into account. This implies that if the unobserved covariate more (or less) frequently appears in the treated group and predicts the outcome in the opposite (or same) direction as the treatment does, the primary analysis tends to underestimate the actual treatment effect. This pattern agrees with the previous literature on sensitivity analyses (Rosenbaum and Silber, 2009). However, as shown in Appendix 3—table 1, the magnitude of this potential estimation bias is estimated to be no greater than −1.83−(−1.48) = 0.35 percentage points as long as ${p}_{1},{p}_{2}\in$ (0, 10) percentage points or ${p}_{1},{p}_{2}\in$ [−10, 0) percentage points.
Cases 2 and 3: In these two cases, the magnitude of the estimated treatment effect obtained from the primary analysis is smaller than that obtained from the sensitivity analyses with $U$ taken into account. This implies that if the unobserved covariate more (or less) frequently appears in the treated group and predicts the outcome in the same (or opposite) direction as the treatment does, the primary analysis tends to overestimate the actual treatment effect. This pattern also agrees with the previous literature on sensitivity analyses (Rosenbaum and Silber, 2009). However, as shown in Appendix 3—table 1, the magnitude of this potential estimation bias is estimated to be no greater than −1.13−(−1.48) = 0.35 percentage points as long as ${p}_{1}\le 10$ percentage points and ${p}_{2}\le 10$ percentage points.
Data availability
Our study is an observational study that uses the following three publicly available data sets: (1) Annual Mean of Plasmodium falciparum Parasite Rate, created by the Malaria Atlas Project, available at https://malariaatlas.org/malariaburdendatadownload/; (2) Integrated Public Use Microdata Series' recoding of the DHS variables (IPUMSDHS), created by the IPUMSDHS Team, available at https://www.idhsdata.org/idhs/index.shtml; (3) DHSGPS data, created by the Demographic and Health Surveys (DHS) Program, available at https://dhsprogram.com/data/availabledatasets.cfm. The data resources are also described in the "Data resources" section of the manuscript. The source code for producing the results in Figure 1, the results in Figure 3, the results in Tables 2, 3, 5, and 6, the results in Table 4, the results in Appendix 1—table 2, the results in Appendix 1—table 3, and the results in Appendix 3 —table 1 can be found in Source code 1 and on GitHub at https://github.com/siyuheng/MalariaandLowBirthWeight (copy archived at https://archive.softwareheritage.org/swh:1:rev:faf6455f95bca6bab364ab95699ea7cd81af1061).
References

Semiparametric differenceindifferences estimatorsThe Review of Economic Studies 72:1–19.https://doi.org/10.1111/00346527.00321

BookMostly Harmless Econometrics: An Empiricist’s CompanionPrinceton University Press.

Using the longitudinal structure of earnings to estimate the effect of training programsThe Review of Economics and Statistics 67:648–660.https://doi.org/10.2307/1924810

Birth weight and schoolage disabilities: a populationbased studyAmerican Journal of Epidemiology 154:895–901.https://doi.org/10.1093/aje/154.10.895

The risk factor indicators of malaria in EthiopiaInternational Journal of Medicine and Medical Sciences 5:335–347.

Monitoring low birth weight: an evaluation of international estimates and an updated estimation procedureBulletin of the World Health Organization 83:178–185.https://doi.org/10.1590/S004296862005000300010

Data on birth weight in developing countries: can surveys help?Bulletin of the World Health Organization 74:209.

DataIPUMSDemographic and Health Surveys: Version 7Minnesota Population Center and ICF International.https://doi.org/10.18128/D080.V7

Minimum wages and employment: a case study of the fastfood industry in New Jersey and Pennsylvania: replyAmerican Economic Review 90:1397–1420.https://doi.org/10.1257/aer.90.5.1397

BookMultiple Imputation and Its ApplicationJohn Wiley & Sons.https://doi.org/10.1002/9781119942283

Recent oral contraceptive use and adverse birth outcomesEuropean Journal of Obstetrics & Gynecology and Reproductive Biology 144:40–43.https://doi.org/10.1016/j.ejogrb.2008.12.016

Demographic and health surveys: a profileInternational Journal of Epidemiology 41:1602–1613.https://doi.org/10.1093/ije/dys184

An investigation of nonresponse bias and survey location variability in the 20172018 national health and nutrition examination surveyVital and Health Statistics. Series 2, Data Evaluation and Methods Research 1:1–36.

Association of young maternal age with adverse reproductive outcomesNew England Journal of Medicine 332:1113–1118.https://doi.org/10.1056/NEJM199504273321701

BookLinear mixedeffects modelIn: Gałecki A, editors. Linear MixedEffects Models Using R. Springer. pp. 245–273.https://doi.org/10.1007/9781461439004_13

A weakly informative default prior distribution for logistic and other regression modelsThe Annals of Applied Statistics 2:1360–1383.https://doi.org/10.1214/08AOAS191

Spatial patterns of infant mortality in Mali: the effect of malaria endemicityAmerican Journal of Epidemiology 159:64–72.https://doi.org/10.1093/aje/kwh001

Impact of malaria during pregnancy on low birth weight in subSaharan africaClinical Microbiology Reviews 17:760–769.https://doi.org/10.1128/CMR.17.4.760769.2004

Full matching in an observational study of coaching for the SATJournal of the American Statistical Association 99:609–618.https://doi.org/10.1198/016214504000000647

Optimal full matching and related designs via network flowsJournal of Computational and Graphical Statistics 15:609–627.https://doi.org/10.1198/106186006X137047

Matching as an econometric evaluation estimator: evidence from evaluating a job training programmeThe Review of Economic Studies 64:605–654.https://doi.org/10.2307/2971733

Alternative methods for evaluating the impact of interventionsJournal of Econometrics 30:239–267.https://doi.org/10.1016/03044076(85)901393

Distinguishing “missing at random” and “missing completely at random”The American Statistician 50:207–213.https://doi.org/10.2307/2684656

SoftwareMalariaandLowBirthWeight, version swh:1:rev:faf6455f95bca6bab364ab95699ea7cd81af1061Software Heritage.

Influence of the timing of malaria infection during pregnancy on birth weight and on maternal Anemia in BeninThe American Journal of Tropical Medicine and Hygiene 85:214–220.https://doi.org/10.4269/ajtmh.2011.110103

Burden of malaria in early pregnancy: a neglected problem?Clinical Infectious Diseases 60:598–604.https://doi.org/10.1093/cid/ciu848

ReportDemographic and Health Surveys (Various) [Datasets]. Funded by USAID. Rockville, Maryland: ICF [Distributor]Technical Report.

From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?Journal of Applied Econometrics 23:305–327.https://doi.org/10.1002/jae.998

Sensitivity to exogeneity assumptions in program evaluationAmerican Economic Review 93:126–132.https://doi.org/10.1257/000282803321946921

Changing trends in P. falciparum burden, immunity, and disease in pregnancyThe New England Journal of Medicine 373:1607–1617.https://doi.org/10.1056/NEJMoa1406459

The health and developmental status of very lowbirthweight children at school ageJAMA: The Journal of the American Medical Association 267:2204–2208.https://doi.org/10.1001/jama.1992.03480160062035

Malaria infection of the placenta in the Gambia, West Africa; its incidence and relationship to stillbirth, birthweight and placental weightTransactions of the Royal Society of Tropical Medicine and Hygiene 77:232–244.https://doi.org/10.1016/00359203(83)900810

The impact of placental malaria on gestational age and birth weightThe Journal of Infectious Diseases 181:1740–1745.https://doi.org/10.1086/315449

Multipleimputation inferences with uncongenial sources of inputStatistical Science 1:538–558.https://doi.org/10.1214/ss/1177010269

Large, sparse optimal matching with refined covariate balance in an observational study of the health outcomes produced by new surgeonsJournal of the American Statistical Association 110:515–527.https://doi.org/10.1080/01621459.2014.997879

SoftwareR: A Language and Environment for Statistical ComputingR Foundation for Statistical Computing, Vienna, Austria.

Drugs for preventing malaria in pregnant women in endemic Areas: any drug regimen versus placebo or no treatmentCochrane Database of Systematic Reviews 9:CD000169.https://doi.org/10.1002/14651858.CD000169.pub3

Can accurate data on birthweight be obtained from health interview surveys?International Journal of Epidemiology 28:925–931.https://doi.org/10.1093/ije/28.5.925

Malaria in pregnancy: linking immunity and pathogenesis to preventionAmerican Journal of Tropical Medicine and Hygiene 77:iii.https://doi.org/10.4269/ajtmh.2007.77.iii

The consquences of adjustment for a concomitant variable that has been affected by the treatmentJournal of the Royal Statistical Society: Series A 147:656–666.https://doi.org/10.2307/2981697

Optimal matching for observational studiesJournal of the American Statistical Association 84:1024–1032.https://doi.org/10.1080/01621459.1989.10478868

Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcomeJournal of the Royal Statistical Society: Series B 45:212–218.https://doi.org/10.1111/j.25176161.1983.tb01242.x

Amplification of sensitivity analysis in matched observational studiesJournal of the American Statistical Association 104:1398–1405.https://doi.org/10.1198/jasa.2009.tm08470

The effect of malaria transmission intensity on neonatal mortality in endemic AreasThe American Journal of Tropical Medicine and Hygiene 75:74–81.https://doi.org/10.4269/ajtmh.2006.75.74

Using multivariate matched sampling and regression adjustment to control bias in observational studiesJournal of the American Statistical Association 74:318–328.https://doi.org/10.2307/2286330

BookMultiple Imputation for Nonresponse in SurveysJohn Wiley & Sons.https://doi.org/10.2307/3172772

Multiple imputation after 18+ yearsJournal of the American Statistical Association 91:473–489.https://doi.org/10.1080/01621459.1996.10476908

BookMatched Sampling for Causal EffectsCambridge University Press.https://doi.org/10.1017/CBO9780511810725

UrbanRural inequality in living standards in AfricaJournal of African Economics 12:564–597.https://doi.org/10.1093/jae/12.4.564

Multiple imputation: a primerStatistical Methods in Medical Research 8:3–15.https://doi.org/10.1177/096228029900800102

Plasmodium falciparum infection early in pregnancy has profound consequences for fetal growthThe Journal of Infectious Diseases 216:1601–1610.https://doi.org/10.1093/infdis/jix530

Four factors influencing birth weightJournal of Epidemiology & Community Health 25:12–16.https://doi.org/10.1136/jech.25.1.12

BookExperimental and Quasi‑Experimental Designs For Generalized Causal InferenceBoston: Houghton Mifflin.

Indirect standardization matching: assessing specific advantage and risk synergyHealth Services Research 51:2330–2357.https://doi.org/10.1111/14756773.12470

Differenceindifferences methods in public financeNational Tax Journal 68:319–338.https://doi.org/10.17310/ntj.2015.2.04

Mechanisms for maternal age differences in birth weightAmerican Journal of Epidemiology 142:504–514.https://doi.org/10.1093/oxfordjournals.aje.a117668

Risk factors for low birth weight: a reviewEuropean Journal of Obstetrics & Gynecology and Reproductive Biology 116:3–15.https://doi.org/10.1016/j.ejogrb.2004.03.007

Handling limited overlap in observational studies with cardinality matchingObservational Studies 4:217–249.https://doi.org/10.1353/obs.2018.0012

Campbell's and Rubin's perspectives on causal inferencePsychological Methods 15:18–37.https://doi.org/10.1037/a0015917

ReportGlobal Malaria Action Plan 1 (2000–2015)Roll Back Malaria Partnership/World Health Organization.

ReportWorld Malaria Report 2019, Technical ReportGeneva: World Health Organization.

Designing difference in difference studies: best practices for public health policy researchAnnual Review of Public Health 39:453–469.https://doi.org/10.1146/annurevpublhealth040617013507

A calibrated sensitivity analysis for matched observational studies with application to the effect of secondhand smoke exposure on blood lead levels in childrenJournal of the Royal Statistical Society: Series C 69:1285–1305.https://doi.org/10.1111/rssc.12443

Using mixed integer programming for matching in an observational study of kidney failure after surgeryJournal of the American Statistical Association 107:1360–1371.https://doi.org/10.1080/01621459.2012.703874
Decision letter

Jennifer FleggReviewing Editor; The University of Melbourne, Australia

Eduardo FrancoSenior Editor; McGill University, Canada

Jennifer FleggReviewer; The University of Melbourne, Australia
In the interests of transparency, eLife publishes the most substantive revision requests and the accompanying author responses.
Acceptance summary:
This paper provides relevant findings of the effects of changing malaria burden on low birth weight using a novel designbased causal inference approach (i.e., a twostep matching procedure as nonparametric data preprocessing in a differenceindifferences design). There are a lot of things to like about this paper, such as its creative design, its extensive data collection effort, and its important results for the policy and health literature. The research topic is wellmotivated and of importance to the malaria research community. The statistical methods will be applicable in other contexts.
Decision letter after peer review:
Thank you for submitting your article "Relationship between changing malaria burden and low birth weight in subSaharan Africa" for consideration by eLife. Your article has been reviewed by 2 peer reviewers, and the evaluation has been overseen by a Reviewing Editor and a Senior Editor. The following individual involved in review of your submission has agreed to reveal their identity: Jennifer Flegg (Reviewer #1).
The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.
Summary:
This paper provides relevant findings of the effects of changing malaria burden on low birth weight using a novel designbased causal inference approach (i.e., a twostep matching procedure as nonparametric data preprocessing in a differenceindifferences design). There are a lot of things to like about this paper, such as its creative design, its extensive data collection effort, and its important results for the policy and health literature. The research topic is wellmotivated and of importance to the malaria research community. The statistical methods will be applicable in other contexts.
Essential Revisions:
1. To answer the research question, the authors make use of the fact that "while the overall prevalence of malaria has declined in subSaharan Africa, the decline has been uneven, with some malariaendemic areas experiencing sharp drops and others experiencing little change" (page 2). However, they never discuss if that heterogeneity can be explained by hidden variables that could also predict the outcomes. In other words, an unobserved factor u could be explaining both the uneven reduction of malaria in certain areas and birth weight. I understand that it is impossible to provide a final answer to this concern, but I would expect some discussion about it. Probably a sensitivity analysis or the amplification of a sensitivity analysis could help to shed some light on this issue.
2. The authors combine two strategies to answer the research question: differenceindifferences and matching. The authors justify combining both strategies by claiming that matching can make the parallel trend assumption more likely to hold. Even though this point makes sense, it would require a better explanation. The main assumption behind a DID is the outcome in treated and control groups would follow parallel trends in the absence of the treatment. As a result, both observed and unobserved characteristics should also follow a common trajectory across both the control and treated groups before the intervention. Matching can help to address imbalances in terms of observed covariates, however, it will require authors to make assumptions about unobservables that are not discussed in the paper. As in my previous comment, a sensitivity analysis might help to address this concern or at least a discussion to better understand under what conditions matching can credibility enhance a differenceindifferences design.
3. Locations are different across time within the same country because the DHS sample different places when constructing representative samples. This is not a problem per se when implementing a DID. However, it might become problematic if the sampling variability is generating imbalances in only one group and therefore those imbalances are not following a common trajectory, which might produce biased results when implementing the DID. In other words, it is not an issue if sampling variability is changing both the control and treated groups in the same direction, but it is going to be an issue if that is only happening for one of the groups or for both groups but in opposite directions. Matching can provide a direct solution to this problem since now we can attribute the changes in outcomes to the intervention and not to a different group composition. I would recommend authors to discuss how matching can help to improve differenceindifferences design when the units of analysis are not the same across time.
4. DID will be biased if there is an event that is occurring at the same time as the intervention, and therefore that is only affecting the treated group after the treatment (i.e., selective maturation). For example, places experiencing a malaria prevalence decline might also experience other positive health outcomes that can contribute to explaining birth weight. I would encourage authors to discuss this possibility.
5. There has been updated estimates of pf parasite rates that include estimates up to 2017 which I think should be used.
6. The choice of "early" and "late" years was a little arbitrary – is there any justification that can be provided or a sensitivity on these definitions?
7. It wasn't clear how the sociodemographic covariates were chosen – is this list (on page 7) an exhaustive list? If not, how were these covariates chosen?
8. In how the model in Equation (1) is presented, that the mixed effects model was fitted in a frequentist setting? Eg there is a reference later to confidence intervals (not credible intervals). I find the change of using a Bayesian approach in the earlier steps of the methodology to using a Frequentist approach quite strange and would suggest that a consistent approach is used throughout.
9. One of the main findings is about the reduction in the rate of low birth weight, but this is not (at the 95% confidence level) significant based on the modelling. While this is mentioned in the Discussion of the paper, I think this should be more upfront in the abstract/results.
10. Can you share on github or similar?
Reviewer #1:
This paper presents a statistical approach to quantify the relationship between changing pf malaria and the rate of a lowbirth weight babies in Africa. A major strength of the work is that the methodology brings together multiple data sources and statistical methods into the one analysis. The authors have achieved their aims and the results support their conclusions. The research topic is wellmotivated and of importance to the malaria research community. The statistical methods will be applicable in other contexts.
1. There has been updated estimates of pf parasite rates that include estimates up to 2017 which I think should be used.
2. I thought the choice of "early" and "late" years was a little arbitrary – is there any justification that can be provided or a sensitivity on these definitions?
3. It wasn't clear how the sociodemographic covariates were chosen – is this list (on page 7) an exhaustive list? If not, how were these covariates chosen?
4. It seems to me, in how the model in Equation (1) is presented, that the mixed effects model was fitted in a frequentist setting? Eg there is a reference later to confidence intervals (not credible intervals). I find the change of using a Bayesian approach in the earlier steps of the methodology to using a Frequentist approach quite strange and would suggest that a consistent approach is used throughout.
5. One of the main findings is about the reduction in the rate of low birth weight, but this is not (at the 95% confidence level) significant based on the modelling. While this is mentioned in the Discussion of the paper, I think this should be more upfront in the abstract/results.
Reviewer #2:
The authors study the effects of a malaria prevalence decline on low birth rates. To achieve this goal, they use data from 19 countries in subSaharan Africa. This manuscript's main strengths are the data collection efforts (merging annual malaria prevalence, demographic and health surveys, and geographical information) and the use of a novel methodological approach (combining recent developments in optimal matching with a differenceindifferences design). Some weaknesses or aspects that could be improved are the lack of discussion about possible biases such as the presence of unobserved factors that could explain the uneven decline in malaria, the role of sampling variability when using survey data to construct a differenceindifferences design, and the role of selective maturation. Regardless of these previous points, the paper makes clear contributions to the applied causal inference literature by illustrating how it is possible to enhance a traditional differenceindifferences design, and to the health and policy literature by showing the effects of malaria on a crucial development outcome.
I have four main comments/suggestions for the authors:
1. To answer the research question, the authors make use of the fact that "while the overall prevalence of malaria has declined in subSaharan Africa, the decline has been uneven, with some malariaendemic areas experiencing sharp drops and others experiencing little change" (page 2). However, they never discuss if that heterogeneity can be explained by hidden variables that could also predict the outcomes. In other words, an unobserved factor u could be explaining both the uneven reduction of malaria in certain areas and birth weight. I understand that it is impossible to provide a final answer to this concern, but I would expect some discussion about it. Probably a sensitivity analysis or the amplification of a sensitivity analysis could help to shed some light on this issue.
2. The authors combine two strategies to answer the research question: differenceindifferences and matching. The authors justify combining both strategies by claiming that matching can make the parallel trend assumption more likely to hold. Even though this point makes sense, it would require a better explanation. The main assumption behind a DID is the outcome in treated and control groups would follow parallel trends in the absence of the treatment. As a result, both observed and unobserved characteristics should also follow a common trajectory across both the control and treated groups before the intervention. Matching can help to address imbalances in terms of observed covariates, however, it will require authors to make assumptions about unobservables that are not discussed in the paper. As in my previous comment, a sensitivity analysis might help to address this concern or at least a discussion to better understand under what conditions matching can credibility enhance a differenceindifferences design.
3. Locations are different across time within the same country because the DHS sample different places when constructing representative samples. This is not a problem per se when implementing a DID. However, it might become problematic if the sampling variability is generating imbalances in only one group and therefore those imbalances are not following a common trajectory, which might produce biased results when implementing the DID. In other words, it is not an issue if sampling variability is changing both the control and treated groups in the same direction, but it is going to be an issue if that is only happening for one of the groups or for both groups but in opposite directions. Matching can provide a direct solution to this problem since now we can attribute the changes in outcomes to the intervention and not to a different group composition. I would recommend authors to discuss how matching can help to improve differenceindifferences design when the units of analysis are not the same across time.
4. DID will be biased if there is an event that is occurring at the same time as the intervention, and therefore that is only affecting the treated group after the treatment (i.e., selective maturation). For example, places experiencing a malaria prevalence decline might also experience other positive health outcomes that can contribute to explaining birth weight. I would encourage authors to discuss this possibility.
https://doi.org/10.7554/eLife.65133.sa1Author response
Reviewer #1:
This paper presents a statistical approach to quantify the relationship between changing pf malaria and the rate of a lowbirth weight babies in Africa. A major strength of the work is that the methodology brings together multiple data sources and statistical methods into the one analysis. The authors have achieved their aims and the results support their conclusions. The research topic is wellmotivated and of importance to the malaria research community. The statistical methods will be applicable in other contexts.
1. There has been updated estimates of pf parasite rates that include estimates up to 2017 which I think should be used.
Thank you for checking this issue with us and for these helpful instructions and suggestions in the decision letter related to this comment. Our response to this comment and the related comments from the decision letter consists of three parts: 1) clarifications on why we chose the years 2000–2015 as the study period of our study at the design stage and why we stick with this choice throughout the outcome analysis in the current study; 2) what adjustments corresponding to these comments have been made in the revised manuscript; 3) the confirmation that we plan to conduct a followup study in which those published or upcoming post2015 Malaria Atlas Project (MAP) data will also be considered and the resulting paper or technical report will be linked to the final published version of the current paper.
First, we here clarify why we chose the years 2000–2015 as the study period at the study design stage and then stick with this choice throughout the outcome analysis of this study. We chose the year 2000 as the starting point of the study period because it is both the earliest year in which the estimated annual Pf PR_{2−10} is published by the Malaria Atlas Project (MAP) (MAP, 2020) and a turning point year in the multilateral commitment to malaria control in subSaharan Africa (Bhatt et al., 2015). We chose the year 2015 as the ending point of the study period is mainly based on the fact that at the design stage of our study (the year 2017), the year 2015 was the latest year in which the estimated annual Pf PR_{2−10} produced by MAP was available to us. As you have pointed out, MAP published some post2015 estimated annual Pf PR_{2−10} data since then. However, including these post2015 data in the midst of our outcome statistical inference procedure will change the study sample determined at the design stage and therefore may influence the transparency and validity of our statistical inference (Rubin, 2007). Following Rubin (2007)’s advice to design observational studies before seeing and analyzing the outcome data, throughout the whole outcome analysis of the current study, we stick with the study sample selection procedure determined at the design stage and do not change the prespecified study period (the years 2000–2015) to ensure the transparency of the statistical inference of the current study.
Second, we list what corresponding adjustments have been made in the revised manuscript from the following three aspects:
1. To make the reasons why we chose the years 2000–2015 as the study period at the design stage and then stick with this choice throughout the whole outcome analysis of the current study more transparent for readers, we have added the following paragraph at the beginning of the “Data selection procedure” section (on page 4 of the revised manuscript):
“In this article, we set the study period to be the years 2000–2015, and correspondingly, all the results and conclusions obtained in this article are limited to the years 2000–2015. We set the year 2000 as the starting point of the study period for two reasons. First, the year 2000 is the earliest year in which the estimated annual Pf PR_{2−10} is published by MAP (MAP, 2020). Second, according to Bhatt et al. (2015), “the year 2000 marked a turning point in multilateral commitment to malaria control in subSaharan Africa, catalysed by the Roll Back Malaria initiative and the wider development agenda around the United Nations Millennium Development Goals.” We set the year 2015 as the ending point based on two considerations. First, when we designed our study in the year 2017, the year 2015 was the latest year in which the estimated annual Pf PR_{2−10} was available to us. We became aware after starting our outcome analysis that MAP has published some post2015 estimated annual Pf PR_{2−10} data since then, but, following Rubin (2007)’s advice to design observational studies before seeing and analyzing the outcome data, we felt it was best to stick with the design of our original study for this report and consider the additional data in a later report. Second, the year 2015 was set as a target year by a series of international goals on malaria control. For example, the United Nations Millennium Development Goals set a goal to “halt by 2015 and begin to reverse the incidence of malaria” and ``the more ambitious target defined later by the World Health Organization (WHO) of reducing case incidence by 75% relative to 2000 levels." (WHO, 2008). It is worth emphasizing that although we set the years 2000–2015 as the study period and did not investigate any post2015 MAP data because of the above considerations, those published or upcoming post2015 MAP data should be considered or leveraged for future related research or followup studies.”
2. Following the suggestion corresponding to your Comment 1 in the decision letter, to limit our results and conclusions drawn from this article to the years 2000–2015 and make this point more transparent for readers, we have made the following adjustments in the revised manuscript:
i. In the “Abstract” section (on page 1 of the revised manuscript), we have added the words “during the years 2000–2015” in the sentence “We conducted an observational study of the effect of changing malaria burden on low birth weight using data from 18,112 births in 19 countries in subSaharan African countries during the years 2000–2015.”
ii. We have added the following sentence at the beginning of the “Data selection procedure” section (on page 4 of the revised manuscript): “In this article, we set the study period to be the years 2000–2015, and correspondingly, all the results and conclusions obtained in this article are limited to the years 2000–2015.”
iii. We have added the following sentence at the beginning of the “Results” section (on page 14 of the revised manuscript): “In this section, we report and interpret the results of matching, primary analysis, secondary analyses, and sensitivity analyses relating changes in malaria burden to changes in the birth weight rate between 2000–2015 in subSaharan Africa.”
iv. At the beginning of the “Discussion” section (on page 18 of the revised manuscript), we have added the words “during the years 2000– 2015” in the sentence “We have developed a pairofpairs matching approach to conduct a differenceindifferences study to examine the causal effect of a reduction in malaria prevalence on the low birth weight rate in subSaharan Africa during the years 2000–2015.”
3. To emphasize that although we did not include any post2015 MAP data in the current study for the transparency of our statistical inference, these post2015 MAP data are useful and should be considered in future research, we have included the following sentence in the “Data selection procedure” section (on page 4 of the revised manuscript): “It is worth emphasizing that although we set the years 2000–2015 as the study period and did not investigate any post2015 MAP data because of the above considerations, those published or upcoming post2015 MAP data should be considered or leveraged for future related research or followup studies.”
Third, we here confirm that, following eLife’s requirement, we will conduct a followup study in the future to consider both the 2000–2015 MAP data and any published or upcoming post2015 MAP data and report how including the additional data would affect the relevant conclusions. We are considering two types of followup study determined by our further investigation on the study design and the data selection procedure:
1. TypeI followup study: We follow a similar study design as that in the current paper except that this time we consider both the 2000–2015 MAP data and any published or upcoming post2015 MAP data. This type of followup study would be more appropriate to be developed into a short technical report posted on a preprint server.
2. TypeII followup study: We both consider the relevant additional new data (including those post2015 MAP data) and elaborate on the current study design and statistical approach. That is, this type of followup study aims to contribute to both the empirical research problem and the statistical methodology. This type of followup study would be more appropriate to be developed into a formal paper which would be both posted on a preprint server and sent out for peer review.
2. I thought the choice of "early" and "late" years was a little arbitrary – is there any justification that can be provided or a sensitivity on these definitions?
Thank you for checking this issue with us. To clarify this issue and provide some justifications on the robustness of the study to our way of defining the “early years” and the “late years,” we have made the following adjustments to the manuscript:
We have added the following sentences to the “Data selection procedure” section (on page 4 of the revised manuscript) to clarify how we define the “early years” and the “late years”: “After selecting 2000–2015 as our study period, we take the middle point years 2007 and 2008 as the cutoff and define the years 2000–2007 as the “early years” and the years 2008–2015 as the “late years.””
To assess the sensitivity of the study to our way of defining the “early years” and the “late years,” we added the following paragraph to interpret Table 1 (on pages 4 and 5 of the revised manuscript): “From Table 1, we can see that among the 19 countries, only two countries (Congo Democratic Republic and Zambia) happen to take the margin year 2007 as the early year and no countries take the margin year 2008 as the late year. This implies that our study is relatively insensitive to our way of defining the early years (2000–2007) and the late years (2008–2015) as most of the selected early years and late years in Table 1 do not fall near the margin years 2007 and 2008.”
3. It wasn't clear how the sociodemographic covariates were chosen – is this list (on page 7) an exhaustive list? If not, how were these covariates chosen?
Thank you for checking this issue with us. To clarify this issue, we have added the following paragraph below the list of the six chosen sociodemographic covariates:
“The above six sociodemographic covariates were chosen by looking over the variables in the Demographic and Health Surveys (DHS) and choosing those which we thought met the following criteria: 1) The above six covariates are potentially strongly correlated with both the risk of malaria (Baragatti et al., 2009; Krefis et al., 2010; Ayele et al., 2013; Roberts and Matthews, 2016; Sulyok et al., 2017) and birth outcomes (Sahn and Stifel, 2003; Gemperli et al., 2004; Chen et al., 2009; Grace et al., 2015; Padhi et al., 2015), and therefore may be important confounding variables that need to be adjusted for via statistical matching (Rosenbaum and Silber, 2009; Rosenbaum, 2010; Stuart, 2010). 2) The records of the above six covariates are mostly available for all the countries and the survey years in our study samples. Specifically, for the above six covariates, the percentages of missing data (missingness can arise either because the question was not asked or the individual was asked the question but did not respond) among the total individual records from IPUMSDHS among the 6,812 pairs of clusters remaining after Step 1 are all less than 0.3%.”
4. It seems to me, in how the model in Equation (1) is presented, that the mixed effects model was fitted in a frequentist setting? Eg there is a reference later to confidence intervals (not credible intervals). I find the change of using a Bayesian approach in the earlier steps of the methodology to using a Frequentist approach quite strange and would suggest that a consistent approach is used throughout.
Thank you for checking this issue with us. To clarify this issue, we have added the following paragraph at the end of the “Statistical analysis” section (on page 12 of the revised manuscript):
“It is worth clarifying that although we take a Bayesian approach when imputing (i.e., predicting) the missing low birth weight indicators in Step 3 (i.e., imputation model) and then take a frequentist approach when conducting the 500 separate outcome analyses with the 500 imputed data sets in Step 4 (i.e., substantive model), these two different statistical perspectives (i.e., Bayesian and frequentist) do not conflict with each other when we apply Rubin’s rules to combine these 500 separate outcome analyses as the single estimator and inference reported in Table 6. This is because the frequentist validity of applying Rubin’s rules to combine separate outcome analyses with multiple imputed data sets only explicitly depends on the asymptotic normal approximation assumption for each coefficient estimator in Model (1) (see Appendix 2 for more details), and does not directly depend on how the multiple imputed data sets are generated (e.g., either using a Bayesian imputation model as in Step 3 or using a frequentist imputation model instead). Using a Bayesian imputation model followed by a frequentist substantive model is one of the most common strategies when applying Rubin’s rules to conduct statistical inference with multiple imputation; see Rubin (1996), Chapter 3 of Rubin (1987), and Chapter 2 of Carpenter and Kenward (2012). For representative works on justifying the advantages of using a Bayesian imputation model in multipleimputation inferences, see Meng (1994) and Chapter 2 of Carpenter and Kenward (2012).”
5. One of the main findings is about the reduction in the rate of low birth weight, but this is not (at the 95% confidence level) significant based on the modelling. While this is mentioned in the Discussion of the paper, I think this should be more upfront in the abstract/results.
Thank you for this helpful suggestion. We have made the following adjustments correspondingly in the revised manuscript:
We have added the following sentence to the abstract (on page 1 of the revised manuscript): “Although the confidence intervals cannot rule out the possibility of no effect at the 95% confidence level, the concurrence between our primary analysis, secondary analyses, and sensitivity analyses, and the magnitude of the effect size, contribute to the weight of the evidence suggesting that declining malaria burden can potentially substantially reduce the low birth weight rate at the community level in subSaharan Africa, particularly among firstborns.”
We have added the following paragraph at the end of the “Results” section (on page 18 of the revised manuscript): “To conclude, although the confidence intervals of the coefficient of the low malaria prevalence indicator on the low birth weight rate presented in the “Results” section cannot exclude a possibility of no effect at level 95% based on our proposed study sample selection procedure and statistical approach, the results and the corresponding interpretations of the primary analysis, the secondary analyses, and the sensitivity analyses have contributed to the weight of the evidence that reduced malaria burden has an important influence on the low birth weight rate in subSaharan Africa at the community level.”
Reviewer #2:
The authors study the effects of a malaria prevalence decline on low birth rates. To achieve this goal, they use data from 19 countries in subSaharan Africa. This manuscript's main strengths are the data collection efforts (merging annual malaria prevalence, demographic and health surveys, and geographical information) and the use of a novel methodological approach (combining recent developments in optimal matching with a differenceindifferences design). Some weaknesses or aspects that could be improved are the lack of discussion about possible biases such as the presence of unobserved factors that could explain the uneven decline in malaria, the role of sampling variability when using survey data to construct a differenceindifferences design, and the role of selective maturation. Regardless of these previous points, the paper makes clear contributions to the applied causal inference literature by illustrating how it is possible to enhance a traditional differenceindifferences design, and to the health and policy literature by showing the effects of malaria on a crucial development outcome.
I have four main comments/suggestions for the authors:
1. To answer the research question, the authors make use of the fact that "while the overall prevalence of malaria has declined in subSaharan Africa, the decline has been uneven, with some malariaendemic areas experiencing sharp drops and others experiencing little change" (page 2). However, they never discuss if that heterogeneity can be explained by hidden variables that could also predict the outcomes. In other words, an unobserved factor u could be explaining both the uneven reduction of malaria in certain areas and birth weight. I understand that it is impossible to provide a final answer to this concern, but I would expect some discussion about it. Probably a sensitivity analysis or the amplification of a sensitivity analysis could help to shed some light on this issue.
Thank you for this helpful suggestion. We have added two new sections “Sensitivity analyses” (on pages 13 and 14 of the revised manuscript) and “Results of the sensitivity analyses” (on page 18 of the revised manuscript) to the main text and two new sections “Design of the sensitivity analyses” (on pages 32–34 of the revised manuscript) and “Detailed results of the sensitivity analyses” (on pages 34 and 35 of the revised manuscript) to Appendix 3 to address the hidden bias issues raised in your Comments 1, 2, and 4. Specifically, we realize that these three comments correspond to three closely connected perspectives on potential hidden bias in the previous literature that cannot be directly removed by neither matching nor a differenceindifferences design (see Perspectives 1–3 in the “Sensitivity analyses” section of the main text and the “Design of the sensitivity analyses” section of Appendix 3), and therefore should be addressed by sensitivity analyses. Among Perspectives 1–3 in the newly added “Sensitivity analyses” section and the “Design of the sensitivity analyses” section, Perspective 1 corresponds to your Comment 1 and is briefly summarized in the “Sensitivity analyses” section written as follows (on page 13 of the revised manuscript): “Perspective 1: The potential violation of the unconfoundedness assumption (Rosenbaum and Rubin, 1983; Heckman and Robb, 1985; Heckman et al., 1997).” We then give a detailed description of Perspective 1 in the “Design of the sensitivity analyses” section of Appendix 3 (on page 32 of the revised manuscript) written as follows:
“Perspective 1: The potential violation of the unconfoundedness assumption (Rosenbaum and Rubin, 1983; Heckman and Robb, 1985). Roughly speaking, the unconfoundedness assumption states that, after adjusting for observed covariates (measured confounders), there are no differential trends over time of any characteristics, other than the intervention itself, between the treated group and the control group, that may be correlated with their outcomes. This assumption may be violated if there is selection bias on unobserved covariates across time (Heckman and Robb, 1985; Heckman et al., 1997) such that there are differences in these observed covariates of the treated group and the control group which impact their trends in the outcome (Ashenfelter and Card, 1984; Doyle et al., 2018). For example, in our study, the unconfoundedness assumption can be violated if the sharp drops in malaria prevalence experienced by some areas could be explained by the changes of some unobserved characteristics over time that could also predict the low birth weight rate.”
To assess the robustness of the results of our primary analysis to potential hidden bias which can be viewed from various alternative perspectives (including Perspectives 1–3 described in the “Sensitivity analyses” section and the “Design of the sensitivity analyses” section), we have proposed a sensitivity analysis model in which we include a hypothetical unobserved covariate (unmeasured confounding variable or event) U that is correlated with both the low malaria prevalence indicator and the low birth weight indicator (see pages 14 and 33 of the revised manuscript). In Appendix 3 (on page 33 of the revised manuscript), we have discussed how our sensitivity analysis model covers Perspectives 1–3 when assessing the potential hidden bias. We post the corresponding interpretation of our sensitivity analysis model for addressing Perspective 1:
“For Perspective 1: The proposed sensitivity analysis model covers Perspective 1 by considering a hypothetical unobserved covariate U such that it is correlated with both the low malaria prevalence indicator (i.e., the indicator for units who have experienced sharp drops in malaria prevalence) (by prespecifying various p_{1}) and the low birth weight indicator (by prespecifying various p_{2}). With the unobserved covariate U, the unconfoundedness assumption may be violated as matching can only adjust for observed covariates but cannot directly adjust for unobserved covariates.”
Results of the sensitivity analyses are briefly summarized in the newly added “Results of the sensitivity analyses” section (on page 18 of the revised manuscript) and are reported in detail in Appendix 3 (on pages 34 and 35 of the revised manuscript). Specifically, in Table 1 of Appendix 3, we report the point estimates, the 95% confidence intervals, and the pvalues of the coefficient of the low malaria prevalence indicator (i.e., the treatment effect) under the proposed sensitivity analysis model with various magnitudes of unmeasured confounding. In conclusion, our sensitivity analyses suggest that the magnitude of the estimated treatment effect is still evident even if the magnitude of unmeasured confounding was nontrivial. Please see pages 18, 34, and 35 of the revised manuscript for details on the results and interpretations of the sensitivity analyses.
2. The authors combine two strategies to answer the research question: differenceindifferences and matching. The authors justify combining both strategies by claiming that matching can make the parallel trend assumption more likely to hold. Even though this point makes sense, it would require a better explanation. The main assumption behind a DID is the outcome in treated and control groups would follow parallel trends in the absence of the treatment. As a result, both observed and unobserved characteristics should also follow a common trajectory across both the control and treated groups before the intervention. Matching can help to address imbalances in terms of observed covariates, however, it will require authors to make assumptions about unobservables that are not discussed in the paper. As in my previous comment, a sensitivity analysis might help to address this concern or at least a discussion to better understand under what conditions matching can credibility enhance a differenceindifferences design.
Thank you for this helpful suggestion. We have added two new sections “Sensitivity analyses” (on pages 13 and 14 of the revised manuscript) and “Results of the sensitivity analyses” (on page 18 of the revised manuscript) to the main text and two new sections “Design of the sensitivity analyses” (on pages 32–34 of the revised manuscript) and “Detailed results of the sensitivity analyses” (on pages 34 and 35 of the revised manuscript) to Appendix 3 to address the issues raised in your Comments 1, 2, and 4. Specifically, among Perspectives 1–3 on the potential hidden bias in the newly added “Sensitivity analyses” and “Design of sensitivity analyses” sections, Perspective 2 corresponds to your Comment 2 and is briefly summarized as follows (on page 13 of the revised manuscript): “Perspective 2: The potential violation of the parallel trend assumption in a differenceindifferences study (Card and Krueger, 2000; Angrist and Pischke, 2008; Hasegawa et al., 2019; Basu and Small, 2020).” We then give a detailed description of Perspective 2 in the “Design of the sensitivity analyses” section of Appendix 3 (on page 32 of the revised manuscript) written as follows:
“Perspective 2: The potential violation of the parallel trend assumption in a differenceindifferences study (Card and Krueger, 2000; Angrist and Pischke, 2008; Hasegawa et al., 2019; Basu and Small, 2020). Recall that the parallel trend assumption behind a differenceindifferences study states that, in the absence of the treatment (i.e., intervention), after adjusting for relevant covariates, the outcome trajectory of the treated group would follow a parallel trend with that of the control group. Therefore, to make the parallel trend assumption more likely to hold, ideally each observed or unobserved covariate should be well balanced (i.e., follow a common trajectory) between the treated group and the control group, before and after the intervention. Matching can balance observed covariates by ensuring each covariate follows a common trajectory in the treated and control groups. However, matching cannot directly adjust for unobserved covariates and their trajectories among the treated and control groups may differ and correspondingly the parallel trend assumption may not hold.”
We have designed a sensitivity analysis model (on pages 14 and 33 of the revised manuscript) in which we include a hypothetical unobserved covariate U. On page 33 of the revised manuscript, we have discussed in detail how our sensitivity analysis model covers Perspective 2 which corresponds to your Comment 2:
“For Perspective 2: The proposed sensitivity analysis model also covers Perspective 2 by including the unobserved covariate U in the final outcome model. This is because by setting a nonzero p_{1}, the distributions of U between highlow and highhigh pairs of clusters will be imbalanced (i.e., will not follow a common trajectory). Meanwhile, by setting a nonzero p_{2} (corresponds to a nonzero λ in Model (3)), the imbalances of U across the treated and controls will make the outcome trend of the highlow pairs of clusters (i.e., the treated group) in the absence of the treatment deviate from a parallel trend with that of the highhigh pairs (i.e., the control group).”
We have reported the detailed results of the sensitivity analyses in Table 1 of Appendix 3 (on page 35 of the revised manuscript). Our sensitivity analyses in general support the conclusion from the primary analysis that the estimated magnitude of the treatment effect is evident, even under a nontrivial magnitude of unmeasured confounding. Please see pages 18, 34, and 35 of the revised manuscript for details.
3. Locations are different across time within the same country because the DHS sample different places when constructing representative samples. This is not a problem per se when implementing a DID. However, it might become problematic if the sampling variability is generating imbalances in only one group and therefore those imbalances are not following a common trajectory, which might produce biased results when implementing the DID. In other words, it is not an issue if sampling variability is changing both the control and treated groups in the same direction, but it is going to be an issue if that is only happening for one of the groups or for both groups but in opposite directions. Matching can provide a direct solution to this problem since now we can attribute the changes in outcomes to the intervention and not to a different group composition. I would recommend authors to discuss how matching can help to improve differenceindifferences design when the units of analysis are not the same across time.
Thank you for this helpful suggestion. When discussing how using matching as a data preprocessing step in a differenceindifferences design goes beyond directly applying a differenceindifferences approach in the “Motivation and overview of our approach: differenceindifferences via pairofpairs” section (on pages 6 and 7 of the revised manuscript), we have added the following paragraph to discuss how matching helps to address the survey location sampling variability issue when using survey data to conduct a differenceindifferences design raised in your Comment 3 (on pages 6 and 7 of the revised manuscript):
“Another perspective on how our secondstep matching helps to improve a differenceindifferences study is through the survey location sampling variability (Fakhouri et al., 2020). Recall that when constructing representative samples, the DHS are sampled at different locations (i.e., clusters) across time (ICF, 2019; Elizabeth Heger Boyle and Sobek, 2019). Therefore, if we simply implemented a differenceindifferences approach over all the highlow and highhigh pairs of survey clusters and did not use matching to adjust for observed covariates, this survey location sampling variability may generate imbalances (i.e., different trajectories) of observed covariates across the treated and control groups, and therefore may bias the differenceindifferences estimator (Heckman et al., 1997). Imbalances of observed covariates caused by the survey location sampling variability may occur in the following three cases: 1) The survey location sampling variability is affecting the treated and control groups in the opposite direction. Specifically, there is some observed covariate for which the difference between the highlow pairs of sampled clusters tends to be larger (or smaller) than the country’s overall difference between the high malaria prevalence regions in the early years and the low malaria prevalence regions in the late years and conversely, the difference in that observed covariate between the highhigh pairs of sampled clusters tends to be smaller (or larger) than the country’s overall difference between the high malaria prevalence regions in the early years and the high malaria prevalence regions in the late years. 2) The survey location sampling variability is affecting the treated and control groups in the same direction but to different extents. 3) The survey location sampling variability only happened in the treated or control group. Specifically, there is some observed covariate for which the difference between the highlow (or highhigh) pairs of sampled clusters tends to differ from the country’s overall difference between the high malaria prevalence regions in the early years and the low (or high) malaria prevalence regions in the late years, but this is not the case for the highhigh (or highlow) pairs of sampled clusters. Using matching as a nonparametric data preprocessing step in a differenceindifferences study can remove this type of bias because the observed covariates trajectories are forced to be common among the matched treated and control groups (St.Clair and Cook, 2015; Basu and Small, 2020).”
4. DID will be biased if there is an event that is occurring at the same time as the intervention, and therefore that is only affecting the treated group after the treatment (i.e., selective maturation). For example, places experiencing a malaria prevalence decline might also experience other positive health outcomes that can contribute to explaining birth weight. I would encourage authors to discuss this possibility.
Thank you for this helpful suggestion. As also mentioned above, we have added two new sections “Sensitivity analyses” (on pages 13 and 14 of the revised manuscript) and “Results of the sensitivity analyses” (on page 18 of the revised manuscript) to the main text and two new sections “Design of the sensitivity analyses” (on pages 32–34 of the revised manuscript) and “Detailed results of the sensitivity analyses” (on pages 34 and 35 of the revised manuscript) to Appendix 3. Specifically, among Perspectives 1–3 included in the newly added “Sensitivity analyses” and “Design of the sensitivity analyses” sections, Perspective 3 corresponds to your Comment 4 and is summarized as follows (on page 13 of the revised manuscript): “Perspective 3: The differenceindifferences estimator may be biased if there is an event that is more (or less) likely to occur as the intervention happens and the occurrence probability of this event cannot be fully captured by observed covariates (Shadish, 2010; West and Thoemmes, 2010).” We then give a detailed description of Perspective 3 in Appendix 3 (on page 32 of the revised manuscript):
“Perspective 3: A differenceindifferences study may be biased if there is an event that is more (or less) likely to occur as the treatment (i.e., intervention) happens in the treated group, but, unlike the case discussed in Section “Motivation and overview of our approach: differenceindifferences via pairofpairs” of the main text, the occurrence probability of this event cannot be fully captured by observed covariates. In this case, if this event can affect the outcome, its contribution to the outcome will be more (or less) substantial within the treated group after the treatment (i.e., intervention) than that within the control group (Shadish, 2010; West and Thoemmes, 2010). For example, areas experiencing sharp drops in malaria prevalence might also be more likely to experience other events (e.g., sharp drops in the prevalence of other infectious diseases) that can contribute to decreasing the low birth weight rate.”‘
As also mentioned above, we have proposed a sensitivity analysis framework (on pages 14 and 33 of the revised manuscript) with considering a hypothetical unobserved covariate (unmeasured confounding variable or event) $U$ in the outcome model. On page 33 of the revised manuscript, we have discussed how our sensitivity analysis framework covers Perspective 3 which corresponds to your Comment 4:
“For Perspective 3: When setting ${p}_{1}\ne 0$, the hypothetical unobserved covariate U in our sensitivity analysis model can also be regarded as some event of which the occurrence probability varies across the treated group and the control group and is not associated with observed covariates. Meanwhile, by setting some ${p}_{2}\ne 0$, the contribution of that event to the low birth weight rate differs across the treated group and the control group as that event occurs more (or less) frequently in the treated group. Therefore, our sensitivity analyses also cover Perspective 3 of the potential hidden bias.”
As also mentioned our sensitivity analyses results and the corresponding interpretations can be found in the “Results of the sensitivity analyses” section of the main text (on page 18 of the revised manuscript) and in the “Detailed results of the sensitivity analyses” section in Appendix 3 (on pages 34 and 35 of the revised manuscript).
References
Angrist, J. D. and Pischke, J.S. (2008). Mostly Harmless Econometrics: An Empiricist’s Companion. Princeton University Press.
Ashenfelter, O. C. and Card, D. (1984). Using the longitudinal structure of earnings to estimate the effect of training programs.
Ayele, D. G., Zewotir, T. T., and Mwambi, H. G. (2013). The risk factor indicators of malaria in ethiopia. International Journal of Medicine and Medical Sciences, 5(7):335– 347.
Baragatti, M., Fournet, F., Henry, M.C., Assi, S., Ouedraogo, H., Rogier, C., and Salem, G. (2009). Social and environmental malaria risk factors in urban areas of ouagadougou, burkina faso. Malaria Journal, 8(1):1–14.
Basu, P. and Small, D. S. (2020). Constructing a more closely matched control group in a differenceindifferences analysis: its effect on history interacting with group bias. Observational Studies, 6:103–130.
Bhatt, S., Weiss, D., Cameron, E., Bisanzio, D., Mappin, B., Dalrymple, U., Battle, K., Moyes, C., Henry, A., Eckhoff, P., Wenger, E., Briët, O., Penny, M., Smith, T., Bennett, A., Yukich, J., Eisele, T., Griffin, J., Fergus, C., Lynch, M., Lindgren, F., Cohen, J., Murray, C., Smith, D., Hay, S., Cibulskis, R., and Gething, P. (2015). The effect of malaria control on Plasmodium falciparum in africa between 2000 and 2015. Nature, 526(7572):207.
Card, D. and Krueger, A. B. (2000). Minimum wages and employment: a case study of the fastfood industry in new jersey and pennsylvania: reply. American Economic Review, 90(5):1397–1420.
Carpenter, J. and Kenward, M. (2012). Multiple imputation and its application. John Wiley and Sons.
Chen, X.K., Wen, S. W., Sun, L.M., Yang, Q., Walker, M. C., and Krewski, D. (2009). Recent oral contraceptive use and adverse birth outcomes. European Journal of Obstetrics and Gynecology and Reproductive Biology, 144(1):40–43.
Doyle, O., Hegarty, M., and Owens, C. (2018). Populationbased system of parenting support to reduce the prevalence of child social, emotional, and behavioural problems: differenceindifferences study. Prevention Science, 19(6):772–781.
Elizabeth Heger Boyle, M. K. and Sobek, M. (2019). Minnesota Population Center and ICF International.
Fakhouri, T. H., Martin, C. B., Chen, T.C., Akinbami, L. J., Ogden, C. L., PauloseRam, R., Riddles, M. K., Van de Kerckhove, W., Roth, S. B., Clark, J., Mohadjer, L. K., and Fay, R. E. (2020). An investigation of nonresponse bias and survey location variability in the 20172018 national health and nutrition examination survey. Vital and Health statistics. Series 2, Data Evaluation and Methods Research, (185):1–36.
Gemperli, A., Vounatsou, P., Kleinschmidt, I., Bagayoko, M., Lengeler, C., and Smith, T. (2004). Spatial patterns of infant mortality in mali: the effect of malaria endemicity. American Journal of Epidemiology, 159(1):64–72.
Grace, K., Davenport, F., Hanson, H., Funk, C., and Shukla, S. (2015). Linking climate change and health outcomes: Examining the relationship between temperature, precipitation and birth weight in africa. Global Environmental Change, 35:125–137.
Hasegawa, R. B., Webster, D. W., and Small, D. S. (2019). Evaluating missouri’s handgun purchaser law: a bracketing method for addressing concerns about history interacting with group. Epidemiology, 30(3):371–379.
Heckman, J. J., Ichimura, H., and Todd, P. E. (1997). Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme. The Review of Economic Studies, 64(4):605–654.
Heckman, J. J. and Robb, R. J. (1985). Alternative methods for evaluating the impact of interventions: An overview. Journal of Econometrics, 30(12):239–267.
ICF (2019). 20042017. demographic and health surveys (various) [datasets]. funded by usaid. rockville, maryland: Icf [distributor]. Technical report.
Krefis, A. C., Schwarz, N. G., Nkrumah, B., Acquah, S., Loag, W., Sarpong, N., AduSarkodie, Y., Ranft, U., and May, J. (2010). Principal component analysis of socioeconomic factors and their association with malaria in children from the ashanti region, ghana. Malaria Journal, 9(1):1–7.
MAP (2020). Malaria atlas project. The MAP Group.
Meng, X.L. (1994). Multipleimputation inferences with uncongenial sources of input. Statistical Science, pages 538–558.
Padhi, B. K., Baker, K. K., Dutta, A., Cumming, O., Freeman, M. C., Satpathy, R., Das, B. S., and Panigrahi, P. (2015). Risk of adverse pregnancy outcomes among women practicing poor sanitation in rural india: a populationbased prospective cohort study. PLoS Medicine, 12(7):e1001851.
Roberts, D. and Matthews, G. (2016). Risk factors of malaria in children under the age of five years old in uganda. Malaria Journal, 15(1):1–11.
Rosenbaum, P. R. (2010). Design of Observational Studies, volume 10. Springer.
Rosenbaum, P. R. and Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1):41–55.
Rosenbaum, P. R. and Silber, J. H. (2009). Amplification of sensitivity analysis in matched observational studies. Journal of the American Statistical Association, 104(488):1398–1405.
Rubin, D. B. (1987). Multiple Imputation for Nonresponse in Surveys. John Wiley and Sons.
Rubin, D. B. (1996). Multiple imputation after 18+ years. Journal of the American statistical Association, 91(434):473–489.
Rubin, D. B. (2007). The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials. Statistics in Medicine, 26(1):20– 36.
Sahn, D. E. and Stifel, D. C. (2003). Urban–rural inequality in living standards in africa. Journal of African Economies, 12(4):564–597.
Shadish, W. R. (2010). Campbell and rubin: A primer and comparison of their approaches to causal inference in field settings. Psychological Methods, 15(1):3.
St.Clair, T. and Cook, T. D. (2015). Differenceindifferences methods in public finance. National Tax Journal, 68(2):319–338.
Stuart, E. A. (2010). Matching methods for causal inference: A review and a look forward. Statistical Science, 25(1):1.
Sulyok, M., Rückle, T., Roth, A., Mürbeth, R. E., Chalon, S., Kerr, N., Samec, S. S., Gobeau, N., Calle, C. L., Ibáñez, J., Sulyok, Z., Held, J., Gebru, T., Granados, P., Brückner, S., Nguetse, C., Mengue, J., Lalremruata, A., Sim, B. K. L., Hoffman, S. L., Möhrle, J. J., Kremsner, P. G., and Mordmüller, B. (2017). DSM265 for Plasmodium falciparum chemoprophylaxis: a randomised, double blinded, phase 1 trial with controlled human malaria infection. The Lancet Infectious Diseases, 17(6):636–644.
West, S. G. and Thoemmes, F. (2010). Campbell’s and rubin’s perspectives on causal inference. Psychological Methods, 15(1):18.
WHO (2008). Global malaria action plan 1 (2000–2015). Roll Back Malaria Partnership/World Health Organization.
https://doi.org/10.7554/eLife.65133.sa2Article and author information
Author details
Funding
National Center for Advancing Translational Sciences (UL1TR002553)
 Ryan Simmons
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
The authors thank Bhaswar Bhattacharya, Shuxiao Chen, Emily Diana, Sheng Gao, Bikram Karmakar, Hongming Pu, Hua Wang, and Bo Zhang for helpful discussions and comments. Funding: Ryan A Simmons is supported by National Center for Advancing Translational Sciences (UL1TR002553). The funder had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Senior Editor
 Eduardo Franco, McGill University, Canada
Reviewing Editor
 Jennifer Flegg, The University of Melbourne, Australia
Reviewer
 Jennifer Flegg, The University of Melbourne, Australia
Version history
 Received: November 24, 2020
 Accepted: June 5, 2021
 Version of Record published: July 14, 2021 (version 1)
Copyright
© 2021, Heng et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics

 921
 Page views

 126
 Downloads

 1
 Citations
Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading

 Epidemiology and Global Health
Background:
Machine learning (ML) techniques improve disease prediction by identifying the most relevant features in multidimensional data. We compared the accuracy of ML algorithms for predicting incident diabetic kidney disease (DKD).
Methods:
We utilized longitudinal data from 1365 Chinese, Malay, and Indian participants aged 40–80 y with diabetes but free of DKD who participated in the baseline and 6year followup visit of the Singapore Epidemiology of Eye Diseases Study (2004–2017). Incident DKD (11.9%) was defined as an estimated glomerular filtration rate (eGFR) <60 mL/min/1.73 m^{2} with at least 25% decrease in eGFR at followup from baseline. A total of 339 features, including participant characteristics, retinal imaging, and genetic and blood metabolites, were used as predictors. Performances of several ML models were compared to each other and to logistic regression (LR) model based on established features of DKD (age, sex, ethnicity, duration of diabetes, systolic blood pressure, HbA1c, and body mass index) using area under the receiver operating characteristic curve (AUC).
Results:
ML model Elastic Net (EN) had the best AUC (95% CI) of 0.851 (0.847–0.856), which was 7.0% relatively higher than by LR 0.795 (0.790–0.801). Sensitivity and specificity of EN were 88.2 and 65.9% vs. 73.0 and 72.8% by LR. The top 15 predictors included age, ethnicity, antidiabetic medication, hypertension, diabetic retinopathy, systolic blood pressure, HbA1c, eGFR, and metabolites related to lipids, lipoproteins, fatty acids, and ketone bodies.
Conclusions:
Our results showed that ML, together with feature selection, improves prediction accuracy of DKD risk in an asymptomatic stable population and identifies novel risk factors, including metabolites.
Funding:
This study was supported by the National Medical Research Council, NMRC/OFLCG/001/2017 and NMRC/HCSAINV/MOH00101900. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

 Epidemiology and Global Health
The NIHfunded RECOVER study is collecting clinical data on patients who experience a SARSCoV2 infection. As patient representatives of the RECOVER Initiative’s Mechanistic Pathways task force, we offer our perspectives on patient motivations for partnering with researchers to obtain results from mechanistic studies. We emphasize the challenges of balancing urgency with scientific rigor. We recognize the importance of such partnerships in addressing postacute sequelae of SARSCoV2 infection (PASC), which includes ‘long COVID,’ through contrasting objective and subjective narratives. Long COVID’s prevalence served as a call to action for patients like us to become actively involved in efforts to understand our condition. Patientcentered and patientpartnered research informs the balance between urgency and robust mechanistic research. Results from collaborating on protocol design, diverse patient inclusion, and awareness of community concerns establish a new precedent in biomedical research study design. With a public health matter as pressing as the longterm complications that can emerge after SARSCoV2 infection, considerate and equitable stakeholder involvement is essential to guiding seminal research. Discussions in the RECOVER Mechanistic Pathways task force gave rise to this commentary as well as other review articles on the current scientific understanding of PASC mechanisms.