Combination of inflammatory and vascular markers in the febrile phase of dengue is associated with more severe outcomes
Abstract
Background:
Early identification of severe dengue patients is important regarding patient management and resource allocation. We investigated the association of 10 biomarkers (VCAM-1, SDC-1, Ang-2, IL-8, IP-10, IL-1RA, sCD163, sTREM-1, ferritin, CRP) with the development of severe/moderate dengue (S/MD).
Methods:
We performed a nested case-control study from a multi-country study. A total of 281 S/MD and 556 uncomplicated dengue cases were included.
Results:
On days 1–3 from symptom onset, higher levels of any biomarker increased the risk of developing S/MD. When assessing together, SDC-1 and IL-1RA were stable, while IP-10 changed the association from positive to negative; others showed weaker associations. The best combinations associated with S/MD comprised IL-1RA, Ang-2, IL-8, ferritin, IP-10, and SDC-1 for children, and SDC-1, IL-8, ferritin, sTREM-1, IL-1RA, IP-10, and sCD163 for adults.
Conclusions:
Our findings assist the development of biomarker panels for clinical use and could improve triage and risk prediction in dengue patients.
Funding:
This study was supported by the EU's Seventh Framework Programme (FP7-281803 IDAMS), the WHO, and the Bill and Melinda Gates Foundation.
Introduction
Dengue is the most common arboviral disease to affect humans globally. In 2019, the World Health Organization (WHO) identified dengue as one of the top 10 threats to global health (World Health Organization, 2019). Transmission occurs in 129 countries, with an estimated 3.9 billion people being at risk (World Health Organization, 2020). Over the last two decades, the number of reported cases per year has increased more than eight-fold (World Health Organization, 2020), and in 2020 the annual number of dengue virus (DENV) infections was estimated to be 105 million, with 51 million cases being clinically apparent (Cattarino et al., 2020). With climate change, increased travel and urbanization, this rise is forecasted to continue over the coming decades (Whitehorn and Yacoub, 2019; Yacoub et al., 2011). Despite the large disease burden, there is still no specific treatment for dengue, and the only licensed vaccine is recommended only in individuals with earlier dengue infection (Redoni et al., 2020).
In many dengue-endemic settings, seasonal epidemics can rapidly overwhelm fragile health systems. Although most symptomatic dengue infections are self-limiting, a small proportion of patients develop complications, most of which manifest at around 4–6 days from symptom onset. Thus, large numbers of patients require regular assessments to identify complications should they arise. The accurate and early identification of such patients, particularly within the first 3 days of illness in the febrile phase, should allow for appropriate care to be provided and potentially increase health system effectiveness. Although the 2009 WHO dengue guidelines set out specific warning signs for use in patient triage, utility of these guidelines at identifying those at risk for complications remains limited (Morra et al., 2018).
The pathogenesis of dengue involves a complex interplay between viral factors and the host response. It is hypothesized that an excessive immune response acting through inflammatory mediators can lead to the observed manifestations of bleeding, shock, and organ dysfunction. Studies have shown that in secondary infections, adaptive immune activation can result in high circulating levels of plasma cytokines and chemokines (Katzelnick et al., 2017; Midgley et al., 2011; Screaton et al., 2015). Binding of viral NS1 protein onto endothelial cells can act in concert with vasoactive substances, cytokines, and chemokines, to result in endothelial activation and glycocalyx disruption, and these processes likely underlie the increased vascular permeability and coagulopathy (McBride and Khanh Lam, 2020; Modhiran et al., 2015; St John et al., 2013).
The role of blood biomarkers in predicting severe outcomes has been investigated in many studies, but mostly at later time-points or at hospital admission and many of these biomarkers either peak too late in the disease course or have too short a half-life to be clinically useful (Ab-Rahman et al., 2016; John et al., 2015; Oliveira et al., 2017; Puerta-Guardo et al., 2019; Rathore et al., 2020; Robinson and Einav, 2020; S S et al., 2017; Soo et al., 2017; Vasey et al., 2020; Yacoub et al., 2017; Yacoub et al., 2016b; Yong et al., 2017). Acknowledging these characteristics, we selected 10 candidate biomarkers from the vascular, immunological, and inflammatory pathways with good evidence supporting their involvement in the pathogenesis of dengue infection – focusing on those likely to be increased early in the disease course. We included vascular cell adhesion molecule-1 (VCAM-1), syndecan-1 (SDC-1), and angiopoietin-2 (Ang-2) because they represent endothelial activation and glycocalyx integrity (Han et al., 2019; Mapalagamage et al., 2020; Suwarto et al., 2017; Yacoub et al., 2016a). For markers of immune activation, we measured interleukin-8 (IL-8) and interferon gamma-induced protein-10 (IP-10) as these are associated with disease severity (Oliveira et al., 2017; Pandey et al., 2015; Rathakrishnan et al., 2012), and IL-1 receptor antagonist (IL-1RA), soluble cluster of differentiation 163 (sCD163), and soluble triggering receptor expressed on myeloid cells-1 (sTREM-1) as these are activation markers of monocytes and macrophages, the major targets for dengue replication (Ab-Rahman et al., 2016; John et al., 2015; S S et al., 2017). For markers of general inflammation, we included ferritin and C-reactive protein (CRP) (Ab-Rahman et al., 2016; Finkelstein et al., 2020; Mukherjee and Tripathi, 2020; Soundravally et al., 2015; Vuong et al., 2020).
The aims of this study were: (1) to investigate the association of these ten biomarkers with development of more severe dengue outcomes, (2) to find the best combination of biomarkers associated with more severe dengue outcomes. The results of the second aim could help in developing multiplex panels for use in outpatient settings to rapidly identify patients who require hospitalization.
Materials and methods
Study design
Request a detailed protocolWe conducted a nested case-control study using the samples and clinical information from a large multi-country observational study named ‘Clinical evaluation of dengue and identification of risk factors for severe disease’ (IDAMS study, NCT01550016) (Jaenisch et al., 2016). The IDAMS study and the blood sample analysis were approved by the Scientific and Ethics Committees of all study sites (Hospital for Tropical Diseases [Ho Chi Minh City, Vietnam] Ref No 03/HDDD-05/01/2018; Angkor Hospital for Children [Siem Reap, Cambodia] Ref No 0146/18-AHC; University of Malaya Medical Centre [Kuala Lumpur, Malaysia] Ref No 201865–6361) and by the Oxford Tropical Research Ethics Committee (OxTREC Ref No 502–18). There were 7428 participants in eight countries across Asia and Latin America enrolled in the IDAMS study. Patients were eligible for inclusion if they were aged 5 years or older, had fever or history of fever for less than 72 hr, and had symptoms consistent with dengue, with no features strongly suggestive of another disease. Participants were followed daily with a standard schedule of clinical examination and blood samples. Individual management (including hospitalization) was in accordance with routine practice at each study site. All diagnostic samples were processed and stored following specific protocols, and later transferred to designated sites for diagnostic testing in order to ensure consistency. Laboratory-confirmed dengue was defined by a positive reverse transcriptase polymerase chain reaction (RT-PCR) or a positive NS1 enzyme-linked immunosorbent assay (ELISA) result. Immune status was classified based on capture IgG results on paired samples. A probable primary infection was defined by two negative IgG results on two consecutive specimens taken at least 2 days apart, with at least one specimen obtained during the convalescent phase (after illness day 5). A probable secondary infection was defined by a positive IgG result identified during either or both the febrile and convalescent phases. In all other cases with the absence of suitable specimens at the appropriate time points immune status was classified as inconclusive. Each participant was given an overall severity grade (severe, moderate, or uncomplicated dengue), using all available information and a grading system in line with current guidelines and recommendations to classify clinical endpoints in dengue clinical trials (Tomashek et al., 2018).
Study population
Request a detailed protocolOf the 2694 laboratory-confirmed dengue cases in the IDAMS study, 38 and 266 cases were classified as severe and moderate dengue respectively. For this study, we selected all severe and moderate cases from five study sites in four countries (Vietnam, Cambodia, Malaysia, and El Salvador), as residual plasma from these countries’ sample sets was available at the Oxford University Clinical Research Unit (OUCRU) in Ho Chi Minh City, Vietnam. For the control group, we selected patients with uncomplicated dengue with similar geographic and demographic characteristics at a 2:1 ratio. In total 281 cases and 556 controls were included in the analysis (Figure 1).
Laboratory evaluation (details in Appendix 1)
Request a detailed protocolThe biomarkers were measured at two time points: at enrollment (illness day 1–3) and after recovery (day 10–31 post-symptom onset), if available. Eight biomarkers (CRP and ferritin excepted) were combined in a premixed magnetic bead panel (Cat No. LXSAHM; R and D). CRP was measured using a separate commercial magnetic bead panel (Cat. No. HCVD3MAG-67K; EMD Millipore Corporation). These panels were analyzed using the Luminex200 analyzer with the Luminex calibration (Cat. No. LX200-CAL-K25) and verification kits (Cat. No. LX200-CON-K25). Ferritin was measured using the Human Ferritin ELISA kit (Cat. No. ARG80501, Arigo). All tests were done according to the manufacturer’s specifications.
Study endpoints (details in Appendix 2)
Request a detailed protocolThe primary endpoint was combined severe and moderate dengue (S/MD), defined by the development of severe or moderate grades of any of the following – plasma leakage, haemorrhage, or organ impairment (including neurologic, hepatic, or cardiac involvement) (Appendix 2—table 1). We combined severe and moderate dengue to form the primary endpoint (S/MD) as severe dengue events were rare; this combined endpoint is relevant to clinical practice since the moderate group is likely to develop complications and therefore may also require medical intervention and hospitalization. We studied three secondary endpoints: severe dengue alone, severe dengue or dengue with warning signs according to the 2009 WHO classification, and hospitalization. These endpoints were selected as they also reflect the disease burden and severity and are generalizable across different settings. The decision to hospitalize was based only on clinical judgement and local guidelines particular to each study site, without use of any biomarker information.
Statistical analysis (details in Appendix 3)
Request a detailed protocolPlasma levels of all biomarkers were transformed to the base-2 logarithm (log-2) before analysis as a right skewed distribution was apparent. We used a logistic regression model for all endpoints. We investigated the non-linear effects of all biomarkers and age on the endpoints, using restricted cubic splines with three knots at the 10th, 50th, and 90th percentiles.
For the first aim, that is to investigate the association of all biomarkers with the primary and secondary endpoints, we performed two different analyses: (1) fitting models for each biomarker separately (‘single models’) and (2) fitting models including all biomarkers together (‘global models’). In the ‘single models’ for a particular biomarker, only that biomarker along with age and their interaction were included, whereas in the ‘global models’ all the biomarkers along with their interactions with age were included. We performed the ‘global model’ in order to investigate the influence of the biomarkers when considering them together and this was also the initial step to develop models for the second aim. Results are reported as odds ratio (OR) and presented graphically.
For the second aim to find the best combination of biomarkers associated with the primary endpoint, we built upon the results from the first aim to fit separate models for children and adults (<15 versus ≥15 years of age), as differences were apparent by age. We used variable selection based on the ‘best subset’ approach (Hastie et al., 2017; Hocking and Leslie, 1967). Briefly, this approach screened all possible combinations of biomarkers and selected the best based on the Akaike information criterion (AIC). We chose AIC as a ranking measurement because it quantifies goodness of fit, while guarding against over-fitting. The marker combination with the lowest AIC was taken as the best. From an ‘initial model’ including all biomarkers, we determined the best general combination and the best combinations of 2, 3, 4, and 5 biomarkers. We then performed a bootstrap procedure to check the robustness (stability) of the selected models. For this we resampled 1000 times with replacement from the original dataset. For each of these 1000 bootstrap samples, we performed the ‘best subset’ procedure similar to above to determine the best combination. We calculated the selection frequency of each marker combination over the 1000 samples. The frequency of the combination that was selected when using the original dataset in relation to the other combinations characterizes robustness of the selection.
We carried out several sensitivity analyses. First, we fitted the single and global models taking into account potential differences between serotypes by including serotype variable along with its interaction with the biomarkers. Second, we included viremia (viral RNA measured by RT-PCR) levels as an additional biomarker and performed the single model, global model and best subset procedure. Higher viremia levels have been associated with worse disease outcomes; however, viral load was not considered in the main analysis as the focus was on host markers with the potential for combining in a biomarker rapid test.
All analyses were done using the statistical software R version 3.6.3 (R Core Development Team, 2020) and the packages ‘rms’ (Harrell Jr, 2019), ‘MuMIn’ (Bartoń, 2020) and ‘ggplot2’ (Wickham, 2016). The code is available on GitHub (Vuong, 2021b; copy archived at swh:1:rev:847d8e0f564eeb3f075b443205fb3384598bc2b4).
Results
Patient characteristics
The majority of the patients were from Vietnam (640 cases, 76%). Median (1st, 3rd quartiles) age of the case and control groups were 12 (9, 22) and 16 (10, 24) years. Among the S/MD group, 127 cases (45%) were children and 154 cases (55%) were adults. Male gender was predominant (60% and 54% in the case and control groups respectively). Serotype distribution was similar between the S/MD and control groups, with DENV-1 predominating (42%), particularly in children (48%). Host immune status however differed: there was a higher proportion of secondary infections in the S/MD group compared with controls (78% versus 64%, respectively) and this was consistent in both children and adults. The S/MD had a slightly lower percentage of obese patients than the control group (10% versus 14%). As expected, hospitalization was more common in the S/MD group (57% versus 31%) (Table 1). Overall, 38 patients developed severe dengue, most were severe plasma leakage (33/38 cases, 87%) and 29/38 (76%) were children. Most of the moderate dengue cases were plasma leakage and/or hepatic involvement (Appendix 4—table 1).
Biomarker levels
On average, the patients who progressed to S/MD had higher levels of the biomarkers in both children and adult patients, both at enrollment and at follow-up (Figure 2, Appendix 4—table 2). For most individuals, the levels of five biomarkers (VCAM-1, IL-8, IP-10, IL-1RA, and CRP) decreased between enrollment and follow-up, whereas SDC-1 increased slightly and the other markers showed no clear trends (Appendix 4—figure 1). In some of the cases the biomarkers did not return to normal at convalescence. Moderate-to-strong positive correlations were evident for some markers, in particular IP-10 and IL-1RA, and IP-10 and VCAM-1, both with Spearman’s rank correlation coefficients above 0.6 (Appendix 4—figure 2).
Associations between biomarker levels and the endpoints
In the single models, higher levels of each biomarker on illness days 1, 2, or 3 increased the risk of developing S/MD, with the exception of ferritin in adults where there was a downward trend at higher values (Figure 3, Table 2). We observed differences between children and adults for several biomarkers, the most pronounced being SDC-1, IL-8, ferritin, and IL-1RA. Associations between SDC-1 and IL-8 and the S/MD endpoint were stronger in adults than children, while the effects of IL-1RA and ferritin were stronger in children than adults.
In the global model there were some differences compared to the single models (Figure 3, Table 2). The biomarkers SDC-1 and IL-1RA were the most stable relative to the single models for both children and adults. However, for IP-10 the trend of the association with S/MD changed from positive to negative in both children and adults. In children, VCAM-1 changed the trend from positive to weakly negative and IL-8 changed the trend from weakly positive to negative. Other biomarkers showed weaker associations with the endpoint in the global model based on the ORs. In addition, the differences of the associations between children and adults were more marked, particularly for Ang-2, IL-8, and ferritin.
The sensitivity analysis showed that the association between the biomarkers and S/MD did not differ between DENV-1 and other serotypes (Appendix 5—figure 1; Appendix 5—figure 2; Appendix 5—table 1; Appendix 5—table 2). Similar patterns were observed in the various analyses related to the secondary endpoints, as described in detail in the Appendix 6 (Appendix 6—figure 1; Appendix 6—figure 2, Appendix 6—table 1; Appendix 6—table 2, Appendix 6—table 3).
Best combinations of biomarkers associated with the primary endpoint
For children, the best subset that showed the clearest association with S/MD was the combination of the six markers IL-1RA, Ang-2, IL-8, ferritin, IP-10, and SDC-1 with an AIC of 465.9. This model was selected most often in the bootstrap procedure, but was not highly robust (it was selected in 134 of the 1000 samples) (Table 3, Appendix 7—table 1). Over the 1000 samples, the six variables had an inclusion frequency ranging from 73.5% for SDC-1 to 100% for IL-1RA. The most important biomarkers in order were IL-1RA, Ang-2, IL-8, and ferritin (Appendix 7—table 2). The best combination of two biomarkers was IL-1RA and ferritin, the best of three added Ang-2, the best of four added IP-10, and the best of five added IL-8. The best combinations of two and five variables were most robust with a selection percentage of 43.7% and 44%. The best of five had almost the same AIC as the best subset of six markers (467.6 versus 465.9) (Table 3). The coefficients of the selected biomarkers were similar to the initial model estimates (Appendix 7—table 2).
For adults, the best subset included the seven markers SDC-1, IL-8, ferritin, sTREM-1, IL-1RA, IP-10, and sCD163. This model was selected 79 times among 1000 bootstrap samples, but still was selected more often than the other models (Table 4, Appendix 7—table 3). Over the 1000 samples, the seven variables had a bootstrap inclusion frequency ranging from 59.1% for sCD163 to 99.2% for SDC-1. The three most important biomarkers in order were SDC-1, IL-8, and ferritin (Appendix 7—table 4). The best combination of two biomarkers included SDC-1 and IL-8, the best of three added ferritin, the best of four added IL-1RA, and the best of five added sTREM-1. The best combination of two was the most robust with a selection percentage of 56.7%, followed by the best of three variables (43.2%) (Table 4). The coefficients of the selected markers were also similar to the initial model estimates (Appendix 7—table 4).
In the sensitivity analysis, viremia was not selected in any of the best combinations for children, and the marker combinations remained the same as the main analysis. For adults, the best subset included five markers SDC-1, IL-8, ferritin, viremia and sCD163. The best of two and three were the same as the main analysis; viremia was selected in the best of four and five (Appendix 8—figure 1; Appendix 8—table 1; Appendix 8—table 2; Appendix 8—table 3).
Discussion
This nested case-control study has shown that a range of endothelial, immune activation and inflammatory biomarkers measured during the early febrile phase of dengue are associated with progression to worse clinical outcomes in both children and adults. In children we found IL-1RA to have the most robust association with S/MD, whereas in adults we found SDC-1 and IL-8 to have the most robust association. For children, the best combination (ordered by robustness) included six biomarkers IL-1RA, Ang-2, IL-8, ferritin, IP-10, and SDC-1; for adults the best combination identified comprised seven biomarkers SDC-1, IL-8, ferritin, sTREM-1, IL-1RA, IP-10, and sCD163.
Our results add to the current literature on biomarkers in severe/moderate dengue compared with uncomplicated dengue, by including early time-points prior to the development of the severe manifestations, as well as providing data on the use of biomarker combinations, which takes into consideration the complex inflammatory-vascular pathogenesis of severe dengue. We observed that there were marked changes in the associations between individual biomarkers and outcomes when considering them together, while other biomarkers showed consistent associations. Particularly, the association of IP-10 with S/MD changed significantly from the single to global model, which may be because another biomarker in our model is a mediator or confounder of IP-10 in the pathway to the outcome. This could be IL-1RA as its association with S/MD was similar between the single and global model, and the correlation between IP-10 and IL-1RA was strong (Spearman’s rank correlation coefficient was 0.75). Nonetheless, changing the direction of the association from the single to global model does not diminish the possibility of that biomarker being selected in the best combinations.
Our study also demonstrates some key differences between pediatric and adult dengue. Clinical phenotypes of dengue in children and adults differ, with children experiencing more shock and adults more organ impairment and bleeding, with distinct clinical management guidelines published by the WHO. Our results imply dengue pathogenesis may differ by age, with distinct combinations of immune-activation and vascular markers demonstrated between children and adults. Specifically, the association of IL-8 and ferritin differed between children and adults, which is likely to be due to the composite endpoint of severe and moderate dengue. As shown in the analysis of severe dengue alone (Appendix 4—figure 1, Appendix 4—table 1), the effects of IL-8 and ferritin were similar in children and adults, which suggests these biomarkers are still associated with severe disease in all age groups and that the difference is driven by the moderate dengue group. In addition, uncomplicated dengue in adults have higher ferritin levels compared to in children, with increasing age and chronic conditions in adults likely contributing to this observation. Hence patients’ age should be considered when developing biomarker panels for dengue risk prediction.
The use of biomarker panels for the prediction of severe outcomes in dengue has been investigated in previous studies, using several statistical approaches (Brasier et al., 2012; Conroy et al., 2015; Ju and Brasier, 2013; Lee et al., 2016; Pang et al., 2016). However, because of small sample size and differences in the biomarkers assessed, the associations found vary between studies and as yet there are no validated prognostic panels for dengue. Dengue cases are forecasted to increase over the next few decades and, given the limited healthcare resources available in many endemic settings, particularly during epidemics, there is an urgent need to develop innovative methods to rapidly identify patients likely to develop complications and require hospital care (Rodriguez-Manzano et al., 2018). Previously, we showed that CRP as a single biomarker was useful for early dengue diagnosis and risk identification, which is currently easy to use in all settings (Vuong et al., 2020). Recently, we also showed that higher plasma viremia was associated with increased dengue severity regardless of age, serotype and immune status of patients (Vuong et al., 2021a). However, future point-of-care testing could be improved by using a combination of biomarkers outlined in this study. Our results are applicable to the development of point-of-care panels capable of multiplex analysis and suited for use in outpatient settings for dengue prognosis, with scope for incorporation with innovative point-of-care technologies. To be more applicable by balancing model fit, robustness, and parsimony, we suggest the combination of five biomarkers IL-1RA, Ang-2, IL-8, ferritin, and IP-10 for children, and the combination of three biomarkers SDC-1, IL-8, and ferritin for adults to be used in practice. These combinations had a similar AIC with the best combinations (the difference of AIC was less than 5), but they required fewer number of biomarkers in a test panel. With the advent of novel technologies including microarray platforms and multiplex lateral flow assays, the cost is likely to come down in the future, allowing for wide-spread use in low-to-middle-income countries.
Methods of variable selection have been discussed previously but there remains no clear consensus regarding the best approach (Heinze et al., 2018; Sauerbrei et al., 2020). We adopted a data-driven ‘best subset’ approach which we think offers advantages over other methods, given the complexity of the biomarkers involved and their interactions. We also explored other approaches for variable selection (Heinze et al., 2018; Piironen and Vehtari, 2017; Sauerbrei et al., 2020) and the results were very similar to the best subset procedure (Appendix 9—table 1; Appendix 9—table 2).
Strengths of our study include the large sample size and use of a nested case-control dataset from a prospective multi-country cohort study with consistent data collection and standardized outcome definitions and laboratory methodologies. The biomarker panel we selected was guided by pathogenesis studies, focusing on pathways activated early in the disease course, thus ensuring clinical relevance.
There are some limitations in our study. One being we analysed the biomarkers at only one time-point in the early phase; limited financial resources did not allow us to evaluate the full range of biomarkers across the whole IDAMS population and at more time-points. Secondly, this study was not designed to build prediction models so we did not use a measure of predictive value as a criterion, which was motivated by the nested case-control design. Our findings need to be validated in new studies.
In conclusion, higher levels of the ten biomarkers (VCAM-1, SDC-1, Ang-2, IL-8, IP-10, IL-1RA, sCD163, sTREM-1, ferritin, and CRP), when considered individually, are associated with increased risk of adverse clinical outcomes in both children and adults with dengue. The best biomarker combination for children includes IL-1RA, Ang-2, IL-8, ferritin, IP-10, and SDC-1; for adults, SDC-1, IL-8, ferritin, sTREM-1, IL-1RA, IP-10, and sCD163 were selected. These findings serve to assist the development of biomarker panels to improve future triage and early assessment of dengue patients. This would aid not only individual patient management and facilitate healthcare allocation which would be of major public health benefit especially in outbreak settings, but could also serve as potential biological endpoints for dengue clinical trials.
Appendix 1
Laboratory evaluation of the ten biomarkers
All research blood samples enrolled at different study sites were processed at site laboratories within one hour after drawn from participants with the same procedure. The blood samples were centrifuged at 500 g/min in 10 min at 4°C, collected plasma, and stored at −20°C. The specimens enrolled from international sites were transported on dry ice to the Oxford University Clinical Research Unit (OUCRU) laboratory by worldwide couriers. Biomarker levels were measured on these stored samples at two time-points: enrollment sample (illness day 1–3) and follow-up (day 10–31 post symptom onset) using the quantitative magnetic bead assays and enzyme-linked immunosorbent assays (ELISAs).
Eight biomarkers (VCAM-1, SDC-1, Ang-2, IL-8, IP-10, IL-1RA, sCD163, and sTREM-1) combined in a premixed magnetic bead panel (Cat No. LXSAHM; R and D) was selected to investigate these interested targets. A commercial kit used for CRP level measurements was Human Cardiovascular Disease (CVD) Magnetic Bead Panel 3 (Cat. No. HCVD3MAG-67K) produced by EMD Millipore Corporation. Each assay had two quality controls (low and high levels) which was acquired along with the standards and unknown specimens.
The xPonent 3.1 software installed in the Luminex200 analyzer was used to acquire and analyze the data of the magnetic luminex assays. The system was calibrated daily using the Luminex calibration (Cat. No. LX200-CAL-K25) and verification kits (Cat. No. LX200-CON-K25). Equipment settings included probe height adjustment, number of events for each analyte, sample size, gate settings, and bead set were followed as the kit’s instruction. A background was set up using assay buffer instead of sample in all luminex assays.
As recommended by manufacturers, the magnetic bead assays were performed using samples with less than two freeze/thaw cycles and the samples after thawed completely were centrifuged to remove particles prior to use in the assays. The samples were diluted at the different dilutions in order to fall within the standard curve range in each assay.
The magnetic bead assays were designed in multiplex sandwich ELISAs. The magnetic microparticles pre-coated with specific antibodies were pipetted into the wells containing standards or controls or diluted samples and the immobilized antibodies bound the analytes of interest for two hours incubation at room temperature or overnight (16–18 hr) at 4°C on a shaker. Then, these analytes were detected specifically by a secondary biotinylated antibody cocktail during the next incubation. After being washed to remove any unbound antibody, the streptavidin-phycoerythrin conjugate was added to bind to the biotinylated antibody. Finally, the microparticles were re-suspended in buffer and read using the Luminex200 analyzer. The microparticles were re-suspended immediately prior to reading by shaking the plate for two minutes on the shaker.
Ferritin levels were measured separately using Human Ferritin ELISA kit (Cat. No. ARG80501, Arigo). This assay is a quantitative sandwich ELISA. An antibody specific for Ferritin was pre-coated onto a microplate. Standard or samples were pipetted into the wells and any Ferritin present was bound by the immobilized antibody. After washing away any unbound substances, a horseradish peroxidase (HRP) conjugated antibody specific for ferritin was added to each well and incubated. A substrate solution (3,3′,5,5′-tetramethylbenzidine [TMB]) was then added to the wells and color developed in proportion to the amount of ferritin bound in the initial step. The color development was stopped by addition of acid and the intensity of the color was measured by a wavelength of 450 nm. The concentration of ferritin in the sample was then determined by comparing the optical density of samples to the standard curve.
Appendix 2
Clinical endpoint definition
Appendix 3
Statistical analysis
Treatment of values lower than the limit of detection
There were several biomarker values lower than the limit of detection (LOD): 9% for VCAM-1, 5% for Ang-2, 1% for IP-10 and sTREM-1,<1% for IL-8 and sCD163, and none for SDC-1, IL-1RA, ferritin, and CRP. All of them were set to the LOD and a dummy binary variable (Yes/No) was created for each biomarker to describe whether the value was lower than the LOD or not. In all models for the first aim (to investigate the association of biomarkers with clinical outcomes), for each biomarker that had values below the LOD, we included the binary variable ‘<LOD’ as a covariate.
Analysis of the secondary endpoints: case-control setting
Since cases and controls were selected based on the primary endpoint, in the analyses of the secondary endpoints we lose the case-control distinction. We used inverse probability weighting (IPW) to correct for different inclusion probabilities between controls and cases in our data set (Tchetgen Tchetgen, 2014; Schifano, 2019): the weight of all cases was 1, while the weight of the controls was the inverse of the inclusion probability in each country (Vietnam: 1301/436; Cambodia: 272/39; Malaysia: 230/58; and El Salvador: 288/23). A robust (sandwich) estimate of the standard error was used for estimating 95% confidence intervals. For the severe dengue (SD) endpoint, the non-linear effect was not considered because of the low number of events.
Analysis to find the best combination of biomarkers to predict the primary endpoint (aim #2)
The results from the ‘single models’ and ‘global model’ in the first aim showed that the association between the biomarkers and the primary endpoint differed by age. We therefore performed the analysis separately for children (<15 years of age) and adults (≥15 years of age). The procedure was done in two steps. In step #1 we built an ‘initial model’ including all biomarkers, but possibly with less flexible structure than the global model. In step #2 we determined the best combination of biomarkers from the initial models defined in step #1.
Step #1: As the number of primary endpoint events was limited (127 in children and 154 in adults), we tried to keep the events-per-variable (EPV) at more than 10 by including only important terms (all the ten biomarkers but only some of the non-linear trends and binary variables that represent values < LOD) (Heinze et al., 2018). For each biomarker, we fitted and compared four logistic regression models:
model with the biomarker with a linear effect as the only covariate: logit(Y) = α + β*X
model with the biomarker with a non-linear effect using restricted cubic splines (as in the single and global model): logit(Y) = α + β1*spline(X)1 + β2*spline(X)2
model with the biomarker with a linear effect and the dummy binary variable for value <LOD: logit(Y) = α + β*X + γ*(X < LOD)
model with the biomarker with a non-linear effect and the dummy binary variable for value <LOD: logit(Y) = α + β1*spline(X)1 + β2*spline(X)2 + γ*(X < LOD)
Y is the primary endpoint, X is a biomarker
We calculated and compared the Akaike information criterion (AIC) of these four models and included the non-linear effect and/or additional binary variable of values < LOD only if it had the lowest AIC and this value was at least five lower than for model (1). The AICs of these models are summarized in the table below:
Biomarker | Children | Adults | |||||||
---|---|---|---|---|---|---|---|---|---|
model1 | model2 | model3 | model4 | model1 | model2 | model3 | model4 | ||
VCAM-1 | 530.8 | 531.3 | 530.6 | 532.6 | 499.8 | 496.7 | 501.3 | 496.4 | |
SDC-1 | 537.9 | 538.0 | - | - | 459.5 | 461.0 | - | - | |
Ang-2 | 511.0 | 509.6 | 512.5 | 509.7 | 493.5 | 490.8 | 493.3 | 492.8 | |
IL-8 | 548.5 | 549.0 | 548.1 | 546.8 | 457.7 | 457.8 | 456.5 | 457.8 | |
IP-10 | 521.2 | 517.2 | 523.0 | 518.3 | 500.7 | 492.6 | 502.5 | 494.5 | |
IL-1RA | 492.9 | 494.9 | - | - | 493.5 | 494.2 | - | - | |
sCD163 | 531.9 | 533.2 | 531.9 | 533.2 | 497.6 | 499.3 | 499.5 | 501.1 | |
sTREM-1 | 545.7 | 544.2 | 545.6 | 545.4 | 507.8 | 509.5 | 507.0 | 505.0 | |
Ferritin | 542.6 | 544.4 | - | - | 509.3 | 505.2 | - | - | |
CRP | 536.7 | 536.4 | - | - | 505.1 | 506.8 | - | - |
-
The selected models are in bold face.
The initial model for children included all biomarkers as a linear term without any binary variable for values < LOD, and the final initial model for adults included IP-10 with a non-linear term and all the other biomarkers with a linear term, again without any binary variable for values < LOD. The number of parameters of the initial model was 10 and 11 for children and adults; the EPV was then 12.7 and 14 respectively.
Step #2: From the ‘initial model’, we performed several approaches to find the best combination of biomarkers associated with the primary endpoint.
The primary method was the ‘best subset’ approach, in which all possible subsets of biomarkers (210 = 1024 subsets) were evaluated and compared via the AIC. The subset with the lowest AIC was selected as the best subset, we also determined the best subset of exactly 2, 3, 4, and five biomarkers.
We also performed other approaches to investigate whether they gave similar results. These included backward elimination, forward selection, stepwise forward, stepwise backward, augmented backward elimination, and Bayesian projection variable selection (Heinze et al., 2018; Piironen and Vehtari, 2017; Sauerbrei et al., 2020).
Checking model robustness by bootstrap resampling
To check the robustness (stability) of the selected ‘best subset’ model, we used a bootstrap procedure by resampling with replacement from the original data set (1000 times). For each bootstrap sample, we performed the ‘best subset’ approach (similar to step #2 above) to determine the best model based on the lowest AIC. From the 1000 samples we calculated Heinze et al., 2018:
Inclusion frequency for each of the ten biomarkers
The root mean squared difference (RMSD) ratio of each regression coefficient. The root mean squared difference is computed between the 1000 estimates of the regression coefficient after the best subset selection and its value in the initial model (which includes all 10 biomarkers and is estimated on the original data).
is the estimate of parameter j in bootstrap sample b
is the estimate of parameter j based on the initial model
is the number of bootstrap samples (1000)
The RMSD ratio is the RMSD divided by the standard error of that coefficient in the initial model.
Relative bias conditional on selection for each parameter
is the mean bootstrapped estimate of the parameter
is the initial model estimate of the parameter
BIF is the bootstrap inclusion frequency of the corresponding biomarker
The selection frequencies for the finally selected model and the 20 most frequent selected models
The median and the 2.5th and 97.5th percentiles of the regression coefficient of each biomarker.
In ii, iii and v, the value of a parameter was set at zero if the marker was not selected.
Appendix 4
Additional descriptive analysis
Appendix 5
Results for primary endpoint in DENV-1 and other serotypes
As DENV-1 is predominant in this study (42% of all cases), we performed a sensitivity analysis taking into account potential differences of the association between the biomarkers and the primary endpoint. For this analysis, we performed the single and global models similar to the main analysis, plus including the interaction between the biomarkers and serotype. Serotype was treated as a binary variable with values of DENV-1 and non-DENV-1 due to the limited number of outcomes (severe/moderate dengue). We also performed the analysis with the four serotypes (DENV-1, 2, 3 and 4) but the results were not certain (confidence intervals were wide) as the limited sample size (results are not presented).
Below are the results from the single models (Appendix 5—figure 1, Appendix 5—table 1) and global model (Appendix 5—figure 2, Appendix 5—table 2). The results are reported separately for DENV-1 and other serotypes, and for children and adults. Overall, there was no significant difference between DENV-1 and the others, in both the single and global models. These results suggest that the association between biomarkers and clinical outcome is similar in patients infected with different DENV serotypes.
Appendix 6
Results for secondary endpoints
In the single models, higher levels of the biomarkers generally increased the risk of developing severe dengue (SD), however, as the number of events was small, the confidence intervals (CIs) were wide and the association was not certain (Appendix 6—figure 1, Appendix 6—table 1). For severe dengue or dengue with warning signs (SD/DWWS) and hospitalization endpoints, the associations were similar to the primary endpoint, apart for sCD163, sTREM-1, and CRP (Appendix 6—figure 2, Appendix 6—figure 3, Appendix 6—table 2, Appendix 6—table 3) – these biomarkers did not show an association with the endpoints. Moreover, the odds ratios (ORs) of SD/DWWS and hospitalization were generally lower than of severe or moderate dengue (S/MD) for every 2-fold difference in biomarker levels.
The difference between the global and single models in the analysis of secondary endpoints was similar to in the primary endpoint. The most stable biomarkers were SDC-1 and IL-1RA, while IP-10 markedly changed the trend of the association with the endpoints; others showed a weaker association.
Appendix 7
Results from bootstrap resampling to check model robustness
Appendix 7—table 1, Appendix 7—table 2, Appendix 7—table 3, Appendix 7—table 4 show the robustness (stability) of the selected models. The best subset models for children and adults based on the original data ranked first (Appendix 7—table 1, Appendix 7—table 3), but they were selected in only 13.4% and 7.9% of the resamples, indicating the instability of these models. The almost equal inclusion frequencies of the models ranked next suggest that there are many competing models of the selected one. Variable selection also added to uncertainty about the regression coefficients of the parameters, which is evidenced by the RMSD ratio of more than one in most of the biomarkers, except for sTREM-1 (0.92) and CRP (0.88) in children (Appendix 7—table 2 and Appendix 7—table 4). Regarding relative conditional bias, which quantifies expected bias induced by variable selection of a parameter when it is selected, it is quite small for the first 3–4 selected parameters (IL-1RA, Ang-2, IL-8, and ferritin for children, and SDC-1, IL-8, and ferritin for adults), all of which have bootstrap inclusion percentages greater than 90%. This bias is much higher in the parameters for which selection is less certain. The bootstrap median and percentiles of the regression coefficients of the biomarkers reflect the variability of the coefficients over the different models selected in the bootstrap samples. The coefficients of the selected parameters from the initial estimates and the bootstrap median were very similar, suggesting no selection bias in the selected model.
Appendix 8
Results when including viremia as a potential biomarker
We included plasma viremia (plasma viral RNA) levels along with the ten biomarkers and performed analyses similar to the main analyses.
The single and global models showed that higher viremia was associated with increased risk of severe or moderate dengue (Appendix 8—figure 1, Appendix 8—table 1). The association was relatively linear with log-10 viremia levels and was not different between children and adults. This finding is similar to our previous study which shows that higher plasma viremia levels are associated with increased more severe outcome in dengue infection, regardless of age, serotype and host immune status (Vuong et al., 2021a). Results of the association between viremia and the endpoint were similar between the single and global models. In addition, including viremia to the global model did not affect markedly to the results of other biomarkers. This suggests that viremia and the other ten biomarkers might not be confounders or intermediate variables of each other in the association with severe or moderate dengue outcome.
Results from the ‘best subset’ procedure when including viremia as a potential biomarker showed that viremia was not selected in any of the best combinations in children. The results for children were the same with the main analysis (Appendix 8—table 2). For adults, the selection resulted differently: the best of all combinations included five biomarkers SDC-1, IL-8, ferritin, viremia and sCD163. The best combinations of 2 and 3 variables were the same with the main analysis. Viremia was selected in the best combination of 4 and 5 biomarkers (Appendix 8—table 3).
Appendix 9
Results of variable selection using different approaches
Data availability
All data generated or analysed during this study have been deposited in the Oxford Research Archive (ORA) at https://doi.org/10.5287/bodleian:JN2wXDpjq and all code has been deposited on GitHub at https://github.com/Nguyenlamvuong/eLife_Biomarkers_Dengue_2021 copy archived at https://archive.softwareheritage.org/swh:1:rev:847d8e0f564eeb3f075b443205fb3384598bc2b4.
-
Oxford Research ArchiveCombination of inflammatory and vascular markers in the febrile phase of dengue is associated with more severe outcomes.https://doi.org/10.5287/bodleian:JN2wXDpjq
References
-
Macrophage activation Syndrome-Associated markers in severe dengueInternational Journal of Medical Sciences 13:179–186.https://doi.org/10.7150/ijms.13680
-
A three-component biomarker panel for prediction of dengue hemorrhagic feverThe American Journal of Tropical Medicine and Hygiene 86:341–348.https://doi.org/10.4269/ajtmh.2012.11-0469
-
Mapping global variation in dengue transmission intensityScience Translational Medicine 12:eaax4144.https://doi.org/10.1126/scitranslmed.aax4144
-
Host biomarkers are associated with progression to dengue haemorrhagic fever: a nested case-control studyInternational Journal of Infectious Diseases 40:45–53.https://doi.org/10.1016/j.ijid.2015.07.027
-
Quantitative comparative proteomics reveal biomarkers for dengue disease severityFrontiers in Microbiology 10:2836.https://doi.org/10.3389/fmicb.2019.02836
-
Variable selection - A review and recommendations for the practicing statisticianBiometrical Journal 60:431–449.https://doi.org/10.1002/bimj.201700067
-
Biomarkers of severe dengue disease - a reviewJournal of Biomedical Science 22:83.https://doi.org/10.1186/s12929-015-0191-6
-
Markers of dengue severity: a systematic review of cytokines and chemokinesJournal of General Virology 97:3103–3119.https://doi.org/10.1099/jgv.0.000637
-
An in-depth analysis of original antigenic sin in dengue virus infectionJournal of Virology 85:410–421.https://doi.org/10.1128/JVI.01826-10
-
Dengue virus NS1 protein activates cells via Toll-like receptor 4 and disrupts endothelial cell monolayer integrityScience Translational Medicine 7:304ra142.https://doi.org/10.1126/scitranslmed.aaa3863
-
Comparison of bayesian predictive methods for model selectionStatistics and Computing 27:711–735.https://doi.org/10.1007/s11222-016-9649-y
-
SoftwareA language and environment for statistical computingR Foundation for Statistical Computing, Vienna, Austria.
-
Risk factors and biomarkers of severe dengueCurrent Opinion in Virology 43:1–8.https://doi.org/10.1016/j.coviro.2020.06.008
-
Dengue: Status of current and under-development vaccinesReviews in Medical Virology 30:e2101.https://doi.org/10.1002/rmv.2101
-
Towards Predicting Progression to Severe DengueTrends in Microbiology 28:478–486.https://doi.org/10.1016/j.tim.2019.12.003
-
Improving Dengue Diagnostics and Management Through Innovative TechnologyCurrent Infectious Disease Reports 20:25.https://doi.org/10.1007/s11908-018-0633-x
-
Increased serum levels of macrophage activation marker sCD163 in dengue patientsJournal of Clinical Virology : The Official Publication of the Pan American Society for Clinical Virology 86:62–67.https://doi.org/10.1016/j.jcv.2016.10.009
-
State of the art in selection of variables and functional forms in multivariable analysis-outstanding issuesDiagnostic and Prognostic Research 4:3.https://doi.org/10.1186/s41512-020-00074-3
-
A review of analysis methods for secondary outcomes in case-control studiesCommunications for Statistical Applications and Methods 26:103–129.https://doi.org/10.29220/CSAM.2019.26.2.103
-
New insights into the immunopathology and control of dengue virus infectionNature Reviews Immunology 15:745–759.https://doi.org/10.1038/nri3916
-
Association of endothelial glycocalyx and tight and adherens junctions with severity of plasma leakage in dengue infectionThe Journal of Infectious Diseases 215:992–999.https://doi.org/10.1093/infdis/jix041
-
Development of standard clinical endpoints for use in dengue interventional trialsPLOS Neglected Tropical Diseases 12:e0006497.https://doi.org/10.1371/journal.pntd.0006497
-
Multivariate time-series analysis of biomarkers from a dengue cohort offers new approaches for diagnosis and prognosisPLOS Neglected Tropical Diseases 14:e0008199.https://doi.org/10.1371/journal.pntd.0008199
-
SoftwareeLife_Biomarkers_Dengue_2021, version swh:1:rev:847d8e0f564eeb3f075b443205fb3384598bc2b4Software Heritage .
-
Global warming and arboviral infectionsClinical Medicine 19:149–152.https://doi.org/10.7861/clinmedicine.19-2-149
-
WebsiteStrong country capacity, improved tools and community engagement critical to enhancing dengue prevention and controlAccessed May 14, 2021.
-
Disease appearance and evolution against a background of climate change and reduced resourcesPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 369:1719–1729.https://doi.org/10.1098/rsta.2011.0013
-
Association of microvascular function and endothelial biomarkers with clinical outcome in dengue: an observational studyJournal of Infectious Diseases 214:697–706.https://doi.org/10.1093/infdis/jiw220
-
Endothelial nitric oxide pathways in the pathophysiology of dengue: a prospective observational studyClinical Infectious Diseases 65:1453–1461.https://doi.org/10.1093/cid/cix567
-
Aberrant monocyte responses predict and characterize dengue virus infection in individuals with severe diseaseJournal of Translational Medicine 15:121.https://doi.org/10.1186/s12967-017-1226-4
Article and author information
Author details
Funding
European Union Seventh Framework Programme (FP7-281803 IDAMS)
- Thomas Jaenisch
World Health Organization (UNICEF/UNDP/ World Bank/WHO Special Programme for Research and Training in Tropical Diseases)
- Sophie Yacoub
Bill and Melinda Gates Foundation (The Global Good Fund I, LLC at Intellectual Ventures)
- Sophie Yacoub
Wellcome Trust (106680/Z/14/Z)
- Ronald B Geskus
- Sophie Yacoub
Wellcome Trust (215010/Z/18/Z)
- Damien Keng Yen Ming
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We acknowledge all the patients who took part in this study and the medical and nursing staff who looked helped in their management, at all the participating hospitals in Vietnam, Cambodia, Malaysia, and El Salvador. This work was supported by the European Union’s Seventh Framework Programme for research, technological development and demonstration (grant FP7-281803 IDAMS; http://www.idams.eu; publication reference number IDAMS: 53), and by the World Health Organization, UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases, and by the Bill and Melinda Gates Foundation Trust through The Global Good Fund I, LLC at Intellectual Ventures. The funders had no role in the study design, data collection and analysis, or preparation of the manuscript. The authors alone are responsible for the views expressed in this article and they do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated.
Ethics
Human subjects: The study and the blood sample analysis were approved by the Scientific and Ethics Committees of all study sites (Hospital for Tropical Diseases [Ho Chi Minh City, Vietnam] Ref No 03/HDDD-05/01/2018; Angkor Hospital for Children [Siem Reap, Cambodia] Ref No 0146/18-AHC; University of Malaya Medical Centre [Kuala Lumpur, Malaysia] Ref No 201865-6361) and by the Oxford Tropical Research Ethics Committee (OxTREC Ref No 502-18).
Copyright
© 2021, Vuong et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 3,063
- views
-
- 411
- downloads
-
- 18
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF and Executable version)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Medicine
- Microbiology and Infectious Disease
- Epidemiology and Global Health
- Immunology and Inflammation
eLife has published articles on a wide range of infectious diseases, including COVID-19, influenza, tuberculosis, HIV/AIDS, malaria and typhoid fever.
-
- Medicine
- Microbiology and Infectious Disease
Background:
Under which conditions antibiotic combination therapy decelerates rather than accelerates resistance evolution is not well understood. We examined the effect of combining antibiotics on within-patient resistance development across various bacterial pathogens and antibiotics.
Methods:
We searched CENTRAL, EMBASE, and PubMed for (quasi)-randomised controlled trials (RCTs) published from database inception to 24 November 2022. Trials comparing antibiotic treatments with different numbers of antibiotics were included. Patients were considered to have acquired resistance if, at the follow-up culture, a resistant bacterium (as defined by the study authors) was detected that had not been present in the baseline culture. We combined results using a random effects model and performed meta-regression and stratified analyses. The trials’ risk of bias was assessed with the Cochrane tool.
Results:
42 trials were eligible and 29, including 5054 patients, qualified for statistical analysis. In most trials, resistance development was not the primary outcome and studies lacked power. The combined odds ratio for the acquisition of resistance comparing the group with the higher number of antibiotics with the comparison group was 1.23 (95% CI 0.68–2.25), with substantial between-study heterogeneity (I2=77%). We identified tentative evidence for potential beneficial or detrimental effects of antibiotic combination therapy for specific pathogens or medical conditions.
Conclusions:
The evidence for combining a higher number of antibiotics compared to fewer from RCTs is scarce and overall compatible with both benefit or harm. Trials powered to detect differences in resistance development or well-designed observational studies are required to clarify the impact of combination therapy on resistance.
Funding:
Support from the Swiss National Science Foundation (grant 310030B_176401 (SB, BS, CW), grant 32FP30-174281 (ME), grant 324730_207957 (RDK)) and from the National Institute of Allergy and Infectious Diseases (NIAID, cooperative agreement AI069924 (ME)) is gratefully acknowledged.