Abstract
Several countries have reported that deaths with a primary code of cancer did not rise during COVID-19 pandemic waves compared to baseline pre-pandemic levels. This is in apparent conflict with findings from cohort studies where cancer has been identified as a risk factor for COVID-19 mortality. Here we further elucidate the relationship between cancer mortality and COVID-19 on a population level in the US by testing the impact of death certificate coding changes during the pandemic and leveraging heterogeneity in pandemic intensity across US states. We computed excess mortality from weekly deaths during 2014-2020 nationally and for three states with distinct COVID-19 wave timing (NY, TX, and CA). We compared pandemic-related mortality patterns from underlying and multiple cause (MC) death data for six types of cancer and compared to that seen for chronic conditions such as diabetes and Alzheimer’s. Any death certificate coding changes should be eliminated by study of MC data.
Nationally in 2020, we found only modest excess MC cancer mortality (∼13,600 deaths), representing a 3% elevation over baseline level. Mortality elevation was measurably higher for less deadly cancers (breast, colorectal, and hematologic, 2-7%) than cancers with a poor 5-year survival (lung and pancreatic, 0-1%). In comparison, there was substantial elevation in MC deaths from diabetes (37%) and Alzheimer’s (19%). Homing in on the intense spring 2020 COVID-19 wave in NY, mortality elevation was 1-16% for different types of cancer and 128% and 49% for diabetes and Alzheimer’s, respectively. To investigate the peculiar absence of excess mortality on deadly cancers, we implemented a demographic model and simulated the expected covid-related mortality using COVID-19 attack rates, life expectancy, population size and mean age for each chronic condition. This model indicates that these factors largely explain the considerable differences in observed excess mortality between these chronic conditions during the COVID-19 pandemic, even if cancer had increased the relative risk of mortality by a factor of 2 or 5.
In conclusion, we found limited elevation in cancer mortality during COVID-19 waves, even after considering MC mortality, and this was especially pronounced for the deadliest cancers. Our demographic model predicted low expected excess mortality in populations living with certain types of cancer, even if cancer is a risk factor for COVID-19 fatality, due to competing mortality risk. We also find a moderate increase in excess mortality from hematological cancers, aligned with other types of observational studies. While our study concentrates on the immediate consequences of the COVID-19 pandemic on cancer mortality in 2020, further research should consider excess mortality in the complete pandemic period. Also, a study of the delayed impact of the pandemic on cancer mortality due to delayed diagnosis and treatment during the pandemic period is warranted.
Introduction
The dominant risk factors for COVID-19 mortality have consistently been shown to be advanced age, male gender and certain chronic diseases such as diabetes, obesity and heart disease (Chavez-MacGregor et al., 2022; Rüthrich et al., 2021; Williamson et al., 2020). Cancer has also been identified as a high-risk condition based on case-control and cohort studies, although these studies have provided conflicting results. In a large cohort study of ∼500,000 COVID-19 inpatients, only cancer patients under recent treatment were at increased risk of COVID-19 related deaths (OR=1.7) relative to non-cancer patients (Chavez-MacGregor et al., 2022). Conversely, a smaller European study of 3,000 COVID-19 inpatients found that cancer was not a risk factor (Rüthrich et al., 2021), as did an international, multicenter study of 4,000 confirmed COVID-19 inpatients (Raad et al., 2023). More recently a meta-analysis of 35 studies from Europe, North America, and Asia found a 2-fold increased risk of COVID-19 mortality among cancer patients (Di Felice et al., 2022). Similarly, a large analysis from the UK found that the risk of COVID-19 mortality for cancer patients had declined over the course of the pandemic but remained 2.5 times higher than for non-cancer patients into 2022 (Starkey et al., 2023). Taken together, such observational studies provide a mixed picture of cancer as a COVID-19 mortality risk factor, with several studies reporting that controlling for important factors such as age is a challenge. Furthermore, cancer is often considered as a single disease category despite the diversity of conditions and patients represented.
Further evidence for the relationship between cancer and COVID-19 comes from population-level analysis of vital statistics. A recent US study showed no elevation in underlying cancer deaths concomitant with COVID-19 waves, in stark contrast to the sharp rise in mortality from other chronic diseases (W.-E. Lee et al., 2023). In several other countries, including Sweden, Italy, Latvia, Brazil, England and Wales, underlying cancer mortality was found to be stable or decreasing during the first year of the pandemic (Alicandro et al., 2023; Fernandes et al., 2021; Gobiņa et al., 2022; Grande et al., 2022; Kontopantelis et al., 2022; Lundberg et al., 2023). Further, an excess mortality study of 240,000 cancer patients in Belgium found a 33% rise in mortality in April 2020, but concluded that this was no different from the rise observed in the general population (Silversmit et al., 2021). The apparent lack of association between cancer mortality and COVID-19 on a population level raises the question of the true relationship between cancer and COVID-19.
The relationship between these two diseases could occur via multiple biological mechanisms. First, immunosuppression in cancer patients could increase susceptibility to SARS-CoV-2 infection and/or risk of severe clinical outcome upon infection. Conversely, immunosuppression could act as a protective factor in the face of a severe respiratory infection that kills by over-stimulating the immune system – the immune incompetence rescue hypothesis (Reichert 2004). This hypothesis was put forward to explain the observed absence in excess cancer mortality during the 1968 influenza pandemic, a departure from elevated mortality seen for other high-risk conditions such as heart disease and diabetes (Reichert 2004). A further mechanism that could affect the observed relationship between cancer deaths and COVID-19 is changing guidelines for establishing the primary cause of death. Coding guidelines evolved throughout the pandemic as testing for SARS-CoV-2 infection became more widespread, which presumably affected vital statistics studies.
To further elucidate the relationship between cancer mortality and COVID-19 on a population level, we analyzed US vital statistics in detail to understand the potential role of death certificate coding changes during the pandemic and explored putative differences in mortality patterns between different types of cancer. We considered death certificates listing cancer as the underlying cause of death (UC) or anywhere on the death certificate (multiple-cause (MC)). Assuming there is a high propensity to attribute a primary code of COVID-19 during the pandemic in any patient with COVID-19, deaths among individuals with both cancer and COVID-19 near the time of death would be coded as UC COVID-19. However, cancer should still be captured in the MC data, and thus, analysis of MC death data should control for any changes in death certificate coding practices during the pandemic (Fedeli et al., 2024). The US provides a particularly useful case study as the timing of COVID-19 waves varied considerably between states, so that elevations in cancer deaths, should they exist, should also be heterogeneous. For comparison, we also assessed population-level excess mortality patterns for other chronic conditions such as diabetes, ischemic heart disease (IHD), kidney disease, and Alzheimer’s, for which the association with COVID-19 is less debated.
Results
Establishing patterns and timing of COVID-19 related deaths
We obtained individual ICD-10 coded death certificate data from the US for the period January 1, 2014, to December 31, 2020. We compiled time series by week and cause of death, for underlying cause (UC) and for multiple-cause (MC) mortality. We considered 10 causes of death, including diabetes, Alzheimer’s disease, ischemic heart disease (IHD), kidney disease, and 6 types of cancer (all-cause cancer, colorectal, breast, pancreatic, lung, and hematological; see Table 1 and Appendix 1 - Table 1 for a list of disease codes). We chose these specific cancers to illustrate conditions for which the 5-year survival rate is low (13% and 25%, respectively, for pancreatic and lung cancers) and high (65% and 91%, respectively, for colorectal and breast cancers) (National Cancer Institute, n.d.). Hematological cancer (67% 5-year survival rate) was included because it has been singled out as a risk factor in several previous studies due to the immune suppression associated with both its malignancy and treatment. (Chavez-MacGregor et al., 2022; X. Han et al., 2022; Rüthrich et al., 2021; Williamson et al., 2020). To compare mortality patterns with the timing of COVID-19 pandemic waves, we accessed national and state-level counts of reported COVID-19 cases from the Centers for Disease Control and Prevention (CDC)(Centers for Disease Control and Prevention, 2022).
In national data, time series of COVID-19-coded death certificates (both UC and MC) tracked with the temporal patterns of laboratory-confirmed COVID-19 cases (Figure 1), revealing three distinct COVID-19 waves: a spring wave peaking on April 12, 2020, a smaller summer wave peaking on July 26, 2020, and a large winter wave that had not yet peaked by the end of the study in December 2020. This correspondence between COVID-19 case and death activity represents a “signature” mortality pattern of COVID-19.
Analysis of state-level data reveals variable timing, intensity, and number of COVID-19 waves across the US during 2020. To focus on periods with substantial COVID-19 activity and explore the association with cancer, we identified three large US states with unique, well-defined waves (Figure 1). New York (NY) state experienced a large, early wave in March-May 2020, based on recorded COVID-19 cases and deaths and high seroprevalence of SARS-CoV-2 antibodies in this period (over 20% (Stadlbauer et al., 2021)). Meanwhile, California (CA) experienced a large COVID-19 wave at the end of the year and had little activity during the spring and summer. Finally, Texas (TX) had two large waves; one during late summer, followed by one in winter 2020.
National patterns in excess mortality from cancer
Similar to other influenza and COVID-19 population-level mortality studies (Islam et al., 2021; Karlinsky and Kobak, 2021; W.-E. Lee et al., 2023; Msemburi et al., 2023), we established a weekly baseline model for expected mortality in the absence of pandemic activity by modeling time trends and seasonality in pre-pandemic data and letting the model run forward during the pandemic (see Methods). Each cause of death (UC and MC) and geography (aggregated National, NY, TX, and CA) was modeled separately. We then computed excess mortality as the difference between observed deaths and the model-predicted baseline. We summed weekly estimates to calculate excess mortality for the full pandemic period and during each of the 3 waves (see Methods). In addition to these absolute effects of the pandemic on mortality, we also calculated the relative effects by dividing excess mortality by baseline mortality. This approach has been used in the past to standardize mortality effects in strata with very different underlying risks (e.g., age groups, geographies, or causes of death, see Methods).
Nationally, we found a drop in UC cancer deaths during spring 2020 (Figure 2, panel a; Table 2), although the drop was not statistically significant. A similar non-significant decline was also seen for specific cancer types (Figure 2, panels d-f; Appendix 1 - Figure 1, panels a,f-j). Further, pre-pandemic mortality trends for each cancer type continued unabated during the first pandemic year. We reasoned that this early drop in UC cancer deaths may be explained by changes in coding practices, so we next turned to MC mortality to resolve this question.
Time series of MC cancer mortality showed a significant increase in all three waves (Figure 2, panel a; Appendix 1 - Table 2). A similar pattern was seen in MC time series for colorectal (Figure 2, panel h), breast (Appendix 1 - Figure 1, panel i), and hematological cancer (Appendix 1 - Figure 1, panel j). However, the total excess mortality was modest with 13,600 excess cancer deaths in 2020, representing a statistically significant 3% elevation over baseline (Table 2). The largest relative increase in MC mortality was observed in hematological cancer at 7% (statistically significant, 3,600 excess deaths). No excess in MC mortality was seen for the two deadliest cancers, pancreatic cancer (Figure 2, panel f) and lung cancer (Appendix 1 - Figure 1, panel g).
National patterns in deaths due to other chronic conditions
We considered diabetes and Alzheimer’s as “positive controls” as they are also considered COVID-19 risk factors and can illustrate how positive associations between chronic conditions and COVID-19 manifest in population level excess mortality studies. Diabetes provides a particularly useful comparator for cancer as the mean age at death is similar (∼72 years, Table 1) and because few individuals live in a nursing home (Appendix 1 - Supplemental Methods). Mortality time series from UC and MC diabetes and Alzheimer’s were highly correlated with COVID-19 activity, with statistically significant mortality elevation synchronous with pandemic waves (Figure 2 b-c; Appendix 1 - Figures 2-5). For diabetes, we measured an excess of 10,800 and 82,300 deaths (UC and MC, respectively), corresponding to statistically significant elevations of 16% and 37% over baseline level mortality (Table 2). For Alzheimer’s, we estimated 8,500 and 21,700 excess deaths, corresponding to statistically significant elevations of 9% and 19% elevation over baseline, respectively. Pandemic-related excess mortality was also seen for IHD and kidney disease (see supplement for estimates, Appendix 1 - Table 2).
State-level patterns in excess mortality
Similar to patterns seen in national level data, none of the state-level analyses revealed notable increases in UC cancer mortality, while there was a modest, non-significant increase in MC cancer mortality (Figures 3-5; Appendix 1 - Figures 6-8). The largest mortality increase was seen in NY during the spring wave, with a 6% rise in MC cancer mortality above the model baseline (Table 2; Appendix 1 - Table 3). The magnitude of the increase seen during the spring wave varied by cancer type, with minimal increases seen in pancreatic and lung cancers (1%) and higher increases in colorectal, hematological, and breast cancers (9%, 10%, and 16%, respectively). For comparison, there was a statistically significant rise in Alzheimer’s and diabetes deaths during this wave of 49% and 128%.
In CA and TX, mortality fluctuations were less pronounced than in NY, coinciding with less intense COVID-19 waves, and this was seen across all conditions. MC excess mortality estimates remained within +/-4% of baseline levels for cancers, irrespective of the type of cancer and pandemic wave, except for hematological cancers which saw an 11% rise in Texas during the summer wave and an 8% rise in California during the winter wave. None of these elevations were statistically significant. In comparison, there was statistically significant excess mortality elevation for both Alzheimer’s and diabetes deaths (range, 18-59% in the CA winter wave, and 45-77% in the TX summer wave, Table 2, Appendix 1-Tables 4-5).
Demographic mortality projections under the null hypothesis that cancer in and of itself is not a risk factor for COVID-19 mortality
Next, to get a sense of the expected mortality elevation, we ran simulations to gauge the level of individual-level association (traditionally measured as relative risk, RR) between COVID-19 and the studied chronic conditions that is consistent with the population-level excess mortality patterns observed during the pandemic. Using cancer as an example, two main factors could drive cancer mortality patterns during COVID-19, namely the size and age of the population living with cancer (since age is such a pronounced risk factor for COVID-19), and the life expectancy under cancer diagnosis. These factors would operate irrespective of the true biological relationship between COVID-19 severity and cancer. The same logic applies to mortality from other chronic conditions, such as diabetes or Alzheimer’s.
To test the hypothesis that these population factors alone could explain differences in excess mortality between chronic conditions, we designed a simple model of COVID-19 mortality for individuals with chronic conditions (see methods for details). The model projected excess mortality during the pandemic under the null hypothesis that the chronic condition was not in and of itself a risk factor for COVID-19 mortality, with only the demography of the population living with the disease (namely, the age and size of the at-risk populations and baseline risk of death from each condition) affecting excess mortality. In the demographic model, we first estimated the number of expected SARS-CoV-2 infections among persons with a certain condition, by multiplying the estimated number of US individuals living with the condition (CDC, Division of Population Health, n.d.; Dhana et al., 2023; Rajan et al., 2021; U.S. Cancer Statistics Working Group, released in November 2023) by the reported SARS-CoV-2 seroprevalence at the end of our study period (December 2020 for the national, or after each wave for the state data)(Centers for Disease Control and Prevention, 2023). We focused on seroprevalence among individuals ≥65 years, the most relevant age group for the conditions we considered (we also run a sensitivity analysis considering seroprevalence in adults 50-64 years, see discussion). We then multiplied the estimated number of SARS-CoV-2 infections by an age-specific infection-fatality ratio (IFR) for SARS-CoV-2 (COVID-19 Forecasting Team, 2022). This gave an estimate of COVID-19-related deaths, or excess deaths, for a given condition. To estimate a percent elevation over baseline and compare with our vital statistics analysis, we divided the excess death estimate derived from the demographic model by the total deaths for that condition for a similar period of time in 2019 (see Methods). We repeated this analysis for each cancer type, diabetes, and Alzheimer’s. In addition to the null hypothesis, we also projected alternative hypotheses of a biological association between chronic conditions and COVID-19, assuming that a given chronic condition would raise the risk of COVID-19 mortality (via the infection fatality ratio) by a factor of 2 or 5. We compared these modeled expectations for the null and alternative hypotheses with the observed excess mortality in 2020, using MC mortality as the outcome (Table 2).
Under the null hypothesis we projected a 0-2% elevation over the 2019 baseline in deaths for all cancer types in national data, and 0-9% elevations in state-level data (Table 3). Under the alternative hypothesis that cancer increases COVID-19 mortality risk by a factor of 2, the projected elevation is 0-5% in national data and 0-18% in state-level data. In general, the largest projected increases were found in NY state, driven by the higher attack rates. We also see systematic differences in the percent elevation over baseline by type of cancer, related to the lethality of different cancers. For instance, even if cancer increases COVID-19 mortality risk by a factor of 2, we expect to see only a 0-1% increase for particularly deadly cancers such as pancreatic and lung cancer, in part driven by the high competing risk of death from these cancers (short life expectancy) and the small size of the population-at-risk. The expected increases for less deadly cancers, such as colorectal and breast, were notably higher (2-5% in national data, and 9-18% during the large spring wave in New York), in part driven by the lower risk of death from these cancers (longer life expectancy). Based on the observations from our time series analysis of MC mortality in all states, non-hematological cancers are most consistent with a 1- to 2-fold increase in mortality, with the caveat that most of the confidence intervals include zero, and the differences in projected mortality under these hypotheses are minimal. In contrast, for hematological cancer, the observed rise in mortality exceeds the expected elevation even under the assumption of a 5-fold increase in mortality.
We repeated this analysis for diabetes and Alzheimer’s (Table 3). For diabetes under the null hypothesis, we projected an 8% elevation over baseline in national data and 12-30% in state-level data based on the age distribution and substantial size of the population-at-risk alone. In fact, we observed in vital statistics analysis a 37% elevation over baseline in national US data and 59-128% in state-level data, with the largest increase seen in NY and lowest increase in CA. These observations are most consistent with a 5-fold increase in mortality based on our demographic model (projected elevation 40% nationally and 62-148% at the state level). For Alzheimer’s under the null hypothesis, we projected a 28% increase over baseline nationally, and 30-191% increases at the state level, largely driven by the advanced age of the population-at-risk. In contrast, analysis of vital statistics data reveals a 19% increase nationally and 18-49% across states, which is in fact lower than the null hypothesis (we return to this surprising result in the discussion). Strikingly, our demographic model supports that COVID-19 will manifest differently in population-level excess mortality for each of these chronic conditions, even under the null hypothesis of no biological association between viral infection and these underlying comorbidities. Overall, these projections support the idea that demography alone (age, size, and baseline mortality of the population living with each of these conditions) can explain much of the differences in absolute and relative mortality elevations seen during the pandemic across conditions like cancer, diabetes, and Alzheimer’s.
Discussion
Cancer is generally thought of as a risk factor for severe COVID-19 outcomes, yet observational studies have produced conflicting evidence. With recent availability of more detailed US vital statistics data, we used statistical time series approaches to generate excess mortality estimates for multiple cause of death data, different types of cancer, and several geographic locations during 2020. We accounted for potential changes in coding practices during the pandemic, for instance capturing a COVID-19 patient with cancer whose death may have been coded as an underlying COVID-19 death and not a cancer death. Based on multiple cause of death data, we estimated 13,600 national COVID-19-related excess cancer deaths, which aligns well with reporting on death certificate data, where 13,400 deaths are ascribed to COVID-19 in cancer patients (Appendix 1 - Figure 9) (Fedeli et al., 2024). Yet these deaths only represent a 3% elevation over the expected baseline cancer mortality. Percent mortality elevation was measurably higher for less deadly cancers (breast and colorectal) than cancers with a poor 5-year survival (lung and pancreatic). Consistent with other studies (Chavez-MacGregor et al., 2022; S. Han et al., 2022; Rüthrich et al., 2021; Williamson et al., 2020), we found that the largest mortality increase for specific cancer types was seen in hematological cancers with a 7% elevation over baseline in national data. Across the board, the largest elevations in cancer mortality were observed in the states most impacted by the first year of the COVID-19 pandemic (e.g., NY), lending support to the specificity of our excess mortality approach.
In contrast to cancer, we observed substantial COVID-19-related excess mortality for diabetes and Alzheimer’s, temporally and geographically consistent with the three-wave “signature” pattern observed in reported COVID-19 cases and deaths across the US. To investigate whether demographic differences in underlying patient populations (age distribution, population size, and baseline risk of death due to chronic condition) could explain differences in excess mortality during the pandemic, we ran a simple demographic model for each condition – first assuming the condition in and of itself was not a risk factor for COVID-19-related mortality (null hypothesis). Doing so we found that the rise in cancer deaths during COVID-19 was expected to remain low compared to these other chronic conditions, largely driven by the higher risk of death from cancer itself compared to diabetes and Alzheimer’s. These demographic projections illustrate the importance of competing risks (Figure 6), where the risk of cancer death predominates over the risk of COVID-19 death in 2020. This is exacerbated in cancers with high mortality rates. For instance, even if pancreatic cancer had in fact doubled the risk of dying of COVID-19 (IFR = 4.2% vs. 2.1%), we would only expect a rise in excess mortality around 0.4% during the pandemic (Table 3), while the 2019 baseline risk of death for pancreatic cancer itself is over 60% (Figure 6). On the other hand, for conditions with a lower baseline level mortality, such as diabetes, we expect substantial COVID-19 driven elevations in mortality.
Our analysis revealed interesting differences between types of cancers. Both nationally and at the state-level, the observed excess mortality for non-hematological cancers was consistent with a 1-to 2-fold increase in COVID-19 mortality risk in patients with these types of cancer. Importantly, our analysis ignores any behavioral effects associated with the pandemic. It is conceivable that cancer patients may have shielded themselves from COVID-19 more than the average person in 2020. Our projections assume an average risk of infection for a typical individual over 65 years as there is no serologic data on infection attack rates for specific clinical population subgroups (of any age). If shielding from exposure to SARS-CoV-2 was high among cancer patients, our projections of cancer excess mortality during the pandemic would be inflated. In other words, if shielding was particularly pronounced, cancer may conceivably be a higher risk factor than shown here. Retrospective serologic analysis of banked sera from the first year of the pandemic, broken down by underlying comorbidities, may shed light on whether infection risk may have varied by chronic condition.
State-level mortality patterns can potentially provide complementary insights on the question of shielding. Because NY state experienced the earliest and most intense COVID-19 wave of the US, with over 20% of the population infected in Spring 2020 (Stadlbauer et al., 2021), and because social distancing did not come into effect until March 2020, shielding would have had a more limited impact there than in other states. Thus, a biological relationship between cancer and COVID-19 would have been most dramatic in NY in spring 2020. Indeed, cancer excess mortality was exacerbated in NY, including an 9-16% increase in colorectal and breast cancer mortality, consistent with a 2-fold increase in COVID-19 mortality risk from these cancers, and a 10% increase in hematological cancers, consistent with a 5-fold increase in COVID-19 mortality risk. In NY, the absence of excess mortality in lethal cancers, such as pancreatic and lung cancers (1% over baseline) are, as discussed above, still consistent with what would be expected under a high competing risk situation.
We used diabetes and Alzheimer as positive controls for a known biological association between COVID-19 and chronic conditions. Diabetes stood out in our analyses with the highest absolute and relative increases in excess mortality during the pandemic. The magnitude of the mortality increases, both nationally and at the state level, were close to what would be expected if diabetes increased COVID-19 mortality by 5-fold. Many studies have shown that diabetes increases the risk of COVID-19 mortality, with an effect size around 2 (Williamson et al. 2020; Huang et al. 2020; Kastora et al. 2022). Impaired immune function and chronic inflammation have been identified as mechanisms driving poor outcomes for diabetes patients (Figueroa-Pizano et al. 2021). The discrepancy between the observed excess and our expectations may come down to uncertainty in the SARS-CoV-2 infection rates assumed in our demographic model. The population living with diabetes is slightly younger than that of the other conditions (mean age, 58-60 years), while we used serologic infection rates reported for individuals over 65 years in our main analysis. The SARS-CoV-2 attack-rate among those 50-64 years was 10.1% at the end of 2020, compared to 6.3% in individuals over 65 (Centers for Disease Control and Prevention, 2023). A sensitivity analysis using this higher attack rate in our demographic model lends more support to the hypothesis that diabetes increases COVID-19 mortality by 2-fold, rather than 5-fold as found in our main analysis.
Our second positive control, Alzheimer’s, revealed surprising results. Although we observed significant excess mortality in MC Alzheimer’s data, it was still less than expected under the null hypothesis that Alzheimer’s was not a risk factor for COVID-19 mortality. This is unexpected in light of several observational studies that have shown Alzheimer’s to be a risk factor (Tahira et al., 2021; Wang et al., 2021; Zhang et al., 2021). As with cancer and diabetes, there is uncertainty in the SARS-CoV-2 infection rates used in the demographic model, due to the potential effect of shielding and the age-specific SARS-CoV-2 infection risk of the Alzheimer’s population. We estimated that the average age of the population living with Alzheimer’s disease was 80-81 years, and the infection rates for the general population over 65 years may not accurately reflect exposure in this subpopulation. Decreasing the attack rates by 20-30% (down to 4.4-5.0%) puts the observed estimates in the range of the expectations under the null hypothesis. Overall, given uncertainty in SARS-CoV-2 attack-rates and the age and size of the population-at-risk for all studied conditions, our demographic model projections are not an exact tool to titrate excess mortality nor the relative risk associated with each condition. Our model merely serves as an illustration of the role of demography and competing risks.
Most vital statistics studies of the COVID-19 pandemic have relied on underlying cause-specific deaths, which are prone to changes in coding practices. Our initial hypothesis going into this work was that coding changes associated with a better recognition of the impact of SARS-CoV-2 led to an underestimation of excess mortality from cancer, affecting our perception of the relationship between cancer and COVID-19. We certainly found an effect of coding changes, where for instance a drop in excess mortality in underlying cancer deaths turned into an increase in multiple-cause (any-listed) cancer deaths, particularly in the first COVID-19 pandemic wave. A similar observation was made by Fedeli et al. The impact of coding changes was also seen in mortality from other chronic conditions but was particularly important for cancer. Yet both the absolute and relative excess mortality elevation remained modest for cancer, even after adjustment for coding changes, highlighting the importance of additional mechanisms such as competing mortality risks between COVID-19 and cancer.
An interesting hypothesis was put forward 20 years ago proposing that immunosuppression from cancer may explain the lack of excess cancer mortality in the 1968 influenza pandemic – the immune incompetence rescue hypothesis (Reichert et al 2004). This hypothesis contends that it is a detrimental immune response that leads to influenza death. A similar hypothesis was put forward to explain the extreme mortality in young healthy adults in the 1918 pandemic (Short et al., 2018). However, observational studies have found that patients with hematological cancers have twice the risk of dying compared to patients without cancer, likely due to the immunosuppression associated with their malignancy and treatment (X. Han et al., 2022; Starkey et al., 2023; Williamson et al., 2020). Under the immune incompetence rescue hypothesis, hematological cancers would be expected to have the lowest excess mortality of all types of cancers. Our excess mortality analysis reveals instead that hematologic cancers were the most impacted by the pandemic, relative to other types of cancer, with observed mortality patterns consistent with a 5-fold increase in risk of COVID-19 death in patients with hematological cancers. Overall, we do not find any support for the immune competence rescue hypothesis.
Our study is subject to limitations. First, we did not study the potential long-term consequences of the pandemic on cancer care, which may have resulted in avoidance of the health care system for diagnosis or treatment. We did not see any delayed pandemic effect on mortality from pancreatic cancer, which may have manifested in 2020 given the very low survival rate of this cancer (Lemanska et al., 2023), but we cannot rule out longer-term effects on breast or colorectal cancers that would not be seen until 2021 or later (Doan et al., 2023; Han et al., 2023; Haribhai et al., 2023; R. Lee et al., 2023; Nascimento de Lima et al., 2023; Nickson et al., 2023; Nonboe et al., 2023; Tope et al., 2023). Interestingly, in the US, all-cause underlying cancer mortality rates do not appear to rise between 2020 and 2023 (Appendix 1 - Figure 10), but data prior to the pandemic show a rise in cancer incidence, largely driven by increasing cancer rates in younger adults (Zhao et al. 2023; Siegel et al. 2024). Additional years of data will be important to evaluate the long-term impacts of the COVID-19 pandemic and these changing demographics on cancer mortality rates. Additional years of data will also be important for assessing the impact of vaccination on the relationship between cancer and COVID-19; there is evidence that vaccines may be less immunogenic in patients with cancer compared to those without (Seneviratne et al., 2022). Another limitation of our study is the reliance on mortality as an outcome, and not the risk of COVID-19-related hospitalization and morbidity, and Long COVID in cancer patients. A small US study reported that 60% of cancer patients suffered Long COVID symptoms (Dagher et al., 2023). Future analyses using hospitalization data and electronic medical records may provide additional insights on how different cancer stages or other comorbidities may contribute to increased risk of severe COVID-19 outcomes. Lastly, a few methodological limitations are worth raising. Though it was important to assess excess mortality in state level data because of asynchrony in pandemic waves, confidence intervals in state-level estimates were large, particularly for specific types of cancers, affecting significance levels. Additional methodological limitations relate to our demographic model, especially as regards assumptions about SARS-CoV-2 infection rates in populations of different ages and with different chronic conditions. Importantly, our conclusions regarding the importance of competing risks are robust to these assumptions. Lastly, our study is a time-trend analysis and – like cohort and case-control studies – correlation does not necessarily imply causation. However, the intensity and brevity of COVID-19 pandemic waves in space and time lends support to our analyses.
Conclusion
Our detailed excess mortality study considered six cancer types and found that there is at most a modest elevation in cancer mortality during the COVID-19 pandemic in the US. Our results demonstrate the importance of considering multiple-causes-of-death records to accurately reflect changes in coding practices associated with the emergence of a new pathogen. In contrast to earlier studies, we propose that lack of excess cancer mortality during the COVID-19 pandemic reflects the competing mortality risk from cancer (especially for deadly types like pancreatic and lung cancers) itself rather than protection conferred from immunosuppression. We note the more pronounced elevation in mortality from hematological cancers during the pandemic, compared to other cancers and to expectations from a demographic model, which aligns with a particular group of cancer patients singled out in several cohort studies. Future research on the relationship between COVID-19 and cancer should concentrate on additional outcomes, such as excess hospitalizations, Long COVID, changes in screening practices during COVID-19, and longer-term patterns in cancer mortality.
Materials and Methods
Data sources
US National vital statistics
We obtained individual ICD-10 coded death certificate data with exact date of death from the United States for the period January 1, 2014, to December 31, 2020. Each death certificate has one underlying cause (UC) of death, defined as the disease or injury that initiated the train of events leading directly to death, and up to twenty causes of death in total, referred to here as multiple cause mortality (MC). We considered 10 conditions, including diabetes, Alzheimer’s disease, ischemic heart disease (IHD), kidney disease, and 6 types of cancer (all-cause cancer, colorectal, breast, pancreatic, lung, and hematological; see Table 1 and Appendix 1 – Table 1 for a list of disease codes). We chose these types of cancer to illustrate conditions for which the 5-year survival rate is low (13% and 25%, respectively, for pancreatic and lung cancers) and high (65% and 91%, respectively, for colorectal and breast cancers) (National Cancer Institute, n.d.). Hematological cancer (67% 5-year survival) was included because it was singled out as a risk factor by previous studies. We compiled time series by week, geography (aggregated National, NY, TX, and CA) and cause of death, separately for underlying and multiple cause mortality.
To observe longer-term trends in later years of the COVID-19 pandemic, we downloaded aggregated weekly-level data from 2021 to 2023 for all-cause cancer, diabetes, and Alzheimer’s disease from CDC Wonder.
Estimated populations living with each chronic condition
We estimated the size of the population-at-risk for all-cause and specific cancers using the 5-year limited duration prevalence estimates provided by the U.S. Cancer Statistics webpage (U.S. Cancer Statistics Working Group …). Estimates for diabetes were drawn from CDC’s Behavioral Risk Factor Surveillance System Chronic Disease Indicators (CDC, Division of Population Health). Estimates for Alzheimer’s disease were taken from publications from the Alzheimer’s Association (Rajan et al. 2021; Dhana et al. 2023).
For each condition, age-specific prevalence data were tabulated for the US and for each state separately. For cancer, age-level data were only available at the national level so these age-specific prevalence estimates were applied to the populations for each of the three states considered (NY, CA, TX). Age-level data were provided for all ages for cancer (<20 years, 20-80 years in 10-year groupings, ≥80 years), for adults ≥ 18 for diabetes (18-44years, 45-64years, ≥65 years) and for adults ≥65 for Alzheimer’s disease (65-74years, 75-84yrs, ≥85years). A weighted mean age for the population-at-risk for each condition was calculated using the mid-point for each age group.
Other data sources
To compare vital statistics patterns with COVID-19 surveillance data, we accessed national and state counts of laboratory-confirmed COVID-19 cases in 2020, from the CDC (Centers for Disease Control and Prevention, 2022).
To clarify the expected role of COVID-19 on excess mortality, we compiled data on the proportion of the population with serologic evidence of SARS-CoV-2 infection from the CDC dashboard (Centers for Disease Control and Prevention, 2023). We further compiled data on estimated age-specific infection-fatality ratios from COVID-19, provided by single year of age (COVID-19 Forecasting Team, 2022).
Statistical approach
Weekly excess mortality models
Similar to other influenza and COVID-19 excess mortality studies (Islam et al., 2021; Karlinsky and Kobak, 2021; W.-E. Lee et al., 2023; Msemburi et al., 2023), we established a predicted baseline of expected mortality for each time series, and computed the excess mortality as the excess in observed deaths over this baseline. To establish baselines for each disease nationally and in each state, we applied negative binomial regression models to weekly mortality counts for each cause of death, smoothed with a 5-week moving average and rounded to the nearest integer. Models included harmonic terms for seasonality, time trends, and an offset for population size. For each condition and location, we used Akaike Information Criterion (AIC) to select between three models with different time trends (see Appendix 1 - Supplemental Methods, Appendix 1- Figure 11, for the final model selection for each location and condition), following:
Model 1:
Weekly_mortality = t + cos(2πt/52.17) + sin(2πt/52.17) + offset(log(population)), where t represents week.
Model 2:
Weekly_mortality = t + t2 + cos(2πt/52.17) + sin(2πt/52.17) + offset(log(population)), where t represents week.
Model 3:
Weekly_mortality = t + t2 + t3 + cos(2πt/52.17) + sin(2πt/52.17) + offset(log(population)), where t represents week.
We fitted national and state-level models for each mortality outcome from January 19, 2014, to March 1, 2020, and projected the baseline forward until December 6, 2020, the last complete week of smoothed mortality data. Models were fitted using the MASS package in R version 4.3.
Using COVID-19 coded death certificates from March 1, 2020, to December 6, 2020, we established the timing of each pandemic wave from trough to trough. We found that nationally, the first wave occurred from March 1, 2020, to June 27, 2020; the second wave from June 28, 2020, to October 3, 2020, and the third from October 4, 2020, to December 6, 2020 (the 3rd wave was not completed by the last week of available smoothed data on December 6, 2020). For NY, the pandemic pattern was characterized by an intense first wave in Spring 2020, while TX had its major wave in summer 2020 and CA in late 2020. Comparison of mortality patterns from these three states provides an opportunity to separate the effect of SARS-CoV-2 infection from that of behavioral changes later in the pandemic. For instance, the effects of healthcare avoidance would predominate in CA or TX in Spring 2020, as there was little SARS-CoV-2 activity but much media attention on COVID-19, with cancer patients potentially avoiding medical care out of fear of getting infected. In contrast, risk of infection would dominate in NY in Spring 2020, and behavioral factors may only play a role as SARS-CoV-2 awareness increased and the wave was brought under control by social distancing.
We estimated weekly excess mortality by subtracting the predicted baseline from the observed mortality. We summed weekly estimates to calculate excess mortality for the full pandemic period and for each of the 3 waves within the first year of the pandemic. In addition to estimating the absolute effects of the pandemic on mortality, we also calculated relative effects by dividing excess deaths in each diagnosis group by the model baseline. Confidence intervals on excess mortality estimates were calculated by resampling the estimated model coefficients 10,000 times using a multivariate normal distribution and accounting for negative binomial errors in weekly mortality counts.
We used Pearson correlation to test synchronicity patterns in weekly excess mortality from different cancers and chronic conditions to underlying COVID-19 deaths. Correlation analysis assumes a direct and immediate effect of COVID-19 on cancer mortality. We also investigated the possibility of delayed effects or harvesting by inspecting the time series for evidence of such effects and by comparing total excess deaths for distinct pandemic waves and the whole of 2020.
Projections of excess mortality under the null hypothesis of no specific COVID-19 mortality risk of each condition
To further test the impact of age on the association between chronic conditions and COVID-19 and clarify the additional risk due to each chronic condition, we projected the number of COVID-19 deaths under the null hypothesis that demographic characteristics alone (size, age, and baseline mortality risk for each condition) are driving excess mortality, and that there is no interaction between the condition and SARS-CoV-2 infection. Excess mortality projections were then compared with observed excess mortality. We only used MC deaths for this approach to account for the possibility that some individuals may suffer from multiple conditions. For example, an estimated 11.5% of US adults with type 2 diabetes also have a history of cancer (Yeh et al., 2018).
We first calculated the number of expected COVID-19 infections among persons living with a certain chronic condition, by multiplying the estimated number of individuals living with the condition by the reported SARS-CoV-2 seroprevalence among individuals ≥65 years at specific time points during 2020. For the national data and California, we used results from the survey conducted from November 23 - December 12, 2020. For New York we used estimates from the survey conducted from July 27 - August 13, 2020 (the earliest data available). And for Texas we used the survey conducted from October 5-19, 2020 (following the large summer wave). (Centers for Disease Control and Prevention, 2023). We then multiplied this by the COVID-19 IFR based on the estimated mean age of individuals living with the condition (COVID-19 Forecasting Team, 2022) to arrive at the projected number of COVID-19-related excess deaths for a particular condition during 2020. We put uncertainty intervals around these estimates using the lower and upper bounds from the estimated attack-rates and COVID-19 IFRs.
To obtain a relative metric of expected COVID-19 burden, we divided projected COVID-19 excess deaths by total deaths in each diagnosis group in the 2019 baseline period (March to December 2019, for the national data. For the states we used the months in 2019 corresponding to their large waves in 2020), resulting in an expected percentage elevation over baseline in 2020. We compared this null expectation to the observed percentage elevation over baseline from our excess mortality models. We also generated the expected number of excess deaths under alternative hypotheses where each condition is associated with a 2- or 5-fold increased risk of COVID-19 related death given infection (i.e., the baseline age-adjusted infection fatality ratio used in the null hypothesis was increased 2- or 5-fold).
The equation for the expected percent increase in excess mortality over baseline deaths under the null hypothesis, for a specific risk condition (cancer, diabetes., Alzheimer) and time-period, can be written as:
Expected percent increase in excess mortality for a chronic condition and time period = (size of population-at-risk for the condition * SARS-CoV-2 infection rate for the period * age-specific IFR) / baseline mortality for the condition in comparable period in 2019
The expected mortality increases under the alternative hypothesis of a 2- or 5-fold increased risk of COVID-19 death from the condition under study is modeled by multiplying the right-hand side of the above equation by the increased risk (i.e., we assume that presence of the underlying condition will increase the IFR by 2- or 5-fold compared to the IFR for the general population).
Acknowledgements
This paper is dedicated to our colleague Robert J Taylor who succumbed to cancer in 2022 and who wanted to know if a cancer diagnosis was a COVID-19 mortality risk factor.
Additional Information
Funding
LS acknowledges funding from the Carlsberg Foundation, grant number CF20-0046. LS and CLH acknowledge funding from Danish National Research Foundation (grant number DNRF170) for the PandemiX Center of Excellence. CLH has received contract-based hourly consulting fees from Sanofi outside of the submitted work.
Author contributions
Chelsea Hansen, Data curation, Formal analysis, Visualization, Methodology, Writing – original draft, Writing – review and editing; Cécile Viboud, Data curation, Formal analysis, Visualization, Methodology, Writing – original draft, Writing – review and editing; Lone Simonsen, Conceptualization, Data curation, Formal analysis, Visualization, Methodology, Writing – original draft, Writing – review and editing
Data availability
Individual-level mortality data were obtained from the National Center for Healthcare Statistics. These data are not publicly available due to privacy concerns, but descriptive characteristics have been summarized in Table 1 and Appendix - Table 1. The excess mortality models in this paper use mortality data aggregated by week and US state. These data, along with the model code, have been posted to the following public GitHub repository: https://github.com/chelsea-hansen/Disentangling-the-relationship-between-cancer-mortality-and-COVID-19
Additional weekly, aggregated mortality data are publicly available through CDC Wonder.
Data used for the demographic model, along with the code have also been posted to the GitHub repository.
Weekly, state-level data on recorded COVID-19 cases and deaths are publicly available. Data were downloaded from here: https://data.cdc.gov/Case-Surveillance/Weekly-United-States-COVID-19-Cases-and-Deaths-by-/pwn4-m3yp and have also been posted as a .csv file to the GitHub repository referenced above.
Disclaimer
This article represents the views of the authors and not necessarily those of the National Institutes of Health or the US government.
Appendix 1
Supplemental Methods
Model selection and cross validation
Time series models included harmonic terms for seasonality, time trends, and an offset for population size. For each condition and location, we used Akaike Information Criterion (AIC) to select between three models with different time trends. The starting model (Model 1) included only a linear time trend. We then tested this against a model with linear and quadratic time trends (Model 2). If the AIC of Model 2 was not 2 less than Model 1, Model 1 was used as the final model. If the AIC of Model 2 was 2 less than Model 1, then Model 2 was tested against a model with linear, quadratic, and cubic time trends (Model 3). If the AIC of Model 3 was not 2 less than Model 2, then Model 2 was taken as the final model. If the AIC of Model 3 was 2 less than Model 2, Model 3 was taken as the final model. The final model for each condition and location was then applied to the data from 2014-2018 only and used to predict the 2019 data. The coverage probability was calculated as the proportion of weeks of observed data in 2019 that fell within the 95% prediction interval of the time series model. The final model selected for each condition and location is provided in the appendix (Appendix 1-Figure 11).
Characteristics of cancer, diabetes, and Alzheimer’s deaths in the pre-pandemic period
For each chronic condition studied (cancer, diabetes, Alzheimer’s), we assessed potential changes in the characteristics of deaths during the pandemic period that are unrelated to timing but may signal an association with COVID-19. For instance, age is known to be a major risk factor for COVID-19 mortality. For each chronic condition, we computed the average age-at-death in the pre-pandemic year 2019, and compared this to the average age-at-death in 2020. The second potential confounder is living arrangement, as individuals living in nursing homes may be at increased risk of exposure (and death) to COVID-19 due to mixing, even if their underlying condition is not per se a risk factor. To test this hypothesis, we also compared the proportion of individuals in each disease group who died in nursing homes in 2019 and 2020. And finally, to illustrate the impact of coding practices we compared ICD-10 letter categories between 2020 and 2019 for the underlying cause of death when cancer or diabetes are included on the death certificate but are not listed as the underlying cause of death (Appendix 1 - Figure 9). For 2020, we further compared death certificates listing both COVID-19 and cancer to those listing both COVID-19 and diabetes. For all comparisons between 2019 and 2020 data are limited to March to December to isolate the pandemic period.
Supplemental tables and figures
References
- A comprehensive analysis of all-cause and cause-specific excess deaths in 30 countries during 2020Eur J Epidemiol https://doi.org/10.1007/s10654-023-01044-x
- Chronic disease indicators
- Centers for Disease Control and Prevention. 2023. COVID-19 serology surveillance. https://www.cdc.gov/coronavirus/2019-ncov/covid-data/serology.html
- Weekly United States COVID-19 cases and deaths by state - ARCHIVED
- Evaluation of COVID-19 Mortality and Adverse Outcomes in US Patients With or Without CancerJAMA Oncol 8:69–78
- Variation in the COVID-19 infection-fatality ratio by age, time, and geography during the pre-vaccine era: a systematic analysisLancet 399:1469–1488
- Long COVID in cancer patients: preponderance of symptoms in majority of patients over long time periodElife 12https://doi.org/10.7554/eLife.81182
- Prevalence of Alzheimer’s disease dementia in the 50 US states and 3142 counties: A population estimate using the 2020 bridged-race postcensal from the National Center for Health StatisticsAlzheimers Dement 19:4388–4395
- Effect of cancer on outcome of COVID-19 patients: a systematic review and meta-analysis of studies of unvaccinated patientsElife 11https://doi.org/10.7554/eLife.74634
- Breast and Lung Cancer Screening Among Medicare Enrollees During the COVID-19 PandemicJAMA Netw Open 6
- Changes in cancer-related mortality during the COVID-19 pandemic in the United StatesJNCI 116:167–169https://doi.org/10.1093/jnci/djad191
- . Excess mortality by specific causes of deaths in the city of São Paulo, Brazil, during the COVID-19 pandemicPLoS One 16
- Excess mortality associated with the COVID-19 pandemic in Latvia: a population-level analysis of all-cause and noncommunicable disease deaths in 2020BMC Public Health 22
- Variation in Cause-Specific Mortality Rates in Italy during the First Wave of the COVID-19 Pandemic: A Study Based on Nationwide DataInt J Environ Res Public Health 19https://doi.org/10.3390/ijerph19020805
- Impact of cancer diagnoses on the outcomes of patients with COVID-19: a systematic review and meta-analysisBMJ Open 12
- Identification of Deaths Caused by Cancer and COVID-19 in the US During March to December 2020JAMA Oncol 8:1696–1698
- Changes in cancer diagnoses and stage distribution during the first year of the COVID-19 pandemic in the USA: a cross-sectional nationwide assessmentLancet Oncol 24:855–867
- Global elective breast- and colorectal cancer surgery performance backlogs, attributable mortality and implemented health system responses during the COVID-19 pandemic: A scoping reviewPLOS Glob Public Health 3
- Excess deaths associated with covid-19 pandemic in 2020: age and sex disaggregated time series analysis in 29 high income countriesBMJ 373
- Tracking excess mortality across countries during the COVID-19 pandemic with the World Mortality DatasetElife 10https://doi.org/10.7554/eLife.69336
- Excess years of life lost to COVID-19 and other causes of death by sex, neighbourhood deprivation, and region in England and Wales during 2020: A registry-based studyPLoS Med 19
- A rapid review on the COVID-19’s global impact on breast cancer screening participation rates and volumes from January-December 2020Elife 12https://doi.org/10.7554/eLife.85680
- Direct and indirect mortality impacts of the COVID-19 pandemic in the United States, March 1, 2020 to January 1, 2022Elife 12https://doi.org/10.7554/eLife.77562
- Healthcare in England was affected by the COVID-19 pandemic across the pancreatic cancer pathway: A cohort study using OpenSAFELY-TPPElife 12https://doi.org/10.7554/eLife.85332
- Age and sex differences in cause-specific excess mortality and years of life lost associated with COVID-19 infection in the Swedish populationEur J Public Health https://doi.org/10.1093/eurpub/ckad086
- The WHO estimates of excess mortality associated with the COVID-19 pandemicNature 613:130–137
- Projected long-term effects of colorectal cancer screening disruptions following the COVID-19 pandemicElife 12https://doi.org/10.7554/eLife.85264
- Cancer stat facts
- A modelled evaluation of the impact of COVID-19 on breast, bowel, and cervical cancer screening programmes in Australiahttps://doi.org/10.7554/eLife.82818
- Impact of COVID-19 pandemic on breast and cervical cancer screening in Denmark: A register-based studyElife 12https://doi.org/10.7554/eLife.81605
- International multicenter study comparing COVID-19 in patients with cancer to patients without cancer: Impact of risk factors and treatment modalities on survivorshipElife 12https://doi.org/10.7554/eLife.81127
- Population estimate of people with clinical Alzheimer’s disease and mild cognitive impairment in the United States (2020-2060)Alzheimers Dement 17:1966–1975
- COVID-19 in cancer patients: clinical characteristics and outcome-an analysis of the LEOSS registryAnn Hematol 100:383–393
- COVID-19 vaccination in cancer patients: a narrative reviewJ Int Med Res 50
- Back to the Future: Lessons Learned From the 1918 Influenza PandemicFront Cell Infect Microbiol 8
- Excess Mortality in a Nationwide Cohort of Cancer Patients during the Initial Phase of the COVID-19 Pandemic in BelgiumCancer Epidemiol Biomarkers Prev 30:1615–1619
- Repeated cross-sectional sero-monitoring of SARS-CoV-2 in New York CityNature 590:146–150
- A population-scale temporal case-control evaluation of COVID-19 disease phenotype and related outcome rates in patients with cancer in England (UKCCP)Sci Rep 13
- Dementia is an age-independent risk factor for severity and death in COVID-19 inpatientsAlzheimers Dement 17:1818–1831
- The impact of lag time to cancer diagnosis and treatment on clinical outcomes prior to the COVID-19 pandemic: A scoping review of systematic reviews and meta-analysesElife 12https://doi.org/10.7554/eLife.81354
- U.S. Cancer Statistics Data Visualizations Tool, based on 2022 submission data (1999-2020): U.S. Department of Health and Human Services, Centers for Disease Control and Prevention and National Cancer Institute
- COVID-19 and dementia: Analyses of risk, disparity, and outcomes from electronic health records in the USAlzheimers Dement 17:1297–1306
- Factors associated with COVID-19-related death using OpenSAFELYNature 584:430–436
- Diabetes in AmericaBethesda (MD): National Institute of Diabetes and Digestive and Kidney Diseases (US)
- COVID-19 case fatality and Alzheimer’s diseaseJ Alzheimers Dis 84:1447–1452
Article and author information
Author information
Version history
- Sent for peer review:
- Preprint posted:
- Reviewed Preprint version 1:
- Reviewed Preprint version 2:
- Version of Record published:
Copyright
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Metrics
- views
- 720
- downloads
- 52
- citation
- 1
Views, downloads and citations are aggregated across all versions of this paper published by eLife.