Research Article

Medicine

Early prediction of clinical response to checkpoint inhibitor therapy in human solid tumors through mathematical modeling

Mathematics in Medicine Program, Houston Methodist Research Institute, United States
Department of Radiation Oncology, The University of Texas M.D. Anderson Cancer Center, United States
Department of Imaging Physics, The University of Texas M.D. Anderson Cancer Center, United States
Department of Nanomedicine, Houston Methodist Research Institute, United States
Swansea University Medical School, Singleton Park, United Kingdom
Department of Surgery, Houston Methodist Cancer Center, United States
Department of Investigational Cancer Therapeutics, The University of Texas M.D. Anderson Cancer Center, United States
University of Texas Health Science Center (UTHealth), McGovern Medical School, United States
Breast Oncology Program, Dana Farber/Brigham and Women's Cancer Center, United States
Michael E. DeBakey Department of Surgery, Baylor College of Medicine, United States
Immunotherapy Research Center, Houston Methodist Research Institute, United States
Cancer Center, Houston Methodist Research Institute, United States
Rutgers Cancer Institute of New Jersey, United States
Department of Surgery, Rutgers Robert Wood Johnson Medical School, United States
Department of Neurology, Harvard Medical School, United States
Division of Cancer Biology, Department of Radiation Oncology, Rutgers New Jersey Medical School, United States
Division of Hematology/Oncology, Department of Medicine, Rutgers New Jersey Medical School, United States

Nov 9, 2021

https://doi.org/10.7554/eLife.70130

Open access
Copyright information

Abstract
Editor's evaluation
Introduction
Methods
Results
Discussion
Appendix 1
Data availability
References
Article and author information
Metrics

Abstract

Background:

Checkpoint inhibitor therapy of cancer has led to markedly improved survival of a subset of patients in multiple solid malignant tumor types, yet the factors driving these clinical responses or lack thereof are not known. We have developed a mechanistic mathematical model for better understanding these factors and their relations in order to predict treatment outcome and optimize personal treatment strategies.

Methods:

Here, we present a translational mathematical model dependent on three key parameters for describing efficacy of checkpoint inhibitors in human cancer: tumor growth rate (α), tumor-immune infiltration (Λ), and immunotherapy-mediated amplification of anti-tumor response (µ). The model was calibrated by fitting it to a compiled clinical tumor response dataset (n = 189 patients) obtained from published anti-PD-1 and anti-PD-L1 clinical trials, and then validated on an additional validation cohort (n = 64 patients) obtained from our in-house clinical trials.

Results:

The derived parameters Λ and µ were both significantly different between responding versus nonresponding patients. Of note, our model appropriately classified response in 81.4% of patients by using only tumor volume measurements and within 2 months of treatment initiation in a retrospective analysis. The model reliably predicted clinical response to the PD-1/PD-L1 class of checkpoint inhibitors across multiple solid malignant tumor types. Comparison of model parameters to immunohistochemical measurement of PD-L1 and CD8+ T cells confirmed robust relationships between model parameters and their underlying biology.

Conclusions:

These results have demonstrated reliable methods to inform model parameters directly from biopsy samples, which are conveniently obtainable as early as the start of treatment. Together, these suggest that the model parameters may serve as early and robust biomarkers of the efficacy of checkpoint inhibitor therapy on an individualized per-patient basis.

Funding:

We gratefully acknowledge support from the Andrew Sabin Family Fellowship, Center for Radiation Oncology Research, Sheikh Ahmed Center for Pancreatic Cancer Research, GE Healthcare, Philips Healthcare, and institutional funds from the University of Texas M.D. Anderson Cancer Center. We have also received Cancer Center Support Grants from the National Cancer Institute (P30CA016672 to the University of Texas M.D. Anderson Cancer Center and P30CA072720 the Rutgers Cancer Institute of New Jersey). This research has also been supported in part by grants from the National Science Foundation Grant DMS-1930583 (ZW, VC), the National Institutes of Health (NIH) 1R01CA253865 (ZW, VC), 1U01CA196403 (ZW, VC), 1U01CA213759 (ZW, VC), 1R01CA226537 (ZW, RP, WA, VC), 1R01CA222007 (ZW, VC), U54CA210181 (ZW, VC), and the University of Texas System STARS Award (VC). BC acknowledges support through the SER Cymru II Programme, funded by the European Commission through the Horizon 2020 Marie Skłodowska-Curie Actions (MSCA) COFUND scheme and the Welsh European Funding Office (WEFO) under the European Regional Development Fund (ERDF). EK has also received support from the Project Purple, NIH (U54CA210181, U01CA200468, and U01CA196403), and the Pancreatic Cancer Action Network (16-65-SING). MF was supported through NIH/NCI center grant U54CA210181, R01CA222959, DoD Breast Cancer Research Breakthrough Level IV Award W81XWH-17-1-0389, and the Ernest Cockrell Jr. Presidential Distinguished Chair at Houston Methodist Research Institute. RP and WA received serial research awards from AngelWorks, the Gillson-Longenbaugh Foundation, and the Marcus Foundation. This work was also supported in part by grants from the National Cancer Institute to SHC (R01CA109322, R01CA127483, R01CA208703, and U54CA210181 CITO pilot grant) and to PYP (R01CA140243, R01CA188610, and U54CA210181 CITO pilot grant). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Editor's evaluation

A mathematical model was established for predicting immunotherapy efficacy in this work. With three convenient available clinical parameters, the model has exhibited considerable predictive capacity with stable performance across several tumor types. It may show great promise in selecting participants for prospective trials and guiding targeted application of immunotherapy in cancer patients.

https://doi.org/10.7554/eLife.70130.sa0

Introduction

Recent advances in the understanding of immunological pathways responsible for antibody- and/or cell-mediated destruction of tumors have led to the development of unique cancer therapeutics in recent years, leading to markedly improved survival in the setting of previously intractable metastatic melanoma, bladder, kidney, lung, and head and neck cancers, among several other human solid tumor types (Borghaei et al., 2015; Robert et al., 2015a; Robert et al., 2015b). In particular, one of the most successful clinical applications of immune checkpoint inhibitors includes antibodies directed against the programmed death protein 1 (PD-1) pathway, which inhibits cellular immune killing of cancer cells via complementary binding of tumor expressed programmed death ligand 1 (PD-L1) to PD-1 on immune cells (Pardoll, 2012). As a still emerging yet quite compelling immunotherapy approach in contemporary cancer medicine, targeting of immune checkpoints is being extensively investigated in ongoing and upcoming clinical trials aimed at unleashing T cell activity, augmenting immune recognition against tumor metastases, and boosting immune memory for long-lasting clinical remission post-treatment (Postow et al., 2015; Le et al., 2017). While the remarkable potential for checkpoint inhibitors in treating cancer is unequivocally exciting, the combined clinical trial experience has shown that durable effective treatment outcomes occur only in a limited subset of patients (Sharma et al., 2017). Alas, some cancer types are presumed to be minimally immunogenic, resulting in little or no response to this treatment strategy (Brahmer et al., 2012). An accumulating body of evidence has established that certain immunological features, including T cell exhaustion (e.g., Tim-3) and exclusion (Jerby-Arnon et al., 2018), senescence markers (Moreira et al., 2019) such as CD57, or immune incompetence, exhaustion, or premature senescence (e.g., loss of CD27) (Riaz et al., 2017; Vallejo, 2005), could perhaps reflect or even predict sensitivity and resistance to checkpoint inhibitor-based cancer immunotherapy. However, early attempts at identification of specific pathological biomarkers to predict immunotherapy response, including transcriptomic rubrics (Auslander et al., 2018), machine learning algorithms (Johannet et al., 2021), genomic approaches (Cormedi et al., 2021) such as tumor mutational burden (Duffy and Crown, 2019), among others (Pilard et al., 2021), have thus far shown somewhat inconsistent results, challenged further by the inherent molecular, cellular, and biophysical diversity of human tumors (Teng et al., 2015; Tumeh et al., 2014; Carbognin et al., 2015). Instead, most currently applied parameters merely document tumor responses that have already occurred as opposed to predicting it a priori; these include the standard Response Evaluation Criteria in Solid Tumor (RECIST) v1.1 (Eisenhauer et al., 2009) and even the newer proposed response assessment rubrics specific for immunotherapy (iRECIST). Considering the sheer complexity of the biological interactions between the immune system and the tumor microenvironment, one could reason that the introduction of more sophisticated mathematical analytic techniques would hopefully have potential to enhance the qualitative and quantitative understanding of such interactions and to improve malignant tumor treatment with checkpoint inhibitors, ultimately supporting the development of a predictive clinical tool that could either minimize or overcome this clear unmet need of cancer medicine.

In previous work, mechanistic mathematical models of immunomodulatory interventions for cancer control utilizing coupled ordinary differential equations (ODEs) have already allowed the prediction of tumor response after Bacillus Calmette–Guérin (BCG) administration in superficial transitional cell carcinoma of the urinary bladder and the serum prostate-specific antigen response after prostate cancer vaccine administration with considerable accuracy (Bunimovich-Mendrazitsky et al., 2016; Bunimovich-Mendrazitsky et al., 2007; Kronik et al., 2010). Moreover, other investigators have shown that mechanistic models of interleukin-21 (IL-21) therapy schedules based on tumor mass and antigenic properties can predict growth patterns of multiple tumor types in patients receiving personalized doses of IL-21 (de Pillis et al., 2005). In another notable work, mathematical modeling of neoantigen fitness based on cancer population evolution and antigen recognition potential was able to predict tumor response and patient survival following treatment with checkpoint blockade therapy, as validated in both melanoma patients treated with anti-CTLA4 and in lung cancer patients treated with anti-PD-1 therapies (Łuksza et al., 2017). Finally, modeling of chemotherapy and targeted drug therapy by our group with similar mathematical techniques was able to accurately reproduce entire dose–response curves of tumor cell kill with untargeted cytotoxic and ligand-directed agents (Pascal et al., 2013a; Hosoya et al., 2016; Dogra et al., 2018; Goel et al., 2019; Dogra et al., 2020b). These examples highlight the previous success of mathematical models to qualitatively or quantitatively discern the underlying biologically and physically relevant, often nonlinear processes present in cancer, which may otherwise be missed, and help optimize treatment delivery approaches.

The innovation and scope of the present study is to demonstrate how standard clinical measures, including radiological imaging assessments and immunohistochemical (IHC) analysis of tissue samples, may inform a mechanistic mathematical model to elucidate patient and tumor-specific attributes that would likely benefit from the application of checkpoint inhibitor-based therapy. Our model parameters, which can be determined in multiple ways (e.g., from early time point imaging and/or histopathology data), present a clear advantage over the standard measures currently used in the clinic for predicting treatment outcome and patient survival. The mathematical model presented in this report is based on an extensive series of prior methodological reports (Pascal et al., 2013a; Hosoya et al., 2016; Dogra et al., 2018; Goel et al., 2019; Dogra et al., 2020b; Das et al., 2013; Pascal et al., 2013b; Wang et al., 2016; Koay et al., 2014; Frieboes et al., 2015; Wang et al., 2015; Brocato et al., 2018; Cristini et al., 2017; Dogra et al., 2019; Brocato et al., 2019; Dogra et al., 2020a; Goel et al., 2020; Anaya et al., 2021), but with rigorous emphasis on parameters related to the cancer-immune response to the treatment with checkpoint inhibitors in the setting of patients with solid tumors. In particular, we have developed a model that contains key mechanistic biological and physical processes involved in checkpoint inhibitor therapy, which has been objectively validated against imaging data of patient tumor burden and measured response, defined by both change in total tumor burden and patient survival (Butner et al., 2020). To date, this modeling work has only examined tumor response on a bulk scale, without confirming the mechanistic links between key model parameters and the underlying biology they describe. In this work, we demonstrate how model parameters may be informed by using cell-scale IHC analysis of biopsied tissues, which are available as early as at the start of treatment, for reliable prediction of therapeutic response. Thus, this represents a key step towards clinical translation (i) by validating prior results in additional patient cohorts and (ii) demonstrating how IHC may be used with the model to predict patient response at times closer to the start of treatment. The predictions obtained through this model were compared against available retrospective clinical data from published trials with monoclonal antibodies blocking the PD-1/PD-L1 pathway for validation, thereby focusing on a quantitative relationship between tumor response and its underlying mechanisms. Taken together, these retrospective results indicate that our predictive mathematical model with the class of PD-1/PD-L1 checkpoint inhibitors has translational merit and that it should therefore be evaluated as an integral predictive biomarker in the setting of carefully designed prospective cancer investigational trials.

Methods

Mathematical model

The final mathematical model we used for comparison with clinical data is a single ODE, which determines changes in relative tumor mass over time after initiation of anti-PD-1 therapy. It is a simplified and user-friendly version originated from a complex set of partial differential equations (PDEs), which takes into account spatial relationships within the tumor microenvironment. By reducing the model to this closed-form solution, we present the model in a form that combines related biological processes (see Figure 1) into only a few easy-to-interpret values, while also ensuring the ability to obtain unique solutions when only minimal data are available. The full mathematical derivation has been demonstrated elsewhere (Butner et al., 2020) and also in Appendix 1, but its underlying cancer biology is also schematically depicted in Figure 1. It is ultimately represented by

ρ^{`} = \frac{ρ_{\infty}}{1 - (1 - ρ_{\infty}) e^{- (α - μ + μ \cdot Λ) \cdot t}}

Figure 1

Download asset Open asset

Schematic representation of biological mechanisms included in the mathematical model.

These processes are described by four partial differential equations, which are solved to obtain Equation (1). Briefly, the checkpoint inhibitor enters the tumor via diffusion (D_a) leading to time-dependent drug concentration (σ), which then binds to the conjugate receptor on immune cells at rate λ. Immune cells (ψ_k) are drawn into the tumor microenvironment via cytokine-mediated chemotaxis (χ), resulting in immune checkpoint inhibitor-mediated cancer cell kill at rate λ_p. The full mathematical model derivation and its underlying assumptions are provided in a recent modeling and analysis report (Butner et al., 2020).

where ρ′ is the normalized tumor mass, t is time, α is a proliferation constant of tumor cells, Λ is the ratio of cancer cells (σ) to effector immune cells multiplied by the ability of immune cells (ψ_k) to kill cancer cells (namely, the anti-tumor immune state), µ is the effect of immunotherapy on the ability of immune cells to kill cancer cells, and $ρ_{\infty}$ represents the final long-term tumor burden, which may be calculated as

ρ_{\infty} = 1 + \frac{α - μ}{μ \cdot Λ}

In words, Equation (1) describes the time-course tumor burden under immunotherapy intervention as a function of three key parameters α, Λ, and µ, which represent the ability of malignant tumor cells to grow, the ability of immune cells to kill cancer cells within the tumor environment, and the potential efficacy of checkpoint inhibitor-based immunotherapy treatment. Equation (2) states that long-term tumor burden is a function of the relationship between tumor growth and kill rates [the greater of which sets the sign of response, i.e., progressive disease ( $α §amp;gt; μ$ ) or favorable clinical response ( $α §amp;lt; μ$ )], as scaled by the parameter $μ \cdot Λ$ . These three parameters are intrinsically abstract terms, which have multiple components in themselves. Λ is dependent on the density of malignant tumor versus immune cells at the initiation of immunotherapy (t = 0) and on the ability of each immune cell to kill tumor cells. Equation (1) assumes the following five assumptions: (i) tumor mass grows exponentially with rate α in the absence of immune cell killing; (ii) cancer cells are killed by one type of net effector immune cell (termed $ψ$ _k); (iii) the influx of immune cells and the concentration of checkpoint inhibitor within the tumor environment reaches a drug steady state on time scales far faster (i.e., from hours to days) than clinical response (i.e., from weeks to months); (iv) all cancer cells are within an average intratumoral movement path length of effector immune cells, and the effect of cytokines in stimulating immune cell function/movement is small, thus spatial diversity effects are negligible in this particular case; and (v) the site of action of the checkpoint inhibitor takes place at the interface between the tumor cell and immune cell, with blocking of one of the immune checkpoint receptors, either on the cancer or on the immune cell, which are deemed necessary and sufficient for blockade of the immune inhibitory pathway.

While one must recognize that although these assumptions certainly represent a gross biological generalization of the true tumor-immune microenvironment complexity, they enable direct comparison with clinical response data, in which measurements of all the parameters required for a full description of immune system reaction to tumors are often not readily available in conventional clinical settings. In this retrospective mechanistic analysis, we start with a simple biophysical model to validate clinical findings and the mechanistic links between high-level model parameters and the underlying biology they describe, with the possible addition of further refining variables as an aspirational goal for future prospective translational or clinical cancer studies. The mathematical simulations and procedures conducted are fully described in Appendix 1 (Appendix 1—figures 1 and 2); finally, we also address the implications of these arbitrary choices in ‘Discussion’.

Table 1

Clinical trials with checkpoint inhibitors used to fit the mathematical model and derived values of tumor proliferation constant, α.

Reference	Tumor type histopathology	Checkpoint inhibitor monoclonal antibody	Constantα (days^–1)	Calculated tumor doubling time (α^–1, days)
Le et al., 2015	CRC	Pembrolizumab (anti-PD1)	0.0622	11
Powles et al., 2014	UCC	Atezolizumab (anti-PD-L1)	0.016	43
Antonia et al., 2015	SCLC	Nivolumab (anti-PD1)	0.014	50
Topalian et al., 2012	MM	Nivolumab (anti-PD1)	0.0069	100
Borghaei et al., 2015	NSCLC	Nivolumab (anti-PD1)	0.0069	100
Motzer et al., 2015	RCC	Nivolumab (anti-PD1)	0.0034	204

CRC, colorectal carcinoma; UCC, urothelial cell carcinoma; SCLC, small cell lung cancer;MM, malignant melanoma; NSCLC, non-small lung cancer; RCC, renal cell carcinoma.

Clinical evaluation and fitting of the mathematical model

To evaluate Equation (1) with clinical data, we initially focused on clinical trials with the class of checkpoint inhibitors that specifically target the PD-1/PD-L1 pathway. In this analysis, tumor volumes over time measurements were obtained from six published clinical trial reports (Borghaei et al., 2015; Antonia et al., 2015; Le et al., 2015; Motzer et al., 2015; Powles et al., 2014; Topalian et al., 2012). As an initial retrospective proof of concept, five clinical trials of anti-PD-1 therapy plus another clinical trial of anti-PD-L1 treatment (Table 1) were included, with the combined dataset representing several common solid tumor pathology types (n = 189 cancer patients); this dataset represents our model calibration cohort. An online tool (Web Plot Digitizer [Rohatgi, 2010]) served to extract the individual patient tumor response data over time from the published clinical trials, and subsequently Equation (1) was fit to these individual and collective datasets to derive the parameters α, Λ, and µ. A unique fit (and thus set of parameter values) was obtained for the data from each individual patient, and more details on this procedure may also be found in Butner et al., 2020.

The fitting procedure was performed in two sequential steps. First, the fastest progressing patient in each trial was fit to a simple exponential function to estimate α for each cancer histopathology (i.e., approximation for uninhibited tumor doubling time). Although this approximation represents a limiting factor in the study, it was necessary due to lack of pretreatment tumor measurement in the calibration cohort, which would allow for more accurate estimation of the growth kinetic without clinical intervention. As presented, α may represent the fastest tumor growth potential in the cohort and thus and overestimate the true average growth kinetic; however, because it likely represents the patient with the least response to treatment in each cohort, we take it to be a reasonable approximation of tumor growth kinetic unaffected by treatment. Second, this cancer-specific α was used to determine the remaining parameters, Λ and µ, for each individual patient by fitting Equation (1) to time-course tumor burden data (Figure 2 and Appendix 1—figure 1). The curve fitting was performed by using nonlinear least squares and the Mathematica function NonLinearModelFit (Wolfram Research I, 2017). The workflow for deriving the model parameters from the clinical data is depicted in Appendix 1—figure 1.

Figure 2

Download asset Open asset

Mathematical model fit to individual responses to immune checkpoint inhibition.

Open circles represent data points of clinical response in 10 patients extracted from Topalian et al., 2012, while solid lines represent best curve fits of Equation (1) to those data (with α^–1 = 144 days). Each color represents a different patient. Immunotherapy was begun at t = 0, and tumor volume was designated as the relative change in volume from t = 0 (i.e., tumor volume of 1 at t = 0). The dashed line depicts the cutoff used for classifying patients deemed as responders (partial or complete response) versus nonresponders (stable disease or disease progression) according to the RECIST v1.1 criteria.

The results from this model calibration were checked against an additional validation patient cohort from the University of Texas M.D. Anderson Cancer Center (MDACC). Briefly, data from patients (n = 64) with non-small cell lung cancer (NSCLC) treated with pembrolizumab (MK-3475) were obtained from the investigational study NCT02444741 (a total of 95 patients were obtained; however, 18 left the study after admission, 11 were removed due to lack of pretreatment measurements, 1 was excluded because all indexed lesions were treated with XRT, and 1 discontinued treatment but continued follow-up). Serial lung tumor measurements were taken on post-contract chest CT images acquired with 2.5 mm slice thickness. All lesions that were previously indexed by the radiologist were included in order to best reproduce actual clinical practice (patients had a range of 1–12 indexed lesions; median, 3 indexed lesions). Lesion volumes were estimated as 3D spheres calculated from the geometric mean of long and short axes of each lesion at each follow-up, and then volumes were summed to generate a total volume for all indexed lesions at each follow-up time point. Because imaging data before the start of pembrolizumab treatment were available for each patient within this cohort, we were able to obtain a patient-specific pretreatment growth rate α for each patient between the imaging immediately preceding start of treatment and at the time of first immunotherapy treatment by using the exponential growth rate estimation $ρ (t) \approx e^{α ∙ t}$ between tumor burdens measured via imaging collected before treatment and at start of treatment. These per-patient α values were then used in Equation (1) to obtain values for Λ and µ, as described above.

Sensitivity analysis and model simulations

A sensitivity analysis was next performed on Equation (1) in two independent ways (Appendix 1—figure 2). First, each of the parameters Λ and µ were individually altered by ±10% while holding the other parameters constant to simulate the change in relative tumor mass ( $ρ `$ ). Second, individual values of $ρ `$ in the calibration cohort were varied by a uniform random variable by ±0.1 (i.e., 10%) and Equation (1) was re-fitted to these modified data to determine any changes in the derived values for Λ and µ. To determine stability of derived Λ and µ values over time, we also truncated the $ρ `$ data at differing time points (namely, t < 30, 60, 120, 200 days), and subsequently re-fitted Equation (1) to these truncated data to determine Λ and µ. The correlation between the derived values of Λ and µ from the truncated datasets and the full composite dataset was then determined by using Spearman correlation analysis. A simulated long-term RECIST v1.1 score was then determined for each patient by projecting the expected tumor burden at t = 700 days (chosen as a time point beyond the last reported follow-up for most of the patients) by using these values of Λ and µ derived from the truncated fits in order to compare the predicted RECIST scores to the known retrospective scores. Finally, full model simulations were performed at different levels of α, Λ, and µ to determine values of $ρ `$ based on input parameter variation.

Validation of Λ and µ by tumor-infiltrating immune cells and immunostaining

The parameters Λ and µ derived from fitting the clinical response data were compared to pathological biomarkers from additional anti-PD-1 or PD-L1 clinical trials (Borghaei et al., 2015; Robert et al., 2015b; Brahmer et al., 2012; Tumeh et al., 2014; Motzer et al., 2015; Powles et al., 2014; Topalian et al., 2012; Garon et al., 2015; Herbst et al., 2014; Kefford et al., 2014; Spira et al., 2015; Taube et al., 2014; Weber et al., 2015), as shown in Appendix 1—table 1. Specifically, we investigated the ability of Λ and µ to correlate with CD8+ tumor-infiltrating lymphocytes (TILs) and tumor PD-L1 expression, respectively. To compare the values of Λ and µ derived from fitting the clinical response data over time with the trials assessing TILs and PD-L1 expression, the extracted cancer patients were categorized into objective responders versus nonresponders by applying RECIST v1.1 (Eisenhauer et al., 2009) note that resist categories determined by lesion diameter (D) or our volume estimation are mathematically comparable by $V o l u m e = \frac{4}{3} π {(\frac{D}{2})}^{3}$ . Specifically, patients from all RECIST categories (Eisenhauer et al., 2009) were condensed into two groups for analysis, with patients who had ≥30% reduction in tumor burden (partial or complete response) grouped into the ‘favorable’ response group, and patients with either <30% disease reduction (stable disease or disease progression) into the ‘unfavorable’ response group. The last recorded time point from the response curve from each individual patient served to designate the RECIST v1.1 category as this provides the most accurate long-term treatment outcome.

After stratifying each patient into a RECIST v1.1 category, Λ and µ were compared between responding and nonresponding patients by using a Wilcoxon rank sum test and compared to the literature either as a continuous variable (Λ) or by using thresholds (µ). For comparison with biomarkers reported in the literature, Λ was converted to an estimated intratumoral CD8+ T cell count (for details, the interested reader is referred to Butner et al., 2020) by assuming each CD8+ T cell would kill one tumor cell on average (the assumed mean ‘fitness’ of the immune cell population [Mempel and Bauer, 2008]), and that there were 5558 cells/mm² in the tumor microenvironment, as has been quantitatively measured in melanoma (Erdag et al., 2012). For comparison with PD-L1 staining, µ was converted from its raw numerical value to a percentage; no other scaling of the variable was performed as the number of cancer cells bound by anti-PD-1/PD-L1 therapy action is the dominant term in the integral specified in Equation S4 in Butner et al., 2020; this approximation and its implications are further examined in ‘Discussion.’ Assessment of objective response rates (ORRs) at standard thresholds of 1% and 5% PD-L1 staining (corresponding to µ) were used in this study. Other alternative PD-L1 cutoffs present in some studies (Table 1 and Appendix 1—table 1) were not included in this analysis due to the relatively small numbers of patients. The biomarker trials used for validation of these parameters are also presented in Appendix 1—table 1.

Results

Quantification of model parameters α, Λ, and µ

Measured tumor burden data over time from the total collective calibration patient pool (n = 189) after initiating checkpoint inhibitor-based therapy were extracted from the six reported clinical trials (Table 1). Of this population, 55 patients (29%) had objective responses by RECIST v1.1 criteria while 134 patients (71%) demonstrated stable/progressive disease. The derived tumor proliferation constant, α, was determined to range from 0.0034 (tumor doubling time of ~200 days) in renal cell carcinoma to 0.0622 (tumor doubling time of ~11 days) in non-mismatch repair colon cancer with an average α of 0.018 and average tumor doubling time of ~85 days (Table 1). In the validation NSCLC cohort, 25 patients (39%) had objective response, and 39 patients (61%) demonstrated stable/progressive disease, with individual patient proliferation constants (α) ranging from –0.0129 to 0.0602 (note that α < 0 indicates a subset of patients that had a shrinking tumor burden before start of therapy).

Having determined α for each cancer histopathology, the clinical response curves to checkpoint inhibitors for each tumor type were fit to Equation (1) to determine Λ and µ. The average root-mean-square error of fitting Equation (1) to the clinical data was only 0.4%. A sample exponential fit to extracted melanoma time-course data is shown (Appendix 1—figure 1, second panel, red curve). A sample of these curve fits for patients with melanoma from the trial by Topalian et al., 2012 is depicted in Figure 2. The derived fits from all 189 patient response curves in the calibration cohort yielded a mean ± standard error of the mean (SEM) value of Λ of 0.714 ± 0.257 in patients with partial/complete response and 0.0995 ± 0.0264 in patients with stable/progressive disease (p=0.119; Wilcoxon two-tail), while the mean ± SEM value of µ was 0.054 ± 0.014 versus 0.013 ± 0.0012 in partial/complete response versus stable/progressive disease, respectively (p<0.001). In the validation NSCLC cohort, the mean ± SEM value of Λ was 0.876 ± 0.102 in patients with partial/complete response and 0.0297 ± 0.469 in patients with stable/progressive disease (p<0.001), while the mean ± SEM value of µ was 0.0529 ± 0.00982 to –0.0064 ± 0.0032 in partial/complete response versus stable/progressive disease (p<0.001). These values are depicted in Figure 3. These results suggest that, while Λ and µ give significantly separated classification ranges for partial/complete response versus stable/progressive disease, the specific value of the binary classification threshold is likely a function of the unique disease-drug combination used, as observed in our prior studies (Butner et al., 2021). This point was explored further through a ‘leave-one-cancer-type-out’ validation study within the calibration cohort, wherein one cancer type was removed from the calibration cohort and used as validation against the parameter ranges in the reduced calibration set obtained from Borghaei et al., 2015; Antonia et al., 2015; Le et al., 2015; Motzer et al., 2015; Powles et al., 2014; and Topalian et al., 2012. Results revealed that mean ranges vary between individual cancer types, and that μ shows more consistent significant difference between response categories relative to Λ (these results are consistent with the results shown in Butner et al., 2020; these results are shown in Appendix 1—figure 3, Appendix 1—figure 3—source data 1, and explored further in ‘Discussion’).

Figure 3

Download asset Open asset

Depiction of average Λ and μ values in patients with response (n = 55) versus nonresponse (n = 134) in the calibration cohort (circular markers), while n = 25 patients had objective response and 39 patients demonstrated stable/progressive disease in the validation cohort (square markers) as determined by RECIST v1.1 criteria.

Open markers represent the average values of patients with response, and solid markers represent patients with stable/progressive disease. Error bars represent the standard error of the mean (SEM). p-Values of separation between groups by Wilcoxon rank sum (two tails): Λ, p=0.119 and p<0.001 for literature (calibration) and non-small cell lung cancer (NSCLC) (validation) cohorts, respectively; μ, p<0.001 for both literature (calibration) and NSCLC (validation) cohorts. Insets: receiver-operator characteristic (ROC) curves for patient response versus model parameters for both cohorts; Λ, literature cohort: sensitivity = 0.381, specificity = 0.945, accuracy = 545; μ, literature cohort: sensitivity = 0.891, specificity = 0.567, accuracy = 0.661; Λ, NSCLC clinical cohort: sensitivity = 0.600, specificity = 0.744, accuracy = 0.688; μ, NSCLC clinical cohort: sensitivity = 0.960, specificity = 0.769, accuracy = 0.844. PR, partial response; CR, complete response. Examples of cancer drug-specific parameter values may be found in Butner et al., 2020.

Figure 3—source data 1 Numerical data for Figure 3.: https://cdn.elifesciences.org/articles/70130/elife-70130-fig3-data1-v2.xlsx
Download elife-70130-fig3-data1-v2.xlsx

Confirmation of model stability

The parameters α, Λ, and µ were held constant during the sensitivity analysis at three different values for each parameter. These values were the minimum, average, and maximum values derived from fitting Equation (1) to the data as described above. Changing Λ and µ from these values ± 10% yielded a maximum change in $ρ `$ of 9.2% at t = 200 days. Varying $ρ^{`}$ data points randomly up to ±0.1 resulted in Spearman correlation coefficients of 0.766 and 0.919 for Λ and µ, respectively, derived from fitting these randomized data versus the actual clinical data. We note that, due to high stability observed to these perturbations in the large calibration cohort (n = 189 patients), we did not repeat this sensitivity analysis in the validation cohort. Λ values derived from fitting truncated $ρ `$ data for the calibration cohort at various time points displayed Spearman correlation coefficients with Λ derived from fitting the full data ranging from 0.071 at t < 30 days to 0.730 at t < 200 days, while Spearman correlation coefficients for µ ranged from 0.910 (t < 30 days) to 0.921 (t < 200 days) for all truncated datasets (Table 2). In the validation cohort, Spearman correlation coefficients for Λ ranged 0.800 at t < 30 days to 0.771 at t < 200 days, and 0.800 at t < 30 days to 0.989 at t < 200 days for μ. Simulated RECIST v1.1 categorization (complete/partial response vs. stable/progressive disease) by using the values of Λ and µ derived from fitting the truncated calibration cohort data resulted in 19% misclassification by using data from t < 60 days (n = 177) and 13% misclassification at t < 200 days (n = 189) when compared to the full dataset. In the validation cohort, we observed 18.6% misclassification at t < 60 days (n = 43) and 10.9% misclassification at t <200 days (n = 64). Predicted normalized tumor mass after initiation of immunotherapy is depicted at different combinations of α, Λ, and µ (Figure 4).

Table 2

Spearman correlation coefficients between Λ and µ derived from fitting truncated datasets versus full dataset.

t: days. Note that values of 1.000 are due to only a small number of patients (n = 4) that were imaged before t = 30 days in the validation cohort; these either did not have lesion volumes reassessed before the next reported time threshold (t = 60 days) or did not observe a change in monotonic relationships within this timeframe (t = 30–120 days).

	Calibration cohort					Validation cohort
Λ	t < 60	t < 120	t < 200	t = all days	Λ	t < 60	t < 120	t < 200	t = all days
t < 30	0.476	0.162	0.080	0.071	t < 30	1.000	1.000	0.800	0.800
t < 60		0.416	0.309	0.306	t < 60		0.812	0.658	0.823
t < 120			0.668	0.599	t < 120			0.676	0.750
t < 200				0.730	t < 200				0.771
µ	t < 60	t < 120	t < 200	t = all days	µ	t < 60	t < 120	t < 200	t = all days
t < 30	0.942	0.928	0.922	0.910	t < 30	1.000	0.800	0.800	0.800
t < 60		0.968	0.941	0.946	t < 60		0.974	0.960	0.963
t < 120			0.946	0.922	t < 120			0.971	0.961
t < 200				0.921	t < 200				0.989

Figure 4

Download asset Open asset

Simulated response to immune checkpoint inhibition at different values of α, Λ, and µ.

Data are obtained from Equation (1). Normalized tumor volume ( $ρ `$ ) was determined at t = 200 days. Three different α values were used that represent the minimum, average, and maximum values derived from fitting the calibration cohort, as described in the text. Λ and µ were varied continuously over their respective ranges. Colors also correspond with $ρ `$ as per color map on the right. RECIST v1.1 criteria of response are listed to the right of the color bars.

Analysis of model predictions

Using the binary classification of tumor response of partial/complete response as positive and stable/progressive disease as negative, receiver-operator characteristic (ROC) analysis was performed to identify optimal predictive response thresholds for μ and Λ (Figure 3, insets) as higher values of μ and Λ are expected to correspond to a more favorable patient response. Identification of optimal predictive thresholds in the calibration cohort by maximizing the Youden’s J statistic revealed cutoff thresholds where sensitivity (the proportion of correctly identified patients with partial/complete response) was higher for both Λ and μ (0.945 and 0.891, respectively), while specificity was reduced (0.381 for Λ and 0.567 μ). Response prediction thresholds were identified as 0.722 for Λ and 0.00905 for μ. Testing these same response threshold values (identified in the calibration cohort) in the validation cohort revealed sensitivity of 0.6 for Λ and for 0.960 μ, and specificity of 0.743 for Λ and 0.769 for μ in the validation cohort. We found that, in the calibration cohort, positive predictive values (PPVs; the probability a patient will be a responder when the model predicts they will be a responder: 0.381 for Λ and 0.458 for μ) were lower than the negative predictive values (NPVs; 0.889 for Λ and 0.927 for μ), indicating fewer false-negatives (stable/progressive disease) than false-positives (partial/complete response). This trend was confirmed in the validation cohort (a PPV of 0.600 for Λ and 0.723 for μ; an NPV of 0.744 for Λ and 0.968 for μ). Lastly, we note that overall accuracy was lower by both Λ and μ in the calibration cohort than were observed in the validation cohort; this is presumably due to the misbalance of patients with ORR (29% = 55 patients) versus patients with stable/progressive disease (71%, = 134 patients) while sensitivity (correctly identified patients with ORR) was higher than specificity.

Comparison of Λ and µ with clinical and pathological data

Conversion of Λ to an estimated intratumoral CD8+ T cell count yielded a predicted mean ± SEM of 3970 ± 1429 cells/mm² in patients with partial/complete response to checkpoint inhibition and 553 ± 147 cells/mm² in patients with stable/progressive disease (Figure 5) in the calibration cohort, and 4871 ± 567 cells/mm² versus 165 ± 2,604 cells/mm² in patients with partial/complete response versus stable/progressive disease in the validation cohort. Intratumoral CD8+ T cell counts referenced from Tumeh et al., 2014 are derived from two scenarios, either encompassing data in the pretreatment setting only (n = 46) or data including pathological CD8+ T cell counts encompassing both pretreatment and on treatment (n = 23). In the pretreatment setting, the average intratumoral CD8+ T cell count was 2632 ± 518 cells/mm² in patients with partial/complete response to checkpoint inhibitors and 322 ± 133 cells/mm² in patients demonstrating stable/progressive disease, while including on-treatment plus pretreatment data yielded an average of 3770 ± 675 cells/mm² in patients with partial/complete response and 501 ± 113 cells/mm² in patients with stable/progressive disease.

Figure 5

Download asset Open asset

Comparison of intratumoral CD8+ T cell count and tumor PD-L1 staining derived from fitting the model to clinical data and values reported in the literature, as described in the text.

(A) Model intratumoral CD8+ T cell count (circles: calibration cohort, p=0.119 [Wilcoxon, two-tail]; squares: validation cohort, p<0.001) was derived from Λ and literature CD8 intratumoral count was taken from immunohistochemical (IHC) staining in Tumeh et al., 2014 in melanoma (diamonds; average CD8 counts including on-treatment values [n = 23]). CD8+ T cell counts from pretreatment biopsies only (n = 46) demonstrated mean values (± SEM) of 2632 ± 518 cells/mm² in patients with response to immunotherapy and 322 ± 133 cells/mm² in nonresponding patients, respectively. Values for CD8+ T cell counts are plotted as averages with error bars representing the standard error. (B) Patient response rates to immunotherapy stratified by PD-L1 staining were derived from µ from the model (calibration: red; validation: blue) and from references (Borghaei et al., 2015; Robert et al., 2015b; Brahmer et al., 2012; Tumeh et al., 2014; Motzer et al., 2015; Powles et al., 2014; Topalian et al., 2012; Garon et al., 2015; Herbst et al., 2014; Kefford et al., 2014; Spira et al., 2015; Taube et al., 2014; Weber et al., 2015) for the literature data (green; n = 975 for 1% cutoff, n = 1492 for 5% cutoff; see Appendix 1—table 1). Response to immune checkpoint inhibition was determined by RECIST v1.1 criteria. PR, partial response; CR, complete response.

Figure 5—source data 1 Numerical data for Figure 5.: https://cdn.elifesciences.org/articles/70130/elife-70130-fig5-data1-v2.xlsx
Download elife-70130-fig5-data1-v2.xlsx

For comparison of µ with PD-L1 staining, data were extracted from a total of 12 published clinical trials (n = 975 cancer patients) with data on clinical response by using a PD-L1 staining cutoff of ≥1% versus <1% and 1492 patients with a cutoff of ≥5% versus <5%. The ORR of patients with these thresholds was 15% for PD-L1 staining <1% and 28% for PD-L1 staining ≥1%, and 21% and 38% for <5% and ≥5%, respectively. The ORR of patients in the calibration cohort by using the same thresholds in the derived values of µ was therefore 10% and 45% for patients with µ < 1% and ≥1%, respectively, and was 25% and 67% for patients with µ < 5% and ≥5%, while in the validation cohort, the model-predicted ORR was 9% and 71% for patients with µ < 1% and ≥1%, respectively, and was 29% and 100% for patients with µ < 5% and ≥5% (Figure 5—source data 1).

Discussion

The translational mathematical model introduced here retrospectively investigates the molecular, cellular, and biophysical mechanism(s) behind patient response to immune checkpoint inhibitor therapy, and it explores the potential clinical value of the early prediction of treatment effectiveness. The reductionist approach introduced here simplifies the rather complex biological cross-talk between the immune system with cancer cells to a set of differential equations ultimately dependent on three intrinsic parameters that represent tumor proliferation, intratumoral immune cell presence/killing efficiency (considered as baseline immune cell infiltration), and checkpoint inhibition efficacy; this latter parameter represents the active role of the checkpoint inhibitors in initiating and amplifying the anti-tumor response. We have demonstrated that these parameters may be informed using either imaging or IHC measures, enabling for robust implementation even when some of these measures are unavailable, and offering methods to calculate PD-L1 density and intratumoral CD8+ T cell counts without invasive methods or to inform the model using only IHC measures at start of treatment.

From a mechanistic standpoint, the mathematical model is fully compatible with the current understanding of the biological effect of checkpoint blockade and clinical subtypes of immunotherapy-responsive tumors (Teng et al., 2015). First, the parameter values derived from our model for intratumoral immune cell infiltration (Λ) and immunotherapy antibody efficacy (µ) correspond with the quantitative pathological measures of intratumoral CD8+ T cell infiltration and PD-L1-positive staining (Figure 4; Figure 5). Although parameters Λ and μ are not direct representations of CD8+ T cell counts or PD-L1 expression, they correlated with measured pathological biomarkers, thus providing strong experimental evidence that these mathematical parameters may be quantified from these biomarkers. This offers a unique method for clinical translation using clinically available measured quantities to provide personalized prediction of patient response, a potential that we have often found particularly lacking in prior mechanistic modeling research. By demonstrating links between model parameters and known biology, our model may also be used to quantify the associated mechanistic underpinnings of treatment failure, with the goal of suggesting clinical interventions that may overcome these deficiencies to improve patient outcome. Unfortunately, the absence of per-patient measurements of CD8+ T cell counts or PD-L1 expression corresponding to individual patient response to treatment in the cohorts examined prevented analysis of how these parameters perform on a per-patient basis. We are currently collecting in-house a new dataset containing both measures for single patients, and the results of this study will be published once complete. We are also investigating how these biomarkers may inform the model to prospectively identify pseudoprogression (a clinical phenomenon wherein lesions are observed to experience rapid volume increase followed by disease response) on a per-patient basis, based on our previous result that retrospectively known long-term parameter values are unique in pseudoprogression (Butner et al., 2020).

Moreover, the model demonstrates that the rate of immunotherapy response arises from nonlinear interactions between both adequate effector immune cell infiltration in tumors and immunotherapy efficacy within the tumor microenvironment (Figure 4). Mechanistic mathematical modeling across several cancer types (Table 1) suggests that the overlying master equation [i.e., Equation (1)] may well be universally applied, while the model parameter values presented here are likely tumor-specific. Indeed, this conclusion may be observed in Figure 3, where Λ and µ are distinctly different for ORR versus stable or progressive disease, but the values are different for the different cohorts, thereby capturing mechanistic differences across the different cancer types. However, further testing of the model in additional cancer types and larger patient cohorts remains necessary, in part due to the heterogeneous nature of solid tumors, both within individual patients and across different cancer types. The nontrivial interaction of these inputs predicted by this model is different in comparison to many established and current candidate biomarker studies (which focus on linear immunotherapy responses to just one of these markers, e.g., PD-L1 expression [Carbognin et al., 2015]), perhaps providing a plausible explanation why single biomarkers sometimes provide inconsistent predictions across multiple cancer types (Carbognin et al., 2015). Similarly, the unique insights presented herein allow for a more direct comparison of the model parameters to common pathological markers either reported in the literature or as yet to be reported, and provide a different perspective compared to other immune checkpoint inhibitor modeling studies (Łuksza et al., 2017; Wilkie and Hahnfeldt, 2013; Serre et al., 2016).

The high sensitivity at early time points (t < 60 days) demonstrated here indicates that this model may provide valuable early identification of cancer patients most likely to benefit from checkpoint inhibition therapy, with a high NPV indicating minimal false-negatives in the group predicted to receive the least benefit from therapy. Therefore, this attribute could serve as an early indicator of the efficacy of checkpoint inhibition by simply using either clinical or imaging measurements of index tumor lesions and by applying the mathematical model to project maximal effect for an individual patient. Further, the model demonstrates robustness and stability in the derived values of Λ and μ to random variations in $ρ `$ , and by using values of Λ and μ derived from fitting limited data over time (Table 2). This result is in stark contrast to previous mathematical descriptions of immune-mediated killing of cancer cells, where a relatively small change in a single input parameter of merely ±1% could dramatically vary tumor response by up to ±50% (de Pillis et al., 2005).

Towards clinical translation of cancer models, a mathematical model with two simple terms (an exponential growth term and a regression term) has previously been used to successfully correlate and predict patient survival (Stein et al., 2008). The fundamental difference between this prior model (Stein et al., 2008) and the model reported here is that the quantification of cell death is more mechanistic, that is, depending on the specific mechanisms (Figure 1) that underlie cancer cell and immunotherapy drug interactions, hence allowing one to gain more mechanistic insight into the treatment system. As demonstrated, model parameters Λ and µ can be used to stratify responding and nonresponding patients (Figure 3), which has immediate potential utility as a biomarker for patient selection in prospective clinical trials. Moreover, the model contains biological values that, at least in principle, may either be measured (e.g., tumor burden, growth rate) or changed clinically (µ: e.g., drug dosing or dosing schedule; $Λ$ : e.g., radiotherapy-induced increase in PD-L1 expression, radiotherapy abscopal effect). Thus, we expect that the model (i) may be informed by using standard-of-care measurements (e.g., Figure 5) and (ii) can provide quantitative information on which parameters must be changed to maximize therapeutic benefit, providing clinicians with potentially valuable decision-making information.

Of course, as with any biomathematical model, this model is based on several educated assumptions about the interactions of immune effectors (CD8+ T cells) with cancer cells, which naturally does not reflect the sheer magnitude and complexity of the tumor-immune microenvironment. These include the presence of immunosuppressive cells (such as neutrophils, myeloid-derived suppressor cells, Treg, and M2-polarized tumor-associated macrophages), which extensively infiltrate into tumor mass and hinder the efficacy of immune checkpoint inhibitors (Jenkins et al., 2018). Moreover, effects of other immune cells, such as CD4+ T cells, are not explicitly included in the current model form; while it is likely that some of the effects from these other cells are captured within the model representation of CD8+ T cells, this assumption warrants future model development where each immune component is explicitly represented. Some of these assumptions (e.g., lack of immune cell/antibody infiltration terms) are supported with in vitro or in vivo data such as high rates of immune cell binding by anti-PD1 antibodies in the peripheral circulation (Topalian et al., 2012) and local intratumoral (as opposed to systemic myelogenous) expansion of CD8+ T cells during checkpoint inhibition (Tumeh et al., 2014; Ribas et al., 2016). Other potential model parameters would logistically be quite challenging to measure in an outpatient clinic-ready setting routinely at this time, and their inclusion remains open for follow-up confirmatory retrospective studies and ultimately for future prospective clinical trials. As such, the integration of additional prognostic biomarkers and master regulators that intrinsically (e.g., genetic stability) and extrinsically control the efficacy of immunotherapy represents open research areas for future translational investigation.

Moreover, the two response parameters derived from the model, Λ and μ, represent abstract terms, which may not precisely model intratumoral CD8+ lymphocyte infiltration and tumor cell PD-L1 staining and potentially can be modified by relevant determinants, such as tumor mutational burden (Goodman et al., 2017) or the human microbiome of the gut (Gopalakrishnan et al., 2018). Moreover, these parameters represent a simplifying average value of these fluctuating parameters. We take this to be a reasonable assumption because (i) these quantities are not directly measurable (this is also the case for cell proliferation events underlying the tumor growth rate parameter α), (ii) in our in-house data, times between patient reassessment ranged 17–91 days, so even direct measurement of these would provide an average value over this time period, and (iii) these processes take place at far shorter times than patient reassessments. By presenting the model in this reduced form, we enable simplified interpretation of the results while also providing a single, easy-to-understand scalar that contains significant information about the treatment response.

Finally, a few operational aspects of this work deserve further comment. Response was defined using RECIST v1.1 criteria, in lieu of the more recent adaptation of RECIST criteria to immunotherapy treatment (iRECIST), because the studies used to derive the model parameters in this mechanistic analysis did not incorporate these new criteria, and our use of published data for the calibration cohort limited or precluded us from obtaining a priori knowledge about nontarget lesions. Moreover, our work to date has only involved testing our model in a handful of cancer types, and further validation in additional disease phenotypes and larger total patient populations remains outstanding. These inherent study limitations notwithstanding, we will continue to improve our model to more accurately predict outcomes in the immunotherapy-specific setting of individualized cancer patients, potentially through the inclusion of additional biomarkers, as bioactive molecules such as IFNγ, CD206, CX3CR1, CD1D, and iNOS, along with cell-mediated mechanisms known to have an effect on immune checkpoint inhibitor therapy (Park et al., 2018; Gubin et al., 2018). However, we do not anticipate that such improvements and refinements would change the basic findings and the potential value of the mechanistic mathematical model reported in this work. In going forward, one hopes that knowledge broadly applicable across multiple cancer types and/or immune microenvironment control will be serially incorporated to the dynamic model upon their future discovery and validation.

In conclusion, we present a mechanistic model of immune checkpoint inhibition that is able to describe various immunotherapy response profiles, with the inputs to the model correlating with common pathological biomarkers in current clinical use. An early and robust a priori predictor for checkpoint inhibition response and outcome might provide a glimpse of the immense potential for timely adjustments and therapeutic personalization. Future prospective investigations of this computational science-assisted approach will focus on readily available clinical data as inputs to the model and further refining the complex interplay between the immune system and the cancer environment to extract other important variables for immunotherapy efficacy. Towards this end, we are currently pursuing in-house collection of per-patient, paired IHC measures of PD-L1 or T cell counts with tumor response, which will enable us to directly correlate IHC measures of interest with tumor response, while also allowing for examination of additional patient parameters, such as tumor stage or patient age. We will also obtain data from different cancer types known to be receptive to ICI therapy in order to further evaluate the potential of our model to perform as a more universal predictor across an even more diverse array of cancer phenotypes. Ultimately, the merit of this approach will rely on its future ability to reliably predict early individual patient response with the goal of improving personalized cancer care.

Appendix 1

Immunotherapy model derivation

The mechanistic model of cancer immunotherapy presented in this paper is essentially an extension of our prior mathematical model describing chemotherapy response that has been shown to predict cancer cell kill with various cytotoxic or targeted agents. In particular, we extend these equations to consider immune cell presence as necessary for cancer cell kill secondary to immunotherapy, and that immune cells respond to not only diffusion gradients within a tumor microenvironment but can also be influenced by the presence of cytokines through cell signaling pathways and chemotaxis. The model hypothesis of immunotherapy presented here is that these molecules or antibodies diffuse and block the complimentary interaction between immune checkpoint ligands expressed on cancer cells with their complementary proteins on immune cells. This mechanism renders effector immune cells potentially active for cancer cell killing; thus, the therapeutic site of action occurs within the tumor microenvironment (i.e., because our model only describes the tumor region and the factors and processes contained therein, we have made the assumption that all key mechanisms such as drug binding occur only within the tumor). These assumptions lead to the following system of PDEs:

\frac{\partial ρ}{\partial t} = α \cdot ρ - λ_{p} \cdot ρ \cdot ψ_{k} \cdot \int_{0}^{t} λ \cdot σ \cdot ρ \cdot d t^{'}

\frac{\partial ψ_{k}}{\partial t} = - χ \cdot \nabla \cdot (ψ_{k} \cdot \nabla \cdot C) + Λ_{ψ} \cdot (\frac{\partial ρ}{\partial t} - α \cdot ρ)

0 = D_{a} \cdot \nabla^{2} σ - λ \cdot σ \cdot ρ

0 = D_{C} \cdot \nabla^{2} C + Λ_{C} \cdot λ \cdot σ \cdot ρ

Here $ρ$ , $ψ_{k}$ , $σ$ , and $C$ represent the local concentration of cancer cells, therapeutic immune cells, immunotherapy antibodies, and cytokines, respectively. Moreover, α is the proliferation rate of tumor cells, $λ_{p}$ is the specific death rate of cancer cells, $λ$ is the binding coefficient of immunotherapy antibodies that block the interaction between immune inhibitory ligands on cancer cells and their counterparts on immune cells, $Λ_{ψ}$ is the coupling of immune cell activity relative to the number of cancer cells (i.e., killing and tumor infiltration capacity of the host immune system), χ is the chemotaxis coefficient, Λ_C is the number of released cytokines as immunotherapy antibodies are bound, and D_a and D_c are the diffusivity of antibodies and cytokines (see also Figure 1, main text).

The first equation describes the death rate of cancer cells as proportional to the concentration of therapeutic immune cells and the time history of immunotherapy antibody uptake and binding within the tumor environment. The second equation represents mass conservation of ‘effective’ therapeutic immune cells, including the rate at which these cells become ineffective at killing cancer cells. The third and fourth equations represent the concentration and diffusion of immunotherapy antibodies and cytokines in the presence of immunotherapy antibody binding.

To compare this mechanistic model with clinical immunotherapy data, we make multiple reductionist assumptions about the influence of various parameters from Equation A1-4 on immunotherapy response. These assumptions suppose that immune cells are in relatively close physical proximity to cancer cells, allowing one to ignore the influence of cytokines to guide their movement, and that the primary effector immune cell response to immunotherapy is driven by the presence of immune cells already present in the tumor at the initiation of the therapy. Furthermore, we assume uptake and binding of immunotherapy antibodies within the tumor environment to occur diffusely relative to cancer and immune cell concentrations; therefore, in this model, we set $χ = 0$ and remove the influence of immunotherapy antibody concentration. These assumptions reduced the four PDEs to the following set of coupled ODEs as follows:

\frac{d ρ}{d t} = α \cdot ρ - λ_{p} \cdot ρ \cdot ψ_{k} \cdot \int_{0}^{t} λ \cdot σ \cdot ρ \cdot d t^{`}

\frac{d ψ_{k}}{d t} = Λ_{ψ} \cdot (\frac{d ρ}{d t} - α \cdot ρ)

Here, Equation A6 represents the change in tumor-infiltrating immune cells relative to the change in cancer cells killed by the immune system. In the case where immune cell killing is weak (i.e., $λ_{p} ≅ 0$ , and thus $\frac{d ρ}{d t} = α \cdot ρ$ ), the change in immune cell concentration within the tumor is negligible compared to the growth of the tumor, thus Equation A6 satisfies the relationship $\frac{d ψ_{k}}{d t} ≅ 0$ (i.e., immune cell concentration within the tumor remains roughly constant over time). When immune cell killing is sufficiently effective, then

$λ_{p} \cdot ρ \cdot ψ_{k} \cdot \int_{0}^{t} λ \cdot σ \cdot ρ \cdot d t^{`} §amp;gt; α \cdot ρ$ and thus $\frac{d ψ_{k}}{d t} ≅ Λ_{ψ} \cdot (\frac{d ρ}{d t})$ . In essence, the change in immune cells in the tumor over time is roughly equal to the immune cell coupling to cancer cells [i.e., immune cells in the tumor environment are related to the tumor volume by a coupling factor ( $Λ_{ψ}$ )], which captures the immunogenicity of an individual tumor. Integrating both sides of Equation A6 over time leads to the following relationship:

ψ_{k} - ψ_{0} = Λ_{ψ} \cdot [ρ - ρ_{0}]

where $ρ_{0}$ and $ψ_{0}$ represent the concentration of tumor cells and immune cells at the start of immunotherapy. We then substitute $ψ_{k}$ from, Equation (A7) into Equation (A5) express $Λ_{ψ ρ} = {Λ_{ψ} \cdot ρ}_{0} / ψ_{0}$ , and replace the concentration of tumor cells $ρ$ by a proportion of the original tumor cell concentration to obtain the normalized tumor mass $ρ^{`} = ρ / ρ_{0}$ (while noting that one may also use normalized tumor volume here) to give us one equation of tumor response represented by

\frac{d ρ `}{d t} = α \cdot ρ ` - {λ_{p} \cdot ρ}^{`} \cdot [1 + Λ_{ψ ρ} \cdot (ρ^{`} - 1)] \cdot \int_{0}^{t} λ \cdot σ \cdot ρ ` \cdot d t^{`}

Finally, we assume that the binding of immunotherapy antibodies within the tumor environment ( $\int_{0}^{t} λ \cdot σ \cdot ρ ` \cdot d t^{`}$ ) and rate of tumor cell death secondary to effector immune cells ( $λ_{p}$ ) reach constant steady states on time scales faster than measurable tumor cell kill, implying $λ_{p} \cdot \int_{0}^{t} λ \cdot σ \cdot ρ^{'} \cdot d t^{'} = μ$ , leading to

\frac{d ρ^{'}}{d t} = α \cdot ρ^{'} - ρ^{'} \cdot [1 + Λ_{ψ ρ} \cdot (ρ^{'} - 1)] \cdot μ

This ODE can be solved analytically for $ρ `$ by integrating both sides, yielding

ρ^{'} = \frac{1 + \frac{α - μ}{μ \cdot Λ_{ψ ρ}}}{1 + (\frac{α - μ}{μ \cdot Λ_{ψ ρ}}) e^{- (α - μ + μ \cdot Λ_{ψ ρ}) \cdot t}}

Equation A10 is the same as Equation (1) in the primary text, which is used to compare with clinical response data to immunotherapy.

Appendix 1—figure 1

Download asset Open asset

Steps for calibration of the mathematical model with clinical data.

First, checkpoint inhibitor response curves were extracted from the literature. In all cases, immunotherapy treatment began at time t = 0. Second, a tumor-specific proliferation constant (α) was determined for each cancer type by fitting exponential function ( $e^{α t}$ to fastest progressing patient in each clinical trial [red line]). Third, individual patient response data were fit to Equation (1) by using the respective α to determine Λ and *µ. Λ* and µ values were then with compared in patients with partial/complete response versus patients with stable/progressive disease after immunotherapy by using the RECIST v1.1 criteria.

Appendix 1—figure 2

Download asset Open asset

Model validation, sensitivity studies, and comparison of model parameters to immunohistochemical (IHC) measures.

Model parameters were obtained from a second in-house patient cohort of patients with non-small cell lung cancer (NSCLC) (n = 64), which were compared to values obtained in the calibration cohort in a validation study. To study the sensitivity of the model to changes in model parameter values, key parameters were perturbed ±10% and the resultant simulated expected tumor burden was compared to measured values pre-perturbation. Tumor burden measures were also truncated, and results of truncated and full dataset model fits were compared. Lastly, the full parameter space of the model was examined. In order to compare model parameters to the underlying biology, model parameters were converted to intratumoral CD8+ lymphocyte counts (for Λ) and PD-L1 staining (for μ), which were compared to IHC measures obtained from the literature.

Appendix 1—figure 3

Download asset Open asset

Parameter validation analysis within the calibration cohort.

In order to examine the robustness of ranges for (A) parameter Λ and (B) parameter μ between partial and complete response (PR/CR) versus stable/progressive disease among different cancer types, a validation study was performed where one cancer type was removed from the calibration cohort and used as validation against the parameter ranges in the reduced calibration set obtained from Borghaei et al., 2015; Antonia et al., 2015; Le et al., 2015; Motzer et al., 2015; Powles et al., 2014; and Topalian et al., 2012. Analysis was repeated once for each cancer type, and results are shown as mean ± standard deviation (error bars). Parameter ranges were found to vary between individual cancer types, and with μ showing more consistent significant difference between response categories relative to Λ (these results are consistent with results shown in Butner et al., 2020).

Appendix 1—figure 3—source data 1 Numerical data for Appendix 1—figure 3.: https://cdn.elifesciences.org/articles/70130/elife-70130-app1-fig3-data1-v2.xlsx
Download elife-70130-app1-fig3-data1-v2.xlsx

Appendix 1—table 1

Studies used for derivation of pathological markers of immunotherapy response.

Reference (see main text)	Tumor type	Checkpoint inhibitor	Pathological biomarker	PD-L1 staining cutoff
Tumeh et al., 2014	Melanoma	Pembrolizumab	CD8+ TILs	N/A
Kefford et al., 2014	Melanoma	Pembrolizumab	PD-L1	1%
Powles et al., 2014	UCC	Atezolizumab	PD-L1	1%, 5%, 10%
Herbst et al., 2014	NSCLC, RCC, melanoma, HNSCC, CRC, gastric and pancreatic cancer	Atezolizumab	PD-L1	1%, 5%, 10%
Robert et al., 2015b	Melanoma	Nivolumab	PD-L1	5%
Motzer et al., 2015	RCC	Nivolumab	PD-L1	5%
Taube et al., 2014	NSCLC, RCC, melanoma, PC, CRC	Nivolumab	PD-L1	5%
Spira et al., 2015	NSCLC	Atezolizumab	PD-L1	1%, 5%, 10%
Brahmer et al., 2012	NSCLC	Nivolumab	PD-L1	1%, 5%, 10%
Borghaei et al., 2015	NSCLC	Nivolumab	PD-L1	1%, 5%, 10%
Weber et al., 2015	Melanoma	Nivolumab	PD-L1	5%
Topalian et al., 2012	Melanoma, RCC, NSCLC, CRC, PC	Nivolumab	PD-L1	5%
Garon et al., 2015	NSCLC	Pembrolizumab	PD-L1	1%, 50%

RCC: renal cell; UCC: urothelial cell carcinoma; CRC: colorectal carcinoma; NSCLC: non-small lung carcinoma; HNSCC: head and neck squamous cell carcinoma; PC: prostate carcinoma; TIL: tumor-infiltrating lymphocytes

Data availability

No new clinical patient data was produced in this study. Data used that was obtained from literature is available in the original publications; we have been careful to cite each of these in the manuscript. Interested researchers should reach out directly to the primary authors of these studies. Data for the in-house clinical trial cohort are from the study reported in PMC7555111; interested researchers should contact the authors of this publication with any data requests.

References

1. Anaya DA
2. Dogra P
3. Wang Z
4. Haider M
5. Ehab J
6. Jeong DK
7. Ghayouri M
8. Lauwers GY
9. Thomas K
10. Kim R
11. Butner JD
12. Nizzero S
13. Ramírez JR
14. Plodinec M
15. Sidman RL
16. Cavenee WK
17. Pasqualini R
18. Arap W
19. Fleming JB
20. Cristini V
(2021) A Mathematical Model to Estimate Chemotherapy Concentration at the Tumor-Site and Predict Therapy Response in Colorectal Cancer Patients with Liver Metastases
Cancers 13:444.

https://doi.org/10.3390/cancers13030444
- PubMed
- Google Scholar
1. Antonia SJ
2. Bendell JC
3. Taylor MH
4. Calvo E
5. Jaeger D
6. De Braud FG
7. Ott PA
8. Pietanza MC
9. Horn L
10. Le DT
11. Morse M
12. Lopez-Martin JA
13. Ascierto PA
14. Christensen O
15. Grosso J
16. Simon JS
17. Lin CS
18. Eder JP
(2015) Phase I/II study of nivolumab with or without ipilimumab for treatment of recurrent small cell lung cancer (SCLC): CA209-032
Journal of Clinical Oncology 33:7503.

https://doi.org/10.1200/jco.2015.33.15_suppl.7503
- Google Scholar
1. Auslander N
2. Zhang G
3. Lee JS
4. Frederick DT
5. Miao B
6. Moll T
7. Tian T
8. Wei Z
9. Madan S
10. Sullivan RJ
11. Boland G
12. Flaherty K
13. Herlyn M
14. Ruppin E
(2018) Robust prediction of response to immune checkpoint blockade therapy in metastatic melanoma
Nature Medicine 24:1545–1549.

https://doi.org/10.1038/s41591-018-0157-9
- PubMed
- Google Scholar
1. Borghaei H
2. Paz-Ares L
3. Horn L
4. Spigel DR
5. Steins M
6. Ready NE
7. Chow LQ
8. Vokes EE
9. Felip E
10. Holgado E
11. Barlesi F
12. Kohlhäufl M
13. Arrieta O
14. Burgio MA
15. Fayette J
16. Lena H
17. Poddubskaya E
18. Gerber DE
19. Gettinger SN
20. Rudin CM
21. Rizvi N
22. Crinò L
23. Antonia SJ
24. Dorange C
25. Harbison CT
26. Graf Finckenstein F
27. Brahmer JR
(2015) Nivolumab versus docetaxel in advanced nonsquamous non-small-cell lung cancer
The New England Journal of Medicine 373:1627–1639.

https://doi.org/10.1056/NEJMoa1507643
- PubMed
- Google Scholar
1. Brahmer JR
2. Tykodi SS
3. Chow LQM
4. Hwu W-J
5. Topalian SL
6. Hwu P
7. Drake CG
8. Camacho LH
9. Kauh J
10. Odunsi K
11. Pitot HC
12. Hamid O
13. Bhatia S
14. Martins R
15. Eaton K
16. Chen S
17. Salay TM
18. Alaparthy S
19. Grosso JF
20. Korman AJ
21. Parker SM
22. Agrawal S
23. Goldberg SM
24. Pardoll DM
25. Gupta A
26. Wigginton JM
(2012) Safety and activity of anti-PD-L1 antibody in patients with advanced cancer
The New England Journal of Medicine 366:2455–2465.

https://doi.org/10.1056/NEJMoa1200694
- PubMed
- Google Scholar
1. Brocato TA
2. Coker EN
3. Durfee PN
4. Lin Y-S
5. Townson J
6. Wyckoff EF
7. Cristini V
8. Brinker CJ
9. Wang Z
(2018) Understanding the connection between nanoparticle uptake and cancer treatment efficacy using mathematical modeling
Scientific Reports 8:7538.

https://doi.org/10.1038/s41598-018-25878-8
- PubMed
- Google Scholar
1. Brocato TA
2. Brown-Glaberman U
3. Wang Z
4. Selwyn RG
5. Wilson CM
6. Wyckoff EF
7. Lomo LC
8. Saline JL
9. Hooda-Nehra A
10. Pasqualini R
11. Arap W
12. Brinker CJ
13. Cristini V
(2019) Predicting breast cancer response to neoadjuvant chemotherapy based on tumor vascular features in needle biopsies
JCI Insight 4:e126518.

https://doi.org/10.1172/jci.insight.126518
- Google Scholar
(2007) Mathematical model of BCG immunotherapy in superficial bladder cancer
Bulletin of Mathematical Biology 69:1847–1870.

https://doi.org/10.1007/s11538-007-9195-z
- PubMed
- Google Scholar
(2016) Improving bacillus Calmette-Guérin (BCG) immunotherapy for bladder cancer by adding interleukin 2 (IL-2): A mathematical model
Mathematical Medicine and Biology 33:159–188.

https://doi.org/10.1093/imammb/dqv007
- PubMed
- Google Scholar
1. Butner JD
2. Elganainy D
3. Wang CX
4. Wang Z
5. Chen SH
6. Esnaola NF
7. Pasqualini R
8. Arap W
9. Hong DS
10. Welsh J
11. Koay EJ
12. Cristini V
(2020) Mathematical prediction of clinical outcomes in advanced cancer patients treated with checkpoint inhibitor immunotherapy
Science Advances 6:eaay6298.

https://doi.org/10.1126/sciadv.aay6298
- PubMed
- Google Scholar
1. Butner JD
2. Wang Z
3. Elganainy D
4. Al Feghali KA
5. Plodinec M
6. Calin GA
7. Dogra P
8. Nizzero S
9. Ruiz-Ramirez J
10. Martin GV
11. Tawbi HA
12. Chung C
13. Koay EJ
14. Welsh JW
15. Hong DS
16. Cristini V
(2021) A mathematical model for the quantification of a patient’s sensitivity to checkpoint inhibitors and long-term tumour burden
Nature Biomedical Engineering 5:297–308.

https://doi.org/10.1038/s41551-020-00662-0
- Google Scholar
1. Carbognin L
2. Pilotto S
3. Milella M
4. Vaccaro V
5. Brunelli M
6. Caliò A
7. Cuppone F
8. Sperduti I
9. Giannarelli D
10. Chilosi M
11. Bronte V
12. Scarpa A
13. Bria E
14. Tortora G
(2015) Differential activity of nivolumab, pembrolizumab and MPDL3280A according to the tumor expression of programmed death-ligand-1 (PD-L1): Sensitivity analysis of trials in melanoma, lung and genitourinary cancers
PLOS ONE 10:e0130142.

https://doi.org/10.1371/journal.pone.0130142
- PubMed
- Google Scholar
(2021) Predicting immunotherapy response through genomics
Current Opinion in Genetics & Development 66:1–9.

https://doi.org/10.1016/j.gde.2020.11.004
- Google Scholar
(2017)
An Introduction to Physical Oncology: How Mechanistic Mathematical Modeling Can Improve Cancer Therapy Outcomes

An Introduction to Physical Oncology, An Introduction to Physical Oncology: How Mechanistic Mathematical Modeling Can Improve Cancer Therapy Outcomes, CRC Press, Taylor & Francis Group, 10.4324/9781315374499.
- Google Scholar
1. Das H
2. Wang Z
3. Niazi MKK
4. Aggarwal R
5. Lu J
6. Kanji S
7. Das M
8. Joseph M
9. Gurcan M
10. Cristini V
(2013) Impact of diffusion barriers to small cytotoxic molecules on the efficacy of immunotherapy in breast cancer
PLOS ONE 8:e61398.

https://doi.org/10.1371/journal.pone.0061398
- PubMed
- Google Scholar
(2005) A validated mathematical model of cell-mediated immune response to tumor growth
Cancer Research 65:7950–7958.

https://doi.org/10.1158/0008-5472.CAN-05-0564
- PubMed
- Google Scholar
1. Dogra P
2. Adolphi NL
3. Wang Z
4. Lin Y-S
5. Butler KS
6. Durfee PN
7. Croissant JG
8. Noureddine A
9. Coker EN
10. Bearer EL
11. Cristini V
12. Brinker CJ
(2018) Establishing the effects of mesoporous silica nanoparticle properties on in vivo disposition using imaging-based pharmacokinetics
Nature Communications 9:4551.

https://doi.org/10.1038/s41467-018-06730-z
- PubMed
- Google Scholar
1. Dogra P
2. Butner JD
3. Chuang YL
4. Caserta S
5. Goel S
6. Brinker CJ
7. Cristini V
8. Wang Z
(2019) Mathematical modeling in cancer nanomedicine: a review
Biomedical Microdevices 21:e380-2.

https://doi.org/10.1007/s10544-019-0380-2
- PubMed
- Google Scholar
1. Dogra P
2. Butner JD
3. Nizzero S
4. Ruiz Ramírez J
5. Noureddine A
6. Peláez MJ
7. Elganainy D
8. Yang Z
9. Le A-D
10. Goel S
11. Leong HS
12. Koay EJ
13. Brinker CJ
14. Cristini V
15. Wang Z
(2020a) Image-guided mathematical modeling for pharmacological evaluation of nanomaterials and monoclonal antibodies
Wiley Interdisciplinary Reviews. Nanomedicine and Nanobiotechnology 12:e1628.

https://doi.org/10.1002/wnan.1628
- PubMed
- Google Scholar
(2020b) A mathematical model to predict nanomedicine pharmacokinetics and tumor delivery
Computational and Structural Biotechnology Journal 18:518–531.

https://doi.org/10.1016/j.csbj.2020.02.014
- PubMed
- Google Scholar
1. Duffy MJ
2. Crown J
(2019) Biomarkers for Predicting Response to Immunotherapy with Immune Checkpoint Inhibitors in Cancer Patients
Clinical Chemistry 65:1228–1238.

https://doi.org/10.1373/clinchem.2019.303644
- PubMed
- Google Scholar
1. Eisenhauer EA
2. Therasse P
3. Bogaerts J
4. Schwartz LH
5. Sargent D
6. Ford R
7. Dancey J
8. Arbuck S
9. Gwyther S
10. Mooney M
11. Rubinstein L
12. Shankar L
13. Dodd L
14. Kaplan R
15. Lacombe D
16. Verweij J
(2009) New response evaluation criteria in solid tumours: Revised RECIST guideline (version 1.1)
European Journal of Cancer 45:228–247.

https://doi.org/10.1016/j.ejca.2008.10.026
- PubMed
- Google Scholar
(2012) Immunotype and immunohistologic characteristics of tumor-infiltrating immune cells are associated with clinical outcome in metastatic melanoma
Cancer Research 72:1070–1080.

https://doi.org/10.1158/0008-5472.CAN-11-3218
- PubMed
- Google Scholar
1. Frieboes HB
2. Smith BR
3. Wang Z
4. Kotsuma M
5. Ito K
6. Day A
7. Cahill B
8. Flinders C
9. Mumenthaler SM
10. Mallick P
11. Simbawa E
12. AL-Fhaid AS
13. Mahmoud SR
14. Gambhir SS
15. Cristini V
16. Cinti C
(2015) Predictive modeling of drug response in non-Hodgkin’s lymphoma
PLOS ONE 10:e0129433.

https://doi.org/10.1371/journal.pone.0129433
- Google Scholar
1. Garon EB
2. Rizvi NA
3. Hui R
4. Leighl N
5. Balmanoukian AS
6. Eder JP
7. Patnaik A
8. Aggarwal C
9. Gubens M
10. Horn L
11. Carcereny E
12. Ahn M-J
13. Felip E
14. Lee J-S
15. Hellmann MD
16. Hamid O
17. Goldman JW
18. Soria J-C
19. Dolled-Filhart M
20. Rutledge RZ
21. Zhang J
22. Lunceford JK
23. Rangwala R
24. Lubiniecki GM
25. Roach C
26. Emancipator K
27. Gandhi L
28. KEYNOTE-001 Investigators
(2015) Pembrolizumab for the treatment of non-small-cell lung cancer
The New England Journal of Medicine 372:2018–2028.

https://doi.org/10.1056/NEJMoa1501824
- PubMed
- Google Scholar
1. Goel S
2. Ferreira CA
3. Dogra P
4. Yu B
5. Kutyreff CJ
6. Siamof CM
7. Engle JW
8. Barnhart TE
9. Cristini V
10. Wang Z
11. Cai W
(2019) Size‐Optimized Ultrasmall Porous Silica Nanoparticles Depict Vasculature‐Based Differential Targeting in Triple Negative Breast Cancer
Small 15:1903747.

https://doi.org/10.1002/smll.201903747
- Google Scholar
1. Goel S
2. Zhang G
3. Dogra P
4. Nizzero S
5. Cristini V
6. Wang Z
7. Hu Z
8. Li Z
9. Liu X
10. Shen H
11. Ferrari M
(2020) Sequential deconstruction of composite drug transport in metastatic breast cancer
Science Advances 6:26.

https://doi.org/10.1126/sciadv.aba4498
- Google Scholar
1. Goodman AM
2. Kato S
3. Bazhenova L
4. Patel SP
5. Frampton GM
6. Miller V
7. Stephens PJ
8. Daniels GA
9. Kurzrock R
(2017) Tumor mutational burden as an independent predictor of response to immunotherapy in diverse cancers
Molecular Cancer Therapeutics 16:2598–2608.

https://doi.org/10.1158/1535-7163.MCT-17-0386
- PubMed
- Google Scholar
1. Gopalakrishnan V
2. Spencer CN
3. Nezi L
4. Reuben A
5. Andrews MC
6. Karpinets TV
7. Prieto PA
8. Vicente D
9. Hoffman K
10. Wei SC
11. Cogdill AP
12. Zhao L
13. Hudgens CW
14. Hutchinson DS
15. Manzo T
16. Petaccia de Macedo M
17. Cotechini T
18. Kumar T
19. Chen WS
20. Reddy SM
21. Szczepaniak Sloane R
22. Galloway-Pena J
23. Jiang H
24. Chen PL
25. Shpall EJ
26. Rezvani K
27. Alousi AM
28. Chemaly RF
29. Shelburne S
30. Vence LM
31. Okhuysen PC
32. Jensen VB
33. Swennes AG
34. McAllister F
35. Marcelo Riquelme Sanchez E
36. Zhang Y
37. Le Chatelier E
38. Zitvogel L
39. Pons N
40. Austin-Breneman JL
41. Haydu LE
42. Burton EM
43. Gardner JM
44. Sirmans E
45. Hu J
46. Lazar AJ
47. Tsujikawa T
48. Diab A
49. Tawbi H
50. Glitza IC
51. Hwu WJ
52. Patel SP
53. Woodman SE
54. Amaria RN
55. Davies MA
56. Gershenwald JE
57. Hwu P
58. Lee JE
59. Zhang J
60. Coussens LM
61. Cooper ZA
62. Futreal PA
63. Daniel CR
64. Ajami NJ
65. Petrosino JF
66. Tetzlaff MT
67. Sharma P
68. Allison JP
69. Jenq RR
70. Wargo JA
(2018) Gut microbiome modulates response to anti-PD-1 immunotherapy in melanoma patients
Science 359:97–103.

https://doi.org/10.1126/science.aan4236
- PubMed
- Google Scholar
1. Gubin MM
2. Esaulova E
3. Ward JP
4. Malkova ON
5. Runci D
6. Wong P
7. Noguchi T
8. Arthur CD
9. Meng W
10. Alspach E
11. Medrano RFV
12. Fronick C
13. Fehlings M
14. Newell EW
15. Fulton RS
16. Sheehan KCF
17. Oh ST
18. Schreiber RD
19. Artyomov MN
(2018) High-dimensional analysis delineates myeloid and lymphoid compartment remodeling during successful immune-checkpoint cancer therapy
Cell 175:1443.

https://doi.org/10.1016/j.cell.2018.11.003
- Google Scholar
1. Herbst RS
2. Soria J-C
3. Kowanetz M
4. Fine GD
5. Hamid O
6. Gordon MS
7. Sosman JA
8. McDermott DF
9. Powderly JD
10. Gettinger SN
11. Kohrt HEK
12. Horn L
13. Lawrence DP
14. Rost S
15. Leabman M
16. Xiao Y
17. Mokatrin A
18. Koeppen H
19. Hegde PS
20. Mellman I
21. Chen DS
22. Hodi FS
(2014) Predictive correlates of response to the anti-PD-L1 antibody MPDL3280A in cancer patients
Nature 515:563–567.

https://doi.org/10.1038/nature14011
- PubMed
- Google Scholar
1. Hosoya H
2. Dobroff AS
3. Driessen WHP
4. Cristini V
5. Brinker LM
6. Staquicini FI
7. Cardó-Vila M
8. D’Angelo S
9. Ferrara F
10. Proneth B
11. Lin Y-S
12. Dunphy DR
13. Dogra P
14. Melancon MP
15. Stafford RJ
16. Miyazono K
17. Gelovani JG
18. Kataoka K
19. Brinker CJ
20. Sidman RL
21. Arap W
22. Pasqualini R
(2016) Integrated nanotechnology platform for tumor-targeted multimodal imaging and therapeutic cargo release
PNAS 113:1877–1882.

https://doi.org/10.1073/pnas.1525796113
- PubMed
- Google Scholar
(2018) Mechanisms of resistance to immune checkpoint inhibitors
British Journal of Cancer 118:9–16.

https://doi.org/10.1038/bjc.2017.434
- PubMed
- Google Scholar
1. Jerby-Arnon L
2. Shah P
3. Cuoco MS
4. Rodman C
5. Su M-J
6. Melms JC
7. Leeson R
8. Kanodia A
9. Mei S
10. Lin J-R
11. Wang S
12. Rabasha B
13. Liu D
14. Zhang G
15. Margolais C
16. Ashenberg O
17. Ott PA
18. Buchbinder EI
19. Haq R
20. Hodi FS
21. Boland GM
22. Sullivan RJ
23. Frederick DT
24. Miao B
25. Moll T
26. Flaherty KT
27. Herlyn M
28. Jenkins RW
29. Thummalapalli R
30. Kowalczyk MS
31. Cañadas I
32. Schilling B
33. Cartwright ANR
34. Luoma AM
35. Malu S
36. Hwu P
37. Bernatchez C
38. Forget M-A
39. Barbie DA
40. Shalek AK
41. Tirosh I
42. Sorger PK
43. Wucherpfennig K
44. Van Allen EM
45. Schadendorf D
46. Johnson BE
47. Rotem A
48. Rozenblatt-Rosen O
49. Garraway LA
50. Yoon CH
51. Izar B
52. Regev A
(2018) A Cancer Cell Program Promotes T Cell Exclusion and Resistance to Checkpoint Blockade
Cell 175:984–997.

https://doi.org/10.1016/j.cell.2018.09.006
- PubMed
- Google Scholar
1. Johannet P
2. Coudray N
3. Donnelly DM
4. Jour G
5. Illa-Bochaca I
6. Xia Y
7. Johnson DB
8. Wheless L
9. Patrinely JR
10. Nomikou S
11. Rimm DL
12. Pavlick AC
13. Weber JS
14. Zhong J
15. Tsirigos A
16. Osman I
(2021) Using Machine Learning Algorithms to Predict Immunotherapy Response in Patients with Advanced Melanoma
Clinical Cancer Research 27:131–140.

https://doi.org/10.1158/1078-0432.CCR-20-2415
- PubMed
- Google Scholar
1. Kefford R
2. Ribas A
3. Hamid O
4. Robert C
5. Daud A
6. Wolchok JD
7. Joshua AM
8. Hodi FS
9. Gangadhar TC
10. Hersey P
11. Weber JS
12. Dronca RS
13. Patnaik A
14. Zarour HM
15. Dolled-Filhart M
16. Lunceford J
17. Emancipator K
18. Ebbinghaus S
19. Kang SP
20. Hwu WJ
(2014) Clinical efficacy and correlation with tumor PD-L1 expression in patients (pts) with melanoma (MEL) treated with the anti-PD-1 monoclonal antibody MK-3475
Journal of Clinical Oncology 32:3005.

https://doi.org/10.1200/jco.2014.32.15_suppl.3005
- Google Scholar
1. Koay EJ
2. Truty MJ
3. Cristini V
4. Thomas RM
5. Chen R
6. Chatterjee D
7. Kang Y
8. Bhosale PR
9. Tamm EP
10. Crane CH
11. Javle M
12. Katz MH
13. Gottumukkala VN
14. Rozner MA
15. Shen H
16. Lee JE
17. Wang H
18. Chen Y
19. Plunkett W
20. Abbruzzese JL
21. Wolff RA
22. Varadhachary GR
23. Ferrari M
24. Fleming JB
(2014) Transport properties of pancreatic cancer describe gemcitabine delivery and response
The Journal of Clinical Investigation 124:1525–1536.

https://doi.org/10.1172/JCI73455
- PubMed
- Google Scholar
(2010) Predicting outcomes of prostate cancer immunotherapy by personalized mathematical models
PLOS ONE 5:12.

https://doi.org/10.1371/journal.pone.0015482
- PubMed
- Google Scholar
1. Le DT
2. Uram JN
3. Wang H
4. Bartlett BR
5. Kemberling H
6. Eyring AD
7. Skora AD
8. Luber BS
9. Azad NS
10. Laheru D
11. Biedrzycki B
12. Donehower RC
13. Zaheer A
14. Fisher GA
15. Crocenzi TS
16. Lee JJ
17. Duffy SM
18. Goldberg RM
19. de la Chapelle A
20. Koshiji M
21. Bhaijee F
22. Huebner T
23. Hruban RH
24. Wood LD
25. Cuka N
26. Pardoll DM
27. Papadopoulos N
28. Kinzler KW
29. Zhou S
30. Cornish TC
31. Taube JM
32. Anders RA
33. Eshleman JR
34. Vogelstein B
35. Diaz LA Jr
(2015) PD-1 Blockade in tumors with mismatch-repair deficiency
The New England Journal of Medicine 372:2509–2520.

https://doi.org/10.1056/NEJMoa1500596
- PubMed
- Google Scholar
1. Le DT
2. Durham JN
3. Smith KN
4. Wang H
5. Bartlett BR
6. Aulakh LK
7. Lu S
8. Kemberling H
9. Wilt C
10. Luber BS
11. Wong F
12. Azad NS
13. Rucki AA
14. Laheru D
15. Donehower R
16. Zaheer A
17. Fisher GA
18. Crocenzi TS
19. Lee JJ
20. Greten TF
21. Duffy AG
22. Ciombor KK
23. Eyring AD
24. Lam BH
25. Joe A
26. Kang SP
27. Holdhoff M
28. Danilova L
29. Cope L
30. Meyer C
31. Zhou S
32. Goldberg RM
33. Armstrong DK
34. Bever KM
35. Fader AN
36. Taube J
37. Housseau F
38. Spetzler D
39. Xiao N
40. Pardoll DM
41. Papadopoulos N
42. Kinzler KW
43. Eshleman JR
44. Vogelstein B
45. Anders RA
46. Diaz LA Jr
(2017) Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade
Science 357:409–413.

https://doi.org/10.1126/science.aan6733
- PubMed
- Google Scholar
1. Łuksza M
2. Riaz N
3. Makarov V
4. Balachandran VP
5. Hellmann MD
6. Solovyov A
7. Rizvi NA
8. Merghoub T
9. Levine AJ
10. Chan TA
11. Wolchok JD
12. Greenbaum BD
(2017) A neoantigen fitness model predicts tumour response to checkpoint blockade immunotherapy
Nature 551:517–520.

https://doi.org/10.1038/nature24473
- PubMed
- Google Scholar
1. Mempel TR
2. Bauer CA
(2008) Intravital imaging of CD8+ T cell function in cancer
Clinical & Experimental Metastasis 26:311–327.

https://doi.org/10.1007/s10585-008-9196-9
- Google Scholar
(2019) Senescence markers: Predictive for response to checkpoint inhibitors
Ternational Journal of Cancer 144:1147–1150.

https://doi.org/10.1002/ijc.31763
- PubMed
- Google Scholar
1. Motzer RJ
2. Rini BI
3. McDermott DF
4. Redman BG
5. Kuzel TM
6. Harrison MR
7. Vaishampayan UN
8. Drabkin HA
9. George S
10. Logan TF
11. Margolin KA
12. Plimack ER
13. Lambert AM
14. Waxman IM
15. Hammers HJ
(2015) Nivolumab for metastatic renal cell carcinoma: results of a randomized phase II trial
Journal of Clinical Oncology 33:1430–1437.

https://doi.org/10.1200/JCO.2014.59.0703
- PubMed
- Google Scholar
1. Pardoll DM
(2012) The blockade of immune checkpoints in cancer immunotherapy
Nature Reviews. Cancer 12:252–264.

https://doi.org/10.1038/nrc3239
- PubMed
- Google Scholar
1. Park YJ
2. Kuen DS
3. Chung Y
(2018) Future prospects of immune checkpoint blockade in cancer: from response prediction to overcoming resistance
Experimental & Molecular Medicine 50:1–13.

https://doi.org/10.1038/s12276-018-0130-1
- Google Scholar
1. Pascal J
2. Ashley CE
3. Wang Z
4. Brocato TA
5. Butner JD
6. Carnes EC
7. Koay EJ
8. Brinker CJ
9. Cristini V
(2013a) Mechanistic modeling identifies drug-uptake history as predictor of tumor drug resistance and nano-carrier-mediated response
ACS Nano 7:11174–11182.

https://doi.org/10.1021/nn4048974
- PubMed
- Google Scholar
1. Pascal J
2. Bearer EL
3. Wang Z
4. Koay EJ
5. Curley SA
6. Cristini V
(2013b) Mechanistic patient-specific predictive correlation of tumor drug response with microenvironment and perfusion measurements
PNAS 110:14266–14271.

https://doi.org/10.1073/pnas.1300619110
- PubMed
- Google Scholar
1. Pilard C
2. Ancion M
3. Delvenne P
4. Jerusalem G
5. Hubert P
6. Herfs M
(2021) Cancer immunotherapy: it’s time to better predict patients’ response
British Journal of Cancer 125:927–938.

https://doi.org/10.1038/s41416-021-01413-x
- PubMed
- Google Scholar
(2015) Immune checkpoint blockade in cancer therapy
Journal of Clinical Oncology 33:1974–1982.

https://doi.org/10.1200/JCO.2014.59.4358
- PubMed
- Google Scholar
1. Powles T
2. Eder JP
3. Fine GD
4. Braiteh FS
5. Loriot Y
6. Cruz C
7. Bellmunt J
8. Burris HA
9. Petrylak DP
10. Teng S
11. Shen X
12. Boyd Z
13. Hegde PS
14. Chen DS
15. Vogelzang NJ
(2014) MPDL3280A (anti-PD-L1) treatment leads to clinical activity in metastatic bladder cancer
Nature 515:558–562.

https://doi.org/10.1038/nature13904
- PubMed
- Google Scholar
1. Riaz N
2. Havel JJ
3. Makarov V
4. Desrichard A
5. Urba WJ
6. Sims JS
7. Hodi FS
8. Martín-Algarra S
9. Mandal R
10. Sharfman WH
11. Bhatia S
12. Hwu W-J
13. Gajewski TF
14. Slingluff CL Jr
15. Chowell D
16. Kendall SM
17. Chang H
18. Shah R
19. Kuo F
20. Morris LGT
21. Sidhom J-W
22. Schneck JP
23. Horak CE
24. Weinhold N
25. Chan TA
(2017) Tumor and microenvironment evolution during immunotherapy with nivolumab
Cell 171:934–949.

https://doi.org/10.1016/j.cell.2017.09.028
- PubMed
- Google Scholar
1. Ribas A
2. Shin DS
3. Zaretsky J
4. Frederiksen J
5. Cornish A
6. Avramis E
7. Seja E
8. Kivork C
9. Siebert J
10. Kaplan-Lefko P
11. Wang X
12. Chmielowski B
13. Glaspy JA
14. Tumeh PC
15. Chodon T
16. Pe’er D
17. Comin-Anduix B
(2016) PD-1 blockade expands intratumoral memory T cells
Cancer Immunology Research 4:194–203.

https://doi.org/10.1158/2326-6066.CIR-15-0210
- PubMed
- Google Scholar
1. Robert C
2. Long GV
3. Brady B
4. Dutriaux C
5. Maio M
6. Mortier L
7. Hassel JC
8. Rutkowski P
9. McNeil C
10. Kalinka-Warzocha E
11. Savage KJ
12. Hernberg MM
13. Lebbé C
14. Charles J
15. Mihalcioiu C
16. Chiarion-Sileni V
17. Mauch C
18. Cognetti F
19. Arance A
20. Schmidt H
21. Schadendorf D
22. Gogas H
23. Lundgren-Eriksson L
24. Horak C
25. Sharkey B
26. Waxman IM
27. Atkinson V
28. Ascierto PA
(2015a) Nivolumab in previously untreated melanoma without BRAF mutation
The New England Journal of Medicine 372:320–330.

https://doi.org/10.1056/NEJMoa1412082
- PubMed
- Google Scholar
1. Robert C
2. Schachter J
3. Long GV
4. Arance A
5. Grob JJ
6. Mortier L
7. Daud A
8. Carlino MS
9. McNeil C
10. Lotem M
11. Larkin J
12. Lorigan P
13. Neyns B
14. Blank CU
15. Hamid O
16. Mateus C
17. Shapira-Frommer R
18. Kosh M
19. Zhou H
20. Ibrahim N
21. Ebbinghaus S
22. Ribas A
23. KEYNOTE-006 investigators
(2015b) Pembrolizumab versus ipilimumab in advanced melanoma
The New England Journal of Medicine 372:2521–2532.

https://doi.org/10.1056/NEJMoa1503093
- PubMed
- Google Scholar
Website
1. Rohatgi A
(2010) WebPlotDigitalizer: HTML5 based online tool to extractnumerical data from plot images
Accessed April 11, 2019.

https://automeris.io/WebPlotDigitizer
1. Serre R
2. Benzekry S
3. Padovani L
4. Meille C
5. André N
6. Ciccolini J
7. Barlesi F
8. Muracciole X
9. Barbolosi D
(2016) Mathematical modeling of cancer immunotherapy and its synergy with radiotherapy
Cancer Research 76:4931–4940.

https://doi.org/10.1158/0008-5472.CAN-15-3567
- PubMed
- Google Scholar
(2017) Primary, adaptive, and acquired resistance to cancer immunotherapy
Cell 168:707–723.

https://doi.org/10.1016/j.cell.2017.01.017
- PubMed
- Google Scholar
(2015) Efficacy, safety and predictive biomarker results from a randomized phase II study comparing MPDL3280A vs docetaxel in 2L/3L NSCLC (POPLAR)
Journal of Clinical Oncology 33:8010.

https://doi.org/10.1200/jco.2015.33.15_suppl.8010
- Google Scholar
1. Stein WD
2. Figg WD
3. Dahut W
4. Stein AD
5. Hoshen MB
6. Price D
7. Bates SE
8. Fojo T
(2008) Tumor growth rates derived from data for patients in a clinical trial correlate strongly with patient survival: a novel strategy for evaluation of clinical trial data
The Oncologist 13:1046–1054.

https://doi.org/10.1634/theoncologist.2008-0075
- PubMed
- Google Scholar
1. Taube JM
2. Klein A
3. Brahmer JR
4. Xu H
5. Pan X
6. Kim JH
7. Chen L
8. Pardoll DM
9. Topalian SL
10. Anders RA
(2014) Association of PD-1, PD-1 ligands, and other features of the tumor immune microenvironment with response to anti-PD-1 therapy
Clinical Cancer Research 20:5064–5074.

https://doi.org/10.1158/1078-0432.CCR-13-3271
- PubMed
- Google Scholar
1. Teng MWL
2. Ngiow SF
3. Ribas A
4. Smyth MJ
(2015) Classifying cancers based on T-cell infiltration and PD-L1
Cancer Research 75:2139–2145.

https://doi.org/10.1158/0008-5472.CAN-15-0255
- PubMed
- Google Scholar
1. Topalian SL
2. Hodi FS
3. Brahmer JR
4. Gettinger SN
5. Smith DC
6. McDermott DF
7. Powderly JD
8. Carvajal RD
9. Sosman JA
10. Atkins MB
11. Leming PD
12. Spigel DR
13. Antonia SJ
14. Horn L
15. Drake CG
16. Pardoll DM
17. Chen L
18. Sharfman WH
19. Anders RA
20. Taube JM
21. McMiller TL
22. Xu H
23. Korman AJ
24. Jure-Kunkel M
25. Agrawal S
26. McDonald D
27. Kollia GD
28. Gupta A
29. Wigginton JM
30. Sznol M
(2012) Safety, activity, and immune correlates of anti-PD-1 antibody in cancer
The New England Journal of Medicine 366:2443–2454.

https://doi.org/10.1056/NEJMoa1200690
- PubMed
- Google Scholar
1. Tumeh PC
2. Harview CL
3. Yearley JH
4. Shintaku IP
5. Taylor EJM
6. Robert L
7. Chmielowski B
8. Spasic M
9. Henry G
10. Ciobanu V
11. West AN
12. Carmona M
13. Kivork C
14. Seja E
15. Cherry G
16. Gutierrez AJ
17. Grogan TR
18. Mateus C
19. Tomasic G
20. Glaspy JA
21. Emerson RO
22. Robins H
23. Pierce RH
24. Elashoff DA
25. Robert C
26. Ribas A
(2014) PD-1 blockade induces responses by inhibiting adaptive immune resistance
Nature 515:568–571.

https://doi.org/10.1038/nature13954
- PubMed
- Google Scholar
1. Vallejo AN
(2005) CD28 extinction in human T cells: altered functions and the program of T-cell senescence
Immunological Reviews 205:158–169.

https://doi.org/10.1111/j.0105-2896.2005.00256.x
- PubMed
- Google Scholar
(2015) Simulating cancer growth with multiscale agent-based modeling
Seminars in Cancer Biology 30:70–78.

https://doi.org/10.1016/j.semcancer.2014.04.001
- PubMed
- Google Scholar
1. Wang Z
2. Kerketta R
3. Chuang Y-L
4. Dogra P
5. Butner JD
6. Brocato TA
7. Day A
8. Xu R
9. Shen H
10. Simbawa E
11. AL-Fhaid AS
12. Mahmoud SR
13. Curley SA
14. Ferrari M
15. Koay EJ
16. Cristini V
17. Di Bernardo D
(2016) Theory and experimental validation of a spatio-temporal model of chemotherapy transport to enhance tumor cell kill
PLOS Computational Biology 12:e1004969.

https://doi.org/10.1371/journal.pcbi.1004969
- Google Scholar
1. Weber JS
2. D’Angelo SP
3. Minor D
4. Hodi FS
5. Gutzmer R
6. Neyns B
7. Hoeller C
8. Khushalani NI
9. Miller WH Jr
10. Lao CD
11. Linette GP
12. Thomas L
13. Lorigan P
14. Grossmann KF
15. Hassel JC
16. Maio M
17. Sznol M
18. Ascierto PA
19. Mohr P
20. Chmielowski B
21. Bryce A
22. Svane IM
23. Grob J-J
24. Krackhardt AM
25. Horak C
26. Lambert A
27. Yang AS
28. Larkin J
(2015) Nivolumab versus chemotherapy in patients with advanced melanoma who progressed after anti-CTLA-4 treatment (CheckMate 037): A randomised, controlled, open-label, phase 3 trial
The Lancet. Oncology 16:375–384.

https://doi.org/10.1016/S1470-2045(15)70076-8
- PubMed
- Google Scholar
1. Wilkie KP
2. Hahnfeldt P
(2013) Tumor-immune dynamics regulated in the microenvironment inform the transient nature of immune-induced tumor dormancy
Cancer Research 73:3534–3544.

https://doi.org/10.1158/0008-5472.CAN-12-4590
- PubMed
- Google Scholar
Software
1. Wolfram Research I
(2017) Illinois, version 11.2
MathematicaChampaign.

https://www.wolfram.com/mathematica/

Article and author information

Author details

Joseph D Butner

Mathematics in Medicine Program, Houston Methodist Research Institute, Houston, United States

Contribution
Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Validation, Writing – original draft, Writing – review and editing

Contributed equally with
Geoffrey V Martin, Zhihui Wang and Eugene J Koay

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0003-0608-2580
Geoffrey V Martin

Department of Radiation Oncology, The University of Texas M.D. Anderson Cancer Center, Houston, United States

Contribution
Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Writing – original draft, Writing – review and editing

Contributed equally with
Joseph D Butner, Zhihui Wang and Eugene J Koay

Competing interests
No competing interests declared
Zhihui Wang
1. Mathematics in Medicine Program, Houston Methodist Research Institute, Houston, United States
2. Department of Imaging Physics, The University of Texas M.D. Anderson Cancer Center, Houston, United States
Contribution
Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review and editing

Contributed equally with
Joseph D Butner, Geoffrey V Martin and Eugene J Koay

For correspondence
zwang@houstonmethodist.org

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0001-6262-700X
Bruna Corradetti
1. Department of Nanomedicine, Houston Methodist Research Institute, Houston, United States
2. Swansea University Medical School, Singleton Park, Swansea, United Kingdom
Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Mauro Ferrari

Department of Nanomedicine, Houston Methodist Research Institute, Houston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Nestor Esnaola

Department of Surgery, Houston Methodist Cancer Center, Houston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Caroline Chung

Department of Radiation Oncology, The University of Texas M.D. Anderson Cancer Center, Houston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
David S Hong

Department of Investigational Cancer Therapeutics, The University of Texas M.D. Anderson Cancer Center, Houston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
See COI form submitted
James W Welsh

Department of Radiation Oncology, The University of Texas M.D. Anderson Cancer Center, Houston, United States

Contribution
Data curation, Investigation, Resources, Writing – review and editing

Competing interests
See COI form submitted
Naomi Hasegawa

University of Texas Health Science Center (UTHealth), McGovern Medical School, Houston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Elizabeth A Mittendorf

Breast Oncology Program, Dana Farber/Brigham and Women's Cancer Center, Boston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
See COI form submitted
Steven A Curley

Michael E. DeBakey Department of Surgery, Baylor College of Medicine, Houston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Shu-Hsia Chen

Immunotherapy Research Center, Houston Methodist Research Institute, Houston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Ping-Ying Pan
1. Immunotherapy Research Center, Houston Methodist Research Institute, Houston, United States
2. Cancer Center, Houston Methodist Research Institute, Houston, United States
Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Steven K Libutti
1. Rutgers Cancer Institute of New Jersey, New Brunswick, United States
2. Department of Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, United States
Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Shridar Ganesan

Rutgers Cancer Institute of New Jersey, New Brunswick, United States

Contribution
Investigation, Writing – review and editing

Competing interests
See COI form submitted
Richard L Sidman

Department of Neurology, Harvard Medical School, Boston, United States

Contribution
Investigation, Writing – review and editing

Competing interests
No competing interests declared
Renata Pasqualini
1. Rutgers Cancer Institute of New Jersey, Newark, United States
2. Division of Cancer Biology, Department of Radiation Oncology, Rutgers New Jersey Medical School, Newark, United States
Contribution
Investigation, Methodology, Resources, Writing – review and editing

Competing interests
No competing interests declared
Wadih Arap
1. Rutgers Cancer Institute of New Jersey, Newark, United States
2. Division of Hematology/Oncology, Department of Medicine, Rutgers New Jersey Medical School, Newark, United States
Contribution
Investigation, Methodology, Resources, Writing – review and editing

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0002-8686-4584
Eugene J Koay

Department of Radiation Oncology, The University of Texas M.D. Anderson Cancer Center, Houston, United States

Contribution
Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review and editing, Data curation

Contributed equally with
Joseph D Butner, Geoffrey V Martin and Zhihui Wang

For correspondence
EKoay@mdanderson.org

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0001-7675-3461
Vittorio Cristini
1. Mathematics in Medicine Program, Houston Methodist Research Institute, Houston, United States
2. Department of Imaging Physics, The University of Texas M.D. Anderson Cancer Center, Houston, United States
Contribution
Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review and editing

Competing interests
No competing interests declared

Funding

National Science Foundation (DMS-1930583)

Zhihui Wang
Vittorio Cristini

National Institutes of Health (1R01CA253865)

Zhihui Wang
Vittorio Cristini

National Institutes of Health (1U01CA196403)

Zhihui Wang
Eugene J Koay
Vittorio Cristini

National Institutes of Health (1U01CA213759)

Zhihui Wang
Vittorio Cristini

National Institutes of Health (1R01CA226537)

Zhihui Wang
Renata Pasqualini
Wadih Arap
Vittorio Cristini

National Institutes of Health (1R01CA222007)

Zhihui Wang
Vittorio Cristini

National Institutes of Health (U54CA210181)

Zhihui Wang
Mauro Ferrari
Shu-Hsia Chen
Ping-Ying Pan
Eugene J Koay
Vittorio Cristini

National Institutes of Health (P30CA016672)

David S Hong
James W Welsh
Eugene J Koay

National Institutes of Health (P30CA072720)

Steven K Libutti
Shridar Ganesan
Renata Pasqualini
Wadih Arap

European Commission (SER Cymru II Programme)

Bruna Corradetti

National Institutes of Health (U01CA200468)

Eugene J Koay

National Institutes of Health (R01CA222959)

Mauro Ferrari

DOD Breast Cancer Research (Breakthrough Level IV Award W81XWH-17-1-0389)

Mauro Ferrari

AngelWorks

Renata Pasqualini
Wadih Arap

Gillson Longenbaugh Foundation

Renata Pasqualini
Wadih Arap

Marcus Foundation

Renata Pasqualini
Wadih Arap

National Institutes of Health (R01CA109322)

Shu-Hsia Chen

National Institutes of Health (R01CA127483)

Shu-Hsia Chen

National Institutes of Health (R01CA208703)

Shu-Hsia Chen

National Institutes of Health (R01CA140243)

Ping-Ying Pan

National Institutes of Health (R01CA188610)

Ping-Ying Pan

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Clinical trial registration NCT02444741.

Human subjects: In-house patient cohort were obtained as de-identified data from a study conducted in accordance with the U.S. Common Rule and with Institutional Review Board Approval at MD Anderson (2014-1020), including waiver of informed consent. This work has been published in J Immunother Cancer. 2020; 8(2): e001001. PMC7555111. doi: 10.1136/jitc-2020-001001.

Copyright

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.