Reproducibility in Cancer Biology: Rethinking research into metastasis

The partial success of an attempt to repeat findings in cancer biology highlights the need to improve study designs for preclinical research into metastasis and the targeting of cancer cells.
  1. Peter Friedl  Is a corresponding author
  1. Radboud University Medical Centre, Netherlands
  2. University of Texas MD Anderson Cancer Center, United States

Cancer metastasis results from the escape of cancer cells from the primary tumor, followed by circulation in the blood or lymph system, and then seeding in distant organs. In 2011 researchers at the CNIC in Madrid and other institutions in Spain and the United States reported the results of in vitro experiments and experiments in mice that highlighted how the mechanical properties of the stromal cells around a tumor can influence cancer progression and metastasis (Goetz et al., 2011). In particular they reported that the expression of an intracellular protein called caveolin-1 in tumor-associated fibroblasts resulted in remodeling of the stroma in breast cancer xenografts, which led to increased metastasis.

In 2015, as part of the Reproducibility Project: Cancer Biology, Fiering et al. published a Registered Report which explained in detail how they would seek to replicate some of these experiments (Fiering et al., 2015). The results of these experiment have now been published as a Replication Study (Sheen et al., 2019). Sheen et al. confirmed that fibroblasts expressing caveolin-1 display increased extracellular matrix (ECM) remodeling in vitro, and a higher capacity for intra-tumoral stroma remodeling in vivo. Moreover, by co-implanting caveolin-1-expressing or caveolin-1-deficient fibroblasts with breast cancer cells in nude mice, they confirmed that the expression of caveolin-1 does not affect the tumor growth at the implantation site. However, in contrast to the original study, metastasis formation was not enhanced by caveolin-1 expression, though it should be noted that there were important differences between the original work and the replication. This means that we cannot draw about conclusions about the reproducibility or otherwise of the original findings about metastasis. It is worth looking at these differences to see what we can learn for future studies.

Experiments with mice and other animals are stopped at a 'humane endpoint' to prevent unnecessary suffering. The original experiments to monitor metastasis were stopped 75 days after the breast cancer cells had been implanted in the mice. However, the tumors grew much faster in the replication, which meant that the humane endpoint was reached after just 45 days. Tumor growth and metastasis are both nonlinear processes, with long periods of relatively slow growth being followed by periods of rapid growth. It is possible, therefore, that the low levels of metastasis seen in the replication are due to the duration of the experiments being significantly shorter than the original experiments.

So what lessons might we take away from this Replication Study? First, the differences between the two studies with respect to the link between ECM remodeling in the primary tumor site and metastasis might indicate that factors other than ECM alignment have an influence on the outcome. In particular, the orientation of the ECM relative to the tumor may be important: it is known that the invasion of neighboring tissue by cancer cells, metastasis and poor prognosis are all supported when the ECM is perpendicular to the tumor surface, whereas a capsule-like orientation of the ECM parallel to the tumor surface can limit tumor cell evasion (Figure 1A; Conklin et al., 2011; Park et al., 2019).

Studying tumor invasion and metastasis.

(A) The orientation of the extracellular matrix (ECM) and fibroblasts in the vicinity of a tumor (pale blue) has an influence on the development of the tumor. A capsule-like orientation will limit the escape of cancer cells from the tumor (1), whereas a perpendicular orientation will encourage escape and the invasion of nearby tissue (2). The orientation of the ECM and the fibroblasts can be quantified by image processing. (B) Experiments in which cancer cells are implanted into an animal have to be stopped when the primary tumor reaches a certain size to prevent unnecessary suffering (1). This can limit the data that can be collected on other aspects of cancer, such as metastasis. An alternative approach is to monitor each animal individually and to resection a tumor when it reaches a certain size (2): this allows for longer studies, including the collection of Kaplan-Meier survival curves similar to those collected during clinical trials.

Second, it is possible to design experiments where faster-than-expected growth of the primary tumor does not limit our ability to study metastasis. This can be done by monitoring each mouse individually and resecting the primary tumor during exponential growth, before the humane endpoint is reached, while also continuing to measure metastasis and other outcomes (Figure 1B). Preclinical studies using this refined procedure have allowed researchers to measure the response of primary tumors to experimental molecular-targeted therapy and to monitor whether metastasis is affected or not for endpoints after 100 days and later (Gómez-Cuadrado et al., 2017; Miller et al., 2019). It should be noted that resection might not be required if the experimental treatment causes reliable regression of the primary tumor: the present author and co-workers recently used this approach to monitor incidence of metastasis and overall survival in tumor-bearing mice over a period of 180 days (Haeger et al., 2020).

Third, multiple experimental details that are difficult to control may affect tumor growth and metastasis. For example, tumor cells may change their growth characteristics, and grow more or less efficiently, as a result of continued culture. Other factors that influence tumor growth rates in mouse experiments include: the use of fetal calf serum to cultivate cells before implantation (van der Valk et al., 2018); the conditions under which the mice are housed (Kilkenny et al., 2010); and variation in the microbiomes of the mice (Sethi et al., 2018). It is vital, therefore, that the Methods sections of papers fully describe how the mice used in experiments were housed (including information about diet, environmental enrichment and housing temperature; see Kilkenny et al., 2010 for a full list). And in the future, molecular fingerprinting of the microbiome of animals might also be required.

In conclusion, we do not know for sure in which tumors and to what extent the expression of caveolin-1 and the subsequent remodeling of the ECM in the tumor stroma has an influence on metastasis. However, the efforts to replicate previous work in this field provide an opportunity for self-reflection, and make clear that there are strong reasons to refine workflows in preclinical metastasis research and to improve the way we carry out research into anti-cancer pathways and drug discovery.


Peter Friedl was a peer reviewer for Registered Report (Fiering et al., 2015) and the Replication Study (Sheen et al., 2019).


Article and author information

Author details

  1. Peter Friedl

    Peter Friedl is in the Department of Cell Biology, Radboud Institute for Molecular Life Sciences, Radboud University Medical Centre, Nijmegen, Netherlands, the Cancer Genomics Center, Utrecht, Netherlands, and the Department of Genitourinary Medicine, University of Texas MD Anderson Cancer Center, Houston, United States

    For correspondence
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0119-4041

Publication history

  1. Version of Record published: December 17, 2019 (version 1)


© 2019, Friedl

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.


  • 2,059
  • 186
  • 6

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Peter Friedl
Reproducibility in Cancer Biology: Rethinking research into metastasis
eLife 8:e53511.

Further reading

    1. Cancer Biology
    2. Cell Biology
    Mengya Zhao, Beiying Dai ... Yijun Chen
    Research Article

    Philadelphia chromosome-positive (Ph+) leukemia is a fatal hematological malignancy. Although standard treatments with tyrosine kinase inhibitors (TKIs) have achieved remarkable success in prolonging patient survival, intolerance, relapse, and TKI resistance remain serious issues for patients with Ph+ leukemia. Here, we report a new leukemogenic process in which RAPSYN and BCR-ABL co-occur in Ph+ leukemia, and RAPSYN mediates the neddylation of BCR-ABL. Consequently, neddylated BCR-ABL enhances the stability by competing its c-CBL-mediated degradation. Furthermore, SRC phosphorylates RAPSYN to activate its NEDD8 E3 ligase activity, promoting BCR-ABL stabilization and disease progression. Moreover, in contrast to in vivo ineffectiveness of PROTAC-based degraders, depletion of RAPSYN expression, or its ligase activity decreased BCR-ABL stability and, in turn, inhibited tumor formation and growth. Collectively, these findings represent an alternative to tyrosine kinase activity for the oncoprotein and leukemogenic cells and generate a rationale of targeting RAPSYN-mediated BCR-ABL neddylation for the treatment of Ph+ leukemia.

    1. Cancer Biology
    2. Genetics and Genomics
    Jose Mario Bello Pineda, Robert K Bradley
    Research Article

    Cancer immune evasion contributes to checkpoint immunotherapy failure in many patients with metastatic cancers. The embryonic transcription factor DUX4 was recently characterized as a suppressor of interferon-γ signaling and antigen presentation that is aberrantly expressed in a small subset of primary tumors. Here, we report that DUX4 expression is a common feature of metastatic tumors, with ~10–50% of advanced bladder, breast, kidney, prostate, and skin cancers expressing DUX4. DUX4 expression is significantly associated with immune cell exclusion and decreased objective response to PD-L1 blockade in a large cohort of urothelial carcinoma patients. DUX4 expression is a significant predictor of survival even after accounting for tumor mutational burden and other molecular and clinical features in this cohort, with DUX4 expression associated with a median reduction in survival of over 1 year. Our data motivate future attempts to develop DUX4 as a biomarker and therapeutic target for checkpoint immunotherapy resistance.