Reproducibility in Cancer Biology: Rethinking research into metastasis

The partial success of an attempt to repeat findings in cancer biology highlights the need to improve study designs for preclinical research into metastasis and the targeting of cancer cells.
  1. Peter Friedl  Is a corresponding author
  1. Radboud University Medical Centre, Netherlands
  2. University of Texas MD Anderson Cancer Center, United States

Cancer metastasis results from the escape of cancer cells from the primary tumor, followed by circulation in the blood or lymph system, and then seeding in distant organs. In 2011 researchers at the CNIC in Madrid and other institutions in Spain and the United States reported the results of in vitro experiments and experiments in mice that highlighted how the mechanical properties of the stromal cells around a tumor can influence cancer progression and metastasis (Goetz et al., 2011). In particular they reported that the expression of an intracellular protein called caveolin-1 in tumor-associated fibroblasts resulted in remodeling of the stroma in breast cancer xenografts, which led to increased metastasis.

In 2015, as part of the Reproducibility Project: Cancer Biology, Fiering et al. published a Registered Report which explained in detail how they would seek to replicate some of these experiments (Fiering et al., 2015). The results of these experiment have now been published as a Replication Study (Sheen et al., 2019). Sheen et al. confirmed that fibroblasts expressing caveolin-1 display increased extracellular matrix (ECM) remodeling in vitro, and a higher capacity for intra-tumoral stroma remodeling in vivo. Moreover, by co-implanting caveolin-1-expressing or caveolin-1-deficient fibroblasts with breast cancer cells in nude mice, they confirmed that the expression of caveolin-1 does not affect the tumor growth at the implantation site. However, in contrast to the original study, metastasis formation was not enhanced by caveolin-1 expression, though it should be noted that there were important differences between the original work and the replication. This means that we cannot draw about conclusions about the reproducibility or otherwise of the original findings about metastasis. It is worth looking at these differences to see what we can learn for future studies.

Experiments with mice and other animals are stopped at a 'humane endpoint' to prevent unnecessary suffering. The original experiments to monitor metastasis were stopped 75 days after the breast cancer cells had been implanted in the mice. However, the tumors grew much faster in the replication, which meant that the humane endpoint was reached after just 45 days. Tumor growth and metastasis are both nonlinear processes, with long periods of relatively slow growth being followed by periods of rapid growth. It is possible, therefore, that the low levels of metastasis seen in the replication are due to the duration of the experiments being significantly shorter than the original experiments.

So what lessons might we take away from this Replication Study? First, the differences between the two studies with respect to the link between ECM remodeling in the primary tumor site and metastasis might indicate that factors other than ECM alignment have an influence on the outcome. In particular, the orientation of the ECM relative to the tumor may be important: it is known that the invasion of neighboring tissue by cancer cells, metastasis and poor prognosis are all supported when the ECM is perpendicular to the tumor surface, whereas a capsule-like orientation of the ECM parallel to the tumor surface can limit tumor cell evasion (Figure 1A; Conklin et al., 2011; Park et al., 2019).

Studying tumor invasion and metastasis.

(A) The orientation of the extracellular matrix (ECM) and fibroblasts in the vicinity of a tumor (pale blue) has an influence on the development of the tumor. A capsule-like orientation will limit the escape of cancer cells from the tumor (1), whereas a perpendicular orientation will encourage escape and the invasion of nearby tissue (2). The orientation of the ECM and the fibroblasts can be quantified by image processing. (B) Experiments in which cancer cells are implanted into an animal have to be stopped when the primary tumor reaches a certain size to prevent unnecessary suffering (1). This can limit the data that can be collected on other aspects of cancer, such as metastasis. An alternative approach is to monitor each animal individually and to resection a tumor when it reaches a certain size (2): this allows for longer studies, including the collection of Kaplan-Meier survival curves similar to those collected during clinical trials.

Second, it is possible to design experiments where faster-than-expected growth of the primary tumor does not limit our ability to study metastasis. This can be done by monitoring each mouse individually and resecting the primary tumor during exponential growth, before the humane endpoint is reached, while also continuing to measure metastasis and other outcomes (Figure 1B). Preclinical studies using this refined procedure have allowed researchers to measure the response of primary tumors to experimental molecular-targeted therapy and to monitor whether metastasis is affected or not for endpoints after 100 days and later (Gómez-Cuadrado et al., 2017; Miller et al., 2019). It should be noted that resection might not be required if the experimental treatment causes reliable regression of the primary tumor: the present author and co-workers recently used this approach to monitor incidence of metastasis and overall survival in tumor-bearing mice over a period of 180 days (Haeger et al., 2020).

Third, multiple experimental details that are difficult to control may affect tumor growth and metastasis. For example, tumor cells may change their growth characteristics, and grow more or less efficiently, as a result of continued culture. Other factors that influence tumor growth rates in mouse experiments include: the use of fetal calf serum to cultivate cells before implantation (van der Valk et al., 2018); the conditions under which the mice are housed (Kilkenny et al., 2010); and variation in the microbiomes of the mice (Sethi et al., 2018). It is vital, therefore, that the Methods sections of papers fully describe how the mice used in experiments were housed (including information about diet, environmental enrichment and housing temperature; see Kilkenny et al., 2010 for a full list). And in the future, molecular fingerprinting of the microbiome of animals might also be required.

In conclusion, we do not know for sure in which tumors and to what extent the expression of caveolin-1 and the subsequent remodeling of the ECM in the tumor stroma has an influence on metastasis. However, the efforts to replicate previous work in this field provide an opportunity for self-reflection, and make clear that there are strong reasons to refine workflows in preclinical metastasis research and to improve the way we carry out research into anti-cancer pathways and drug discovery.

Note

Peter Friedl was a peer reviewer for Registered Report (Fiering et al., 2015) and the Replication Study (Sheen et al., 2019).

References

Article and author information

Author details

  1. Peter Friedl

    Peter Friedl is in the Department of Cell Biology, Radboud Institute for Molecular Life Sciences, Radboud University Medical Centre, Nijmegen, Netherlands, the Cancer Genomics Center, Utrecht, Netherlands, and the Department of Genitourinary Medicine, University of Texas MD Anderson Cancer Center, Houston, United States

    For correspondence
    peter.friedl@radboudumc.nl
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0119-4041

Publication history

  1. Version of Record published:

Copyright

© 2019, Friedl

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,064
    views
  • 188
    downloads
  • 7
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Peter Friedl
(2019)
Reproducibility in Cancer Biology: Rethinking research into metastasis
eLife 8:e53511.
https://doi.org/10.7554/eLife.53511

Further reading

    1. Cancer Biology
    2. Genetics and Genomics
    Yaroslav Kainov, Fursham Hamid, Eugene V Makeyev
    Research Article

    The expression of eukaryotic genes relies on the precise 3'-terminal cleavage and polyadenylation of newly synthesized pre-mRNA transcripts. Defects in these processes have been associated with various diseases, including cancer. While cancer-focused sequencing studies have identified numerous driver mutations in protein-coding sequences, noncoding drivers – particularly those affecting the cis-elements required for pre-mRNA cleavage and polyadenylation – have received less attention. Here, we systematically analysed somatic mutations affecting 3'UTR polyadenylation signals in human cancers using the Pan-Cancer Analysis of Whole Genomes (PCAWG) dataset. We found a striking enrichment of cancer-specific somatic mutations that disrupt strong and evolutionarily conserved cleavage and polyadenylation signals within tumour suppressor genes. Further bioinformatics and experimental analyses conducted as a part of our study suggest that these mutations have a profound capacity to downregulate the expression of tumour suppressor genes. Thus, this work uncovers a novel class of noncoding somatic mutations with significant potential to drive cancer progression.

    1. Cancer Biology
    2. Immunology and Inflammation
    Simei Go, Constantinos Demetriou ... Eric O Neill
    Research Article

    The immunosuppressive microenvironment in pancreatic ductal adenocarcinoma (PDAC) prevents tumor control and strategies to restore anti-cancer immunity (i.e. by increasing CD8 T-cell activity) have had limited success. Here, we demonstrate how inducing localized physical damage using ionizing radiation (IR) unmasks the benefit of immunotherapy by increasing tissue-resident natural killer (trNK) cells that support CD8 T activity. Our data confirms that targeting mouse orthotopic PDAC tumors with IR together with CCR5 inhibition and PD1 blockade reduces E-cadherin positive tumor cells by recruiting a hypoactive NKG2D-ve NK population, phenotypically reminiscent of trNK cells, that supports CD8 T-cell involvement. We show an equivalent population in human single-cell RNA sequencing (scRNA-seq) PDAC cohorts that represents immunomodulatory trNK cells that could similarly support CD8 T-cell levels in a cDC1-dependent manner. Importantly, a trNK signature associates with survival in PDAC and other solid malignancies revealing a potential beneficial role for trNK in improving adaptive anti-tumor responses and supporting CCR5 inhibitor (CCR5i)/αPD1 and IR-induced damage as a novel therapeutic approach.