Registered report: The CD47-signal regulated protein alpha (SIRPa) interaction is a therapeutic target for human solid tumors

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from ‘The CD47-signal regulatory protein alpha (SIRPa) interaction is a therapeutic target for human solid tumors’ by Willingham et al., 2012, published in PNAS in 2012. The key experiments being replicated are those reported in Figure 6A–C and Table S4. In these experiments, Willingham et al., 2012 test the safety and efficacy of anti-CD47 antibody treatment in immune competent mice utilizing a syngeneic model of mammary tumor growth in FVB mice. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published in eLife. DOI: http://dx.doi.org/10.7554/eLife.04586.001


Introduction
Phagocytosis is an essential process utilized by an organism for pathogen or apoptotic cell clearance (Poon et al., 2014). CD47 is a cell surface glycoprotein with a variety of functions including regulation of phagocytosis through binding to the macrophage and dendritic cell specific protein signal regulatory protein alpha (SIRPα) (Oldenborg, 2013). Binding of SIRPα to CD47 essentially sends a 'don't eat me' message to macrophages by initiating signaling to inhibit phagocytosis (Murata et al., 2014).
Increased expression of CD47 is proposed to be a mechanism through which cancer cells evade immune detection and phagocytosis. CD47 expression is increased in several cancer types including acute myeloid leukemia (AML), acute lymphoblastic leukemia (ALL), non-Hodgkin lymphoma (NHL), primary effusion lymphoma, multiple myeloma, leiomyosarcoma, and bladder cancer, and targeting of CD47 on cancer cells with an anti-CD47 blocking antibody can promote phagocytosis by macrophages in vitro (Chan et al., 2009;Jaiswal et al., 2009;Majeti et al., 2009;Chao et al., 2010a;Edris et al., 2012). Further, treatment with an anti-CD47 blocking antibody synergized with rituximab treatment to promote phagocytosis in vitro and to eliminate cancer cells in an in vivo xenograft model of non-Hodgkin lymphoma (Chao et al., 2010b). This is supported in two syngeneic murine tumor models, in melanoma and squamous cell carcinoma, where irradiation combined with antisense suppression of CD47 delayed tumor growth (Maxhimer et al., 2009). Willingham et al., 2012 further extend these results to demonstrate that CD47 expression increases in a variety of human solid tumor types and that blocking the SIRPα/CD47 interaction with an anti-CD47 antibody can promote phagocytosis of solid tumor cells in vitro and reduce growth of solid tumors in vivo. While it is not clear if SIRPα signaling is involved in the antitumor activity of an anti-CD47 antibody, these results indicate that anti-CD47 antibody therapy may be an effective treatment for a variety of solid tumor types (Soto-Pantoja et al., 2012).
In Figures 6B, 6C, and Table S4, the safety and efficacy of anti-CD47 antibody treatment are tested in immune competent mice using a syngeneic breast cancer model. MT1A2 mouse mammary cancer cells were implanted in the mammary fat pads of FVB mice and IgG control or anti-CD47 antibody treatment commenced upon detection of palpable tumors. Tumor growth was measured by gross weight and analyzed by immunohistochemistry. Willingham et al., 2012 showed that anti-CD47 antibody treatment reduced tumor growth and increased lymphocytic infiltration to the tumor site without unacceptable toxicity, thus demonstrating that anti-CD47 therapy is effective in reducing solid tumor growth in immune competent hosts. This key experiment demonstrates that CD47 is a therapeutic target for solid tumors and follows similar reports from the same laboratory that also demonstrated that anti-CD47 antibody treatment reduced growth of primary human cancer xenografts of several hematopoietic cancers and of solid leiomyosarcoma tumors Majeti et al., 2009;Chao et al., 2010a;Edris et al., 2012). Subsequent reports extended these results to multiple myeloma and primary effusion lymphoma models Goto et al., 2014). These experiments will be replicated in Protocol 1.

Materials and methods
Protocol 1: Engraftment of mouse breast cancer cells and treatment with targeted antibodies This experiment tests the safety and efficacy of anti-CD47 antibody treatment in immune competent mice using a syngeneic model of mammary cancer. This experiment replicates figures 6B, 6C, and table S4 of the original article, which assess tumor growth by weight of the tumor 30 days after implantation, lymphocytic infiltration by immunohistochemistry, and toxicity by blood analysis.
2. Experiment will use seven mice per treatment group.
A. To account for unexpected deaths, seven mice will be used per group to ensure at least five will survive for a minimum power of 80%. B. A separate, untreated cohort of three mice will be used to gather baseline readings for the blood analysis.
I. See 'Power calculations' section for details.

Materials and reagents
All known differences are indicated by an asterisk, with the originally used item listed in the comments section.

Procedure Notes
A. All cells will be sent for mycoplasma testing and STR profiling. B. Cells maintained in DMEM supplemented with 4 mM L-glutamine, 10% FBS, 100 U/ml penicillin and 100 µg/ml streptomycin at 37°C in a humidified atmosphere at 5% CO 2 . A. Total volume/injection is 100 µl and 50,000 cells.
3. Inject 50,000 cells into the left abdominal mammary fat pad (#4) of 6 to 8-week-old female FVB mice using a 27½ G needle.
A. Use 1-5% isoflurane at 1-2 l/min to anesthetize the mice. B. Total number of mice injected is 14.
4. Check mice until palpable tumors form in at least 12 animals.
A. Approximately 7-10 days after injection palpable tumors will arise.
5. Randomize mice with palpable tumors to two treatment groups using the following method.
A. On the day the mice are randomized, measure tumors. Animals with no detectable tumors are excluded from the study. B. Animals are ranked according to tumor size, to balance groups for baseline tumor characteristics, and assigned to group 1 or group 2 using an alternating serpentine method. (rank 1 = group 1, rank 2 = group 2, rank 3 = group 1, rank 4 = group 2, etc).
i. Designation of IgG or CD47 antibody treatment as group 1 or group 2 determined by randomly assigning the two treatments into one block using www.randomization.com. Record seed number.
6. Inject 400 µg of antibody, administered in 100 µl PBS, into mammary fat pad proximal to tumor with an approximate distance of 2 mm to the tumor (do not inject directly into tumor), every other day for 30 days using a 30 G needle.
7. 5 days after the beginning of antibody injections perform complete blood cell counts to assess treatment toxicity with hematology analyzer.
A. Collect 0.2 ml blood by retro-orbital bleeding. B. Collect 0.2 ml blood from three untreated female FVB mice to gather a baseline reading.
8. After 30 days of antibody treatment, sacrifice mice, dissect, and weigh tumor. 9. Dissected tumors are processed for further analysis.
A. Immediately, place tissues into 10% neutral buffered formalin overnight at room temperature. B. Dehydrate tissues through graded alcohols (50%, 70%, 95% ethanol) and clear xylene. C. Infiltrate with paraffin, and then embed tissues in a paraffin block. D. Cut paraffin blocks on a microtome with a section thickness of 5 µm.
C. Stain sections with eosin. D. Dehydrate sections through graded alcohols (50%, 70%, 95% ethanol) and then place in xylene. E. Apply coverslips to slides with Permount and store slides at room temperature.

Blindly image stained sections and have images blindly analyzed by a Board Certified Pathologist
to analyze lymphocytic infiltration of the tissue sections.
A. Assess absence or presence of tumor infiltrating lymphocytes in at least 10 random fields at high power magnification (×400) and score lymphocytic infiltration using the following system (Demaria et al., 2001): iii. 2 = moderate. iv. 3 = brisk.

Deliverables
1. Data to be collected: A. Mouse health records: general health, weight, and age at time of transplant, survival. B. Lab records on time course of tumor formation (noting when tumors become palpable), transplants, and antibody injections (including seed number of randomization). C. Image of each tumor at harvest. D. Raw numbers and graph of tumor weight in control and anti-CD47-treated mice (compare to Figure 6B). E. H&E stained sections from each tumor analyzed (compare to Figure 6C). F. Pathology report for each section and tumor analyzed. G. Complete blood cell counts in control and anti-CD47-treated mice.

Confirmatory analysis plan
This experiment assesses if treatment with an anti-CD47 therapeutic antibody alters breast tumor growth in immune competent hosts and examines the safety of the treatment by looking at blood toxicity. The histological analysis of lymphocytic infiltration of the tumors will be reported for each tumor generated during the study, along with the H&E stained sections. This replication attempt will perform the following statistical analysis.

A. Statistical analysis:
Note: At the time of analysis we will perform the Shapiro-Wilk test and generate a quantilequantile plot to assess the normality of the data. We will also perform Levene's test to assess homoscedasticity. If the data appear skewed, we will perform an appropriate transformation in order to proceed with the proposed statistical analysis. If this is not possible, we will perform the equivalent non-parametric test.
1. Tumor weight from isotype control treated mice to anti-CD47 clone MIAP410 treated mice.
1. Two-way ANOVA (3 × 13 design) with the following planned comparisons with the Bonferroni correction: i. One-way ANOVA of untreated, IgG, and anti-CD47-treated mice for each hematological parameter. ii. Compare the effect size of the original data to the replication data and use a meta-analytic approach to combine the original and replication effects, which will be presented as a forest plot.

Known differences from the original study
The replication attempt will not include the anti-CD47 clone MIAP301. The replication attempt will analyze lymphocytic infiltration of the tumors using a scoring system of the H&E stained sections, which was not implemented by the original study, and is included as exploratory analysis. Toxicity will be assessed during the course of the efficacy experiment instead of on a different strain and cohort of mice as the original study, which was determined in BALB/c mice. Additionally, the replication study will analyze blood 5 days after the beginning of antibody treatment, which precedes a total of three antibody treatments at a dose of 400 µg/injection. This is similar to the original study, which analyzed blood 5 days after two successive daily antibody injections of 500 µg/injection. To determine the baseline reading, untreated female FVB mice will be also be analyzed. The Idexx Laboratories ProCyte Dx hematology analyzer will assess the same parameters as the Heska HemaTrue used in the original study. All known differences of materials and reagents are listed in the 'Materials and reagents' section above, indicated by an asterisk, with the originally used item listed in the comments section. All differences have the same capabilities as the original and are not expected to alter the experimental design. The original study analyzed the data using a Student's t-test, however since the original data variance is not homogenous the Welch's t-test for comparing the samples will be used instead.

Provisions for quality control
The cell line used in this experiment will undergo STR profiling to confirm its identity and will be sent for mycoplasma testing to ensure there is no contamination, as well as rodent pathogen screening to ensure there are no detectable pathogens. The anti-CD47 clone MIAP410 will be checked to verify the specificity by ELISA, which is being conducted by the original lab. The retro-orbital bleeds will be performed by a Science Exchange lab with expertise in this technique to minimize stress. Subjective data collection will be performed blinded to the experimental conditions and treatment groups will be assigned in a random manner with the seed number recorded to reproduce the plan. All of the raw data, including the H&E stained sections, will be uploaded to the project page on the OSF (https://osf. io/9pbos) and made publically available.

Power calculations
Protocol 1 Summary of original data (provided by original authors).

Test family
A. 2 tailed Welch's t test, difference between two independent means, alpha error = 0.05.
Summary analysis of original data presented in Table S4  :

Test family
A. 2-way ANOVA (3 treatments x 13 hematology parameters), Fixed effects, special, main effects, and interactions, alpha error of 0.05. i. ANOVA analysis performed with R software, version 3.1.2 (R Core Team, 2014).

Dataset being analyzed N Mean SD
ii. Power calculations performed with G*Power software, version 3.1.7 (Faul et al., 2007).

Acknowledgements
The