1. Cancer Biology

Registered report: RAF inhibitors prime wild-type RAF to activate the MAPK pathway and enhance growth

  1. Ajay Bhargava
  2. Steven Pelech
  3. Ben Woodard
  4. John Kerwin
  5. Nimet Maherali
  6. Reproducibility Project: Cancer Biology  Is a corresponding author
  1. Shakti BioResearch, United States
  2. Kinexus Bioinformatics Corporation, Canada
  3. University of Maryland, United States
  4. Harvard Stem Cell Institute, United States
https://doi.org/10.7554/eLife.09976
Share this article
Cite this article
  1. Ajay Bhargava
  2. Steven Pelech
  3. Ben Woodard
  4. John Kerwin
  5. Nimet Maherali
  6. Reproducibility Project: Cancer Biology
(2016)
Registered report: RAF inhibitors prime wild-type RAF to activate the MAPK pathway and enhance growth
eLife 5:e09976.
https://doi.org/10.7554/eLife.09976
  2. Download BibTeX
  3. Download .RIS

Abstract

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered Report describes the proposed replication plan of key experiments from 'RAF inhibitors prime wild-type RAF to activate the MAPK pathway and enhance growth' by Hatzivassiliou and colleagues, published in Nature in 2010 (Hatzivassiliou et al., 2010). Hatzivassiliou and colleagues examined the paradoxical response of RAF-WT tumors to treatment with RAF inhibitors. The key experiments being replicated include Figure 1A, in which the original authors demonstrated that treatment of a subset of BRAFWT tumor cell lines with RAF small molecule inhibitors resulted in an increase in cell viability, Figure 2B, which reported that RAF inhibitor activation of the MAPK pathway was dependent on CRAF but not BRAF, and Figure 4A, where the dimerization of BRAF and CRAF was modulated by the RAF inhibitor PLX4720, but not GDC-0879. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

https://doi.org/10.7554/eLife.09976.001

Introduction

Mutations activating the H/K/N-RAS>B/C-RAF>MEK1/2>ERK1/2 signaling pathways are commonly found in many types of cancer, making members of this pathway promising drug targets. Several small molecule inhibitors have been created that target the three RAF isoforms. However, early observations using these drugs noted a surprising paradox; while drugs targeting CRAF were able to inhibit CRAF activity in vitro, they paradoxically activated the MEK1/2>ERK1/2 signaling modules in vivo. This activation was not due to direct activation of signaling components downstream of RAF (Hall-Jackson et al., 1999a; 1999b).

Hatzivassiliou and colleagues found that RAF inhibitors, while effective in blocking signaling in BRAFV600E mutant (MT) cancer cell lines, paradoxically increased cell proliferation in BRAFWT cancer cell lines (Hatzivassiliou et al., 2010). Their findings were published along with two other reports demonstrating similar results (Heidorn et al., 2010; Poulikakos et al., 2010) and provided a key insight into the mechanism of paradoxical RAF activation in BRAFWT cells, showing that it depended on drug-induced dimerization of wild-type (WT) RAF isoforms, specifically CRAF.

In Figure 1A, Hatzivassiliou and colleagues treated 19 cancer cell lines, comprising 4 BRAFV600E mutant lines, 7 RAF/RAS-WT lines, and 8 KRAS-MT lines, with varying concentrations of two RAF inhibitors and calculated the IC50 value for each drug in each cell line. They found that, although cancer cell lines carrying the BRAFV600E mutation were susceptible to the RAF inhibitors, BRAFWT cell lines were not. This experiment will be replicated in Protocol 1.

To elucidate whether CRAF or BRAF contributed to MEK signaling in RAF-treated KRAS-mutant cells, the authors used inducible shRNA cell lines to test whether BRAF or CRAF were necessary for the activation of MEK1/2 in HCT116 cells, which are KRAS mutant. As reported in Figure 2B, silencing CRAF reversed MEK activation upon treatment with the RAF inhibitors GDC-0879 and PLX4720. This experiment will be replicated in Protocol 2.

To test whether inhibitor priming was mediated by the inhibitors’ conformational effects on the RAF kinase domain, the authors assayed BRAF-CRAF heterodimerization through a series of immunoprecipitation assays coupled with or without RAF inhibitors. In Figure 4A, they reported that the CRAF kinase domain forms a stable complex with the BRAF kinase domain when inhibitors are not present. However, in the presence of the RAF inhibitor PLX4720, this CRAF-BRAF heterodimer kinase domain interaction is destabilized. In the presence of DGC-0879, the CRAF-BRAF interaction is stabilized. This experiment will be replicated in Protocol 3.

Hatzivassiliou’s work was published along with two companion papers; Heidorn and colleagues showed that drugs targeting BRAFV600E caused dimerization with CRAF and pathway activation (Heidorn et al., 2010), while Poulikakos and colleagues observed that paradoxical RAF activation only occurred in the context of BRAFWT (Poulikakos et al., 2010). In a subsequent study, Poulikakos and colleagues showed that dimerization was a critical factor in allowing a variant of BRAFV600E to demonstrate enhanced activity as compared to BRAFV600E (Poulikakos et al., 2011). Work by Joseph and colleagues confirmed the findings of Hatzivassiliou and colleagues that BRAFV600E cell lines were sensitive to treatment with the BRAF inhibitor PLX4720, while RAS mutant/BRAFWT or RAS/RAF WT cell lines were not, and that MEK1/2>ERK1/2 signaling was activated in these BRAFWT lines (Joseph et al., 2010). Lee and colleagues assayed a panel of BRAFV600E, NRAS mutant, or BRAF/NRAS WT cell lines by treating them with PLX4720. They observed that PLX4720 inhibited ERK signaling in BRAFV600E cells, but they did not observe paradoxical MEK1/2>ERK1/2 activation in BRAFWT lines. They attributed this effect to a lower percentage of serum in their culture conditions as compared to those used in previous studies. They then examined colony formation to assess drug effects on cell survival, and saw strong growth inhibition exclusively in BRAFV600E cells (Lee et al., 2010). Paradoxical activation was also observed in BRAFWT cells by Carnahan and colleagues and by Halaban and colleagues (Carnahan et al., 2010; Halaban et al., 2010). A year later, Kaplan and colleagues published corroborating evidence that PLX4720 paradoxically activated MEK1/2>ERK1/2 signaling in BRAFWT cells. They also confirmed that silencing of CRAF abrogated this activation of MEK1/2>ERK1/2 signaling (Kaplan et al., 2011).

Materials and methods

Unless otherwise noted, all protocol information were derived from the original paper, references from the original paper, or information obtained directly from the authors. An asterisk (*) indicates data or information provided by the Reproducibility Project: Cancer Biology core team. A hashtag (#) indicates information provided by the replicating lab. All references to Figures refer to the original study.

Protocol 1: Assessing cell viability of a panel of cancer cell lines treated with RAF and MEK inhibitors

This protocol describes the treatment of a panel of human cancer cell lines with or without mutations in BRAF or RAS with drugs targeting RAF and MEK and assessing cell viability. This experiment is a replication of Figure 1A.

Sampling

Request a detailed protocol

  • This experiment will be repeated four times.

    • See Power calculations for details.

  • Each experiment consists of three cohorts:

    • Cohort 1: Cell lines treated with a range of concentrations of PLX4720

      • 20 µM

      • 10 µM

      • 5 µM

      • 2.5 µM

      • 1.25 µM

      • 0.625 µM

      • 0.313 µM

      • 0.156 µM

      • 0.078 µM

    • Cohort 2: Cell lines treated with a range of concentrations of GDC-0879

      • 20 µM

      • 10 µM

      • 5 µM

      • 2.5 µM

      • 1.25 µM

      • 0.625 µM

      • 0.313 µM

      • 0.156 µM

      • 0.078 µM

    • Cohort 3: Cell lines treated with a range of concentrations of PD0325901

      • 20 µM

      • 10 µM

      • 5 µM

      • 2.5 µM

      • 1.25 µM

      • 0.625 µM

      • 0.313 µM

      • 0.156 µM

      • 0.078 µM

  • Each cohort consists of three cell lines:

    • A375 cells

      • BRAFV600E mutant

    • MeWo cells

      • RAFWT/RASWT

    • HCT116

      • RAS mutant

Materials and reagents

Request a detailed protocol
ReagentTypeManufacturerCatalog #Comments
A375CellsATCCCRL-1619DMEM + 10% FBS
MeWoCellsATCCHTB-65EMEM + 10% FBS
HCT116CellsATCCCCL-247McCoy's 5a Medium
Modified + 10% FBS
PLX4720InhibitorSymansisSY-PLX4720
PD0325901InhibitorSymansisSY-PD0325901
GDC-0879InhibitorSelleckchemS1104Replaces Genentech and
Array BioPharma source
Fluorescent plate readerEquipmentBioTek FLx800
15-cm cell culture platesEquipmentCorning430599Original unspecified
96-well platesMaterialsCorning3903
DMEMMediumATCC30–2002Original unspecified
EMEMMediumATCC30–2003Original unspecified
McCoy's 5a medium modifiedMediumATCC30–2007Original unspecified
Fetal bovine serum (FBS)ReagentATCC30–2020Original unspecified
DMSOReagentFisherD128–500Original unspecified
Cell Titer Glo kitReagentPromegaG7570

Procedure

Request a detailed protocol

Notes:

  • A375 cells are maintained in DMEM supplemented with 10% FBS.

  • MeWo cells are maintained in EMEM supplemented with 10% FBS.

  • HCT116 cells are maintained in McCoy's 5a Medium Modified supplemented with 10% FBS.

    • All cell lines are kept at 37°C/5% CO2.

  • All cell lines will be sent for STR profiling and mycoplasma testing

  1. Expand cell lines as needed in 15-cm plates.

  2. Determine range of detection of replicating lab’s plate reader:

    1. Plate 500 – 1.6 × 104 A375, MeWo, and HCT116 cells in quadruplicate wells in a 96 well plate with 100 µl of appropriate medium. Incubate 5 days.

      1. Plate medium alone (no cells).

      2. 500 cells/well

      3. 1000 cells/well

      4. 2000 cells/well

      5. 4000 cells/well

      6. 8000 cells/well

      7. 16,000 cells/well

    2. Five days later measure cell viability with the Cell Titer Glo kit according to manufacturer’s instructions.

      1. Plot relative luminescence to cells/well.

      2. Use seeding density for each cell line that give sub-confluency in 5 days and where the signal is still in the linear range at the end of the assay.

  3. Seed cells, at density determined in Step 2 above, in quadruplicate wells (technical replicates) in 96-well plates and incubate overnight. Note: Information in Steps 2 through 3 is derived from Hoeflich and colleagues (Hoeflich et al., 2009).

    1. Include control wells that contain media but no cells to control for background luminescence.

    2. Also include wells with cells that will remain untreated (no DMSO).

  4. The next day, treat cells with varying doses of each drug diluted in DMSO first and then add fresh media (to avoid excess DMSO toxicity, keep final DMSO percentage below 0.2%).

    1. Perform serial dilutions of drugs in DMSO in a 96-well plate.

      1. Drug doses (twofold dilution series, see Sampling section for concentrations)

      2. Vehicle control (DMSO)

    2. Further dilute compounds in fresh growth media.

    3. Replace media in wells with new media containing appropriate drug concentrations.

    4. d. As controls, include wells of untreated cells and wells of cells treated only with vehicle.

  5. Incubate cells for 4 days.

    1. Do not replace media during this incubation.

  6. Measure cell viability with the Cell Titer Glo kit according to the manufacturer’s instructions.

    1. Record luminescence.

    2. For each treated well, subtract average background luminescence calculated from media-only wells. The background luminescence defines 0% viability (baseline).

    3. Normalize luminescence to the average of the vehicle treated cells. The vehicle-treated cells define 100% viability (top).

    4. Fit data to a four-parameter curve, with the top and baseline held constant at 100% and 0% each, and calculate the absolute EC50 value (where the curve crosses 50% viability) for each drug treatment of each cell line.

      1. Only report EC50 values that can be accurately estimated. Otherwise report as >20 µM or <0.078 µM.

  7. Repeat Steps 3–6 independently three additional times.

Deliverables

Request a detailed protocol

  • Data to be collected:

    • All raw luminescence values

    • Luminescence values adjusted to compensate for background luminescence

    • Luminescence values normalized to vehicle treated cells.

    • EC50 values for each cell line and each drug treatment (as seen in Figure 1A)

Confirmatory analysis plan

Request a detailed protocol

  • Statistical analysis of the replication data:

    • n/a

  • Meta-analysis of original and replication attempt effect sizes:

    • The replication data will be presented as a mean with 95% confidence intervals and will include the original data point, calculated directly from the graph, as a single point on the same plot for comparison.

Known differences from the original study

Request a detailed protocol

  • All known differences are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. All differences have the same capabilities as the original and are not expected to alter the experimental design.

  • While the original experiment examined nineteen cell lines, the replication will be restricted to three cell lines; A375, representing the BRAFV600E mutant lines, MeWo, representing the RAFWT/RASWT cell lines, and HCT116, representing the RAS mutant cell lines. HCT116 is used in a subsequent experiment described in Protocol 2.

  • The replicating lab will plate the cells in a 96-well plate as opposed to a 384-well plate.

Provisions for quality control

Request a detailed protocol

All data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either in the published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/0hezb/).

  • STR profiling and mycoplasma detection results

Protocol 2: Assessing CRAF and BRAF roles in drug-dependent activation of MEK

This protocol describes the treatment of HCT116 (KRAS-MT) cells expressing doxycycline-inducible shRNAs against BRAF and CRAF, and treatment with RAF inhibitors followed by Western blot examination of activation of MEK. This experiment is a replication of Figure 2B.

Sampling

Request a detailed protocol

  • This experiment will be repeated seven times for a final power of ≥80%.

    • The original data presented is qualitative (representative images). In order to determine an appropriate number of replicates to perform initially, we have estimated the sample sizes required based on a range of potential variance.

    • See Power calculations for details.

  • The experiment consists of two cohorts:

    • Cohort 1: HCT116 cells with dox-inducible shRNA against BRAF

    • Cohort 2: HCT116 cells with dox-inducible shRNA against CRAF

  • Each cohort will receive the following treatments:

    • No dox:

      • DMSO

      • 0.1 µM PLX4720

      • 1 µM PLX4720

      • 10 µM PLX4720

    • Dox:

      • DMSO

      • 0.1 µM PLX4720

      • 1 µM PLX4720

      • 10 µM PLX4720

    • No dox:

      • DMSO

      • 0.1 µM GDC-0879

      • 1 µM GDC-0879

      • 10 µM GDC-0879

    • Dox:

      • DMSO

      • 0.1 µM GDC-0879

      • 1 µM GDC-0879

      • 0 µM GDC-0879

  • Lysates from each treatment are probed for:

    • phospho-MEK 1/2

    • total MEK 1/2

    • BRAF

    • CRAF

    • Actin (additional loading control)

Materials and reagents

Request a detailed protocol
ReagentTypeManufacturerCatalog #Comments
HCT116 cells expressing doxycycline-inducible
shRNA directed against BRAF		CellsProvided by original authors
HCT116 cells expressing doxycycline-inducible
shRNA directed against CRAF		CellsProvided by original authors
DoxycyclineDrugAlfa AesarJ67043-AEOriginal unspecified
PLX4720 RAF inhibitorDrugSymansisSY-PLX4720
GDC-0879InhibitorSelleckchemS1104Replaces Genentech
and Array BioPharma
source
DMSOReagentSigmaD2650-5X5MLOriginal unspecified
McCoy's 5a MediumMediumATCC30-2007
Fetal bovine serumReagentSeradigm1400-500GOriginal unspecified
15-cm cell culture platesMaterialsCorning430599Original unspecified
Protease inhibitor mixture; Complete MiniReagentRoche Applied Science04693159001
Phosphatase inhibitor mixReagentPierce78420
SDS-PAGE (4–20%) Tris-GlycineMaterialsBioRad456–1094Original unspecified
Nitrocellulose membraneMaterialsBioRad170–4158Original unspecified
ECL detection reagentsReagentsAmershamRPN2232
Rabbit phospho MEK (pMEK) 1/2 (Ser217/221) antibodyAntibodyCell Signaling Technology91211:1000
Rabbit MEK 1/2 antibody (clone 47E6)AntibodyCell Signaling Technology91261:1000
Mouse anti-BRAF antibodyAntibodySanta Cruz Biotechnologysc-52841:1000
Goat Anti-Mouse IgG-HRPAntibodyPierce314321:5,000–1:200,000
Goat Anti-Rabbit IgG-HRPAntibodyPierce314601:5,000–1:200,000
Mouse anti-CRAF antibodyAntibodyBD6101511:1000
Mouse anti-ß-actin (HRP conjugate) (clone 8H10D10)AntibodyCell Signaling Technology12262Not originally used
Kaleidoscope prestained standards protein ladderReagentBioRad161–0324Original unspecified
4–15% Mini-PROTEAN TGX Stain-Free SDS-PAGE gelMaterialsBioRad456–8085Original unspecified
Trans-Blot Turbo Mini Nitrocellulose transfer packsEquipmentBioRad170–4158Original unspecified

Procedure

Request a detailed protocol

Notes:

  • Some information derived from Hoeflich and colleagues (Hoeflich et al., 2006).

  • HCT116 cells are maintained in McCoy’s 5a Medium modified supplemented with 10% FBS at 37°C/5% CO2.

  • All cells will be sent for STR profiling and mycoplasma testing.

  1. Determine if concentration of doxycycline to induce knockdown of BRAF and CRAF in HCT116 cells needs to be optimized. Before beginning experiment, perform protocol details as outlined below, without drug treatment (Step 4) and only analyzing expression of BRAF, CRAF, and actin (Step 8). Perform with at least 1 well per group (with and without dox treatment for each cell line).

    1. Normalize BRAF and CRAF to actin levels.

    2. If level of depletion is not similar to reported levels in Figure 2B, further optimize conditions, such as increasing concentration of dox.

    3. Once conditions of knockdown are optimized, use for all replicates of experimental procedure.

  2. Seed #5x104 cells/well in 24-well plates for treatment.

    1. Seed 16 wells per cohort.

      1. 8 wells will be treated with dox.

      2. 8 wells will remain untreated.

  3. Induce shRNA expression of appropriate wells by treatment with 2 mg/ml dox for 3 days.

    1. This condition will be checked in Step 1 of this protocol and optimized if needed. Once optimized, use that condition for all replicates.

  4. Treat appropriate cells with varying concentrations of PLX4720 or GDC-0879 for 1 hr.

    1. Treat cells with varying doses of each drug diluted in DMSO first and then fresh media added (to avoid excess DMSO toxicity, keep final DMSO percentage below 0.2%).

    2. In each set of 8 wells (dox treated and untreated), treat as follows:

      1. Well 1: DMSO

      2. Well 2: 0.1 µM PLX4720

      3. Well 3: 1 µM PLX4720

      4. Well 4: 10 µM PLX4720

      5. Well 5: DMSO

      6. Well 6: 0.1 µM GDC-0879

      7. Well 7: 1 µM GDC-0879

      8. Well 8: 10 µM GDC-0879

  5. Lyse cells and harvest protein:

    1. Rinse cells in ice cold PBS.

    2. Lyse cells in ice cold lysis buffer: 0.5% NP40, 20 mM Tris pH7.5, 137 mM NaCl, 10% glycerol, 1 mM EDTA plus protease inhibitor mixture-complete mini, and phosphatase inhibitor mix.

    3. Spin lysate at 12,000xg for 5 min at 4°C.

      1. Transfer lysate to fresh tube after spinning.

    4. Quantify protein by the BCA method.

  6. Separate proteins by SDS-PAGE:

    1. #Adjust sample to 1.5 µg/µL with 2X Lammeli Buffer/H2O.

    2. #Boil sample for 5 min at >90°C.

      1. Load #10–20 µg of protein per lane on a #4–15% SDS-PAGE gel.

      2. Run alongside a size marker ladder.

      3. Transfer to nitrocellulose membrane using a #Trans-Blot Turbo Mini according to the manufacturer’s instructions.

        1. #Run at 25 V, 1 A for 30 min.

        2. *Confirm protein transfer by Ponceau staining.

  7. Block membrane in 5% non-fat dried milk in TBST (20 mM Tris pH 7.5, 136 mM NaCl, 0.1% Tween-20).

  8. Incubate membrane at 4°C overnight with primary antibodies #diluted in 5% milk in TBST:

    1. Mouse anti-BRAF; 1:1000 dilution; 86 kDa

    2. Mouse anti-CRAF; 1:1000 dilution; 74 kDa

    3. Rabbit anti-pMEK 1/2; 1:1000 dilution; 45 kDa

    4. Rabbit anti-total MEK 1/2; 1:1000 dilution; 45 kDa

    5. Mouse anti-ß-Actin-HRP; 1:1000 dilution; 42 kDa

      1. Run one gel/membrane per antibody; do not strip and reprobe membranes for multiple antibodies.

      2. Note: Actin serves as a loading control to ensure equal loading of lanes (additional).

  9. #Wash membranes 3 x 5 min in TBST.

  10. Incubate with HRP-conjugated secondary antibodies #diluted 1:20,000 in 5% milk in TBST for 1 hr at room temperature.

  11. Visualize bands with ECL detection kit according to manufacturer’s protocol.

    1. Quantify band intensity.

    2. For each drug and dose in each cell line (treated with or without dox), normalize pMEK values to total MEK values.

  12. Repeat Steps 2–11 independently six additional times.

Deliverables

Request a detailed protocol

  • Data to be collected:

    • Images of whole gel, including ladder, of shRNA optimization (Step 1).

    • Images of whole gel, including ladder (compare to Figure 2B).

    • Quantification of band intensities; phospho-protein levels normalized to total protein levels.

Confirmatory analysis plan

Request a detailed protocol

  • Statistical analysis of the replication data:

    • Compare band intensities across all groups.

      • Four-way ANOVA (2 x 2 x 2 x 4 factorial) of the normalized pMEK values for each cell line (with or without dox), drug (PLX4720 or GDC-0879), and dose (0, 0.1, 1, and 10 µM) followed by:

        • Two-way interaction contrast of normalized pMEK values from BRAF and CRAF shRNA cell lines (with or without dox) across varying doses of GDC-0879 with the following Bonferroni corrected comparisons:

          • BRAF shRNA cell line with dox compared to without dox (across varying doses of GDC-0879)

          • CRAF shRNA cell line with dox compared to without dox (across varying doses of GDC-0879)

        • Two-way interaction contrast of normalized pMEK values from BRAF and CRAF shRNA cell lines (with or without dox) across varying doses of PLX4720 with the following Bonferroni corrected comparisons:

          • BRAF shRNA cell line with dox compared to without dox (across varying doses of PLX4720)

          • CRAF shRNA cell line with dox compared to without dox (across varying doses of PLX4720)

  • Meta-analysis of original and replication attempt effect sizes:

    • The replication data will be presented as a mean with 95% confidence intervals and will include the original data point, calculated directly from the representative image, as a single point on the same plot for comparison.

Known differences from the original study

Request a detailed protocol

  • All known differences are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. All differences have the same capabilities as the original and are not expected to alter the experimental design.

  • The replication attempt will use actin as an additional loading control not used in the original study.

Provisions for quality control

Request a detailed protocol

All data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either in the published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/0hezb/).

  • STR profiling and mycoplasma detection results.

  • Induced shRNA knockdown conditions will be checked, and optimized if needed, prior to proceeding with the experiment.

  • Image of Ponceau staining confirming protein transfer.

  • Protein loading will be confirmed using actin.

Protocol 3: Biochemical heterodimerization assay with recombinant RAF proteins in the presence or absence of RAF inhibitors

This protocol describes how to perform immunoprecipitation and Western blot analysis with recombinant CRAF and BRAF kinase domains in the presence or absence of the RAF inhibitors PLX4720 or GDC-0879. Wild-type BRAF and BRAFV600E kinase domains will be tested in the presence of wild-type CRAF. This experiment is a replication of Figure 4A.

Sampling

Request a detailed protocol

  • This experiment will be repeated six times for a final power of ≥80%.

    • The original data presented are qualitative (representative images). In order to determine an appropriate number of replicates to perform initially, we have estimated the sample sizes required based on a range of potential variance. We will also determine sample size post hoc.

    • See Power calculations for details.

  • Each experiment consists of two cohorts:

    • Cohort 1: CRAF + BRAFWT

    • Cohort 2: CRAF + BRAFV600E

  • Each cohort is incubated with CRAF and treated for 1 hr with:

    • DMSO

    • 10 µM of PLX4720

    • 10 µM GDC-0879

    • 1 mM AMP-PCP

  • Include a sample of CRAF, without BRAF, treated with DMSO (negative control)

  • Immunoprecipitate CRAF from each sample and probe for CRAF and BRAF.

Materials and reagents

Request a detailed protocol
ReagentTypeManufacturerCatalog #Comments
pFBHTc delta N 1-416 BRAFPlasmidMRC-PPUDU586Made at Genentech and
Array BioPharma.
Communication with authors.
pFBHTc delta N 1-416 BRAFV600EPlasmidMRC-PPUDU603
Recombinant glutathione
S-transferase (GST)-CRAF
(Y340D/Y341D) kinase domain		ProteinInvitrogenPV3805Original catalog # not specified
Assay bufferChemicalSpecific brand information
will be left up to the
discretion of the replicating
lab and recorded later
DMSOChemical
PLX4720InhibitorSymansisSY-PLX4720
GDC-0879InhibitorSelleckchemS1104Replaces Genentech and Array
BioPharma source
Adenylylmethylenediphosphonate (AMP-PCP)ChemicalSigmaM7510Original catalog # not specified
Rabbit anti-GSTAntibodyCell Signaling Technology2622
Protein A agarose beadsChromatographyMilliporeIP02Original catalog # not specified
SDS-PAGE gelWestern materialsPrepared in replicating labOriginal unspecified
Precision Plus Protein All Blue StandardsReagentBioRad161–0393Original unspecified
Ponceau stainReagentSigmaP7170Not originally included
Nitrocellulose membraneMaterialPall CorporationPN 66485Original unspecified
Mouse anti-CRAF (clone 53)AntibodyBD Biosciences610151
Mouse anti-BRAFAntibodySigmaWH0000673M1
Goat anti-mouse IgG-HRPAntibodyInvitrogen Molecular ProbesA11029Replaces Alexa Fluor 488
goat anti-mouse IgG
from Invitrogen, cat# A11029
ECL Plus ReagentDetection assayLumigenPS-3Replaces TyphoonTM Scanner
from Amersham Bioscience
Fluor-S Max ScannerInstrumentBioRad

Procedure

Request a detailed protocol

  1. Express 6His-BRAFWT and 6His-BRAFV600E kinase domains (417–766) from pFBHTc delta N 1-416 BRAF and pFBHTc delta N 1-416 BRAFV600E vectors, respectively, using baculovirus cells, following lab standard procedures. Affinity purify proteins using a nickel column using lab standard procedures.

  2. Add 500 nM 6His-BRAFWT kinase domain or 6His-BRAFV600E kinase domain and 500 nM GST-CRAF kinase domain to assay buffer.

    1. Assay buffer: 25 mM HEPES, pH 7.4, 10 mM MgCl2, 0.01% (v/v) Triton X-100, and 2 mM DTT.

    2. Four samples of GST-CRAF + BRAFWT

    3. Four samples of GST-CRAF + BRAFV600E

    4. One sample with GST-CRAF alone.

  3. Incubate samples for 1 hr at room temperature in the presence of a fixed concentration of compound or vehicle:

    1. DMSO

    2. 10 µM of PLX4720

    3. 10 µM GDC-0879

    4. 1 mM AMP-PCP

      1. For all compounds, keep final DMSO concentration to 0.25%

  4. Immunoprecipitate GST-CRAF proteins with rabbit anti-GST antibody and protein A agarose beads following manufacturer’s instructions.

  5. Separate proteins by SDS-PAGE:

    1. Boil samples in SDS-Sample Buffer at 100°C for 5 min.

    2. Load samples on a SDS-PAGE gel.

      1. Electrophorese all samples on gel alongside a size marker ladder.

      2. Perform electrophoresis at 30 mA for 55 min, monitoring the dye front until it comes off the gel.

    3. Transfer to nitrocellulose membrane at 250 mA per gel for 1 hr.

      1. *Confirm protein transfer by Ponceau staining.

  6. Block membrane in 5% non-fat dried milk in TBST (20 mM Tris-HCl pH 7.5, 136 mM NaCl, 0.1% Tween-20) as recommended by manufacturer.

  7. Incubate membrane at 4°C overnight with antibodies against:

    1. Mouse anti-CRAF; 1:1000; 66 kDa

    2. Mouse anti-BRAF; 1:1000; 44 kDa

  8. Incubate with secondary antibody in 1X TBS for 1 hr at room temperature as recommended by manufacturer.

    1. Rinse the membrane at least three times with TBST.

  9. Detect secondary antibody and visualize bands with an imager.

    1. Quantify band intensity.

    2. For each sample, normalize BRAF IP values to GST-CRAF IP values.

    3. For each BRAF variant, normalize compound treatment to DMSO.

  10. Repeat experiment independently five additional times.

Deliverables

Request a detailed protocol

  • Data to be collected:

    • Full gel images with ladder positions marked

    • Quantification of band intensities

      • Raw measurements as well as normalized band intensities

    • Graph of mean band intensities across replicates

Confirmatory analysis plan

Request a detailed protocol

  • Statistical analysis of the replication data:

    • Bonferonni corrected one-sample t-tests of normalized BRAFWT values (normalized to GST-CRAF and then DMSO) of the following conditions compared to 1 (DMSO):

      • PLX4720

      • GDC-0879

      • AMP-PCP

    • Bonferonni corrected one-sample t-tests of normalized BRAFV600E values (normalized to GST-CRAF and then DMSO) of the following conditions compared to 1 (DMSO):

      • PLX4720

      • GDC-0879

      • AMP-PCP

  • Meta-analysis of original and replication attempt effect sizes:

    • The replication data will be presented as a mean with 95% confidence intervals and will include the original data point, calculated directly from the representative image, as a single point on the same plot for comparison.

  • Additional exploratory analysis:

    • Two-way ANOVA of BRAF values (normalized to GST-CRAF) from DMSO, PLX4720, GDC-0879, or AMP-PCP treated samples for each BRAF variant incubated with GST-CRAF with the following Bonferroni corrected comparisons:

      • BRAFWT treated with DMSO compared to BRAFWT treated with PLX4720

      • BRAFWT treated with DMSO compared to BRAFWT treated with GDC-0879

      • BRAFWT treated with DMSO compared to BRAFWT treated with AMP-PCP

      • BRAFV600E treated with DMSO compared to BRAFV600E treated with PLX4720

      • BRAFV600E treated with DMSO compared to BRAFV600E treated with GDC-0879

      • BRAFV600E treated with DMSO compared to BRAFV600E treated with AMP-PCP

Known differences from the original study

Request a detailed protocol

  • All known differences are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. All differences have the same capabilities as the original and are not expected to alter the experimental design.

  • The original data examined samples treated with AZ-628, a chemically unrelated ATP-competitive RAF inhibitor, which had a similar reported effect as GDC-0879. The replication will be restricted to examining only PLX4720 and GDC-0879, similar to the other experiments included in this replication attempt.

  • The replicating lab will use a modified version of their in-house Western Blot protocol with antibodies analyzed by an ECL detection system instead fluorescence based.

Provisions for quality control

Request a detailed protocol

All data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either in the published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/0hezb/).

  • Image of Ponceau staining confirming protein transfer

Power calculations

Note: for details on the full set of power calculations, see https://osf.io/a4e75/.

Protocol 1

Summary of original data

  • Values estimated from original published figure.

Figure 1A: RAF inhibitors and MEK inhibitorEC50 (µM)
A375PLX47200.5
GDC-08790.3
PD0325901<0.0781
MeWoPLX4720>20
GDC-0879>20
PD0325901<0.0781
HCT116PLX4720>20
GDC-0879>20
PD03259010.18

Power calculations

  • Due to EC50 values, such as PLX4720 and GDC-0879 with MeWo and HCT116 cells, unable to be determined (i.e. they are above 20 µM), this replication attempt will not compare values, but instead report EC50 values that can be accurately estimated and compare them to the original reported values. If unable to obtain an EC50 estimate the highest or lowest dose, depending on the situation, will be reported, similar to the original report.

Protocol 2

Summary of original data reported in Figure 2B

  • Summary of data:

    • Band densities were obtained with Image Studio Lite (LiCOR) from published images.

    • Normalization was performed by dividing the phospho-band intensity by the total protein band intensity.

Figure 2B; assumed number of biological replicates = 3
hairpinDoxDrugDoseNormalized pMEK
band density
shBRAF-GDC-087900.1453
shBRAF-GDC-08790.10.8004
shBRAF-GDC-08791.00.1263
shBRAF-GDC-087910.00.0245
shBRAF+GDC-087900.0457
shBRAF+GDC-08790.10.6477
shBRAF+GDC-08791.00.1485
shBRAF+GDC-087910.00.0115
shBRAF-PLX472000.0795
shBRAF-PLX4720.10.1615
shBRAF-PLX4721.00.7760
shBRAF-PLX47210.01.0721
shBRAF+PLX47200.0861
shBRAF+PLX4720.10.1388
shBRAF+PLX4721.00.4522
shBRAF+PLX47210.00.9831
shCRAF-GDC-087900.2121
shCRAF-GDC-08790.10.7038
shCRAF-GDC-08791.00.1554
shCRAF-GDC-087910.00.0239
shCRAF+GDC-087900.1005
shCRAF+GDC-08790.10.1896
shCRAF+GDC-08791.00.0933
shCRAF+GDC-087910.00.0315
shCRAF-PLX472000.4166
shCRAF-PLX4720.10.7469
shCRAF-PLX4721.01.1387
shCRAF-PLX47210.01.2976
shCRAF+PLX47200.2945
shCRAF+PLX4720.10.2449
shCRAF+PLX4721.00.2983
shCRAF+PLX47210.00.2729

The original data does not indicate the error associated with multiple biological replicates. To identify a suitable sample size, power calculations were performed using different levels of relative variance using the values quantified from the reported image as the mean. At each level of variance the effect size was estimated and used to calculate the needed sample size to achieve at least 80% power with the indicated alpha error. The achieved power is reported.

Test family

  • Four-way ANOVA: Fixed effects, special, main effects and interactions, alpha error = 0.05

Power calculations

  • Performed with G*Power software, version 3.1.7 (Faul et al., 2007).

  • ANOVA F test statistic and partial η2 performed with R software, version 3.2.2 (R Core Team, 2015).

    • For a given relative variance, 10,000 simulations were run and the F statistic and partial η2 was calculated for each simulated data set.

GroupsVariance estimateF test statistic F(1,64)
(shRNA, Dox,
Drug interaction)		Partial η2Effect size fA priori powerTotal sample
size
(32 groups)
Normalized pMEK
in shBRAF or
shCRAF cells treated
with or without Dox
and varying doses
of GDC-0879 or
PLX4720		2%2513.610.972455.9406399.9%96
15%45.61150.396160.8099999.9%96
28%13.83180.167260.4481799.1%96
40%7.32030.096500.3268188.4%96

Test family

  • ANOVA: Fixed effects, special, main effects and interactions, alpha error = 0.05 for two-way interaction contrast.

Power calculations

GroupsVariance estimateF test statistic
F(1,64)
(shRNA, Dox)		Partial η2Effect size fA priori powerTotal sample
size
(32 groups)
Normalized pMEK
in shBRAF or shCRAF
cells treated with or
without Dox across
varying doses of
GDC-0879		2%327.180.836392.2610199.9%96
15%5.816510.083310.3014782.9%96
28%1.669280.025420.1615082.1%320
40%0.817950.012620.1130581.5%640
Normalized pMEK
in shBRAF or
shCRAF cells treated
with or without Dox
across varying doses
of PLX4720		2%7267.40.9912710.656199.9%96
15%129.1980.668731.4208299.9%96
28%37.07860.366830.7611599.9%96
40%18.16850.221110.5328199.9%96

Test family

  • ANOVA: Fixed effects, special, main effects and interactions, Bonferroni’s correction, alpha error = 0.025 for contrasts within each drug type

Power calculations

DrugGroup 1
across dose		Group 2
across dose		Variance
estimate		Effect
size f		A priori
power		Samples
per group
GDC-0879shBRAF (+ Dox)shBRAF (- Dox)2%1.7787499.9%3
15%0.2371784.6%6
28%0.1270581.2%19
40%0.0889480.4%38
shCRAF (+ Dox)shCRAF (- Dox)2%4.9762999.9%3
15%0.6635199.9%3
28%0.3554588.0%3
40%0.2488180.9%5
PLX4720shBRAF (+ Dox)shBRAF (- Dox)2%3.1381599.9%3
15%0.4184196.2%3
28%0.2241586.2%7
40%0.1569082.9%13
shCRAF (+ Dox)shCRAF (- Dox)2%18.208199.9%3
15%2.4277599.9%3
28%1.3005899.9%3
40%0.9104099.9%3

  • Based on these power calculations, we will then run the experiment seven times. Each time we will quantify band intensity. We will determine the standard deviation of band intensity across the biological replicates and combine this with the reported value from the original study to simulate the original effect size. We will use this simulated effect size to determine the number of replicates necessary to reach a power of at least 80%. We will then perform additional replicates, if required, to ensure that the experiment has more than 80% power to detect the original effect.

Protocol 3

Summary of original data reported in Figure 4A

  • Summary of data:

    • Normalization was performed by dividing the BRAF-band intensity by the captured GST-CRAF band intensity.

Figure 4A; assumed number of biological replicates = 3
BRAF variantDrugNormalized BRAF band density
WTDMSO1
WTAMP-PCP0.2
WTGDC-08792.7
WTPLX47200.2
V600EDMSO1
V600EAMP-PCP1.4
V600EGDC-08791.3
V600EPLX47201.3

The original data does not indicate the error associated with multiple biological replicates. To identify a suitable sample size, power calculations were performed using different levels of relative variance using the values quantified from the reported image as the mean. At each level of variance, the effect size was estimated and used to calculate the needed sample size to achieve at least 80% power with the indicated alpha error. The achieved power is reported.

Test family

  • Two-tailed t-test: Difference from constant (one sample case), Bonferroni’s correction, alpha error = 0.00833.

Power calculations

Group 1 (constant)Group 2Variance
estimate		Effect
size d		A priori
power		Samples
per group
WT BRAF (DMSO)WT BRAF (AMP-PCP)2%200.0099.9%3
15%26.66799.9%3
28%14.28699.4%3
40%10.00091.8%3
WT BRAF (DMSO)WT BRAF (GDC-0879)2%31.48299.9%3
15%4.197584.2%4
28%2.248782.0%6
40%1.574184.7%9
WT BRAF (DMSO)WT BRAF (PLX4720)2%200.0099.9%3
15%26.66799.9%3
28%14.28699.4%3
40%10.00091.8%3
Sensitivity calculationsDetectable effect
size d		A prior
power		Samples
per group
BRAFV600E (DMSO)BRAFV600E (AMP-PCP)2%8.019480.0%3
15%3.958180.0%4
28%2.197380.0%6
40%1.491780.0%9
BRAFV600E (DMSO)BRAFV600E (GDC-0879)2%8.019480.0%3
15%3.958180.0%4
28%2.197380.0%6
40%1.491780.0%9
BRAFV600E (DMSO)BRAFV600E (PLX4720)2%8.019480.0%3
15%3.958180.0%4
28%2.197380.0%6
40%1.491780.0%9

  • Based on these power calculations, we will then run the experiment six times. Each time we will quantify band intensity. We will determine the standard deviation of band intensity across the biological replicates and combine this with the reported value from the original study to simulate the original effect size. We will use this simulated effect size to determine the number of replicates necessary to reach a power of at least 80%. We will then perform additional replicates, if required, to ensure that the experiment has more than 80% power to detect the original effect.

References

    1. R Core Team
    (2015)
    R: a language and environment for statistical computing
    R Foundation for Statistical Computing.

Article and author information

Author details

  1. Ajay Bhargava

    Shakti BioResearch, Woodbridge, United States
    Contribution
    AB, Drafting or revising the article
    Competing interests
    AB: Shakti Bioresearch is a Science Exchange associated lab.

  2. Steven Pelech

    Kinexus Bioinformatics Corporation, Vancouver, Canada
    Contribution
    SP, Drafting or revising the article
    Competing interests
    No competing interests declared.

  3. Ben Woodard

    Biotechnology Research and Education Program, University of Maryland, College Park, United States
    Contribution
    BW, Drafting or revising the article
    Competing interests
    BW: Biotechnology Research and Education Program is a Science Exchange associated lab.

  4. John Kerwin

    Biotechnology Research and Education Program, University of Maryland, College Park, United States
    Contribution
    JK, Drafting or revising the article
    Competing interests
    JK: Biotechnology Research and Education Program is a Science Exchange associated lab.

  5. Nimet Maherali

    Harvard Stem Cell Institute, Cambridge, United States
    Contribution
    NM, Drafting or revising the article
    Competing interests
    No competing interests declared.

  6. Reproducibility Project: Cancer Biology

    Contribution
    RP:CB, Conception and design; Drafting or revising the article
    For correspondence
    fraser@scienceexchange.com
    Competing interests
    RP:CB: EI, FT, JL, and NP are employed by and hold shares in Science Exchange Inc.
    1. Elizabeth Iorns, Science Exchange, Palo Alto, United States
    2. William Gunn, Mendeley, London, United Kingdom
    3. Fraser Tan, Science Exchange, Palo Alto, United States
    4. Joelle Lomax, Science Exchange, Palo Alto, United States
    5. Nicole Perfito, Science Exchange, Palo Alto, United States
    6. Timothy Errington, Center for Open Science, Charlottesville, United States

Funding

Laura and John Arnold Foundation

  • Reproducibility Project: Cancer Biology

The Reproducibility Project: Cancer Biology is funded by the Laura and John Arnold Foundation, provided to the Center for Open Science in collaboration with Science Exchange. The funder had no role in study design or the decision to submit the work for publication.

Acknowledgements

The Reproducibility Project: Cancer Biology core team would like to thank the original authors, in particular Shiva Malek, for generously sharing critical information as well as reagents to ensure the fidelity and quality of this replication attempt. We thank Courtney Soderberg at the Center for Open Science for assistance with statistical analyses and Catherine Sutter at Kinexus Bioinformatics and Stephen Williams at the Center for Open Science for review and helpful comment on the manuscript. We would also like to thank the following companies for generously donating reagents to the Reproducibility Project: Cancer Biology; American Type Culture Collection (ATCC), Applied Biological Materials, BioLegend, Charles River Laboratories, Corning Incorporated, DDC Medical, EMD Millipore, Harlan Laboratories, LI-COR Biosciences, Mirus Bio, Novus Biologicals, Sigma-Aldrich, and System Biosciences (SBI).

Copyright

© 2016, Bhargava et al.

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,276
    views
  • 192
    downloads
  • 5
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Ajay Bhargava
  2. Steven Pelech
  3. Ben Woodard
  4. John Kerwin
  5. Nimet Maherali
  6. Reproducibility Project: Cancer Biology
(2016)
Registered report: RAF inhibitors prime wild-type RAF to activate the MAPK pathway and enhance growth
eLife 5:e09976.
https://doi.org/10.7554/eLife.09976

Share this article

https://doi.org/10.7554/eLife.09976

Categories and tags

Research organism

Further reading

  1. RAF inhibitors prime wild-type RAF to activate the MAPK pathway and enhance growth

    G Hatzivassiliou, K Song ... S Malek
    Nature
    1. Cancer Biology

    Reproducibility Project: Cancer Biology

    Edited by Roger J Davis et al.
    Collection Updated

    Investigating reproducibility in preclinical cancer research.

    1. Cancer Biology
    2. Computational and Systems Biology

    Luminal epithelial cells integrate variable responses to aging into stereotypical changes that underlie breast cancer susceptibility

    Rosalyn W Sayaman, Masaru Miyano ... Mark LaBarge
    Research Article

    Effects from aging in single cells are heterogenous, whereas at the organ- and tissue-levels aging phenotypes tend to appear as stereotypical changes. The mammary epithelium is a bilayer of two major phenotypically and functionally distinct cell lineages: luminal epithelial and myoepithelial cells. Mammary luminal epithelia exhibit substantial stereotypical changes with age that merit attention because these cells are the putative cells-of-origin for breast cancers. We hypothesize that effects from aging that impinge upon maintenance of lineage fidelity increase susceptibility to cancer initiation. We generated and analyzed transcriptomes from primary luminal epithelial and myoepithelial cells from younger <30 (y)ears old and older >55y women. In addition to age-dependent directional changes in gene expression, we observed increased transcriptional variance with age that contributed to genome-wide loss of lineage fidelity. Age-dependent variant responses were common to both lineages, whereas directional changes were almost exclusively detected in luminal epithelia and involved altered regulation of chromatin and genome organizers such as SATB1. Epithelial expression of gap junction protein GJB6 increased with age, and modulation of GJB6 expression in heterochronous co-cultures revealed that it provided a communication conduit from myoepithelial cells that drove directional change in luminal cells. Age-dependent luminal transcriptomes comprised a prominent signal that could be detected in bulk tissue during aging and transition into cancers. A machine learning classifier based on luminal-specific aging distinguished normal from cancer tissue and was highly predictive of breast cancer subtype. We speculate that luminal epithelia are the ultimate site of integration of the variant responses to aging in their surrounding tissue, and that their emergent phenotype both endows cells with the ability to become cancer-cells-of-origin and represents a biosensor that presages cancer susceptibility.