Registered report: Kinase-dead BRAF and oncogenic RAS cooperate to drive tumor progression through CRAF
Abstract
The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered Report describes the proposed replication plan of key experiments from "Kinase-dead BRAF and oncogenic RAS cooperate to drive tumor progression through CRAF" by Heidorn and colleagues, published in Cell in 2010 (Heidorn et al., 2010). The experiments to be replicated are those reported in Figures 1A, 1B, 3A, 3B, and 4D. Heidorn and colleagues report that paradoxical activation of the RAF-RAS-MEK-ERK pathway by BRAF inhibitors when applied to BRAFWT cells is a result of BRAF/CRAF heterodimer formation upon inactivation of BRAF kinase activity, and occurs only in the context of active RAS. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.
https://doi.org/10.7554/eLife.11999.001Introduction
The RAS-RAF-MEK-ERK signaling pathway is routinely disregulated in many forms of cancer. Activating mutations in BRAF are found in almost half of all melanomas, and of these mutations, almost 90% involve a valine to glutamic acid transition at position 600 (BRAFV600E) (Solit and Rosen 2014). The therapeutic effect of drugs that target this form of BRAF have proved less efficacious than expected, due to an unexpected effect in cells that are BRAFWT; in these cells, drugs that target BRAF paradoxically activate rather than repress downstream signaling (Hall-Jackson et al., 1999a; Hall-Jackson et al., 1999b). In their 2010 paper, Heidorn and colleagues examined the mechanism of action behind this paradoxical activation of MEK/ERK signaling. Heidorn and colleagues first observed that paradoxical activation occurred only in the context of BRAFWT and activated RAS, an observation confirmed by two other groups (Hatzivassiliou et al., 2010; Poulikakos et al., 2010). Dissecting the mechanism, they reported that the formation of BRAF/CRAF heterodimers was necessary for pathway activation, and formation of those heterodimers required active RAS signaling.
In Figure 1A, Heidorn and colleagues examined pathway activation in response to a range of drugs. The inhibitors, sorafenib, which targets and represses both BRAF and CRAF, PLX4720, which is highly selective for and inhibits the activity of BRAFV600E. 885-A, which specifically targets and inhibits BRAF, and the MEK inhibitor PC184352 were examined. As expected, all four drugs blocked MEK/ERK activation in BRAFV600E A375 cells. However, in cells with active RAS, such as D04 cells (BRAFWT/NRASQ61L), MEK/ERK signaling was not repressed by PLX4720 or 885-A. This paradoxical activation in BRAFWT cells was also observed by several other groups (Carnahan et al., 2010; Joseph et al., 2010; Lee et al., 2010; Kaplan et al., 2011). This experiment will be replicated in Protocol 1.
Previous work had shown that activated RAS in melanoma signals through CRAF, while normal signaling in healthy melanocytes is accomplished through BRAF (Dumaz et al., 2006). To determine if CRAF was required for paradoxical pathway activation, Heidorn and colleagues treated D04 cells with siRNAs targeting NRAS and CRAF. Knockdown of either NRAS or CRAF abrogated activation of MEK/ERK by 885-A, as seen in Figure 1B. This experiment will be replicated in Protocol 2. The necessity of CRAF also explains the lack of activation upon treatment with sorafenib observed in Figure 1A; since sorafenib inhibits both BRAF and CRAF, it does not result in pathway activation.
Since activated RAS is known to drive heterodimerization of BRAF and CRAF (Weber et al., 2001), Heidorn and colleagues also tested if drug binding drove heterodimerization of BRAF and CRAF, and if this heterodimerization was dependent on active RAS signaling. In Figure 3A, they transfected D04 cells with a mutant version of CRAF that was unable to bind to RAS (CRAFR89L). Immunoprecipitation experiments showed that while CRAFWT was able to bind to BRAF in the presence of activated RAS, CRAFR89L was unable to bind to BRAF. This key experiment will be replicated in Protocol 3.
The authors showed that BRAF binds to CRAF but only in the presence of WT RAS, not oncogenic RAS. In Figure 3B, myc-tagged BRAF or myc-tagged mutant BRAF (R188LBRAF) were transfected into D04 cells and treated with either DMSO(-) or 885-A(+). The authors show that mutant of BRAF (R188LBRAF) does not bind to CRAF even in the presence of 885-A, which induces RAS activity.
After confirming that drug binding to BRAF drove BRAF binding to CRAF, Heidorn and colleagues tested a kinase dead version of BRAF (BRAFD594A) (Figure 4D). Interestingly, this version of BRAF still bound to CRAF, indicating that it is not drug binding per se, but inhibition of BRAF activity, that drives BRAF binding to CRAF and paradoxical activation of MEK/ERK. This key experiment will be replicated in Protocol 4.
Packer and colleagues extended the work of Heidorn and colleagues to examine if other more broadly targeted tyrosine kinase inhibitors were also able to paradoxically activate the RAS-RAF pathway. They observed paradoxical pathway activation in D04 cells after treatment with imatinib, nilotinib, dasatinib, and the BRAF inhibitor SB590885. As in Heidorn et al., paradoxical activation only occurred in cells with BRAFWT and required active RAS, as knockdown of NRAS abrogated the effect. Interestingly, while Heidorn and colleagues reported that knockdown of CRAF alone was able to block paradoxical activation, Packer and colleagues reported that only combined knockdown of BRAF and CRAF was able to block paradoxical activation (Packer et al., 2011). Work by Rebocho and colleagues and by Kaplan and colleagues aligned with Heidorn’s findings that silencing of CRAF alone was able to abrogate paradoxical activation (Aplin et al., 2011; Rebocho and Marais 2012). Packer and colleagues also reported that BRAF/CRAF heterodimerization was dependent upon RAS by demonstrating that CRAFR89L was unable to form heterodimers with BRAF (Packer et al., 2011).
Activation of NRAS signaling appears to be a key step in acquired drug resistance, supporting the hypothesis that paradoxical activation can only occur in the context of active RAS signaling. Su and colleagues derived a drug-resistant BRAFV600E melanoma cell line by growing A375 cells in the presence of vemurafenib (PLX4032, a BRAFV600E inhibitor). Interestingly, drug resistance was dependent on expression of CRAF, and the resistant lines that emerged had acquired an activating mutation in KRAS (Su et al., 2012). Nazarian and colleagues also observed the acquisition of activating mutations in NRAS when they derived PLX4032-resistant cell lines (Nazarian et al., 2010). Lidsky and colleagues also showed that increased levels of NRAS were key to vemurafenib resistance, although they did not observe any activating mutations in their resistant cell lines (Lidsky et al., 2014).
Materials and methods
Unless otherwise noted, all protocol information was derived from the original paper, references from the original paper, or information obtained directly from the authors. An asterisk (*) indicates data or information provided by the Reproducibility Project: Cancer Biology core team. A hashtag (#) indicates information provided by the replicating lab.
Protocol 1: Treatment of BRAF mutant cells with various RAF inhibitors and assessment of activation of ERK
This protocol describes how to treat NRAS mutant D04 cells and NRAS wild-type cells also carrying the BRAFV600E mutation with various BRAF inhibitors and assess ERK phosphorylation by Western blot, as reported in Figure 1A.
Sampling
Request a detailed protocolThe experiment will be performed independently at least three times for a final power of at least 80%. The original data is qualitative, thus to determine an appropriate number of replicates to initially perform, sample sizes based on a range of potential variance was determined.
See Power calculations for details.
Each experiment consists of eight cohorts:
Cohort 1: D04 cells treated with DMSO
Cohort 2: D04 cells treated with PD184352
Cohort 3: D04 cells treated with sorafenib
Cohort 4: D04 cells treated with SB590885
Cohort 5: A375 cells treated with DMSO
Cohort 6: A375 cells treated with PD184352
Cohort 7: A375 cells treated with sorafenib
Cohort 8: A375 cells treated with SB590885
Each cohort will be probed for ppERK and ERK2 by Western blot.
Materials and reagents
Request a detailed protocolReagent | Type | Manufacturer | Catalog # | Comments | |
---|---|---|---|---|---|
D04 cells | Cells | Provided by Chris Schmidt, Queensland Institute of Medical Research (QIMR) Berghofer, Australia | |||
A375 cells | Cells | ATCC | |||
RPMI | Cell culture media | Life Technologies | 21875-034 | ||
DMEM | Cell culture media | Life Technologies | 41966-029 | ||
FBS | Reagent | Life Technologies | 10270106 | ||
35-mm culture plates | Material | Corning | CLS430165 | Original not specified | |
Sorafenib | Drug | Selleckchem | S7397 | ||
PD184352 | Drug | Selleckchem | S1020 | ||
SB590885 | Drug | Selleckchem | S2220 | *Replaces Plexxion 885-A | |
DMSO | Reagent | Fisher Scientific | D128-500 | Original not specified | |
PBS | Reagent | Gibco | 10010-023 | Original not specified | |
Tris-HCl | Chemical | Specific brand information will be left up to the discretion of the replicating lab and recorded later | |||
NaCl | Chemical | ||||
Igepal | Chemical | ||||
Na3VO4 | Chemical | ||||
NaF | Chemical | ||||
Leupeptin | Chemical | ||||
Bradford Assay | Detection Assay | Bio-Rad Laboratories | 5000001 | Original not specified | |
NuPAGE Sample buffer | Buffer | Invitrogen | NP0007 | Original not specified | |
SDS-Page gel (4–12%) | Western blot reagent | Invitrogen | NP0322BOX | Original not specified | |
Nitrocellulose membrane (iBlot) | Western blot reagent | Invitrogen | IB301002 | Original not specified | |
Ponceau stain | Western blot reagent | Sigma-Aldrich | P7170-1L | Original not specified | |
Tris | Chemical | Sigma-Aldrich | T6066 | Original not specified | |
Tween-20 | Chemical | Sigma-Aldrich | P1379 | Original not specified | |
Mouse α-ppERK1/2 | Antibody | Cell Signaling Technology | 9106 | Replaces Sigma M8159 | |
Rabbit α-ERK1/2 | Antibody | Cell Signaling Technology | 9102 | Replaces Santa Cruz Bio sc-154 | |
HRP-conjugated secondary antibody | Western blot reagent | Bio-Rad | 170-5047 | Original not specified | |
ECL Detection Kit | Western blot reagent | Invitrogen | 32132 | Original not specified | |
-
*Suggested as suitable replacement by original authors by personal communication
Procedure
Request a detailed protocolAll cells will be sent for mycoplasma testing and STR profiling.
D04 cells are maintained in RPMI supplemented with 10% FBS.
A375 cells are maintained in DMEM supplemented with 10% FBS.
All cell lines are maintained at 37°C with 10% CO2.
Sorafenib, PD184352, and SB590885 are dissolved in DMSO.
Seed 1.0-2 x 105 cells per well of a six-well tissue culture plate (cells should be 80% confluent at the time of drug treatment).
Treat cells with drug or equivalent volume vehicle (DMSO, <0.2%) for 4.
10 µM Sorafenib
1 µM SB590885
1 µM PD184352
Lyse cells
Place cells on ice and aspirate media.
Wash three times with ice-cold PBS.
Scrape cells into 50–200 µl of Nonidet P40 extraction buffer.
NP40 extraction buffer: 50 mM Tris-HCl, pH 7.5, 150 mM NaCl, 0.55 (v/v) Igepal, 5 mM NaF, 0.2 mM Na3VO4, 5 µg/ml leupeptin
Incubate on ice for 5min.
Shear cells by passing through a pipette tip several times.
Centrifuge samples at 20,000 x g for 5min at 4°C.
Harvest the soluble fraction for further analysis.
#Quantify protein concentration using a Bradford assay.
Analyze cell lysates by Western blot for phospho-ERK and total ERK.
Load equal amounts of all samples (30–50 µg; approximately half of the lysate) mixed with 4x sample buffer and boiled at 90°C for 5–10min on a #4–12% SDS-Page gel.
#Run at #140v for 55min.
#Transfer to a nitrocellulose membrane at 250 mA for 1 hr
*Confirm protein transfer by Ponceau staining and image membrane.
#Block membrane in 5% non-fat dried milk in TBST (20 mM Tris pH 7.5, 136 mM NaCl, 0.1% Tween-20).
Incubate membrane at 4°C overnight with antibodies against:
Mouse α-ppERK1/2: 1:1000 dilution
#Rabbit α-ERK1/2: 1:1000 dilution
#Incubate with HRP-conjugated secondary antibody diluted 1:10,000 in 1X TBS for 1 hr at room temperature.
Rinse the membrane twice with TBST.
Wash the membrane twice with TBST for 5 min each.
#Visualize bands with ECL detection kit according to manufacturer’s protocol.
Quantify band intensity.
Normalize pERK to ERK 1/2 for each condition.
Repeat independently two additional times.
Deliverables
Request a detailed protocolData to be collected:
Protein quantification results from Bradford assay.
Images of Ponceau stained membranes.
Raw images of whole gels with ladders included (as reported in Figure 1A).
Densitometric quantification of all bands.
Confirmatory analysis plan
Request a detailed protocolStatistical Analysis of the Replication Data:
Note: At the time of analysis, we will perform the Shapiro-Wilk test and generate a quantile-quantile plot to assess the normality of the data. We will also perform Levene’s test to assess homoscedasticity. If the data appears skewed, we will perform a transformation in order to proceed with the proposed statistical analysis. If this is not possible, we will perform the equivalent non-parametric test listed.
Two-way ANOVA on normalized pERK values (to ERK1/2) in A375 or D04 cells treated with PD184352, sorafenib, SB590885, or vehicle (DMSO) with the following planned contrasts with the Bonferroni correction:
Normalized pERK band intensity in A375 cells:
Vehicle treatment vs. all three drug treatments (PD184352, sorafenib, and SB590885)
Normalized pERK band intensity in D04 cells:
Vehicle treatment vs. PD184352 and SB590885 treatments
Vehicle treatment vs. sorafenib treatment
Meta-analysis of original and replication attempt effect sizes:
The replication data (mean and 95% confidence interval) will be plotted with the original quantified data value displayed as a single point on the same plot for comparison.
Known differences from the original study
Request a detailed protocolThe replication attempt will use D04 and A375 cells and will exclude MM415, MM485, and WM852 cells. It will also exclude the drug PLX4720 and will replace 885-A with its analogue SB590885. The original authors suggest they have found similar results with this analogue (personal communication with Dr. Dhomen). All known differences, if any, are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. The comments section also lists if the source of original item was not specified. All differences have the same capabilities as the original and are not expected to alter the experimental design.
Provisions for quality control
Request a detailed protocolAll data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either in the published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/b1aw6/). Cells will be sent for mycoplasma testing confirming lack of contamination and STR profiling confirming cell line authenticity. The transfer efficiency during the Western blot procedure will be monitored by Ponceau staining.
Protocol 2: Treatment of NRAS or CRAF silenced D04 cells with SB590885 and assessment of MEK and ERK phosphorylation
This protocol describes treatment of D04 cells transfected with siRNAs targeting NRAS or CRAF with SB590885 and assessment of those cells for activation of MEK and ERK by Western blot, as reported in Figure 1B.
Sampling
Request a detailed protocolThe experiment will be performed independently at least four times for a final power of at least 80%. The original data is qualitative, thus to determine an appropriate number of replicates to initially perform, sample sizes based on a range of potential variance was determined.
See Power calculations for details.
Each experiment consists of six cohorts:
Cohort 1: control silenced D04 cells
Cohort 2: control silenced D04 cells treated with SB590885
Cohort 3: NRAS silenced D04 cells
Cohort 4: NRAS silenced D04 cells treated with SB590885
Cohort 5: CRAF silenced D04 cells
Cohort 6: CRAF silenced D04 cells treated with SB590885
Each cohort will be probed for NRAS, CRAF, ppMEK, α ppERK, and tubulin by Western blot
Materials and reagents
Request a detailed protocolReagent | Type | Manufacturer | Cat. No. | Comments | |
---|---|---|---|---|---|
D04 cells | Cells | Provided by Chris Schmidt, Queensland Institute of Medical Research (QIMR) Berghofer, Australia | |||
RPMI | Cell culture media | Life Technologies | 21875-034 | ||
FBS | Reagent | Life Technologies | 10270106 | ||
SB590885 | Drug | Selleckchem | S2220 | *Replaces Plexxion 885-A | |
DMSO | Reagent | Fisher Scientific | D128-500 | Original not specified | |
35 mm tissue culture dishes | Materials | Corning | CLS430165 | Original not specified | |
INTERFERin | Reagent | Polyplus Transfection | 409-01 | ||
CRAF siRNA | siRNA | Synthesis left to the discretion of the replicating lab and will be recorded later | 5’-AAGCACGCTTAGATTG GAATA-3’ | ||
NRAS siRNA | siRNA | Synthesis left to the discretion of the replicating lab and will be recorded later | 5’-CATGGCACTGTACTCT TCTCG-3’ | ||
Scrambled siRNA | siRNA | Synthesis left to the discretion of the replicating lab and will be recorded later | 5’-AAACCGTC GATTTCACCCGGG-3’ | ||
PBS | Reagent | Gibco | 10010-023 | Original not specified | |
Tris-HCl | Chemical | Specific brand information will be left up to the discretion of the replicating lab and recorded later | |||
NaCl | Chemical | ||||
Igepal | Chemical | ||||
Na3VO4 | Chemical | ||||
NaF | Chemical | ||||
Leupeptin | Chemical | ||||
Bradford Assay | Detection Assay | Bio-Rad Laboratories | 5000001 | Original not specified | |
NuPAGE Sample buffer | Buffer | Invitrogen | NP0007 | Original not specified | |
SDS-Page gel (4–12%) | Western blot reagent | Invitrogen | NP0322BOX | Original not specified | |
Nitrocellulose membrane (iBlot) | Western blot reagent | Invitrogen | IB301002 | Original not specified | |
Ponceau stain | Western blot reagent | Sigma-Aldrich | P7170-1L | Original not specified | |
Tris | Chemical | Sigma-Aldrich | T6066 | Original not specified | |
Tween-20 | Chemical | Sigma-Aldrich | P1379 | Original not specified | |
Mouse α NRAS (C-20) | Antibody | Santa Cruz Biotechnology | sc-159 | ||
Mouse α CRAF | Antibody | BD Transduction Laboratories | 610152 | ||
Rabbit α ppMEK1/2 | Antibody | Cell Signaling Technology | 9121 | ||
Mouse α ppERK1/2 | Antibody | Sigma | M8159 | ||
Mouse α tubulin | Antibody | Sigma | T5168 | ||
HPR-conjugated secondary antibody | Western blot reagent | Bio-Rad | 170-5047 | Original not specified | |
ECL Detection Kit | Western blot reagent | Invitrogen | 32132 | Original not specified | |
Procedure
Request a detailed protocolNotes
Request a detailed protocolAll cells will be sent for mycoplasma testing and STR profiling.
D04 cells are maintained in RPMI supplemented with 10% FBS.
All cell lines are maintained at 37°C with 10% CO2.
SB590885 is dissolved in DMSO.
Seed 3 x 105 D04 cells per 35-mm plate in 2 ml media.
Let incubate overnight.
The next morning, prepare siRNA transfection mixture with INTERFERin according to the manufacturer’s protocol, summarized here:
Mix 0.6 µl of 20 µM siRNA with 6 µl INTERERin and 200 µl of serum-free media in RNAse-free tubes.
CRAF siRNA: 5’-AAGCACGCTTAGATTGGAATA-3’
NRAS siRNA: 5’-CATGGCACTGTACTCTTCTCG-3’
Scrambled siRNA control: 5’-AAACCGTC GATTTCACCCGGG-3’
Vortex mixture for 10 s.
Incubate for 5 to 10 min.
Add mixture dropwise to seeded cells in complete media.
Incubate overnight.
The next day after transfection, replace with serum free media.
48 hr after siRNA transfection, treat cells with 1 µM SB590885 or equivalent volume vehicle (DMSO, <0.2%) for 4 hr.
Lyse cells and harvest extracts as described in Protocol 1 Step 3.
Perform Western blots on cell extracts as described in Protocol 1 Step 4.
Blot membranes with the following antibodies:
Rabbit α ppMEK: 1:1000 dilution
Rabbit α ppERK: 1:1000 dilution
Mouse α tubulin: 1:5000 dilution
Western blot antibody multiplexing POI Loading control Combination Description Working conc. Description Working conc. 1 Rabit anti-ppMEK (45 kDa) 1:1000 Mouse anti-tubulin (50 kDa) 1:5000 2 Rabbit anti-ppERK (42, 44 kDa) 1:1000 Mouse anti-tubulin (50 kDa) 1:5000 Strip gels with glycine buffer (pH 3.0) containing 1%SDS
Confirm complete stripping and image membranes, block with milk/TBST, and re-probe each gel with one of the following antibodies:
Mouse α NRAS: 1:250 dilution
Mouse α CRAF: 1:1000 dilution
Quantify band intensity.
Normalize NRAS, CRAF, ppMEK, and ppERK to tubulin for each condition.
Repeat independently three additional times.
Deliverables
Request a detailed protocolData to be collected:
Protein quantification results from Bradford assay.
Images of Ponceau stained membranes.
Images of whole gels with ladder (as reported in Figure 1B).
Densitometric quantification of all bands.
Confirmatory analysis plan
Request a detailed protocolStatistical Analysis of the Replication Data:
Note: At the time of analysis, we will calculate Pearson’s r to check for correlation between the dependent variables, a scatter plot to assess linearity, and a Box’s M test to check for equality of covariance matrices. We will also perform the Shapiro-Wilk test and generate a quantile-quantile plot to assess the normality of the data. We will perform Levene’s test to assess homoscedasticity. If the data appears skewed, we will perform a transformation in order to proceed with the proposed statistical analysis. If this is not possible, we will perform the equivalent non-parametric test.
One-way MANOVA comparing the differences between SB590885 treatment and vehicle treatment of normalized band intensities for pMEK and pERK levels in D04 cells transfected with siRNA for NRAS, CRAF, or control with the following Bonferroni-corrected comparisons:
Difference in normalized ppMEK levels between SB590885 and vehicle treatment:
Control siRNA compared to NRAS siRNA.
Control siRNA compared to CRAF siRNA.
Difference in normalized ppERK levels between SB590885 and vehicle treatment:
Control siRNA compared to NRAS siRNA.
Control siRNA compared to CRAF siRNA
Meta-analysis of original and replication attempt effect sizes:
The replication data (mean and 95% confidence interval) will be plotted with the original quantified data value displayed as a single point on the same plot for comparison.
Known differences from the original study
Request a detailed protocolThe replication will replace 885-A with its analogue SB590885. The original authors suggest they have found similar results with this analogue (personal communication with Dr. Dhomen). All known differences, if any, are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. The comments section also lists if the source of original item was not specified. All differences have the same capabilities as the original and are not expected to alter the experimental design.
Provisions for quality control
Request a detailed protocolCells will be sent for mycoplasma testing confirming lack of contamination and STR profiling confirming cell line authenticity. The transfer efficiency during the Western blot procedure will be monitored by Ponceau staining. The membrane will be imaged after stripping to confirm and measure background. All data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either in the published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/b1aw6/).
Protocol 3: Immunoprecipitation of CRAF from SB590885 treated D04 cells expressing myc-tagged CRAFWT or CRAFR89L
This protocol describes how to immunoprecipitate myc-tagged CRAFWT or CRAFR89L, a mutant form that cannot bind RAS, from D04 cells and probe the pulldown for BRAF, as reported in Figure 3A.
Sampling
Request a detailed protocolThe experiment will be performed independently at least three times for a final power of at least 80%. The original data is qualitative, thus to determine an appropriate number of replicates to initially perform, sample sizes based on a range of potential variance was determined.
See Power calculations for details.
Each experiment consists of six cohorts:
Cohort 1: D04 cells transfected with myc-tagged CRAFWT treated with SB590885
Cohort 2: D04 cells transfected with myc-tagged CRAFWT treated with DMSO
Cohort 3: D04 cells transfected with myc-tagged CRAFR89L treated with SB590885
Cohort 4: D04 cells transfected with myc-tagged CRAFR89L treated with DMSO
Cohort 5: D04 cells transfected with empty vector treated with SB590885
Cohort 6: D04 cells transfected with empty vector treated with DMSO
Each cohort will be immunoprecipitated for myc-tagged CRAF and immunoprecipitate and lysates probed for BRAF and myc.
Materials and reagents
Request a detailed protocolReagent | Type | Manufacturer | Catalog # | Comments |
---|---|---|---|---|
D04 cells | Cells | Provided by Chris Schmidt, Queensland Institute of Medical Research (QIMR) Berghofer, Australia | ||
SB590885 | Drug | Selleckchem | S2220 | *Replaces Plexxion 885-A |
DMSO | Reagent | Fisher Scientific | D128-500 | Original not specified |
RPMI | Media | Life Technologies | 21875-034 | |
FBS | Reagent | Life Technologies | 10270106 | |
Effectene Transfection Reagent | Reagent | Qiagen | 301425 | Replaces Cell Line Nucleofector Kit V (10 RCT) Lonza VACA1003 |
35 mm culture dishes | Materials | Corning | CLS430165 | Original not specified |
Myc-CRAFWT vector | Plasmid | Shared by original authors | ||
Myc-CRAFR89L vector | Plasmid | Shared by original authors | ||
Empty vector | Plasmid | Shared by original authors | ||
PBS | Reagent | Gibco | 10010-023 | Original not specified |
Tris-HCl | Chemical | Specific brand information will be left up to the discretion of the replicating lab and recorded later | ||
NaCl | Chemical | |||
Igepal | Chemical | |||
Na3VO4 | Chemical | |||
NaF | Chemical | |||
Leupeptin | Chemical | |||
Rabbit α myc | Antibody | Abcam | ab9106 | |
Mouse α BRAF (F-7) | Antibody | Santa Cruz Biotechnology | sc-5284 | |
Mouse α myc (9B11) (HRP conjugate) | Antibody | Cell Signaling Technology | 2040 | |
Protein G sepharose beads | Materials | Sigma | P3296 | |
NuPAGE Sample buffer | Buffer | Invitrogen | NP0007 | Original not specified |
SDS-Page gel (4–12%) | Western blot reagent | Invitrogen | NP0322BOX | Original not specified |
Nitrocellulose membrane (iBlot) | Western blot reagent | Invitrogen | IB301002 | Original not specified |
Ponceau stain | Western blot reagent | Sigma-Aldrich | P7170-1L | Original not specified |
Tris | Chemical | Sigma-Aldrich | T6066 | Original not specified |
Tween-20 | Chemical | Sigma-Aldrich | P1379 | Original not specified |
HPR-conjugated secondary antibody | Western blot reagent | Bio-Rad | 170-5047 | Original not specified |
ECL Detection Kit | Western blot reagent | Invitrogen | 32132 | Original not specified |
Procedure
Request a detailed protocolNotes
Request a detailed protocolAll cells will be sent for mycoplasma testing and STR profiling.
D04 cells are maintained in RPMI supplemented with 10% FBS.
All cell lines are maintained at 37°C with 10% CO2.
SB590885 is dissolved in DMSO.
Transfect D04 cells with vectors containing myc-tagged CRAFwt or CRAFR89L.
#Plate 1x106 cells per well of a six-well plate with 1.6 ml media 1 day before transfection. The cells should be 40–80% confluent on the day of transfection.
#On the day of transfection, dilute 0.4 µg of DNA for each vector in TE buffer, pH 7 with the DNA-condensation buffer, Buffer EC, to a total volume of 100 μl. Add 3.2 μl Enhancer and mix by vortexing.
Empty vector
Myc-CRAFWT vector
Myc-CRAFR89L vector
#Incubate at room temperature for 5 min, centrifuge quickly.
#Add 10 µl Effectene Transfection Reagent to the DNA-Enhancer mixture and mix by pipetting.
#Incubate at room temperature for 10 min.
#Gently aspirate the medium from the plated cells and wash once with 2 ml PBS. Add 1.6 ml fresh medium to the cells.
#Add 600 µl medium to the tube containing transfection complexes and mix by pipetting. Immediately add transfection complexes drop-wise onto plated cells. Gently swirl to mix.
#Incubate for 18 hr after transfection. Replace with fresh medium.
48 hr after transfection, treat cells with 1 µM SB590885 or equivalent volume vehicle (DMSO, <0.2%) for 4 hr.
Lyse cells and prepare cell lysate as described in Protocol 1 Step 3.
Save 5–15 µg protein from each lysate to confirm transfection by Western blot below.
Immunoprecipitate myc-tagged CRAF proteinsNote: 2-3 35 mm wells of protein lysed in 300 µl NP40 buffer are needed for IP reaction.
Immunoprecipitate the Myc-tagged proteins by adding 2 µg rabbit anti-myc antibody and incubate overnight at 4°C.
Capture the antibody-protein complex by adding 20 µl of a 1:1 Protein G sepharose 4B beads mixture in NP40 extraction buffer.
NP40 extraction buffer: 50 mM Tris-HCl, pH 7.5, 150 mM NaCl, 0.55 (v/v) Igepal, 5 mM NaF, 0.2 mM Na3VO4, 5 µg/ml leupeptin.
Incubate on ice for 5 min.
Mix on a rotating wheel for 2 hr at 4°C.
Wash IPs three times with 300 µl NP40 extraction buffer.
Elute protein complex from beads with NuPage sample buffer
Run IPs and lysate on an SDS-PAGE gel as described in Protocol 1 Step 4.
Probe with the following antibodies:
Mouse α BRAF: 1:2000 dilution
Mouse α myc: 1:1000 dilution
Quantify band intensity.
Normalize IP α BRAF to IP α myc-CRAF for each condition from IP band intensities.
Repeat independently two additional times.
Deliverables
Request a detailed protocolData to be collected:
Protein quantification results from Bradford assay.
Images of Ponceau stained membranes.
Transfection QC images of whole gels with ladder.
Images of whole gels with ladder (as reported in Figure 3A).
Densitometric quantification of all bands.
Confirmatory analysis plan
Request a detailed protocolStatistical Analysis of the Replication Data:
Note: At the time of analysis, we will perform the Shapiro-Wilk test and generate a quantile-quantile plot to assess the normality of the data. We will also perform Levene’s test to assess homoscedasticity. If the data appears skewed, we will perform a transformation in order to proceed with the proposed statistical analysis. If this is not possible, we will perform the equivalent non-parametric test listed.
Two-way ANOVA comparing normalized IP BRAF (to IP α myc) band intensity in D04 cells transfected with Myc-CRAFWT vector or Myc-CRAFR89L vector with or without SB590885 drug treatment, and the following Bonferroni-corrected comparisons:
Normalized IP BRAF band intensity in cells with Myc-CRAFWT vector with SB590885 treatment vs. vehicle treatment.
Normalized IP BRAF band intensity in cells with Myc- CRAFR89L vector with SB590885 treatment vs. vehicle treatment.
Meta-analysis of original and replication attempt effect sizes:
The replication data (mean and 95% confidence interval) will be plotted with the original quantified data value displayed as a single point on the same plot for comparison.
Known differences from the original study
Request a detailed protocolThe transfection method using Nucleofectin Solution V and electroporation will be replaced with a lipid-based method using Effectene Transfection Reagent, and protocol will be changed according to Manufacturer’s instructions. This difference in transfection protocol might lead to differences in expression that could lead to differences in results. The replication will replace 885-A with its analogue SB590885. The original authors suggest they have found similar results with this analogue (personal communication with Dr. Dhomen). All known differences, if any, are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. The comments section also lists if the source of original item was not specified. All differences have the same capabilities as the original and are not expected to alter the experimental design.
Provisions for quality control
Request a detailed protocolCells will be sent for mycoplasma testing confirming lack of contamination and STR profiling confirming cell line authenticity. Transfection will be confirmed with Western blot. The transfer efficiency during the Western blot procedure will be monitored by Ponceau staining. All data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either as a published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/b1aw6/).
Protocol 4: Immunoprecipitation of BRAF from SB590885 treated D04 cells expressing myc-tagged BRAFWT or BRAFR188L
This protocol describes how to immunoprecipitate myc-tagged BRAFWT or BRAFR188L, a mutant form that cannot bind RAS, from D04 cells and probe the pulldown for CRAF, as reported in Figure 3B.
Sampling
Request a detailed protocolThe experiment will be performed independently at least three times for a final power of at least 80%. The original data is qualitative, thus to determine an appropriate number of replicates to initially perform, sample sizes based on a range of potential variance was determined.
See Power calculations for details.
Each experiment consists of six cohorts:
Cohort 1: D04 cells transfected with myc-tagged BRAFWT treated with SB590885
Cohort 2: D04 cells transfected with myc-tagged BRAFWT treated with DMSO
Cohort 3: D04 cells transfected with myc-tagged BRAFR188L treated with SB590885
Cohort 4: D04 cells transfected with myc-tagged BRAFR188L treated with DMSO
Cohort 5: D04 cells transfected with empty vector treated with SB590885
Cohort 6: D04 cells transfected with empty vector treated with DMSO
Each cohort will be immunoprecipitated for myc-tagged BRAF and immunoprecipitate and lysates probed for CRAF and myc.
Materials and reagents
Request a detailed protocolReagent | Type | Manufacturer | Catalog # | Comments |
---|---|---|---|---|
D04 cells | Cells | Provided by Chris Schmidt, Queensland Institute of Medical Research (QIMR) Berghofer, Australia | ||
SB590885 | Drug | Selleckchem | S2220 | *Replaces Plexxion 885-A |
DMSO | Reagent | Fisher Scientific | D128-500 | Original not specified |
RPMI | Media | Life Technologies | 21875-034 | |
FBS | Reagent | Life Technologies | 10270106 | |
Effectene Transfection Reagent | Reagent | Qiagen | 301425 | Replaces Cell Line Nucleofector Kit V (10 RCT) Lonza VACA1003 |
35-mm culture dishes | Materials | Corning | CLS430165 | Original not specified |
Myc-BRAFWT vector | Plasmid | Shared by original authors | ||
Myc-BRAFR188L vector | Plasmid | Shared by original authors | ||
Empty vector | Plasmid | Shared by original authors | ||
PBS | Reagent | Gibco | 10010-023 | Original not specified |
Tris-HCl | Chemical | Specific brand information will be left up to the discretion of the replicating lab and recorded later | ||
NaCl | Chemical | |||
Igepal | Chemical | |||
Na3VO4 | Chemical | |||
NaF | Chemical | |||
Leupeptin | Chemical | |||
Rabbit anti-myc | Antibody | Abcam | ab9106 | |
mouse anti-CRAF | Antibody | BD Transduction Laboratories | 610152 | |
Mouse α myc (9B11) (HRP conjugate) | Antibody | Cell Signaling Technology | 2040 | |
Protein G sepharose beads | Materials | Sigma | P3296 | |
NuPAGE Sample buffer | Buffer | Invitrogen | NP0007 | Original not specified |
SDS-Page gel (4–12%) | Western blot reagent | Invitrogen | NP0322BOX | Original not specified |
Nitrocellulose membrane (iBlot) | Western blot reagent | Invitrogen | IB301002 | Original not specified |
Ponceau stain | Western blot reagent | Sigma-Aldrich | P7170-1L | Original not specified |
Tris | Chemical | Sigma-Aldrich | T6066 | Original not specified |
Tween-20 | Chemical | Sigma-Aldrich | P1379 | Original not specified |
HPR-conjugated secondary antibody | Western blot reagent | Bio-Rad | 170-5047 | Original not specified |
ECL Detection Kit | Western blot reagent | Invitrogen | 32132 | Original not specified |
Procedure
Request a detailed protocolNotes:
All cells will be sent for mycoplasma testing and STR profiling.
D04 cells are maintained in RPMI supplemented with 10% FBS.
All cell lines are maintained at 37°C with 10% CO2.
SB590885 is dissolved in DMSO.
Transfect D04 cells with vectors containing myc-tagged BRAFwt or BRAFR188L as described in Protocol 3 Step 1.
48 hr after transfection, treat cells with 1 µM SB590885 or equivalent volume vehicle (DMSO, <0.2%) for 4 hr.
Lyse cells and prepare cell lysate as described in Protocol 1 Step 3.
Save 5-15 μg protein from each lysate to confirm transfection by Western blot below.
Immunoprecipitate myc-tagged CRAF proteinsNote: 2-3 35 mm wells of protein lysed in 300 µl NP40 buffer are needed for IP reaction.
Immunoprecipitate the Myc-tagged proteins by adding 2 µg rabbit anti-myc antibody and incubate overnight at 4°C.
Capture the antibody-protein complex by adding 20 µl of a 1:1 Protein G sepharose 4B beads mixture in NP40 extraction buffer.
NP40 extraction buffer: 50 mM Tris-HCl, pH 7.5, 150 mM NaCl, 0.55 (v/v) Igepal, 5 mM NaF, 0.2 mM Na3VO4, 5 µg/ml leupeptin.
Incubate on ice for 5 min.
Mix on a rotating wheel for 2 hr at 4°C.
Wash IPs three times with 300 µl NP40 extraction buffer.
Elute protein complex from beads with NuPage sample buffer
Run IPs and lysate on an SDS-PAGE gel as described in Protocol 1 Step 4.
Probe with the following antibodies:
Mouse α CRAF: 1:1000 dilution
Mouse α myc: 1:1000 dilution
Quantify band intensity.
Normalize IP α CRAF to IP α myc-BRAF for each condition from IP band intensities.
Repeat independently two additional times.
Deliverables
Request a detailed protocolData to be collected:
Protein quantification results from Bradford assay.
Images of Ponceau stained membranes.
Transfection QC images of whole gels with ladder.
Images of whole gels with ladder (as reported in Figure 3A).
Densitometric quantification of all bands.
Confirmatory analysis plan
Request a detailed protocolStatistical Analysis of the Replication Data:
Note: At the time of analysis, we will perform the Shapiro-Wilk test and generate a quantile-quantile plot to assess the normality of the data. We will also perform Levene’s test to assess homoscedasticity. If the data appears skewed, we will perform a transformation in order to proceed with the proposed statistical analysis. If this is not possible, we will perform the equivalent non-parametric test listed.
Two-way ANOVA comparing normalized IP CRAF (to IP α myc) band intensity in D04 cells transfected with Myc-BRAFWT vector or Myc-BRAFR188L vector with or without SB590885 drug treatment, and the following Bonferroni-corrected comparisons:
Normalized IP CRAF band intensity in cells with Myc-BRAFWT vector with SB590885 treatment vs. vehicle treatment.
Normalized IP CRAF band intensity in cells with Myc- BRAFR188L vector with SB590885 treatment vs. vehicle treatment.
Meta-analysis of original and replication attempt effect sizes:
The replication data (mean and 95% confidence interval) will be plotted with the original quantified data value displayed as a single point on the same plot for comparison.
Known differences from the original study
Request a detailed protocolThe transfection method using Nucleofectin Solution V and electroporation will be replaced with a lipid-based method using Effectene Transfection Reagent, and protocol will be changed according to Manufacturer’s instructions. The replication will replace 885-A with its analogue SB590885. The original authors suggest they have found similar results with this analogue (personal communication with Dr. Dhomen). All known differences, if any, are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. The comments section also lists if the source of original item was not specified. All differences have the same capabilities as the original and are not expected to alter the experimental design.
Provisions for quality control
Request a detailed protocolCells will be sent for mycoplasma testing confirming lack of contamination and STR profiling confirming cell line authenticity. Transfection will be confirmed with Western blot. The transfer efficiency during the Western blot procedure will be monitored by Ponceau staining. All data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either as a published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/b1aw6/).
Protocol 5: Expression of BRAF kinase dead mutant in D04 cells and its effect on CRAF binding
This protocol describes how to transiently express myc-tagged BRAFWT or BRAFD59A in D04 cells and assess CRAF binding by immunoprecipitation and blotting, as reported in Figure 4D.
Sampling
Request a detailed protocolThe experiment will be performed independently at least three times for a minimum power of 80%. The original data is qualitative, thus to determine an appropriate number of replicates to initially perform, sample sizes based on a range of potential variance was determined.
See Power Calculations for details.
Each experiment consists of three cohorts:
Cohort 1: D04 cells transfected with myc-tagged BRAFWT
Cohort 2: D04 cells transfected with myc-tagged BRAFD594A
Cohort 3: D04 cells transfected with empty vector
Untreated cells are immunoprecipitated with α myc and levels of myc-BRAF and CRAF are assessed by immunoblotting.
Materials and reagents
Request a detailed protocolReagent | Type | Manufacturer | Catalog # | Comments |
---|---|---|---|---|
D04 cells | Cells | Provided by Chris Schmidt, Queensland Institute of Medical Research (QIMR) Berghofer, Australia | ||
RPMI | Media | Life Technologies | 21875-034 | |
FBS | Reagent | Life Technologies | 10270106 | |
Effectene Transfection Reagent | Reagent | Qiagen | 301425 | Replaces Cell Line Nucleofector Kit V (10 RCT) Lonza VACA1003 |
Myc-BRAFWT vector | Plasmid | Shared by original author | ||
Myc-BRAFD594A vector | Plasmid | Shared by original author | ||
Empty vector | Plasmid | Shared by original author | ||
35 mm culture dishes | Materials | |||
PBS | Reagent | Gibco | 10010-023 | Original not specified |
Tris-HCl | Chemical | Specific brand information will be left up to the discretion of the replicating lab and recorded later | ||
NaCl | Chemical | |||
Igepal | Chemical | |||
Na3VO4 | Chemical | |||
NaF | Chemical | |||
Leupeptin | Chemical | |||
Rabbit α myc | Antibody | Abcam | ab9106 | |
Mouse α CRAF (for Western blotting) | Antibody | BD Transduction Laboratories | 610152 | |
Mouse α myc (9B11) (HRP conjugate) | Antibody | Cell Signaling Technology | 2040 | |
Protein G sepharose beads | Materials | Sigma | P3296 | |
NuPAGE Sample buffer | Buffer | Invitrogen | NP0007 | Original not specified |
SDS-Page gel (4–12%) | Western blot reagent | Invitrogen | NP0322BOX | Original not specified |
Nitrocellulose membrane (iBlot) | Western blot reagent | Invitrogen | IB301002 | Original not specified |
Ponceau stain | Western blot reagent | Sigma-Aldrich | P7170-1L | Original not specified |
Tris | Chemical | Sigma-Aldrich | T6066 | Original not specified |
Tween-20 | Chemical | Sigma-Aldrich | P1379 | Original not specified |
HPR-conjugated secondary antibody | Western blot reagent | Bio-Rad | 170-5047 | Original not specified |
ECL Detection Kit | Western blot reagent | Invitrogen | 32132 | Original not specified |
Procedure
Request a detailed protocolNotes:
All cells will be sent for mycoplasma testing and STR profiling.
D04 cells are maintained in RPMI supplemented with 10% FBS.
All cell lines are maintained at 37°C with 10% CO2.
Transiently transfect D04 cells with the following vectors as described in Protocol 3 step 1.
Myc-BRAFWT vector
Myc-BRAFD594A vector
Empty vector
Lyse cells and prepare cell lysates as described in Protocol 1 Step 3.
Save 5–15 μg protein from each lysate to confirm transfection by Western blot below.
Immunoprecipitate myc-tagged BRAF proteins as described in Protocol 3 Step 4.
Run IPs and lysate on SDS-PAGE gel as described in Protocol 1 Step 4.
Probe with the following antibodies:
Mouse α CRAF: 1:1000 dilution
Mouse α myc: 1:1000 dilution
Quantify band intensity.
Normalize IP α CRAF to IP α myc-BRAF for each condition from IP band intensities.
Repeat independently two additional times.
Deliverables
Request a detailed protocolData to be collected:
Protein quantification results from Bradford assay.
Images of Ponceau stained membranes.
Images of whole gels (as reported in Figure 4D).
Densitometric quantification of all bands.
Any data pertaining to cell growth conditions optimization, if performed.
Confirmatory analysis plan
Request a detailed protocolStatistical Analysis of the Replication Data:
A two sample Welch’s t-test comparing normalized IP CRAF (using IP myc-BRAF band intensity) in D04 cells transfected with Myc-BRAFWT vector vs. Myc-BRAFD594A vector
Meta-analysis of original and replication attempt effect sizes:
The replication data (mean and 95% confidence interval) will be plotted with the original quantified data value displayed as a single point on the same plot for comparison.
Known differences from the original study
Request a detailed protocolAll known differences, if any, are listed in the 'Materials and reagents' section above with the originally used item listed in the comments section. The comments section also lists if the source of original item was not specified. All differences have the same capabilities as the original and are not expected to alter the experimental design.
Provisions for quality control
Request a detailed protocolCells will be sent for mycoplasma testing confirming lack of contamination and STR profiling confirming cell line authenticity. Transfection will be confirmed with Western blot. The transfer efficiency during the Western blot procedure will be monitored by Ponceau staining. All data obtained from the experiment - raw data, data analysis, control data, and quality control data - will be made publicly available, either as a published manuscript or as an open access dataset available on the Open Science Framework (https://osf.io/b1aw6/). Cells will be sent for mycoplasma testing confirming lack of contamination and STR profiling confirming cell line authenticity.
Power calculations
Request a detailed protocolFor additional details on power calculations, please see analysis scripts and associated files on the Open Science Framework:
Protocol 1
Summary of original data
Request a detailed protocolThe original data presented is qualitative (images of Western blots). We used Image Studio Lite (LICOR) to perform densitometric analysis of the presented bands. We then performed a priori power calculations with a range of assumed standard deviations to determine the number of replicates to perform.
Note: band intensity quantified from the image reported in Figure 1A:
Cell type | Drug | Band intensity normalized total ERK | Assumed N | |
---|---|---|---|---|
A375 | Control | 1.3864 | 3 | |
PD | 0.0127 | 3 | ||
SF | 0.0257 | 3 | ||
885-A | 0.0510 | 3 | ||
D04 | Control | 0.1315 | 3 | |
PD | 0.0198 | 3 | ||
SF | 0.0123 | 3 | ||
885-A | 0.6650 | 3 |
The original data does not indicate the error associated with multiple biological replicates. To identify a suitable sample size, power calculations were performed using different levels of relative variance.
Test family
Request a detailed protocolTwo-way ANOVA (2 x 4) fixed effects, special, main effects and interactions; alpha error = 0.05 followed by Bonferroni corrected comparisons
Power calculations
Request a detailed protocolPower calculations were performed using R software version 3.2.1 (R Core Team, 2014) and G*Power (version 3.1.7) (Faul et al., 2007)
Groups | Estimated variance | F test statistic F(3,16)interaction | Partial η2 | Effect size f | A priori power | Total sample size (8 groups) |
---|---|---|---|---|---|---|
A375 or D04 cells treated with drugs or control | 2% | 7743.50 | 0.9993 | 38.112 | 99.9% | 9 |
15% | 137.662 | 0.9627 | 5.080 | 98.8% | 10 | |
28% | 39.507 | 0.8811 | 2.722 | 96.0% | 11 | |
40% | 19.359 | 0.7840 | 1.905 | 91.6% | 12 |
Test family
Request a detailed protocolF test, ANOVA: Fixed effects, special, main effects and interactions, Bonferroni’s correction: alpha error = 0.01667
Power Calculations performed with G*Power software, version 3.1.7 (Faul et al., 2007).
ANOVA F test statistic and partial η2performed with R software, version 3.2.1 (Team, 2015). Partial η2 calculated from (Lakens, 2013).
For A375 cells, comparisons are between DMSO and all Drug Treatments (PD184352, sorafenib, and 885-A)
Groups | Cell line | Variance estimate | F test statistic Fc(1,16) | Partial η2 | Effect size f | A priori power | Total sample size (8 groups) |
---|---|---|---|---|---|---|---|
DMSO vs all Drug Treatments | A375 | 2% | 34711.2 | 0.9995 | 46.58 | 99.9% | 9 |
A375 | 15% | 617.09 | 0.9747 | 6.210 | 99.8% | 10 | |
A375 | 28% | 177.10 | 0.9171 | 3.327 | 84.2% | 10 | |
A375 | 40% | 86.78 | 0.8443 | 2.329 | 92.7% | 11 |
For D04 cells, comparisons are between DMSO and PD184352 and sorafenib, and between DMSO and 885-A
Groups | Cell line | Variance estimate | F test statistic Fc(1,16) | Partial η2 | Effect size f | A priori power | Total sample size (8 groups) |
---|---|---|---|---|---|---|---|
DMSO vs. PD184352 and sorafenib | D04 | 2% | 223.55 | 0.9332 | 3.7379 | 90.2% | 10 |
D04 | 15% | 3.9741 | 0.1990 | 0.4984 | 80.4% | 46 | |
D04 | 28% | 1.1405 | 0.0665 | 0.2670 | 80.0% | 150 | |
D04 | 40% | 0.5589 | 0.0337 | 0.1869 | 80.0% | 303 | |
DMSO vs. 885A | D04 | 2% | 3580.31 | 0.9955 | 14.959 | 99.9% | 10 |
D04 | 15% | 63.6498 | 0.7991 | 1.9945 | 84.0% | 11 | |
D04 | 28% | 18.2668 | 0.5331 | 1.0685 | 80.8% | 15 | |
D04 | 40% | 8.9507 | 0.3587 | 0.7479 | 80.1% | 23 |
Based on these power calculations, we will run the experiment three times. Each time, we will quantify band intensity. We will determine the standard deviation of band intensity across the biological replicates and combine this with the effect size from the original study to calculate the number of replicates necessary to reach a power of at least 80%. We will then perform additional replicates, if required, to ensure the experiment has more than 80% power to detect the original effect.
Protocol 2
Summary of original data
Request a detailed protocolThe original data presented is qualitative (images of Western blots). We used Image Studio Lite (LICOR) to perform densitometric analysis of the presented bands. We then performed a priori power calculations with a range of assumed standard deviations to determine the number of replicates to perform.
Note: band intensity quantified from the image reported in Figure 1B:
Target | siRNA | Band intensity normalized to tubulin for transfected cells treated with 885-A minus DMSO | Assumed N |
---|---|---|---|
pMEK | Control | 0.836493931 | 3 |
NRAS | 0.0695447 | 3 | |
CRAF | 0.3538748 | 3 | |
pERK | Control | 0.8769868 | 3 |
NRAS | 0.498252598 | 3 | |
CRAF | 0.653649416 | 3 |
Test family
Request a detailed protocolDue to the lack of raw original data, we are unable to perform power calculations using a MANOVA. We are determining sample size using two one-way ANOVAs.
Two, one-way ANOVAs (Bonferroni corrected) on the difference in the normalized band intensity for pMEK and pERK separately in transfected cells treated with 885-A minus DMSO followed by Bonferroni corrected comparisons for the following groups:
pMEK and pERK each:
Compare the difference in band intensity in cells transfected with control siRNA and treated with 885-A minus control siRNA with DMSO (Control siRNA Difference) vs. the difference in band intensity in cells transfected with NRAS siRNA and treated with 885-A minus NRAS siRNA with DMSO (NRAS siRNA Difference)
Compare the difference in band intensity in cells transfected with control siRNA and treated with 885-A minus control siRNA with DMSO (Control siRNA Difference) vs. the difference in band intensity in cells transfected with CRAF siRNA and treated with 885-A minus CRAF siRNA with DMSO (CRAF siRNA Difference)
Power calculations
Power calculations were performed using R software version 3.1.2 (R Core Team, 2014) and G*Power (version 3.1.7) (Faul et al., 2007)
pMEK
Request a detailed protocol2% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 1019.1 | 0.9971 | 18.5426 | >99.9% | 6 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 36.4575 | 99.3%1 | 21 |
Control siRNA Difference | CRAF siRNA Difference | 8.6916 | 99.9% | 3 |
15% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 72.467 | 0.9602 | 4.9118 | 99.5% | 6 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 9.7218 | >99.9% | 3 |
Control siRNA Difference | CRAF siRNA Difference | 2.3177 | 80.9% | 6 |
28% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 20.797 | 0.8739 | 2.6325 | 99.8% | 9 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 5.2081 | 89.9% | 3 |
Control siRNA Difference | CRAF siRNA Difference | 1.2416 | 82.7% | 17 |
40% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 10.191 | 0.7726 | 1.8432 | 90.8% | 9 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 3.6457 | 89.7% | 4 |
Control siRNA Difference | CRAF siRNA Difference | 0.8692 | 81.4% | 32 |
pERK
Request a detailed protocol2% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 141.13 | 0.9792 | 6.8613 | >99.9% | 6 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 13.6467 | 90.2% | 2 |
Control siRNA Difference | CRAF siRNA Difference | 8.0474 | 99.9% | 3 |
15% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 10.036 | 0.7699 | 1.8292 | 90.3% | 9 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 3.6391 | 89.3% | 4 |
Control siRNA Difference | CRAF siRNA Difference | 2.1460 | 83.7% | 7 |
28% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 2.8802 | 0.4898 | 0.9798 | 86.4% | 18 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 1.9495 | 83.1% | 8 |
Control siRNA Difference | CRAF siRNA Difference | 1.1496 | 81.4% | 19 |
40% variance:
ANOVA: Fixed effects, omnibus, one-way, Bonferroni corrected alpha error = 0.025
Groups | F test statistic | Partial η2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
D04 cells silenced for NRAS or CRAF and exposed to Drug Treatment | F(2,6) = 1.4113 | 0.3199 | 0.6858 | 82.9% | 30 (3 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.0125
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
Control siRNA Difference | NRAS siRNA Difference | 1.3647 | 81.4% | 14 |
Control siRNA Difference | CRAF siRNA Difference | 0.8047 | 81.3% | 37 |
Based on these power calculations, we will run the experiment four times. Each time, we will quantify band intensity. We will determine the standard deviation of band intensity across the biological replicates and combine this with the effect size from the original study to calculate the number of replicates necessary to reach a power of at least 80%. We will then perform additional replicates, if required, to ensure the experiment has more than 80% power to detect the original effect.
Protocol 3
Summary of original data
Request a detailed protocolThe original data presented is qualitative (images of Western blots). We used Image Studio Lite (LICOR) to perform densitometric analysis of the presented bands. We then performed a priori power calculations with a range of assumed standard deviations to determine the number of replicates to perform.
Note: band intensity quantified from the image reported in Figure 3A:
Target | Myc-eptitope tagged vector | Drug | Band intensity normalized to IP myc | Assumed N |
---|---|---|---|---|
BRAF | CRAF | 885-A | 0.01904 | 3 |
DMSO | 0.94756 | 3 | ||
R89L | 885-A | 0.27776 | 3 | |
DMSO | 0.65427 | 3 |
Test family
Request a detailed protocolTwo-way ANOVA (2 x 2) on BRAF values followed by Bonferroni corrected comparisons for the following groups:
Compare the band intensity of BRAF in myc-tagged CRAFWT or CRAFR89L in cells treated with or without 885-A
Power calculations
Request a detailed protocolPower calculations were performed using R software version 3.1.2 (R Core Team, 2014) and G*Power (version 3.1.7) (Faul et al., 2007)
2% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged CRAFWT or CRAFR89Lin cells with or without 885-A | F(1.8) = 1628.39 (interaction) | 0.9951 | 14.267 | 98.7% | 5 (4 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
CRAF +885A | CRAF +DMSO | 69.2756 | 99.9% | 2 |
R89L +885A | R89L +DMSO | 37.4562 | 99.9% | 2 |
15% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged CRAFWT or CRAFR89Lin cells with or without 885-A | F(1.8) = 28.9491 interaction | 0.7835 | 1.9023 | 90.2% | 7 (4 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
CRAF +885A | CRAF +DMSO | 9.2367 | 88.1% | 2 |
R89L +885A | R89L +DMSO | 4.9941 | 96.0% | 3 |
28% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged CRAFWT or CRAFR89Lin cells with or without SB590885 | F(1.8) =8.311 interaction | .05094 | 1.0191 | 82.5% | 11 (4 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
CRAF +885A | CRAF +DMSO | 4.9482 | 95.8% | 3 |
R89L +885A | R89L +DMSO | 2.6754 | 90.1% | 5 |
40% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged CRAFWT or CRAFR89Lin cells with or without SB590885 | F(1.8) = 4.071 interaction | 0.3372 | 0.7133 | 80.3% | 18 (4 groups) |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
CRAF +885A | CRAF +DMSO | 3.4638 | 94.0% | 4 |
R89L +885A | R89L +DMSO | 1.8728 | 81.2% | 7 |
Based on these power calculations, we will run the experiment three times. Each time, we will quantify band intensity. We will determine the standard deviation of band intensity across the biological replicates and combine this with the effect size from the original study to calculate the number of replicates necessary to reach a power of at least 80%. We will then perform additional replicates, if required, to ensure the experiment has more than 80% power to detect the original effect.
Protocol 4
Summary of original data
Request a detailed protocolThe original data presented is qualitative (images of Western blots). We used Image Studio Lite (LICOR) to perform densitometric analysis of the presented bands. We then performed a priori power calculations with a range of assumed standard deviations to determine the number of replicates to perform.
Note: band intensity quantified from the image reported in Figure 3B:
Target | Myc-eptitope tagged vector | Drug | Band intensity normalized to IP myc | Assumed N |
---|---|---|---|---|
CRAF | BRAF | 885-A | 0.0320 | 3 |
DMSO | 0.6015 | 3 | ||
R188L | 885-A | 0.0164 | 3 | |
DMSO | 0.1012 | 3 |
Test family
Request a detailed protocolTwo-way ANOVA (2 x 2) on CRAF values followed by Bonferroni corrected comparisons for the following groups:
Compare the band intensity of BRAF in myc-tagged BRAFWT or BRAFR188L in cells treated with or without 885-A
Power calculations
Request a detailed protocolPower calculations were performed using R software version 3.1.2 (R Core Team, 2014) and G*Power (version 3.1.7) (Faul et al., 2007)
2% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged BRAFWT or BRAFR188Lin cells with or without 885-A | F(1.8) = 4718.4 (interaction) | 0.998 | 24.28 | 99.9% | 5 |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
BRAF +885A | BRAF +DMSO | 66.85 | 99.9% | 2 |
R188L +885A | R188L +DMSO | 58.51 | 99.9% | 2 |
15% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged BRAFWT or BRAFR188Lin cells with or without 885-A | F(1.8) = 83.88 interaction | 0.913 | 3.238 | 95.6% | 6 |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
BRAF +885A | BRAF +DMSO | 8.914 | 86.3% | 2 |
R188L +885A | R188L +DMSO | 7.801 | 99.9% | 3 |
28% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged BRAFWT or BRAFR188Lin cells with or without 885-A | F(1.8) = 24.07 interaction | 0.750 | 1.734 | 85.0% | 7 |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
BRAF +885A | BRAF +DMSO | 4.775 | 94.5% | 3 |
R188L +885A | R188L +DMSO | 4.179 | 87.8% | 3 |
40% variance:
ANOVA: Fixed effects, special, main effects, and interactions; alpha error = 0.05
Groups | F test statistic | Partial eta2 | Effect size f | A priori power | Total sample size |
---|---|---|---|---|---|
myc-tagged BRAFWT or BRAFR188Lin cells with or without 885-A | F(1.8) = 11.79 interaction | 0.596 | 1.214 | 82.7% | 9 |
Bonferroni- corrected planned comparisons; alpha error = 0.025
Group 1 | Group 2 | Effect size d | A priori power | Sample size per group |
---|---|---|---|---|
BRAF +885A | BRAF +DMSO | 3.343 | 92.3% | 4 |
R188L +885A | R188L +DMSO | 2.925 | 83.9% | 4 |
Based on these power calculations, we will run the experiment three times. Each time, we will quantify band intensity. We will determine the standard deviation of band intensity across the biological replicates and combine this with the effect size from the original study to calculate the number of replicates necessary to reach a power of at least 80%. We will then perform additional replicates, if required, to ensure the experiment has more than 80% power to detect the original effect.
Protocol 5
Summary of original data
Request a detailed protocolThe original data presented is qualitative (images of Western blots). We used Image Studio Lite (LICOR) to perform densitometric analysis of the presented bands. We then performed a priori power calculations with a range of assumed standard deviations to determine the number of replicates to perform.
Note: band intensity quantified from the image reported in Figure 4D
The band intensities for two groups were beyond the dynamic range for intensity calculation:
IP myc-tagged BRAF in cells transfected with the BRAF mutant (D594A): In this case, we used the value for band intensity of IP myc-tagged BRAF in cells transfected with wild type BRAF as an estimate. Since the band for wild type BRAF transfected cells was less intense, this underestimates the effect size, so we are likely overestimating the sample size required.
Target | Vector | Band intensity normalized to IP myc | Assumed N |
---|---|---|---|
IP CRAF | BRAF | 0.164 | 3 |
D594A | 0.739 | 3 |
Test family
Request a detailed protocolUnpaired two-tailed Welch’s t-test, alpha error = 0.05.
Power calculations
Request a detailed protocolPower calculations were performed using R software version 3.2.2 (R Core Team, 2014)
Group 1 | Group 2 | Variance estimate | Effect size (Glass’ ∆)1 | A priori power | Sample size per group |
---|---|---|---|---|---|
BRAFWT | BRAFD594A | 2% | 175.30 | >99.9% | 2 |
15% | 23.374 | 89.9% | 2 | ||
28% | 12.522 | 93.3% | 3 | ||
40% | 8.7652 | 90.8% | 4 |
-
1 The BRAF group SD was used as the divisor.
Based on these power calculations, we will run the experiment three times. Each time, we will quantify band intensity. We will determine the standard deviation of band intensity across the biological replicates and combine this with the effect size from the original study to calculate the number of replicates necessary to reach a power of at least 80%. We will then perform additional replicates, if required, to ensure the experiment has more than 80% power to detect the original effect.
References
-
Mechanisms of resistance to RAF inhibitors in melanomaJournal of Investigative Dermatology 131:1817–1820.https://doi.org/10.1038/jid.2011.147
-
Selective and potent raf inhibitors paradoxically stimulate normal cell proliferation and tumor growthMolecular Cancer Therapeutics 9:2399–2410.https://doi.org/10.1158/1535-7163.MCT-10-0181
-
G*power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciencesBehavior Research Methods 39:175–191.https://doi.org/10.3758/BF03193146
-
Paradoxical activation of raf by a novel raf inhibitorChemistry & Biology 6:559–568.https://doi.org/10.1016/S1074-5521(99)80088-X
-
The RAF inhibitor PLX4032 inhibits ERK signaling and tumor cell proliferation in a V600E BRAF-selective mannerProceedings of the National Academy of Sciences of the United States of America 107:14903–14908.https://doi.org/10.1073/pnas.1008990107
-
PLX4032, a potent inhibitor of the b-raf V600E oncogene, selectively inhibits V600E-positive melanomasPigment Cell & Melanoma Research 23:820–827.https://doi.org/10.1111/j.1755-148X.2010.00763.x
-
Mitogen-activated protein kinase (mAPK) hyperactivation and enhanced NRAS expression drive acquired vemurafenib resistance in V600E BRAF melanoma cellsJournal of Biological Chemistry 289:27714–27726.https://doi.org/10.1074/jbc.M113.532432
-
Towards a unified model of RAF inhibitor resistanceCancer Discovery 4:27–30.https://doi.org/10.1158/2159-8290.CD-13-0961
-
RAS mutations in cutaneous squamous-cell carcinomas in patients treated with BRAF inhibitorsNew England Journal of Medicine 366:207–215.https://doi.org/10.1056/NEJMoa1105358
-
BookR: A Language and Environment for Statistical ComputingVienna, Austria: R Foundation for Statistical Computing.
Decision letter
-
Roger DavisReviewing Editor; Howard Hughes Medical Institute & University of Massachusetts Medical School, United States
In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.
Thank you for submitting your work entitled "Registered report: Kinase-Dead BRAF and Oncogenic RAS Cooperate to Drive Tumor Progression through CRAF" for consideration by eLife. Your article has been favorably evaluated by Charles Sawyers (Senior editor) and four reviewers, one of whom is a member of our Board of Reviewing Editors.
The reviewers have discussed the reviews with one another and the Reviewing editor has drafted this decision to help you prepare a revised submission.
The 2010 paper, "Kinase-Dead BRAF and Oncogenic RAS Cooperate to Drive Tumor Progression through CRAF" by Heidorn et al., showed 1) selective BRAF inhibitors in the presence of oncogenic RAS led to RAS-dependent BRAF:CRAF dimerization and RAS-dependent activation of MEK-ERK signaling; 2) kinase-dead BRAF mimics the effects of BRAF-selective inhibitors; and 3) kinase-dead BRAF and oncogenic RAS cooperate to induce melanoma in vivo. The authors of the Reproducibility Project propose to replicate 4 figures. The first three figures (Figures 1A, 1B, and 3A) will support the first finding of the paper and the last figure of the proposal (Figure 4D) will support the second finding. While the proposed replicated figures do not address the third conclusion at all, it is understood that duplication of animal experiments might be considered to be unethical.
Figure 1A demonstrates that selective BRAF inhibitors deplete ERK signaling in BRAF mutant cell lines while promoting signaling in cells with WT BRAF and mutant RAS (NRAS). The authors propose to use only two lines, A375 which is BRAFV600E and D04 which is Ras mutant. They will only use PD, Sorafenib and SB and have chosen to not use PLX4720. The authors might wish to reconsider their decision to not repeat with PLX4720. The data have been repeated many times by others, but the data, that PLX induces paradoxical activation and this is dependent on CRAF is a key finding of this figure.
Figure 1B shows that activation of MEK-ERK signaling was abrogated in the mutant RAS cell line (D04) by transiently depleting NRAS before treatment with the BRAF inhibitor (885-A).
Figure 3A confirms that CRAF must interact with RAS to promote BRAF:CRAF dimerization. Finally, Figure 4D shows that kinase-dead BRAF (BRAFD594A), but not BRAFWT, mimics BRAF inhibition and heterodimerizes with CRAF in NRAS-mutant cells (D04).
Figure 4D: Here it is shown that a specific kinase dead form of BRAFD594A, can bind constitutively to CRAF. This is a straightforward experiment and suggests that BRAF inhibition is sufficient to stimulate dimer formation with CRAF.
The reviewers recommend that the replication study should be expanded to include:
Figure 2A: The authors show that Sorafenib strongly induces dimers between BRAF and CRAF. This was confirmed by Rosen but Therrien suggests that it doesn't induce strong dimers. Thus, it would be of interest to validate this finding.
Figure 2B: The authors suggest that the inability to detect PLX induced dimers between BRAF and CRAF is feedback phosphorylation because of pathway activation. thus, they show that MEK inhibition (which blocks downstream activation), allows for weak detection of PLX induced BRAF/CRAF dimers. This explained how PLX could induce paradoxical activation. However, recent structural studies and work from the Theirrien group suggests that PLX prevents dimer formation because it moves the aC helix. This model is in conflict with the data in Figure 2B. The possibility that weak dimers are formed which are inhibited by MEK activation could be a simple resolution to this issue.
Figure 3B: A key finding of the original study is that RAS interaction with both CRAF and BRAF is required to induce BRAF:CRAF dimerization in the presence of a BRAF inhibitor.
Based on the reasoning outlined above, the reviewers recommend that the replication study should be expanded to include Figures 2A, 2B & 3B.
Specific comments on detailed protocols:
1) Protocol 2:
A) In Step 2, the authors should use a non-targeting siRNA in addition to their "Mock Transfection" control. It is unclear why the authors use the term "Mock siRNA" in their confirmatory analysis plan when their mock transfection clearly states 0.6 μL of media (not non-targeting siRNA).
2) Protocol 3:
A) There is a minor concern that a different transfection protocol will be used. Nucleofection will be replaced with a lipid based transfection reagent. Significant differences in expression could lead to differences in results.
B) It is unclear why the authors list an NRAS antibody in Protocol 3 and not a CRAF antibody when the intent to the protocol is to immunoprecipitate CRAF.
C) Step 3b states: "Freeze the remaining lysate (-20C) to be used for Step 3. Save an aliquot of lysate to run as a control in Step 4b." Are the authors referring to Step 4 in the first sentence? Are the authors proposing to freeze the lysate before an IP? There is substantial concern that protein-protein interactions will not survive the freeze/thaw of the lysate.
D) Step 4a, why are the authors using both anti-CRAF (C-20) and anti-myc in the same IP?
3) Protocol 4:
A) The kinase-dead BRAF mutant is listed as "VRAFD594A" in the Materials and Reagents table.
B) The authors are proposing to freeze the lysate (Step2) before performing the IP (Step 3). As in point 2b above, there is substantial concern that protein-protein interactions will not survive the freeze/thaw of the lysate.
Statistical Comments:
For protocol 1 & 3, the authors propose use ANOVA to analyze the data. Please check for outliers and make sure that the data do not violate the assumptions of the ANOVA: normality and homoscedasticity. If the data do not fit the assumptions well enough, try to find a data transformation that makes them fit. If this doesn't work, then you will need to apply a nonparametric counterpart of ANOVA.
For protocol 2, the authors propose use MANOVA to analyze the data.
In addition to what mentioned above, MANOVA assumes that covariances of dependent variables are homogeneous across the cells of the design and that the dependent variables should not be too correlated to each other. Furthermore, it assumes that there are linear relationships among all pairs of dependent variables. Please verify these assumptions before applying MANOVA.
For protocol 4, the authors propose use unpaired student t-test to analyze the data. We would suggest the authors to use either unequal variance welch t-test or use a test for equal variances followed by appropriate test depending on the outcome of the equal variance test. Please adjust power calculation for protocol 4 accordingly.
https://doi.org/10.7554/eLife.11999.002Author response
The 2010 paper, "Kinase-Dead BRAF and Oncogenic RAS Cooperate to Drive Tumor Progression through CRAF" by Heidorn et al., showed 1) selective BRAF inhibitors in the presence of oncogenic RAS led to RAS-dependent BRAF:CRAF dimerization and RAS-dependent activation of MEK-ERK signaling; 2) kinase-dead BRAF mimics the effects of BRAF-selective inhibitors; and 3) kinase-dead BRAF and oncogenic RAS cooperate to induce melanoma in vivo. The authors of the Reproducibility Project propose to replicate 4 figures. The first three figures (Figures 1A, 1B, and 3A) will support the first finding of the paper and the last figure of the proposal (Figure 4D) will support the second finding. While the proposed replicated figures do not address the third conclusion at all, it is understood that duplication of animal experiments might be considered to be unethical.Figure 1A demonstrates that selective BRAF inhibitors deplete ERK signaling in BRAF mutant cell lines while promoting signaling in cells with WT BRAF and mutant RAS (NRAS). The authors propose to use only two lines, A375 which is BRAF V600E and D04 which is Ras mutant. They will only use PD, Sorafenib and SB and have chosen to not use PLX4720. The authors might wish to reconsider their decision to not repeat with PLX4720. The data have been repeated many times by others, but the data, that PLX induces paradoxical activation and this is dependent on CRAF is a key finding of this figure.
We agree that the key finding to this figure is demonstrating the paradoxical activation of MEK/ERK signaling in cells with WT BRAF and mutant RAS. The authors tested two specific BRAF inhibitors (PLX4720 and 885-A) and compared their effects to a compound that represses both BRAF and CRAF (Sorafenib) in cells with (A375) or without (D04) BRAF mutation to demonstrate that cells with active RAS (D04) respond with increased MEK/ERK signaling to specific BRAF inhibitors, but not with a pan RAF inhibitor. Additionally, 885-A is utilized in further experiments included in this replication attempt, specifically Figure 1B, 3A, and 3B. We agree that including all of the compounds tested would be of general interest and limits the scope of what can be analyzed by the project, but we are attempting to identify a balance of breadth of sampling for general inference with sensible investment of resources on replication projects.
Figure 1B shows that activation of MEK-ERK signaling was abrogated in the mutant RAS cell line (D04) by transiently depleting NRAS before treatment with the BRAF inhibitor (885-A). Figure 3A confirms that CRAF must interact with RAS to promote BRAF:CRAF dimerization. Finally, Figure 4D shows that kinase-dead BRAF (BRAFD594A), but not BRAFWT, mimics BRAF inhibition and heterodimerizes with CRAF in NRAS-mutant cells (D04). Figure 4D: Here it is shown that a specific kinase dead form of BRAF, D594A, can bind constitutively to CRAF. This is a straightforward experiment and suggests that BRAF inhibition is sufficient to stimulate dimer formation with CRAF. The reviewers recommend that the replication study should be expanded to include:Figure 2A: The authors show that Sorafenib strongly induces dimers between BRAF and CRAF. This was confirmed by Rosen but Therrien suggests that it doesn't induce strong dimers. Thus, it would be of interest to validate this finding.Figure 2B: The authors suggest that the inability to detect PLX induced dimers between BRAF and CRAF is feedback phosphorylation because of pathway activation. thus, they show that MEK inhibition (which blocks downstream activation), allows for weak detection of PLX induced BRAF/CRAF dimers. This explained how PLX could induce paradoxical activation. However, recent structural studies and work from the Theirrien group suggests that PLX prevents dimer formation because it moves the aC helix. This model is in conflict with the data in Figure 2B. The possibility that weak dimers are formed which are inhibited by MEK activation could be a simple resolution to this issue.Figure 3B: A key finding of the original study is that RAS interaction with both CRAF and BRAF is required to induce BRAF:CRAF dimerization in the presence of a BRAF inhibitor. Based on the reasoning outlined above, the reviewers recommend that the replication study should be expanded to include Figures 2A, 2B & 3B.
We appreciate the comments provided by the reviewers about expanding the experimental work for this replication. We agree that all of the experiments included in the original study are important, and choosing which experiments to replicate has been one of the great challenges of this project. The Reproducibility Project: Cancer Biology (RP:CB) aims to replicate experiments that are impactful, but does not necessarily aim to replicate all the impactful experiments in any given paper. We agree that the exclusion of certain experiments limits the scope of what can be analyzed by the project, but we are attempting to identify a balance of breadth of sampling for general inference with sensible investment of resources on replication projects to determine to what extent the included experiments are reproducible. We agree that one of the key findings of the original paper was that both BRAF and CRAF must bind to RAS to create the proposed stable complex, so have included this additional experiment, reported in Figure 3B of the original study, into the revised Registered Report. However, we did not include Figures 2A and 2B, since they are not as central to the main findings of the original study even though they would be of interest to replicate considering new evidence reported by other groups. As such, we will restrict our analysis to the experiments being replicated and will not include discussion of experiments not being replicated in this study.
Specific comments on detailed protocols: 1) Protocol 2:
A) In Step 2, the authors should use a non-targeting siRNA in addition to their "Mock Transfection" control. It is unclear why the authors use the term "Mock siRNA" in their confirmatory analysis plan when their mock transfection clearly states 0.6 μL of media (not non-targeting siRNA).
The reviewers make a good point. We have removed the mock transfection and replaced the scrambled siRNA as the relevant control. We have replaced “Mock” with “Control” in the text.
2) Protocol 3:
A) There is a minor concern that a different transfection protocol will be used. Nucleofection will be replaced with a lipid based transfection reagent. Significant differences in expression could lead to differences in results.
We have expanded upon this potential impact on the outcome in the known differences section of the protocol. Since the original expression levels of are unknown, such as expression above endogenous, even if the same transfection protocol was to be used, differences in expression of the original compared to the replication could occur.
B) It is unclear why the authors list an NRAS antibody in Protocol 3 and not a CRAF antibody when the intent to the protocol is to immunoprecipitate CRAF.
Thank you for catching this error. NRAS should not be included in the Reagents list. We have removed it in the revised manuscript. The original authors only probed for myc-tagged CRAF and endogenous BRAF.
C) Step 3b states: "Freeze the remaining lysate (-20C) to be used for Step 3. Save an aliquot of lysate to run as a control in Step 4b." Are the authors referring to Step 4 in the first sentence? Are the authors proposing to freeze the lysate before an IP? There is substantial concern that protein-protein interactions will not survive the freeze/thaw of the lysate.
We agree this section is confusing. We’ve removed the reference to freezing the sample and reworded this section to state the procedure more clearly.
D) Step 4a: why are the authors using both anti-CRAF (C-20) and anti-myc in the same IP?
The incubation should only use α-myc antibody. The reference to anti-CRAF has been removed.
3) Protocol 4:
A) The kinase-dead BRAF mutant is listed as "VRAFD594A" in the Materials and Reagents table.
We have corrected this typo.
B) The authors are proposing to freeze the lysate (Step2) before performing the IP (Step 3). As in point 2b above, there is substantial concern that protein-protein interactions will not survive the freeze/thaw of the lysate.
We agree and have removed the freezing step.
Statistical Comments: For protocol 1 & 3, authors propose use ANOVA to analyze the data. Please check for outliers and make sure that the data do not violate the assumptions of the anova: normality and homoscedasticity. If the data do not fit the assumptions well enough, try to find a data transformation that makes them fit. If this doesn't work, then you will need to apply a nonparametric counterpart of ANOVA.
We agree and at the time of analysis, we will assess the normality and homoscedasticity of the data. If necessary, we will perform the appropriate transformation in order to proceed with the proposed statistical analysis or apply a nonparametric counterpart of ANOVA We will note any changes or transformations made. We have also updated the manuscript to address this point.
For protocol 2, authors propose use MANOVA to analyze the data.
In addition to what mentioned above, MANOVA assumes that covariances of dependent variables are homogeneous across the cells of the design and that the dependent variables should not be too correlated to each other. Furthermore, it assumes that there are linear relationships among all pairs of dependent variables. Please verify these assumptions before applying MANOVA.
We agree and at the time of analyze we will check the additional assumptions of a MANOVA. We have updated the manuscript to address this point.
For protocol 4, the authors propose use unpaired student t-test to analyze the data. We would suggest the authors to use either unequal variance welch t-test or use a test for equal variances followed by appropriate test depending on the outcome of the equal variance test. Please adjust power calculation for protocol 4 accordingly.
Thank you for this suggestion. We have updated the manuscript and power calculations to reflect a Welch’s t-test.
https://doi.org/10.7554/eLife.11999.003Article and author information
Author details
Funding
Laura and John Arnold Foundation
- Nicole Perfito
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
The Reproducibility Project: Cancer Biology core team would like to thank the original authors, in particular Sonja Heidorn and Richard Marais, for generously sharing critical information as well as reagents to ensure the fidelity and quality of this replication attempt. We thank Courtney Soderberg at the Center for Open Science for assistance with statistical analyses. We also thank the following companies for generously d9onating reagents to the Reproducibility Project: Cancer Biology; American Type and Tissue Collection (ATCC), Applied Biological Materials, BioLegend, Charles River Laboratories, Corning Incorporated, DDC Medical, EMD Millipore, Harlan Laboratories, LI-COR Biosciences, Mirus Bio, Novus Biologicals, Sigma-Aldrich, and System Biosciences (SBI).
Reviewing Editor
- Roger Davis, Howard Hughes Medical Institute & University of Massachusetts Medical School, United States
Version history
- Received: October 2, 2015
- Accepted: January 25, 2016
- Version of Record published: February 17, 2016 (version 1)
Copyright
© 2016, Bhargava et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,358
- Page views
-
- 178
- Downloads
-
- 5
- Citations
Article citation count generated by polling the highest count across the following sources: PubMed Central, Crossref, Scopus.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Cancer Biology
Investigating reproducibility in preclinical cancer research.
-
- Cancer Biology
- Computational and Systems Biology
Pancreatic cancer is one of the deadliest cancer types with poor treatment options. Better detection of early symptoms and relevant disease correlations could improve pancreatic cancer prognosis. In this retrospective study, we used symptom and disease codes (ICD-10) from the Danish National Patient Registry (NPR) encompassing 6.9 million patients from 1994 to 2018,, of whom 23,592 were diagnosed with pancreatic cancer. The Danish cancer registry included 18,523 of these patients. To complement and compare the registry diagnosis codes with deeper clinical data, we used a text mining approach to extract symptoms from free text clinical notes in electronic health records (3078 pancreatic cancer patients and 30,780 controls). We used both data sources to generate and compare symptom disease trajectories to uncover temporal patterns of symptoms prior to pancreatic cancer diagnosis for the same patients. We show that the text mining of the clinical notes was able to complement the registry-based symptoms by capturing more symptoms prior to pancreatic cancer diagnosis. For example, ‘Blood pressure reading without diagnosis’, ‘Abnormalities of heartbeat’, and ‘Intestinal obstruction’ were not found for the registry-based analysis. Chaining symptoms together in trajectories identified two groups of patients with lower median survival (<90 days) following the trajectories ‘Cough→Jaundice→Intestinal obstruction’ and ‘Pain→Jaundice→Abnormal results of function studies’. These results provide a comprehensive comparison of the two types of pancreatic cancer symptom trajectories, which in combination can leverage the full potential of the health data and ultimately provide a fuller picture for detection of early risk factors for pancreatic cancer.