Is preclinical research in cancer biology reproducible enough?

The Reproducibility Project: Cancer Biology (RPCB) was established to provide evidence about reproducibility in basic and preclinical cancer research, and to identify the factors that influence reproducibility more generally. In this commentary we address some of the scientific, ethical and policy implications of the project. We liken the basic and preclinical cancer research enterprise to a vast 'diagnostic machine' that is used to determine which clinical hypotheses should be advanced for further development, including clinical trials. The results of the RPCB suggest that this diagnostic machine currently recommends advancing many findings that are not reproducible. While concerning, we believe that more work needs to be done to evaluate the performance of the diagnostic machine. Specifically, we believe three questions remain unanswered: how often does the diagnostic machine correctly recommend against advancing real effects to clinical testing?; what are the relative costs to society of false positive and false negatives?; and how well do scientists and others interpret the outputs of the machine?

What have we learned?

As the final outputs of the Reproducibility Project: Cancer Biology are published, it is clear that preclinical research in cancer biology is not as reproducible as it should be.

Challenges for assessing replicability in preclinical cancer biology

We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication - it is hard to assess whether reported findings are credible.

Investigating the replicability of preclinical cancer biology

Replicability is an important feature of scientific research, but aspects of contemporary research culture, such as an emphasis on novelty, can make replicability seem less important than it should be. The Reproducibility Project: Cancer Biology was set up to provide evidence about the replicability of preclinical research in cancer biology by repeating selected experiments from high-impact papers. A total of 50 experiments from 23 papers were repeated, generating data about the replicability of a total of 158 effects. Most of the original effects were positive effects (136), with the rest being null effects (22). A majority of the original effect sizes were reported as numerical values (117), with the rest being reported as representative images (41). We employed seven methods to assess replicability, and some of these methods were not suitable for all the effects in our sample. One method compared effect sizes: for positive effects, the median effect size in the replications was 85% smaller than the median effect size in the original experiments, and 92% of replication effect sizes were smaller than the original. The other methods were binary - the replication was either a success or a failure - and five of these methods could be used to assess both positive and null effects when effect sizes were reported as numerical values. For positive effects, 40% of replications (39/97) succeeded according to three or more of these five methods, and for null effects 80% of replications (12/15) were successful on this basis; combining positive and null effects, the success rate was 46% (51/112). A successful replication does not definitively confirm an original finding or its theoretical interpretation. Equally, a failure to replicate does not disconfirm a finding, but it does suggest that additional investigation is needed to establish its reliability.

Pseudogenes, RNAs and new reproducibility norms

The partial success of a study to reproduce experiments that linked pseudogenes and cancer proves that understanding RNA networks is more complicated than expected.

Replication Study: Biomechanical remodeling of the microenvironment by stromal caveolin-1 favors tumor invasion and metastasis

As part of the Reproducibility Project: Cancer Biology we published a Registered Report (Fiering et al., 2015) that described how we intended to replicate selected experiments from the paper 'Biomechanical remodeling of the microenvironment by stromal caveolin-1 favors tumor invasion and metastasis' (Goetz et al., 2011). Here we report the results. Primary mouse embryonic fibroblasts (pMEFs) expressing caveolin 1 (Cav1WT) demonstrated increased extracellular matrix remodeling in vitro compared to Cav1 deficient (Cav1KO) pMEFs, similar to the original study (Goetz et al., 2011). In vivo, we found higher levels of intratumoral stroma remodeling, determined by fibronectin fiber orientation, in tumors from cancer cells co-injected with Cav1WT pMEFs compared to cancer cells only or cancer cells plus Cav1KO pMEFs, which were in the same direction as the original study (Supplemental Figure S7C; Goetz et al., 2011), but not statistically significant. Primary tumor growth was similar between conditions, like the original study (Supplemental Figure S7Ca; Goetz et al., 2011). We found metastatic burden was similar between Cav1WT and Cav1KO pMEFs, while the original study found increased metastases with Cav1WT (Figure 7C; Goetz et al., 2011); however, the duration of our in vivo experiments (45 days) were much shorter than in the study by Goetz et al. (2011) (75 days). This makes it difficult to interpret the difference between the studies as it is possible that the cells required more time to manifest the difference between treatments observed by Goetz et al. We also found a statistically significant negative correlation of intratumoral remodeling with metastatic burden, while the original study found a statistically significant positive correlation (Figure 7Cd; Goetz et al., 2011), but again there were differences between the studies in terms of the duration of the metastasis studies and the imaging approaches that could have impacted the outcomes. Finally, we report meta-analyses for each result.

Rethinking research into metastasis

The partial success of an attempt to repeat findings in cancer biology highlights the need to improve study designs for preclinical research into metastasis and the targeting of cancer cells.

Replication Study: Wnt activity defines colon cancer stem cells and is regulated by the microenvironment

As part of the Reproducibility Project: Cancer Biology we published a Registered Report (Evans et al., 2015), that described how we intended to replicate selected experiments from the paper 'Wnt activity defines colon cancer stem cells and is regulated by the microenvironment' (Vermeulen et al., 2010). Here, we report the results. Using three independent primary spheroidal colon cancer cultures that expressed a Wnt reporter construct we observed high Wnt activity was associated with the cell surface markers CD133, CD166, and CD29, but not CD24 and CD44, while the original study found all five markers were correlated with high Wnt activity (Figure 2F; Vermeulen et al., 2010). Clonogenicity was highest in cells with high Wnt activity and clonogenic potential of cells with low Wnt activity were increased by myofibroblast-secreted factors, including HGF. While the effects were in the same direction as the original study (Figure 6D; Vermeulen et al., 2010) whether statistical significance was reached among the different conditions varied. When tested in vivo, we did not find a difference in tumorigenicity between high and low Wnt activity, while the original study found cells with high Wnt activity were more effective in inducing tumors (Figure 7E; Vermeulen et al., 2010). Tumorigenicity, however, was increased with myofibroblast-secreted factors, which was in the same direction as the original study (Figure 7E; Vermeulen et al., 2010), but not statistically significant. Finally, we report meta-analyses for each results where possible.

Replication Study: The microRNA miR-34a inhibits prostate cancer stem cells and metastasis by directly repressing CD44

As part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Li et al., 2015), that described how we intended to replicate selected experiments from the paper 'The microRNA miR-34a inhibits prostate cancer stem cells and metastasis by directly repressing CD44' (Liu et al., 2011). Here we report the results. We found the microRNA, miR-34a, was expressed at twice the level in CD44⁺ prostate cancer cells purified from xenograft tumors (LAPC4 cells) compared to CD44^- LAPC4 cells, whereas the original study reported miR-34a was underexpressed in CD44⁺ LAPC4 cells (Figure 1B; Liu et al., 2011). When LAPC4 cells engineered to express miR-34a were injected into mice, we did not observe changes in tumor growth or CD44 expression; however, unexpectedly miR-34a expression was lost in vivo. In the original study, LAPC4 cells expressing miR-34a had a statistically significant reduction in tumor regeneration and reduced CD44 expression compared to control (Figure 4A and Supplemental Figures 4A,B and 5C; Liu et al., 2011). Furthermore, when we tested if miR-34a regulated CD44 through binding sites in the 3'UTR we did not find a statistically significant difference, whereas the original study reported miR-34a decreased CD44 expression that was partially abrogated by mutation of the binding sites in the CD44 3'UTR (Figure 4D; Liu et al., 2011). Finally, where possible, we report meta-analyses for each result.

Replication study: Melanoma exosomes educate bone marrow progenitor cells toward a pro-metastatic phenotype through MET

As part of the Reproducibility Project: Cancer Biology we published a Registered Report (Lesnik et al., 2016) that described how we intended to replicate selected experiments from the paper ‘Melanoma exosomes educate bone marrow progenitor cells toward a pro-metastatic phenotype through MET’ (Peinado et al., 2012). Here we report the results. We regenerated tumor cells stably expressing a short hairpin to reduce Met expression (shMet) using the same highly metastatic mouse melanoma cell line (B16-F10) as the original study, which efficiently downregulated Met in B16F10 cells similar to the original study (Supplementary Figure 5A; Peinado et al., 2012). Exosomes from control cells expressed Met, which was reduced in exosomes from shMet cells; however, we were unable to reliably detect phosphorylated Met in exosomes. We tested the effect of exosome-dependent Met signaling on primary tumor growth and metastasis. Similar to the results in the original study, we did not find a statistically significant change in primary tumor growth. Measuring lung and femur metastases, we found a small increase in metastatic burden with exosomes from control cells that was diminished when Met expression was reduced; however, while the effects were in the same direction as the original study (Figure 4E; Peinado et al., 2012), they were not statistically significant. Differences between the original study and this replication attempt, such as level of knockdown efficiency, cell line genetic drift, sample sizes, study endpoints, and variability of observed metastatic burden, are factors that might have influenced the outcomes. Finally, we report meta-analyses for each result.

Replication Study: Intestinal inflammation targets cancer-inducing activity of the microbiota

As part of the Reproducibility Project: Cancer Biology we published a Registered Report (Eaton et al., 2015) that described how we intended to replicate selected experiments from the paper "Intestinal Inflammation Targets Cancer-Inducing Activity of the Microbiota" (Arthur et al., 2012). Here we report the results. We observed no impact on bacterial growth or colonization capacity when the polyketide synthase (pks) genotoxic island was deleted from E. coli NC101, similar to the original study (Supplementary Figure 7; Arthur et al., 2012). However, for the experiment that compared inflammation, invasion, and neoplasia in azoxymethane (AOM)-treated interleukin-10-deficient mice mono-associated with NC101 or NC101[Formula: see text] pks the experimental timing of the replication attempt was longer than that of the original study. This difference was because in the original study the methodology was not clearly stated and likely led to the increased mortality and severity of inflammation observed in this replication attempt. Additionally, early death occurred during AOM treatment with higher mortality observed in NC101[Formula: see text] pks mono-associated mice compared to NC101, which was in the same direction, but more severe than the original study (Suppleme1ntal Figure 10; Arthur et al., 2012). A meta-analysis suggests that mice mono-associated with NC101[Formula: see text] pks have higher mortality compared to NC101. While these data were unable to address whether, under the conditions of the original study, NC101 and NC101[Formula: see text] pks differ in inflammation, invasion, and neoplasia this replication attempt demonstrates that clear description of experimental methods is essential to ensure accurate reproduction of experimental studies.

Replication Study: Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma

As part of the <ext-link ext-link-type="uri" xlink:href="https://osf.io/e81xl/wiki/home/">Reproducibility Project: Cancer Biology</ext-link>, we published a Registered Report (Repass et al., 2016), that described how we intended to replicate an experiment from the paper 'Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma' (Castellarin et al., 2012). Here we report the results. When measuring Fusobacterium nucleatum DNA by qPCR in colorectal carcinoma (CRC), adjacent normal tissue, and separate matched control tissue, we did not detect a signal for F. nucleatum in most samples: 25% of CRCs, 15% of adjacent normal, and 0% of matched control tissue were positive based on quantitative PCR (qPCR) and confirmed by sequencing of the qPCR products. When only samples with detectable F. nucleatum in CRC and adjacent normal tissue were compared, the difference was not statistically significant, while the original study reported a statistically significant increase in F. nucleatum expression in CRC compared to adjacent normal tissue (Figure 2; Castellarin et al., 2012). Finally, we report a meta-analysis of the result, which suggests F. nucleatum expression is increased in CRC, but is confounded by the inability to detect F. nucleatum in most samples. The difference in F. nucleatum expression between CRC and adjacent normal tissues was thus smaller than the original study, and not detected in most samples.

The who, where and how of fusobacteria and colon cancer

The association between the bacterium Fusobacterium nucleatum and human colon cancer is more complicated than it first appeared.

Getting to grips with c-Myc

The transcription factor c-Myc amplifies the transcription of many growth-related genes in cancer cells, but its role as an oncogene is not fully understood.

Replication Study: Transcriptional amplification in tumor cells with elevated c-Myc

As part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Blum et al., 2015), that described how we intended to replicate selected experiments from the paper 'Transcriptional amplification in tumor cells with elevated c-Myc' (Lin et al., 2012). Here we report the results. We found overexpression of c-Myc increased total levels of RNA in P493-6 Burkitt's lymphoma cells; however, while the effect was in the same direction as the original study (Figure 3E; Lin et al., 2012), statistical significance and the size of the effect varied between the original study and the two different lots of serum tested in this replication. Digital gene expression analysis for a set of genes was also performed on P493-6 cells before and after c-Myc overexpression. Transcripts from genes that were active before c-Myc induction increased in expression following c-Myc overexpression, similar to the original study (Figure 3F; Lin et al., 2012). Transcripts from genes that were silent before c-Myc induction also increased in expression following c-Myc overexpression, while the original study concluded elevated c-Myc had no effect on silent genes (Figure 3F; Lin et al., 2012). Treating the data as paired, we found a statistically significant increase in gene expression for both active and silent genes upon c-Myc induction, with the change in gene expression greater for active genes compared to silent genes. Finally, we report meta-analyses for each result.

Replication Study: Systematic identification of genomic markers of drug sensitivity in cancer cells

In 2016, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Vanden Heuvel et al., 2016), that described how we intended to replicate selected experiments from the paper ‘Systematic identification of genomic markers of drug sensitivity in cancer cells’ (Garnett et al., 2012). Here we report the results. We found Ewing’s sarcoma cell lines, overall, were more sensitive to the PARP inhibitor olaparib than osteosarcoma cell lines; however, while the effect was in the same direction as the original study (Figure 4C; Garnett et al., 2012), it was not statistically significant. Further, mouse mesenchymal cells transformed with either the EWS-FLI1 or FUS-CHOP rearrangement displayed similar sensitivities to olaparib, whereas the Ewing’s sarcoma cell line SK-N-MC had increased olaparib sensitivity. In the original study, mouse mesenchymal cells transformed with the EWS-FLI1 rearrangement and SK-N-MC cells were found to have similar sensitivities to olaparib, whereas mesenchymal cells transformed with the FUS-CHOP rearrangement displayed a reduced sensitivity to olaparib (Figure 4E; Garnett et al., 2012). We also studied another Ewing’s sarcoma cell line, A673: A673 cells depleted of EWS-FLI1 or a negative control both displayed similar sensitivities to olaparib, whereas the original study reported a decreased sensitivity to olaparib when EWS-FLI1 was depleted (Figure 4F; Garnett et al., 2012). Differences between the original study and this replication attempt, such as the use of different sarcoma cell lines and level of knockdown efficiency, are factors that might have influenced the outcomes. Finally, where possible, we report meta-analyses for each result.

Replication Study: Inhibition of BET recruitment to chromatin as an effective treatment for MLL-fusion leukaemia

In 2015, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Fung et al., 2015), that described how we intended to replicate selected experiments from the paper "Inhibition of BET recruitment to chromatin as an effective treatment for MLL-fusion leukaemia" (Dawson et al., 2011). Here, we report the results of those experiments. We found treatment of MLL-fusion leukaemia cells (MV4;11 cell line) with the BET bromodomain inhibitor I-BET151 resulted in selective growth inhibition, whereas treatment of leukaemia cells harboring a different oncogenic driver (K-562 cell line) did not result in selective growth inhibition; this is similar to the findings reported in the original study (Figure 2A and Supplementary Figure 11A,B; Dawson et al., 2011). Further, I-BET151 resulted in a statistically significant decrease in BCL2 expression in MV4;11 cells, but not in K-562 cells; again this is similar to the findings reported in the original study (Figure 3D; Dawson et al., 2011). We did not find a statistically significant difference in survival when testing I-BET151 efficacy in a disseminated xenograft MLL mouse model, whereas the original study reported increased survival in I-BET151 treated mice compared to vehicle control (Figure 4B,D; Dawson et al., 2011). Differences between the original study and this replication attempt, such as different conditioning regimens and I-BET151 doses, are factors that might have influenced the outcome. We also found I-BET151 treatment resulted in a lower median disease burden compared to vehicle control in all tissues analyzed, similar to the example reported in the original study (Supplementary Figure 16A; Dawson et al., 2011). Finally, we report meta-analyses for each result.

Replication Study: The common feature of leukemia-associated IDH1 and IDH2 mutations is a neomorphic enzyme activity converting alpha-ketoglutarate to 2-hydroxyglutarate

In 2016, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Fiehn et al., 2016), that described how we intended to replicate selected experiments from the paper "The common feature of leukemia-associated IDH1 and IDH2 mutations is a neomorphic enzyme activity converting alpha-ketoglutarate to 2-hydroxyglutarate" (Ward et al., 2010). Here, we report the results of those experiments. We found that cells expressing R172K mutant IDH2 did not display isocitrate-dependent NADPH production above vector control levels, in contrast to the increased production observed with wild-type IDH2. Conversely, expression of R172K mutant IDH2 resulted in increased alpha-ketoglutarate-dependent consumption of NADPH compared to wild-type IDH2 or vector control. These results are similar to those reported in the original study (Figure 2; Ward et al., 2010). Further, expression of R172K mutant IDH2 resulted in increased 2HG levels within cells compared to the background levels observed in wild-type IDH2 and vector control, similar to the original study (Figure 3D; Ward et al., 2010). In primary human AML samples, the 2HG levels observed in samples with mutant IDH1 or IDH2 status were higher than those observed in samples without an IDH mutation, similar to what was observed in the original study (Figure 5C; Ward et al., 2010). Finally, we report meta-analyses for each result.

Making sense of replications

The first results from the Reproducibility Project: Cancer Biology suggest that there is scope for improving reproducibility in pre-clinical cancer research.

Replication Study: The CD47-signal regulatory protein alpha (SIRPa) interaction is a therapeutic target for human solid tumors

In 2015, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Chroscinski et al., 2015) that described how we intended to replicate selected experiments from the paper "The CD47-signal regulatory protein alpha (SIRPa) interaction is a therapeutic target for human solid tumors "(Willingham et al., 2012). Here we report the results of those experiments. We found that treatment of immune competent mice bearing orthotopic breast tumors with anti-mouse CD47 antibodies resulted in short-term anemia compared to controls, consistent with the previously described function of CD47 in normal phagocytosis of aging red blood cells and results reported in the original study (Table S4; Willingham et al., 2012). The weight of tumors after 30 days administration of anti-CD47 antibodies or IgG isotype control were not found to be statistically different, whereas the original study reported inhibition of tumor growth with anti-CD47 treatment (Figure 6A,B; Willingham et al., 2012). However, our efforts to replicate this experiment were confounded because spontaneous regression of tumors occurred in several of the mice. Additionally, the excised tumors were scored for inflammatory cell infiltrates. We found IgG and anti-CD47 treated tumors resulted in minimal to moderate lymphocytic infiltrate, while the original study observed sparse lymphocytic infiltrate in IgG-treated tumors and increased inflammatory cell infiltrates in anti-CD47 treated tumors (Figure 6C; Willingham et al., 2012). Furthermore, we observed neutrophilic infiltration was slightly increased in anti-CD47 treated tumors compared to IgG control. Finally, we report a meta-analysis of the result.

Replication Study: Discovery and preclinical validation of drug indications using compendia of public gene expression data

In 2015, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Kandela et al., 2015) that described how we intended to replicate selected experiments from the paper "Discovery and Preclinical Validation of Drug Indications Using Compendia of Public Gene Expression Data" (Sirota et al., 2011). Here we report the results of those experiments. We found that cimetidine treatment in a xenograft model using A549 lung adenocarcinoma cells resulted in decreased tumor volume compared to vehicle control; however, while the effect was in the same direction as the original study (Figure 4C; Sirota et al., 2011), it was not statistically significant. Cimetidine treatment in a xenograft model using ACHN renal cell carcinoma cells did not differ from vehicle control treatment, similar to the original study (Supplemental Figure 1; Sirota et al., 2011). Doxorubicin treatment in a xenograft model using A549 lung adenocarcinoma cells did not result in a statistically significant difference compared to vehicle control despite tumor volume being reduced to levels similar to those reported in the original study (Figure 4C; Sirota et al., 2011). Finally, we report a random effects meta-analysis for each result. These meta-analyses show that the inhibition of A549 derived tumors by cimetidine resulted in a statistically significant effect, as did the inhibition of A549 derived tumors by doxorubicin. The effect of cimetidine on ACHN derived tumors was not statistically significant, as predicted.

Melanoma mystery

Biological variability has confounded efforts to confirm the role of PREX2 mutations in melanoma.

Small molecules remain on target for c-Myc

Targeting the transcription factor c-Myc via one of its coactivator proteins is a promising strategy for cancer therapy.

The challenges of replication

Interpreting the first results from the Reproducibility Project: Cancer Biology requires a highly nuanced approach.

Mixed outcomes for computational predictions

Experimental efforts to validate the output of a computational model that predicts new uses for existing drugs highlights the inherently complex nature of cancer biology.

Replication Study: BET bromodomain inhibition as a therapeutic strategy to target c-Myc

In 2015, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Kandela et al., 2015) that described how we intended to replicate selected experiments from the paper "BET bromodomain inhibition as a therapeutic strategy to target c-Myc" (Delmore et al., 2011). Here we report the results of those experiments. We found that treatment of human multiple myeloma (MM) cells with the small-molecular inhibitor of BET bromodomains, (+)-JQ1, selectively downregulated MYC transcription, which is similar to what was reported in the original study (Figure 3B; Delmore et al., 2011). Efficacy of (+)-JQ1 was evaluated in an orthotopically xenografted model of MM. Overall survival was increased in (+)-JQ1 treated mice compared to vehicle control, similar to the original study (Figure 7E; Delmore et al., 2011). Tumor burden, as determined by bioluminescence, was decreased in (+)-JQ1 treated mice compared to vehicle control; however, while the effect was in the same direction as the original study (Figure 7C-D; Delmore et al., 2011), it was not statistically significant. The opportunity to detect a statistically significant difference was limited though, due to the higher rate of early death in the control group, and increased overall survival in (+)-JQ1 treated mice before the pre-specified tumor burden analysis endpoint. Additionally, we evaluated the (−)-JQ1 enantiomer that is structurally incapable of inhibiting BET bromodomains, which resulted in a minimal impact on MYC transcription, but did not result in a statistically significant difference in tumor burden or survival distributions compared to treatment with (+)-JQ1. Finally, we report meta-analyses for each result.

DOI:http://dx.doi.org/10.7554/eLife.21253.001

Replication Study: Coadministration of a tumor-penetrating peptide enhances the efficacy of cancer drugs

In 2015, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Kandela et al., 2015) that described how we intended to replicate selected experiments from the paper “Coadministration of a tumor-penetrating peptide enhances the efficacy of cancer drugs“ (Sugahara et al., 2010). Here we report the results of those experiments. We found that coadministration with iRGD peptide did not have an impact on permeability of the chemotherapeutic agent doxorubicin (DOX) in a xenograft model of prostate cancer, whereas the original study reported that it increased the penetrance of this cancer drug (Figure 2B; Sugahara et al., 2010). Further, in mice bearing orthotopic 22Rv1 human prostate tumors, we did not find a statistically significant difference in tumor weight for mice treated with DOX and iRGD compared to DOX alone, whereas the original study reported a decrease in tumor weight when DOX was coadministered with iRGD (Figure 2C; Sugahara et al., 2010). In addition, we did not find a statistically significant difference in TUNEL staining in tumor tissue between mice treated with DOX and iRGD compared to DOX alone, while the original study reported an increase in TUNEL positive staining with iRGD coadministration (Figure 2D; Sugahara et al., 2010). Similar to the original study (Supplemental Figure 9A; Sugahara et al., 2010), we did not observe an impact on mouse body weight with DOX and iRGD treatment. Finally, we report meta-analyses for each result.

DOI:http://dx.doi.org/10.7554/eLife.17584.001

Replication Study: Melanoma genome sequencing reveals frequent PREX2 mutations

In 2015, as part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Chroscinski et al., 2014) that described how we intended to replicate selected experiments from the paper "Melanoma genome sequencing reveals frequent PREX2 mutations" (Berger et al., 2012). Here we report the results of those experiments. We regenerated cells stably expressing ectopic wild-type and mutant phosphatidylinositol-3,4,5-trisphosphate-dependent Rac exchange factor 2 (PREX2) using the same immortalized human NRAS^G12D melanocytes as the original study. Evaluation of PREX2 expression in these newly generated stable cells revealed varying levels of expression among the PREX2 isoforms, which was also observed in the stable cells made in the original study (Figure S6A; Berger et al., 2012). Additionally, ectopically expressed PREX2 was found to be at least 5 times above endogenous PREX2 expression. The monitoring of tumor formation of these stable cells in vivo resulted in no statistically significant difference in tumor-free survival driven by PREX2 variants, whereas the original study reported that these PREX2 mutations increased the rate of tumor incidence compared to controls (Figure 3B and S6B; Berger et al., 2012). Surprisingly, the median tumor-free survival was 1 week in this replication attempt, while 70% of the control mice were reported to be tumor-free after 9 weeks in the original study. The rapid tumor onset observed in this replication attempt, compared to the original study, makes the detection of accelerated tumor growth in PREX2 expressing NRAS^G12D melanocytes extremely difficult. Finally, we report meta-analyses for each result.

Registered report: Systematic identification of genomic markers of drug sensitivity in cancer cells

The Reproducibility Project: Cancer Biology seeks to address growing concerns about the reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered Report describes the proposed replication plan of key experiments from “Systematic identification of genomic markers of drug sensitivity in cancer cells” by Garnett and colleagues, published in Nature in 2012 (Garnett et al., 2012). The experiments to be replicated are those reported in Figures 4C, 4E, 4F, and Supplemental Figures 16 and 20. Garnett and colleagues performed a high throughput screen assessing the effect of 130 drugs on 639 cancer-derived cell lines in order to identify novel interactions for possible therapeutic approaches. They then tested this approach by exploring in more detail a novel interaction they identified in which Ewing’s sarcoma cell lines showed an increased sensitivity to PARP inhibitors (Figure 4C). Mesenchymal progenitor cells (MPCs) transformed with the signature EWS-FLI1 translocation, the hallmark of Ewing’s sarcoma family tumors, exhibited increased sensitivity to the PARP inhibitor olaparib as compared to MPCs transformed with a different translocation (Figure 4E). Knockdown mediated by siRNA of EWS-FLI1 abrogated this sensitivity to olaparib (Figure 4F). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.13620.001

Registered report: Coding-independent regulation of the tumor suppressor PTEN by competing endogenous mRNAs

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered Report describes the proposed replication plan of key experiments from “Coding-Independent Regulation of the Tumor Suppressor PTEN by Competing Endogenous 'mRNAs' by Tay and colleagues, published in Cell in 2011 (Tay et al., 2011). The experiments to be replicated are those reported in Figures 3C, 3D, 3G, 3H, 5A and 5B, and in Supplemental Figures 3A and B. Tay and colleagues proposed a new regulatory mechanism based on competing endogenous RNAs (ceRNAs), which regulate target genes by competitive binding of shared microRNAs. They test their model by identifying and confirming ceRNAs that target PTEN. In Figure 3A and B, they report that perturbing expression of putative PTEN ceRNAs affects expression of PTEN. This effect is dependent on functional microRNA machinery (Figure 3G and H), and affects the pathway downstream of PTEN itself (Figures 5A and B). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.12470.001

Registered report: The common feature of leukemia-associated IDH1 and IDH2 mutations is a neomorphic enzyme activity converting alpha-ketoglutarate to 2-hydroxyglutarate

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered Report describes the proposed replication plan of key experiments from “The common feature of leukemia-associated IDH1 and IDH2 mutations is a neomorphic enzyme activity converting alpha-ketoglutarate to 2-hydroxyglutarate” by Ward and colleagues, published in Cancer Cell in 2010 (Ward et al., 2010). The experiments that will be replicated are those reported in Figures 2, 3 and 5. Ward and colleagues demonstrate the mutations in isocitrate dehydrogenase 2 (IDH2), commonly found in acute myeloid leukemia (AML), abrogate the enzyme’s wild-type activity and confer to the mutant neomorphic activity that produces the oncometabolite 2-hydroxyglutarate (2-HG) (Figures 2 and 3). They then show that elevated levels of 2-HG are correlated with mutations in IDH1 and IDH2 in AML patient samples (Figure 5). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.12626.001

Registered report: Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered Report describes the proposed replication plan of key experiments from 'Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma' by Castellarin and colleagues published in Genome Research in 2012 (Castellarin et al., 2012). The experiment to be replicated is reported in Figure 2. Here, Castellarin and colleagues performed a metagenomic analysis of colorectal carcinoma (CRC) to identify potential associations between inflammatory microorganisms and gastrointestinal cancers. They conducted quantitative real-time PCR on genomic DNA isolated from tumor and matched normal biopsies from a patient cohort and found that the overall abundance of Fusobacterium was 415 times greater in CRC versus adjacent normal tissue. These results confirmed earlier studies and provide evidence for a link between tissue-associated bacteria and tumorigenesis. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.10012.001

Registered report: Melanoma exosomes educate bone marrow progenitor cells toward a pro-metastatic phenotype through MET

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered Report describes the proposed replication plan of key experiments from “Melanoma exosomes educate bone marrow progenitor cells toward a pro-metastatic phenotype through MET” by Peinado and colleagues, published in Nature Medicine in 2012 (Peinado et al., 2012). The key experiments being replicated are from Figures 4E, as well as Supplementary Figures 1C and 5A. In these experiments, Peinado and colleagues show tumor exosomes enhance metastasis to bones and lungs, which is diminished by reducing Met expression in exosomes (Peinado et al., 2012). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.07383.001

Registered report: A coding-independent function of gene and pseudogene mRNAs regulates tumour biology

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered report describes the proposed replication plan of key experiments from ‘A coding-independent function of gene and pseudogene mRNAs regulates tumour biology’ by Poliseno et al. (2010), published in Nature in 2010. The key experiments to be replicated are reported in Figures 1D, 2F-H, and 4A. In these experiments, Poliseno and colleagues report microRNAs miR-19b and miR-20a transcriptionally suppress both PTEN and PTENP1 in prostate cancer cells (Figure 1D; Poliseno et al., 2010). Decreased expression of PTEN and/or PTENP1 resulted in downregulated PTEN protein levels (Figure 2H), downregulation of both mRNAs (Figure 2G), and increased tumor cell proliferation (Figure 2F; Poliseno et al., 2010). Furthermore, overexpression of the PTEN 3′ UTR enhanced PTENP1 mRNA abundance limiting tumor cell proliferation, providing additional evidence for the co-regulation of PTEN and PTENP1 (Figure 4A; Poliseno et al., 2010). The Reproducibility Project: Cancer Biology is collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.08245.001

Registered report: Inhibition of BET recruitment to chromatin as an effective treatment for MLL-fusion leukemia

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered report describes the proposed replication plan of key experiments from ‘Inhibition of bromodomain and extra terminal (BET) recruitment to chromatin as an effective treatment for mixed-lineage leukemia (MLL)-fusion leukemia’ by Dawson and colleagues, published in Nature in 2011 (Dawson et al., 2011). The experiments to be replicated are those reported in Figures 2A, 3D, 4B, 4D and Supplementary Figures 11A-B and 16A. In this study, BET proteins were demonstrated as potential therapeutic targets for modulating aberrant gene expression programs associated with MLL-fusion leukemia. In Figure 2A, the BET bromodomain inhibitor I-BET151 was reported to suppress growth of cells harboring MLL-fusions compared to those with alternate oncogenic drivers. In Figure 3D, treatment of MLL-fusion leukemia cells with I-BET151 resulted in transcriptional suppression of the anti-apoptotic gene BCL2. Figures 4B and 4D tested the therapeutic efficacy of I-BET151 in vivo using mice injected with human MLL-fusion leukemia cells and evaluated disease progression following I-BET151 treatment. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.08997.001

Registered report: Wnt activity defines colon cancer stem cells and is regulated by the microenvironment

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by replicating selected results from a substantial number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered report describes the proposed replication plan of key experiments from ‘Wnt activity defines colon cancer stem cells and is regulated by the microenvironment’ by Vermeulen and colleagues, published in Nature Cell Biology in 2010 (Vermeulen et al., 2010). The key experiments that will be replicated are those reported in Figures 2F, 6D, and 7E. In these experiments, Vermeulen and colleagues utilize a reporter for Wnt activity and show that colon cancer cells with high levels of Wnt activity also express cancer stem cell markers (Figure 2F; Vermeulen et al., 2010). Additionally, treatment either with conditioned medium derived from myofibroblasts or with hepatocyte growth factor restored clonogenic potential in low Wnt activity colon cancer cells in vitro (Figure 6D; Vermeulen et al., 2010) and in vivo (Figure 7E; Vermeulen et al., 2010). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.07301.001

Registered report: Oncometabolite 2-hydroxyglutarate is a competitive inhibitor of α-ketoglutarate-dependent dioxygenases

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of selected experiments from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012, were selected on the basis of citations and Altmetric scores (Errington et al., 2014). This Registered report describes the proposed replication plan of key experiments from 'Oncometabolite 2-hydroxyglutarate is a competitive inhibitor of α-ketoglutarate-dependent dioxygenases' by Xu and colleagues, published in Cancer Cell in 2011 (Xu et al., 2011). The key experiments being replicated include Supplemental Figure 3I, which demonstrates that transfection with mutant forms of IDH1 increases levels of 2-hydroxyglutarate (2-HG), Figures 3A and 8A, which demonstrate changes in histone methylation after treatment with 2-HG, and Figures 3D and 7B, which show that mutant IDH1 can effect the same changes as treatment with excess 2-HG. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

Registered report: Biomechanical remodeling of the microenvironment by stromal caveolin-1 favors tumor invasion and metastasis

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replicating selected results from a number of high-profile papers in the field of cancer biology. The papers, which were published between 2010 and 2012 were selected on the basis of citations and Altimetric scores (Errington et al., 2014). This Registered report describes the proposed replication plan of key experiments from ‘Biomechanical remodeling of the microenvironment by stromal caveolin-1 favors tumor invasion and metastasis’ by Goetz and colleagues, published in Cell in 2011 (Goetz et al., 2011). The key experiments being replicated are those reported in Figures 7C (a-d), Supplemental Figure S2A, and Supplemental Figure S7C (a-c) (Goetz et al., 2011). In these experiments, which are a subset of all the experiments reported in the original publication, Goetz and colleagues show in a subcutaneous xenograft model that stromal caveolin-1 remodels the intratumoral microenvironment, which is correlated with increased metastasis formation. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.04796.001

Registered report: BET bromodomain inhibition as a therapeutic strategy to target c-Myc

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by replicating selected results from a substantial number of high-profile papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from 'BET bromodomain inhibition as a therapeutic strategy to target c-Myc' by Delmore and colleagues, published in Cell in 2011 (Delmore et al., 2011). The key experiments that will be replicated are those reported in Figures 3B and 7C-E. Delmore and colleagues demonstrated that treatment with JQ1, a small molecular inhibitor targeting BET bromodomains, resulted in the transcriptional down-regulation of the c-Myc oncogene in vitro (Figure 3B; Delmore et al., 2011). To assess the therapeutic efficacy of JQ1 in vivo, mice bearing multiple myeloma (MM) lesions were treated with JQ1 before evaluation for tumor burden and overall survival. JQ1 treatment significantly reduced disease burden and increased survival time (Figure 7C-E; Delmore et al., 2011). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange and the results of the replications will be published in eLife.

Registered report: Interactions between cancer stem cells and their niche govern metastatic colonization

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by replicating selected results from a substantial number of high-profile papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from ‘Interactions between cancer stem cells and their niche govern metastatic colonization’ by Malanchi and colleagues, published in Nature in 2012 (Malanchi et al., 2012). The key experiments that will be replicated are those reported in Figures 2H, 3A, 3B, and S13. In these experiments, Malanchi and colleagues analyze messenger RNA levels of periostin (POSTN) in pulmonary fibroblasts, endothelial cells, and immune cells isolated from mice with micrometastases to determine which cell type is producing POSTN in the metastatic niche (Figure 2H; Malanchi et al., 2012). Additionally, they examine MMTV-PyMT control or POSTN null mice to test the effect of POSTN on primary tumor growth and metastasis (Figures 3A, 3B, and S13; Malanchi et al., 2012). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.06938.001

Registered report: Coadministration of a tumor-penetrating peptide enhances the efficacy of cancer drugs

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from ‘Coadministration of a tumor-penetrating peptide enhances the efficacy of cancer drugs’ by Sugahara and colleagues, published in Science in 2010 (Sugahara et al., 2010). The key experiments being replicated include Figure 2 and Supplemental Figure 9A. In Figure 2, Sugahara and colleagues presented data on the tumor penetrance of doxorubicin (DOX) when co-administered with the peptide iRGD, as well as the effect of co-treatment of DOX and iRGD on tumor weight and cell death. In Supplemental Figure 9A, they tracked body weight of mice treated with DOX and iRGD to provide evidence that iRGD does not increase known DOX toxicity. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.06959.001

Registered report: Discovery and preclinical validation of drug indications using compendia of public gene expression data

The Science Translational Medicine in 2011 (Sirota et al., 2011). The key experiments being replicated include Figure 4C and D and Supplemental Figure 1. In these figures, Sirota and colleagues. tested a proof of concept experiment validating their prediction that cimetidine, a histamine-2 (H2) receptor agonist commonly used to treat peptic ulcers (Kubecova et al., 2011), would be effective against lung adenocarcinoma (Figure 4C and D). As a control they also tested the effects of cimetidine against renal carcinoma, for which it was not predicted to be efficacious (Supplemental Figure 1). The Reproducibility Project: Cancer Biology is a collaboration between the eLife.

Registered report: Intestinal inflammation targets cancer-inducing activity of the microbiota

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from ‘Intestinal Inflammation Targets Cancer-Inducing Activity of the Microbiota’ by Arthur et al. (2012), published in Science in 2012. Arthur and colleagues identified a genotoxic island in Escherichia coli NC101 that appeared to be responsible for causing neoplastic lesions in inflammation-induced IL10^−/− mice treated with azoxymethane. The experiments that will be replicated are those reported in Figure 4 (Arthur et al., 2012). Arthur and colleagues inoculated IL10^−/− mice with a mutated strain of E. coli NC101 lacking the genotoxic island, and showed that those mice suffered from fewer neoplastic lesions than mice inoculated with the wild type form of E. coli NC101 (Figure 4). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.04186.001

Registered report: tumour vascularization via endothelial differentiation of glioblastoma stem-like cells

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from ‘Tumour vascularization via endothelial differentiation of glioblastoma stem-like cells’ by Ricci-Vitiani and colleagues, published in Nature in 2010 (Ricci-Vitiani et al., 2010). The experiments that will be replicated are those reported in Figure 4B and Supplementary Figure 10B (Ricci-Vitiani et al., 2010), which demonstrate that glioblastoma stem-like cells can derive into endothelial cells, and can be selectively ablated to reduce tumor progression in vivo, and Supplementary Figures S10C and S10D (Ricci-Vitiani et al., 2010), which demonstrate that fully differentiated glioblastoma cells cannot form functionally relevant endothelium. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.04363.001

Registered report: the CD47-signal regulated protein alpha (SIRPa) interaction is a therapeutic target for human solid tumors

The Willingham et al., 2012, published in PNAS in 2012. The key experiments being replicated are those reported in Figure 6A-C and Table S4. In these experiments, Willingham et al., 2012 test the safety and efficacy of anti-CD47 antibody treatment in immune competent mice utilizing a syngeneic model of mammary tumor growth in FVB mice. The Reproducibility Project: Cancer Biology is a collaboration between the eLife.

Registered report: senescence surveillance of pre-malignant hepatocytes limits liver cancer development

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from ‘Senescence surveillance of pre-malignant hepatocytes limits liver cancer development’ by Kang et al. (2011), published in Nature in 2011. The experiments that will be replicated are those reported in Figures 3B, 3C, 3E, and 4A. In these experiments, Kang et al. (2011) demonstrate the phenomenon of oncogene-induced cellular senescence and immune-mediated clearance of senescent cells after intrahepatic injection of NRAS (Figures 2I, 3B, 3C, and 3E). Additionally, Kang et al. (2011) show the specific necessity of CD4+ T cells for immunoclearance of senescent cells (Figure 4A). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.04105.001

Registered report: transcriptional amplification in tumor cells with elevated c-Myc

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered report describes the proposed replication plan of key experiments from ‘Transcriptional amplification in tumor cells with elevated c-Myc’ by Lin et al. (2012), published in Cell in 2012. The experiments that will be replicated are those reported in Figures 3E and 3F. In these experiments, elevated levels of c-Myc in the P493-6 cell model of Burkitt's lymphoma results in an increase of the total level of RNA using UV/VIS spectrophotometry (Figure 3E; Lin et al., 2012) and on the mRNA levels/cell for a large set of genes using digital gene expression technology (Figure 3F; Lin et al., 2012). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published in eLife.

DOI:http://dx.doi.org/10.7554/eLife.04024.001

Registered report: Widespread potential for growth factor-driven resistance to anticancer kinase inhibitors

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered Report describes the proposed replication plan of key experiments from "Widespread potential for growth-factor-driven resistance to anticancer kinase inhibitors" by Wilson and colleagues, published in Nature in 2012 (Wilson et al., 2012). The experiments that will be replicated are those reported in Figure 2B and C. In these experiments, Wilson and colleagues show that sensitivity to receptor tyrosine kinase (RTK) inhibitors can be bypassed by various ligands through reactivation of downstream signaling pathways (Figure 2A; Wilson et al., 2012), and that blocking the receptors for these bypassing ligands abrogates their ability to block sensitivity to the original RTK inhibitor (Figure 2C; Wilson et al., 2012). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

Registered report: Melanoma genome sequencing reveals frequent PREX2 mutations

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered Report describes the proposed replication plan of key experiments from ‘Melanoma genome sequencing reveals frequent PREX2 mutations’ by Berger and colleagues, published in Nature in 2012 (Berger et al., 2012). The key experiments that will be replicated are those reported in Figure 3B and Supplementary Figure S6. In these experiments, Berger and colleagues show that somatic PREX2 mutations identified through whole-genome sequencing of human melanoma can contribute to enhanced lethality of tumor xenografts in nude mice (Figure 3B, S6B, and S6C; Berger et al., 2012). The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.04180.001

Registered report: Tumour micro-environment elicits innate resistance to RAF inhibitors through HGF secretion

The Reproducibility Project: Cancer Biology seeks to address growing concerns about reproducibility in scientific research by conducting replications of 50 papers in the field of cancer biology published between 2010 and 2012. This Registered Report describes the proposed replication plan of key experiments from ‘Tumour micro-environment elicits innate resistance to RAF inhibitors through HGF secretion’ by Straussman and colleagues, published in Nature in 2012 (Straussman et al., 2012). The key experiments being replicated in this study are from Figure 2A, C, and D (and Supplemental Figure 11) and Figure 4C (and Supplemental Figure 19) (Straussman et al., 2012). Figure 2 demonstrates resistance to drug sensitivity conferred by co-culture with some stromal cell lines and identifies the secreted factor responsible as HGF. In Figure 4, Straussman and colleagues show that blocking the HGF receptor MET abrogates HGF’s rescue of drug sensitivity. The Reproducibility Project: Cancer Biology is a collaboration between the Center for Open Science and Science Exchange, and the results of the replications will be published by eLife.

DOI:http://dx.doi.org/10.7554/eLife.04034.001