Current landscape and new paradigms of proficiency testing and external quality assessment for molecular genetics

Precision cancer genome testing needs proficiency testing involving all stakeholders

To implement precision oncology, analytical validity as well as clinical validity and utility are important. However, proficiency testing (PT) to assess validity has not yet been systematically performed in Japan. To investigate the quality of next-generation sequencing (NGS) platforms and cancer genome testing prevalent in laboratories, we performed pilot PT using patient samples. We prepared genomic DNA from the cancer tissue and peripheral blood of 5 cancer patients and distributed these to 15 laboratories. Most participating laboratories successfully identified the pathogenic variants, except for two closely located KRAS variants and 25 bp delins in EGFR. Conversely, the EGFR L858R variant was successfully identified, and the allele frequency was similar for all the laboratories. A high DNA integrity number led to excellent depth and reliable NGS results. By conducting this pilot study using patient samples, we were able to obtain a glimpse of the current status of cancer genome testing at participating laboratories. To enhance domestic cancer genome testing, it is important to conduct local PT and to involve the parties concerned as organizers and participants.

Building up a clinical microbiota profiling: a quality framework proposal

Extensive characterization of the human microbiota has revealed promising relationships between microbial composition and health or disease, generating interest in biomarkers derived from microbiota profiling. However, microbiota complexity and technical challenges strongly influencing the results limit the generalization of microbiota profiling and question its clinical utility. In addition, no quality management scheme has been adapted to the specificities of microbiota profiling, notably due to the heterogeneity in methods and results. In this review, we discuss possible adaptation of classical quality management tools routinely used in diagnostic laboratories to microbiota profiling and propose a specific framework. Multiple quality controls are needed to cover all steps, from sampling to data processing. Standard operating procedures, primarily developed for wet lab analyses, must be adapted to the use of bioinformatic tools. Finally, requirements for test validation and proficiency testing must take into account expected discrepancies in results due to the heterogeneity of the processes. The proposed quality management framework should support the implementation of routine microbiota profiling by clinical laboratories to support patient care. Furthermore, its use in research laboratories would improve publication reproducibility as well as transferability of methods and results to routine practice.

Tumor BRCA testing in ovarian cancer and EQA scheme: our experience of a critical evaluation

Next generation sequencing (NGS) is a widespread molecular biology method integrated into clinical practice to detect genetic variants, for diagnostic and prognostic purposes. The scheduled external quality assessments (EQA) is integral part of clinical molecular laboratory quality assurance. The EQA provides an efficient system to compare analytic test performances among different laboratories, which is essential to evaluate consistency of molecular test. EQA failures demands targeted corrective action plans. In this context, the complexity of the NGS techniques requires careful and continuous quality control procedures. We report a tumor BRCA1/2 (tBRCA) testing benchmark discrepancy provided by the European Molecular Genetics Quality Network in our laboratory during a round of EQA for somatic mutation testing of BRCA genes in relation to ovarian cancer. The critical analysis emerging from the tBRCA EQA is presented. We underline that harmonization processes are still required for the EQA in the molecular biology field, especially if applied to the evaluation of methods characterized by high complexity.

Proficiency testing for bacterial whole genome sequencing in assuring the quality of microbiology diagnostics in clinical and public health laboratories

The adoption of whole genome sequencing (WGS) data over the past decade for pathogen surveillance, and decision-making for infectious diseases has rapidly transformed the landscape of clinical microbiology and public health. However, for successful transition to routine use of these techniques, it is crucial to ensure the WGS data generated meet defined quality standards for pathogen identification, typing, antimicrobial resistance detection and surveillance. Further, the ongoing development of these standards will ensure that the bioinformatic processes are capable of accurately identifying and characterising organisms of interest, and thereby facilitate the integration of WGS into routine clinical and public health laboratory setting. A pilot proficiency testing (PT) program for WGS of infectious agents was developed to facilitate widely applicable standardisation and benchmarking standards for WGS across a range of laboratories. The PT participating laboratories were required to generate WGS data from two bacterial isolates, and submit the raw data for independent bioinformatics analysis, as well as analyse the data with their own processes and answer relevant questions about the data. Overall, laboratories used a diverse range of bioinformatics tools and could generate and analyse high-quality data, either meeting or exceeding the minimum requirements. This pilot has provided valuable insight into the current state of genomics in clinical microbiology and public health laboratories across Australia. It will provide a baseline guide for the standardisation of WGS and enable the development of a PT program that allows an ongoing performance benchmark for accreditation of WGS-based test processes.

External Quality Assessment for Next-Generation Sequencing-Based HIV Drug Resistance Testing: Unique Requirements and Challenges

Over the past decade, there has been an increase in the adoption of next generation sequencing (NGS) technologies for HIV drug resistance (HIVDR) testing. NGS far outweighs conventional Sanger sequencing as it has much higher throughput, lower cost when samples are batched and, most importantly, significantly higher sensitivities for variants present at low frequencies, which may have significant clinical implications. Despite the advantages of NGS, Sanger sequencing remains the gold standard for HIVDR testing, largely due to the lack of standardization of NGS-based HIVDR testing. One important aspect of standardization includes external quality assessment (EQA) strategies and programs. Current EQA for Sanger-based HIVDR testing includes proficiency testing where samples are sent to labs and the performance of the lab conducting such assays is evaluated. The current methods for Sanger-based EQA may not apply to NGS-based tests because of the fundamental differences in their technologies and outputs. Sanger-based genotyping reports drug resistance mutations (DRMs) data as dichotomous, whereas NGS-based HIVDR genotyping also reports DRMs as numerical data (percent abundance). Here we present an overview of the need to develop EQA for NGS-based HIVDR testing and some unique challenges that may be encountered.

External quality assessment (EQA) and alternative assessment procedures (AAPs) in molecular diagnostics: findings of an international survey

Objectives

Quality management for clinical laboratories requires the establishment of internal procedures including standard operating procedures (SOPs), internal quality control (QC), validation of test results and quality assessment. External quality assessment (EQA) and alternativeassessment procedures (AAPs) are part of the quality hierarchy required for diagnostic testing. The International Organization for Standardization (ISO) document with requirements for conformance ISO 15189 and the Clinical and Laboratory Standards Institute document (CLSI) QMS24 require participation in EQA schemes and AAPs where applicable. The purpose of this study was to perform a global survey of EQA and AAPs for key procedures in molecular diagnostic laboratories.

Methods

The Committee for Molecular Diagnostics of the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC C-MD) conducted a survey of international molecular laboratories that covered specific topics of molecular diagnostic services as well as methods for EQA and AAPs. The survey addressed the following aspects: (1) usage of laboratory-developed test (LDT), (2) participation in EQA schemes and (3) performance of AAPs.

Results

A total of 93 responses from laboratories located in Asia, Europe, the Middle East, North America and South America were received. The majority of the participating laboratories (65.9%) use LDTs and 81.3% stated that it is mandatory for them to participate in EQA programs, while 22% of the laboratories reported not performing AAPs. Thirty-one percent of the laboratories use EQAs for fewer than 50.0% of their reported parameters/analytes.

Conclusions

While the majority of laboratories perform EQA and AAPs to improve their quality in molecular diagnostics, the amount of AAPs as quality procedures differs within the laboratories. Further surveys are necessary to clarify the existing needs in additional EQAs and standardized AAPs. The survey will also guide future efforts of the IFCC C-MD for identifying quality practices in need to improve harmonization and standardization within molecular diagnostics.

The reliable assurance of detecting somatic mutations in cancer-related genes by next-generation sequencing: the results of external quality assessment in China

To evaluate the proficiencies of laboratories utilizing next-generation sequencing (NGS) to detect somatic mutations in cancer-related genes, an external quality assessment (EQA) was implemented by the National Center for Clinical Laboratories of China in 2015. We prepared a panel of samples that comprised eight samples made by mixing synthetic mutated DNA fragments with normal human genomic DNA and one reference sample containing only genomic DNA. We validated our sample panel, and then distributed it to laboratories across China. We received complete results from 64 laboratories. The performances of 51.6 % (33/64) respondent labs were acceptable and 26.6 % (17/64) of the labs returned perfect results. In total, 449 mistakes were reported, including 201 false-negatives (201/449, 44.8 %) and 222 false-positives (222/449, 49.4 %) and 26 slightly discordant results (26/449, 5.8 %). We believe these unsatisfactory results and varied performances are mainly due to the enrichment methods used, the diverse sequencing chemistries of the different NGS platforms, and other errors within the sequencing process. The results indicate that our sample panel is suitable for use in EQA studies, and that further laboratory training in targeted NGS testing is urgently required. To address this, we propose a targeted NGS workflow with details on quality assurance procedures according to the current guidelines.

Reliability and performance of commercial RNA and DNA extraction kits for FFPE tissue cores

Cancer biomarker studies often require nucleic acid extraction from limited amounts of formalin-fixed, paraffin-embedded (FFPE) tissues, such as histologic sections or needle cores. A major challenge is low quantity and quality of extracted nucleic acids, which can limit our ability to perform genetic analyses, and have a significant influence on overall study design. This study was aimed at identifying the most reliable and reproducible method of obtaining sufficient high-quality nucleic acids from FFPE tissues. We compared the yield and quality of nucleic acids from 0.6-mm FFPE prostate tissue cores across 16 DNA and RNA extraction protocols, using 14 commercially available kits. Nucleic acid yield was determined by fluorometry, and quality was determined by spectrophotometry. All protocols yielded nucleic acids in quantities that are compatible with downstream molecular applications. However, the protocols varied widely in the quality of the extracted RNA and DNA. Four RNA and five DNA extraction protocols, including protocols from two kits for dual-extraction of RNA and DNA from the same tissue source, were prioritized for further quality assessment based on the yield and purity of their products. Specifically, their compatibility with downstream reactions was assessed using both NanoString nCounter gene expression assays and reverse-transcriptase real-time PCR for RNA, and methylation-specific PCR assays for DNA. The kit deemed most suitable for FFPE tissue was the AllPrep kit by Qiagen because of its yield, quality, and ability to purify both RNA and DNA from the same sample, which would be advantageous in biomarker studies.

Molecular Biomarkers for the Evaluation of Colorectal Cancer: Guideline From the American Society for Clinical Pathology, College of American Pathologists, Association for Molecular Pathology, and American Society of Clinical Oncology

OBJECTIVES

- To develop evidence-based guideline recommendations through a systematic review of the literature to establish standard molecular biomarker testing of colorectal cancer (CRC) tissues to guide epidermal growth factor receptor (EGFR) therapies and conventional chemotherapy regimens.

METHODS

- The American Society for Clinical Pathology, College of American Pathologists, Association for Molecular Pathology, and American Society of Clinical Oncology convened an expert panel to develop an evidence-based guideline to establish standard molecular biomarker testing and guide therapies for patients with CRC. A comprehensive literature search that included more than 4,000 articles was conducted.

RESULTS

- Twenty-one guideline statements were established.

CONCLUSIONS

- Evidence supports mutational testing for EGFR signaling pathway genes, since they provide clinically actionable information as negative predictors of benefit to anti-EGFR monoclonal antibody therapies for targeted therapy of CRC. Mutations in several of the biomarkers have clear prognostic value. Laboratory approaches to operationalize CRC molecular testing are presented.

Guidelines for Validation of Next-Generation Sequencing-Based Oncology Panels: A Joint Consensus Recommendation of the Association for Molecular Pathology and College of American Pathologists

Next-generation sequencing (NGS) methods for cancer testing have been rapidly adopted by clinical laboratories. To establish analytical validation best practice guidelines for NGS gene panel testing of somatic variants, a working group was convened by the Association of Molecular Pathology with liaison representation from the College of American Pathologists. These joint consensus recommendations address NGS test development, optimization, and validation, including recommendations on panel content selection and rationale for optimization and familiarization phase conducted before test validation; utilization of reference cell lines and reference materials for evaluation of assay performance; determining of positive percentage agreement and positive predictive value for each variant type; and requirements for minimal depth of coverage and minimum number of samples that should be used to establish test performance characteristics. The recommendations emphasize the role of laboratory director in using an error-based approach that identifies potential sources of errors that may occur throughout the analytical process and addressing these potential errors through test design, method validation, or quality controls so that no harm comes to the patient. The recommendations contained herein are intended to assist clinical laboratories with the validation and ongoing monitoring of NGS testing for detection of somatic variants and to ensure high quality of sequencing results.

Molecular Biomarkers for the Evaluation of Colorectal Cancer

Objectives: To develop evidence-based guideline recommendations through a systematic review of the literature to establish standard molecular biomarker testing of colorectal cancer (CRC) tissues to guide epidermal growth factor receptor (EGFR) therapies and conventional chemotherapy regimens. Methods: The American Society for Clinical Pathology, College of American Pathologists, Association for Molecular Pathology, and American Society of Clinical Oncology convened an expert panel to develop an evidence-based guideline to establish standard molecular biomarker testing and guide therapies for patients with CRC. A comprehensive literature search that included more than 4,000 articles was conducted. Results: Twenty-one guideline statements were established. Conclusions: Evidence supports mutational testing for EGFR signaling pathway genes, since they provide clinically actionable information as negative predictors of benefit to anti-EGFR monoclonal antibody therapies for targeted therapy of CRC. Mutations in several of the biomarkers have clear prognostic value. Laboratory approaches to operationalize CRC molecular testing are presented.

Molecular Biomarkers for the Evaluation of Colorectal Cancer: Guideline From the American Society for Clinical Pathology, College of American Pathologists, Association for Molecular Pathology, and American Society of Clinical Oncology

OBJECTIVES

To develop evidence-based guideline recommendations through a systematic review of the literature to establish standard molecular biomarker testing of colorectal cancer (CRC) tissues to guide epidermal growth factor receptor (EGFR) therapies and conventional chemotherapy regimens.

METHODS

The American Society for Clinical Pathology, College of American Pathologists, Association for Molecular Pathology, and American Society of Clinical Oncology convened an expert panel to develop an evidence-based guideline to establish standard molecular biomarker testing and guide therapies for patients with CRC. A comprehensive literature search that included more than 4,000 articles was conducted.

RESULTS

Twenty-one guideline statements were established.

CONCLUSIONS

Evidence supports mutational testing for EGFR signaling pathway genes, since they provide clinically actionable information as negative predictors of benefit to anti-EGFR monoclonal antibody therapies for targeted therapy of CRC. Mutations in several of the biomarkers have clear prognostic value. Laboratory approaches to operationalize CRC molecular testing are presented. Key Words: Molecular diagnostics; Gastrointestinal; Histology; Genetics; Oncology.

Development and Characterization of Reference Materials for Genetic Testing: Focus on Public Partnerships

Characterized reference materials (RMs) are needed for clinical laboratory test development and validation, quality control procedures, and proficiency testing to assure their quality. In this article, we review the development and characterization of RMs for clinical molecular genetic tests. We describe various types of RMs and how to access and utilize them, especially focusing on the Genetic Testing Reference Materials Coordination Program (Get-RM) and the Genome in a Bottle (GIAB) Consortium. This review also reinforces the need for collaborative efforts in the clinical genetic testing community to develop additional RMs.

Molecular Biomarkers for the Evaluation of Colorectal Cancer: Guideline From the American Society for Clinical Pathology, College of American Pathologists, Association for Molecular Pathology, and the American Society of Clinical Oncology

Purpose Molecular testing of colorectal cancers (CRCs) to improve patient care and outcomes of targeted and conventional therapies has been the center of many recent studies, including clinical trials. Evidence-based recommendations for the molecular testing of CRC tissues to guide epidermal growth factor receptor (EGFR) -targeted therapies and conventional chemotherapy regimens are warranted in clinical practice. The purpose of this guideline is to develop evidence-based recommendations to help establish standard molecular biomarker testing for CRC through a systematic review of the literature. Methods The American Society for Clinical Pathology (ASCP), College of American Pathologists (CAP), Association for Molecular Pathology (AMP), and the American Society of Clinical Oncology (ASCO) convened an Expert Panel to develop an evidence-based guideline to help establish standard molecular biomarker testing, guide targeted therapies, and advance personalized care for patients with CRC. A comprehensive literature search that included over 4,000 articles was conducted to gather data to inform this guideline. Results Twenty-one guideline statements (eight recommendations, 10 expert consensus opinions and three no recommendations) were established. Recommendations Evidence supports mutational testing for genes in the EGFR signaling pathway, since they provide clinically actionable information as negative predictors of benefit to anti-EGFR monoclonal antibody therapies for targeted therapy of CRC. Mutations in several of the biomarkers have clear prognostic value. Laboratory approaches to operationalize molecular testing for predictive and prognostic molecular biomarkers involve selection of assays, type of specimens to be tested, timing of ordering of tests and turnaround time for testing results. Additional information is available at: www.asco.org/CRC-markers-guideline and www.asco.org/guidelineswiki.

In Silico Proficiency Testing for Clinical Next-Generation Sequencing

Quality assurance for clinical next-generation sequencing (NGS)-based assays is difficult given the complex methods and the range of sequence variants such assays can detect. As the number and range of mutations detected by clinical NGS assays has increased, it is difficult to apply standard analyte-specific proficiency testing (PT). Most current proficiency testing challenges for NGS are methods-based PT surveys that use DNA from reference samples engineered to harbor specific mutations that test both sequence generation and bioinformatics analysis. These methods-based PTs are limited by the number and types of mutations that can be physically introduced into a single DNA sample. In silico proficiency testing, which evaluates only the bioinformatics component of NGS assays, is a recently introduced PT method that allows for evaluation of numerous mutations spanning a range of variant classes. In silico PT data sets can be generated from simulated or actual sequencing data and are used to test alignment through variant detection and annotation steps. In silico PT has several advantages over the use of physical samples, including greater flexibility in tested variants, the ability to design laboratory-specific challenges, and lower costs. Herein, we review the use of in silico PT as an alternative to traditional methods-based PT as it is evolving in oncology applications and discuss how the approach is applicable more broadly.

Chromosome microarray proficiency testing and analysis of quality metric data trends through an external quality assessment program for Australasian laboratories

Chromosome microarrays are an essential tool for investigation of copy number changes in children with congenital anomalies and intellectual deficit. Attempts to standardise microarray testing have focused on establishing technical and clinical quality criteria, however external quality assessment programs are still needed. We report on a microarray proficiency testing program for Australasian laboratories. Quality metrics evaluated included analytical accuracy, result interpretation, report completeness, and laboratory performance data: sample numbers, success and abnormality rate and reporting times. Between 2009 and 2014 nine samples were dispatched with variable results for analytical accuracy (30-100%), correct interpretation (32-96%), and report completeness (30-92%). Laboratory performance data (2007-2014) showed an overall mean success rate of 99.2% and abnormality rate of 23.6%. Reporting times decreased from >90 days to <30 days for normal results and from >102 days to <35 days for abnormal results. Data trends showed a positive correlation with improvement for all these quality metrics, however only 'report completeness' and reporting times reached statistical significance. Whether the overall improvement in laboratory performance was due to participation in this program, or from accumulated laboratory experience over time, is not clear. Either way, the outcome is likely to assist referring clinicians and improve patient care.

Assuring the Quality of Next-Generation Sequencing in Clinical Microbiology and Public Health Laboratories

Clinical microbiology and public health laboratories are beginning to utilize next-generation sequencing (NGS) for a range of applications. This technology has the potential to transform the field by providing approaches that will complement, or even replace, many conventional laboratory tests. While the benefits of NGS are significant, the complexities of these assays require an evolving set of standards to ensure testing quality. Regulatory and accreditation requirements, professional guidelines, and best practices that help ensure the quality of NGS-based tests are emerging. This review highlights currently available standards and guidelines for the implementation of NGS in the clinical and public health laboratory setting, and it includes considerations for NGS test validation, quality control procedures, proficiency testing, and reference materials.

Molecular digital pathology: progress and potential of exchanging molecular data

Many of the demands to perform next generation sequencing (NGS) in the clinical laboratory can be resolved using the principles of telepathology. Molecular telepathology can allow facilities to outsource all or a portion of their NGS operation such as cloud computing, bioinformatics pipelines, variant data management, and knowledge curation. Clinical pathology laboratories can electronically share diverse types of molecular data with reference laboratories, technology service providers, and/or regulatory agencies. Exchange of electronic molecular data allows laboratories to perform validation of rare diseases using foreign data, check the accuracy of their test results against benchmarks, and leverage in silico proficiency testing. This review covers the emerging subject of molecular telepathology, describes clinical use cases for the appropriate exchange of molecular data, and highlights key issues such as data integrity, interoperable formats for massive genomic datasets, security, malpractice and emerging regulations involved with this novel practice.

A Model Study of In Silico Proficiency Testing for Clinical Next-Generation Sequencing

CONTEXT

-Most current proficiency testing challenges for next-generation sequencing assays are methods-based proficiency testing surveys that use DNA from characterized reference samples to test both the wet-bench and bioinformatics/dry-bench aspects of the tests. Methods-based proficiency testing surveys are limited by the number and types of mutations that either are naturally present or can be introduced into a single DNA sample.

OBJECTIVE

-To address these limitations by exploring a model of in silico proficiency testing in which sequence data from a single well-characterized specimen are manipulated electronically.

DESIGN

-DNA from the College of American Pathologists reference genome was enriched using the Illumina TruSeq and Life Technologies AmpliSeq panels and sequenced on the MiSeq and Ion Torrent platforms, respectively. The resulting data were mutagenized in silico and 26 variants, including single-nucleotide variants, deletions, and dinucleotide substitutions, were added at variant allele fractions (VAFs) from 10% to 50%. Participating clinical laboratories downloaded these files and analyzed them using their clinical bioinformatics pipelines.

RESULTS

-Laboratories using the AmpliSeq/Ion Torrent and/or the TruSeq/MiSeq participated in the 2 surveys. On average, laboratories identified 24.6 of 26 variants (95%) overall and 21.4 of 22 variants (97%) with VAFs greater than 15%. No false-positive calls were reported. The most frequently missed variants were single-nucleotide variants with VAFs less than 15%. Across both challenges, reported VAF concordance was excellent, with less than 1% median absolute difference between the simulated VAF and mean reported VAF.

CONCLUSIONS

-The results indicate that in silico proficiency testing is a feasible approach for methods-based proficiency testing, and demonstrate that the sensitivity and specificity of current next-generation sequencing bioinformatics across clinical laboratories are high.

Applying Ancestry and Sex Computation as a Quality Control Tool in Targeted Next-Generation Sequencing

OBJECTIVES

To apply techniques for ancestry and sex computation from next-generation sequencing (NGS) data as an approach to confirm sample identity and detect sample processing errors.

METHODS

We combined a principal component analysis method with k-nearest neighbors classification to compute the ancestry of patients undergoing NGS testing. By combining this calculation with X chromosome copy number data, we determined the sex and ancestry of patients for comparison with self-report. We also modeled the sensitivity of this technique in detecting sample processing errors.

RESULTS

We applied this technique to 859 patient samples with reliable self-report data. Our k-nearest neighbors ancestry screen had an accuracy of 98.7% for patients reporting a single ancestry. Visual inspection of principal component plots was consistent with self-report in 99.6% of single-ancestry and mixed-ancestry patients. Our model demonstrates that approximately two-thirds of potential sample swaps could be detected in our patient population using this technique.

CONCLUSIONS

Patient ancestry can be estimated from NGS data incidentally sequenced in targeted panels, enabling an inexpensive quality control method when coupled with patient self-report.

The homogeneous mutation status of a 22 gene panel justifies the use of serial sections of colorectal cancer tissue for external quality assessment

Testing for treatment related biomarkers in clinical care, like Ras mutation status in colorectal cancer (CRC), has increased drastically over recent years. Reliable testing of these markers is pivotal for optimal treatment of patients. Participation in external quality assessment (EQA) programs is an important element in quality management and often obligatory to comply with regulations or for accreditation. Formalin-fixed paraffin-embedded (FFPE) clinical specimens would ideally form the basis for these assessments, as they represent the most common starting material for molecular testing. However, molecular heterogeneity of a lesion in a FFPE tissue block could potentially affect test results of participating laboratories, which might compromise reliability of the quality assessment results. To assess the actual impact of this potential problem, we determined the mutation status of 22 genes commonly mutated in colon cancer in four levels covering 360 μm of 30 FFPE tissue blocks, by Next Generation Sequencing. In each block, the genotype of these genes was identical at all four levels, with only little variation in mutation load. This result shows that the mutation status of the selected 22 genes in CRC specimens is homogeneous within a 360 μm segment of the tumor. These data justify the use of serial sections, within a defined segment of a CRC tissue block, for external quality assessment of mutation analysis.

Variation in pre-PCR processing of FFPE samples leads to discrepancies in BRAF and EGFR mutation detection: a diagnostic RING trial

Aims

Mutation detection accuracy has been described extensively; however, it is surprising that pre-PCR processing of formalin-fixed paraffin-embedded (FFPE) samples has not been systematically assessed in clinical context. We designed a RING trial to (i) investigate pre-PCR variability, (ii) correlate pre-PCR variation with EGFR/BRAF mutation testing accuracy and (iii) investigate causes for observed variation.

Methods

13 molecular pathology laboratories were recruited. 104 blinded FFPE curls including engineered FFPE curls, cell-negative FFPE curls and control FFPE tissue samples were distributed to participants for pre-PCR processing and mutation detection. Follow-up analysis was performed to assess sample purity, DNA integrity and DNA quantitation.

Results

Rate of mutation detection failure was 11.9%. Of these failures, 80% were attributed to pre-PCR error. Significant differences in DNA yields across all samples were seen using analysis of variance (p<0.0001), and yield variation from engineered samples was not significant (p=0.3782). Two laboratories failed DNA extraction from samples that may be attributed to operator error. DNA extraction protocols themselves were not found to contribute significant variation. 10/13 labs reported yields averaging 235.8 ng (95% CI 90.7 to 380.9) from cell-negative samples, which was attributed to issues with spectrophotometry. DNA measurements using Qubit Fluorometry demonstrated a median fivefold overestimation of DNA quantity by Nanodrop Spectrophotometry. DNA integrity and PCR inhibition were factors not found to contribute significant variation.

Conclusions

In this study, we provide evidence demonstrating that variation in pre-PCR steps is prevalent and may detrimentally affect the patient's ability to receive critical therapy. We provide recommendations for preanalytical workflow optimisation that may reduce errors in down-stream sequencing and for next-generation sequencing library generation.

Implementation of a companion diagnostic in the clinical laboratory: the BRAF example in melanoma

A companion diagnostic test provides information that is essential for the safe and effective use of a corresponding therapeutic product as indicated in the drug instructions. The implementation of a companion diagnostic follows the rules of a molecular test for somatic mutations in a routine clinical laboratory environment and needs guidance on practical aspects, including the choice of the proper analytical method and the procedures for internal and external quality controls. Selection of the appropriate assay for detection of genetic alterations depends on several factors: the type of mutation under study, the sample to be assayed and its preparation procedure. In addition, the results of a molecular assay require a complex interpretation process of the analytical data as the patient's genotype, the translation of the identified variant into a predicted phenotype and knowledge on restrictions of the method used. In relation to these aspects herein we report an opinion paper of the Working Group Personalized Laboratory Medicine jointly constituted by the European Federation of Laboratory Medicine (EFLM) and by the European Society of Pharmacogenomics and Theranostics (ESPT) using, as an example, the BRAF genotype analysis in tumor tissue samples for identification of melanoma patients that can benefit treatment with BRAF inhibitors. The manuscript is focused on the following aspects: i) medical rationale, ii) methodologies of analysis, iii) laboratory performance evaluation and iv) the laboratory specific report for the clinicians. The critical evaluation of these aspects would be useful for the implementation of a companion diagnostic in the clinical laboratory.

Methods-based proficiency testing in molecular genetic pathology

This Perspectives article describes methods-based proficiency testing (MBPT), the benefits and limitations of MBPT, why the time is right for MBPT in molecular diagnostics, and how MBPT for next-generation sequencing is being developed by the College of American Pathologists.