Monitoring standards for molecular genetic testing in the United Kingdom, the Netherlands, and Ireland

Tumor BRCA testing in ovarian cancer and EQA scheme: our experience of a critical evaluation

Next generation sequencing (NGS) is a widespread molecular biology method integrated into clinical practice to detect genetic variants, for diagnostic and prognostic purposes. The scheduled external quality assessments (EQA) is integral part of clinical molecular laboratory quality assurance. The EQA provides an efficient system to compare analytic test performances among different laboratories, which is essential to evaluate consistency of molecular test. EQA failures demands targeted corrective action plans. In this context, the complexity of the NGS techniques requires careful and continuous quality control procedures. We report a tumor BRCA1/2 (tBRCA) testing benchmark discrepancy provided by the European Molecular Genetics Quality Network in our laboratory during a round of EQA for somatic mutation testing of BRCA genes in relation to ovarian cancer. The critical analysis emerging from the tBRCA EQA is presented. We underline that harmonization processes are still required for the EQA in the molecular biology field, especially if applied to the evaluation of methods characterized by high complexity.

Current and future challenges in quality assurance in molecular diagnostics

The development and performance of molecular genetic assays has required increasingly complex quality assurance in recent years and continues to pose new challenges. Quality management officers, as well as academic and technical personnel are confronted with new molecular genetic parameters, methods, changing regulatory environments, questions regarding appropriate validation, and quality control for these innovative assays that are increasingly applying quantification and/or multiplex formats. Yet, quality assurance and quality control guidelines are still not widely available or in some circumstances have become outdated. For these reasons, the need for solutions to provide test confidence continues to grow. In order to integrate new test procedures into existing quality assurance measures, the ISO 15189 guideline can serve as an orientation. The ISO 15189 guideline describes requirements for medical laboratories and thus includes those performing molecular diagnostics. This article gives an overview of the possibilities and challenges in quality assurance of molecular parameters and shows possible solutions.

Integrating quality control and external quality assurance

Effective management of clinical laboratories relies upon an understanding of Quality Control and External Quality Assurance principles. These processes, when applied effectively, reduce patient risk and drive quality improvement. In this Review, we will describe the purpose of QC and EQA and their role in identifying analytical and process error. The two concepts are linked, and we will illustrate that linkage. Some EQA providers offer far more than analytical surveillance. They facilitate training and education and extend quality improvement and identify areas where there is potential for patient harm into the pre-and post-analytical phases of the total testing process.

Second SPIDIA-DNA External Quality Assessment (EQA): Influence of pre-analytical phase of blood samples on genomic DNA quality

BACKGROUND

In order to develop evidence-based quality guidelines for the pre-analytical phase of blood samples used for DNA molecular testing, two pan-European External Quality Assessments (EQAs) were implemented within the European Commission funded project SPIDIA. Here we report the results of the 2nd SPIDIA EQA that has been implemented on the basis of the 1st DNA EQA with the inclusion of some stringent conditions related to blood storage temperature and time.

METHODS

SPIDIA facility sent to all the participants the same blood sample to be processed by their own procedure following SPIDIA suggestion for time and temperature storage. Evaluated genomic DNA (gDNA) quality parameters were: purity and yield by UV spectrophotometric analysis, PCR interferences by Kineret software and integrity by a dedicated algorithm.

RESULTS/CONCLUSIONS

188 applications have been collected from 26 European countries. A high variability of gDNA integrity was observed whereas purity, yield and PCR interferences had a narrow distribution within laboratories. A dedicated analysis on pre-analytical variables and the evaluated gDNA quality parameters showed that blood storage and DNA extraction procedures influence gDNA integrity. The performances of the participants were improved in comparison with the 1st SPIDIA-DNA EQA, probably due to adopted more stringent pre-analytical conditions.

Preparing compound heterozygous reference material using gene synthesis technology: a model of thrombophilic mutations

AIMS

The aim of our study is to present a novel approach for preparing a compound heterozygous reference material (hetRM) using gene synthesis technology with inverted insertion of wild-type and mutant fragments into a single cloning vector. Factor II (G20210A) and Factor V (G1691A Leiden) gene mutations were used as an experimental model.

METHODS

During the gene synthesis, DNA fragments were aligned in the following order: G1691 FV wild-type forward strain, G20210 FII wild-type forward strain, 1691A FV mutant reverse strain, 20210A FII mutant reverse strain. The complete chain was inserted into a pIDT SMART cloning vector and amplified in an E. coli competent strain. For assessing hetRM characteristics and commutability, we used real-time PCR with subsequent melting curve analysis, real-time PCR with hydrolysis probes, allele-specific amplification, reverse hybridization, and dideoxynucleotide DNA sequencing.

RESULT

All five methods yielded concordant results of DNA analysis of the hetRM. Differences in real-time PCR cycle threshold values after six-months of storage at -80 °C were not statistically significant from those obtained from freshly prepared hetRM aliquots, which is a good indication of their stability.

CONCLUSION

By applying the procedures of gene synthesis and cloning technology, we prepared and verified a model genetic reference material for FII G20210A and FV G1691A testing with a compound heterozygous genotype. The hetRM was stable, commutable, and available in large quantities and in a wide concentration range.

Current landscape and new paradigms of proficiency testing and external quality assessment for molecular genetics

CONTEXT

Participation in proficiency testing (PT) or external quality assessment (EQA) programs allows the assessment and comparison of test performance among different clinical laboratories and technologies. In addition to the approximately 2300 tests for individual genetic disorders, recent advances in technology have enabled the development of clinical tests that quickly and economically analyze the entire human genome. New PT/EQA approaches are needed to ensure the continued quality of these complex tests.

OBJECTIVES

To review the availability and scope of PT/EQA for molecular genetic testing for inherited conditions in Europe, Australasia, and the United States; to evaluate the successes and demonstrated value of available PT/EQA programs; and to examine the challenges to the provision of comprehensive PT/EQA posed by new laboratory practices and methodologies.

DATA SOURCES

The available literature on this topic was reviewed and supplemented with personal experiences of several PT/EQA providers.

CONCLUSIONS

Proficiency testing/EQA schemes are available for common genetic disorders tested in many clinical laboratories but are not available for most genetic tests offered by only one or a few laboratories. Provision of broad, method-based PT schemes, such as DNA sequencing, would allow assessment of many tests for which formal PT is not currently available. Participation in PT/EQA improves the quality of testing by identifying inaccuracies that laboratories can trace to errors in their testing processes. Areas of research and development to ensure that PT/EQA programs can meet the needs of new and evolving genetic tests and technologies are identified and discussed.

The Italian National External quality assessment program in molecular genetic testing: results of the VII round (2010-2011)

Since 2001 the Istituto Superiore di Sanità established a quality assurance programme for molecular genetic testing that covers four pathologies: Cystic Fibrosis (CF), Beta Thalassemia (BT), Fragile X Syndrome (FX), and Familial Adenomatous Polyposis Coli (APC). Since 2009 this activity is an institutional activity and participation is open to both public and private laboratories. Seven rounds have been performed until now and the eighth is in progress. Laboratories receive 4 DNA samples with mock clinical indications. They analyze the samples using their routine procedures. A panel of assessors review the raw data and the reports; all data are managed through a web utility. In 2010 the number of participants was 43, 17, 15, 5 for CF, BT, FX, APC schemes respectively. Genotyping results were correct in 96%, 98.5%, 100%, and 100% of CF, BT, FX, and APC samples, respectively. Interpretation was correct in 74%, 91%, 88%, and 60% of CF, BT, FX, and APC reports, respectively; however in most of them it was not complete but a referral to genetic counseling was given. Reports were satisfactory in more than 60% of samples in all schemes. This work presents the 2010 results in detail comparing our data with those from other European schemes.

Improvement of interpretation in cystic fibrosis clinical laboratory reports: longitudinal analysis of external quality assessment data

Participation in external quality assessment (EQA) is a key element of quality assurance in medical laboratories. In genetics EQA, both genotyping and interpretation are assessed. We aimed to analyse changes in the completeness of interpretation in clinical laboratory reports of the European cystic fibrosis EQA scheme and to investigate the effect of the number of previous participations, laboratory accreditation/certification status, setting and test volume. We distributed similar versions of mock clinical cases to eliminate the influence of the difficulty of the clinical question on interpretation performance: a cystic fibrosis patient (case 1) and a cystic fibrosis carrier (case 2). We then performed a retrospective longitudinal study of reports over a 6-year period from 298 participants for case 1 (2004, 2008, 2009) and from 263 participants for case 2 (2006, 2008, 2009). The number of previous participations had a positive effect on the interpretation score (P<0.0001), whereas the laboratory accreditation/certification status, setting and test volume had no effect. Completeness of interpretation improved over time. The presence of the interpretation element 'requirement for studying the parents to qualify the genotype' increased most (from 49% in 2004 to 93% in 2009). We still observed room for improvement for elements that concerned offering testing for familial mutations in relatives and prenatal/preimplantation diagnosis (16% and 24% omission, respectively, for case 1 in 2009). Overall, regular participation in external quality assessment contributes to improved interpretation in reports, with potential value for quality of care for patients and families by healthcare professionals involved in genetic testing.

The experience of 3 years of external quality assessment of preimplantation genetic diagnosis for cystic fibrosis

Preimplantation genetic diagnosis (PGD) was first performed over 20 years ago and has become an accepted part of genetic testing and assisted reproduction worldwide. The techniques and protocols necessary to carry out genetic testing at the single-cell level can be difficult to master and have been developed independently by the laboratories worldwide offering preimplantation testing. These factors indicated the need for an external quality assessment (EQA) scheme for monogenic disease PGD. Toward this end, the European Society for Human Reproduction and Embryology came together with United Kingdom National External Quality Assessment Services for Molecular Genetics, to create a pilot EQA scheme followed by practical EQA schemes for all interested parties. Here, we detail the development of the pilot scheme as well as development and findings from the practical (clinical) schemes that have followed. Results were generally acceptable and there was marked improvement in results and laboratory scores for those labs that participated in multiple schemes. Data from the first three schemes indicate that the EQA scheme is working as planned and has helped laboratories improve their techniques and result reporting. The EQA scheme for monogenic PGD will continue to be developed to offer assessment for other monogenic disorders.

Molecular diagnostics: harmonization through reference materials, documentary standards and proficiency testing

There is a great need for harmonization in nucleic acid testing for infectious disease and clinical genetics. The proliferation of assay methods, the number of targets for molecular diagnostics and the absence of standard reference materials contribute to variability in test results among laboratories. This article provides a comprehensive overview of reference materials, related documentary standards and proficiency testing programs. The article explores the relationships among these resources and provides necessary information for people practicing in this area that is not taught in formal courses and frequently is obtained on an ad hoc basis. The aim of this article is to provide helpful tools for molecular diagnostic laboratories.

Metastatic non-small-cell lung cancer: consensus on pathology and molecular tests, first-line, second-line, and third-line therapy: 1st ESMO Consensus Conference in Lung Cancer; Lugano 2010

The 1st ESMO Consensus Conference on lung cancer was held in Lugano, Switzerland on 21 and 22 May 2010 with the participation of a multidisciplinary panel of leading professionals in pathology and molecular diagnostics, medical oncology, surgical oncology and radiation oncology. Before the conference, the expert panel prepared clinically relevant questions concerning five areas: early and locally advanced non-small-cell lung cancer (NSCLC), first-line metastatic NSCLC, second-/third-line NSCLC, NSCLC pathology and molecular testing, and small-cell lung cancer to be addressed through discussion at the Consensus Conference. All relevant scientific literature for each question was reviewed in advance. During the Consensus Conference, the panel developed recommendations for each specific question. The consensus agreement on three of these areas: NSCLC pathology and molecular testing, the treatment of first-line, and second-line/third-line therapy in metastatic NSCLC are reported in this article. The recommendations detailed here are based on an expert consensus after careful review of published data. All participants have approved this final update.

Development and implementation of the quality control panel of RT-PCR and real-time RT-PCR for avian influenza A (H5N1) surveillance network in mainland China

BACKGROUND

Reverse transcription PCR (RT-PCR) and real time RT-PCR (rRT-PCR) have been indispensable methods for influenza surveillance, especially for determination of avian influenza. The movement of testing beyond reference lab introduced the need of quality control, including the implementation of an evaluation system for validating personal training and sample proficiency testing.

METHODS

We developed a panel with lysates of seasonal influenza virus (H1N1, H3N2 and B), serials of diluted H5N1 virus lysates, and in-vitro transcribed H5 hemaglutinin (HA) and an artificial gene RNAs for RT-PCR and rRT-PCR quality control assessment. The validations of stability and reproducibility were performed on the panel. Additionally, the panel was implemented to assess the detection capability of Chinese human avian influenza networks.

RESULTS

The panel has relatively high stability and good reproducibility demonstrated by kappa's tests. In the implementation of panel on Chinese human avian influenza networks, the results suggested that there were a relatively low number of discrepancies for both concise and reproducibility in Chinese avian influenza virus net works.

CONCLUSIONS

A quality control panel of RT-PCR and real-time RT-PCR for avian influenza A (H5N1) surveillance network was developed. An available statistical data, which are used to assess the detection capability of networks on avian influenza virus (H5N1), can be obtained relatively easily through implementation of the panel on networks.

Preparation and validation of the first WHO international genetic reference panel for Fragile X syndrome

Fragile X syndrome is the most common inherited form of mental retardation. It is caused by expansion of a trinucleotide (CGG)n repeat sequence in the 5' untranslated region of the FMR1 gene, resulting in promoter hypermethylation and suppression of FMR1 transcription. Additionally, pre-mutation alleles in carrier males and females may result in Fragile X tremor ataxia syndrome and primary ovarian insufficiency, respectively. Fragile X is one of the most commonly requested molecular genetic tests worldwide. Quality assessment schemes have identified a wide disparity in allele sizing between laboratories. It is therefore important that clinical laboratories have access to characterized reference materials (RMs) to aid accurate allele sizing and diagnosis. With this in mind, a panel of genotyping RMs for Fragile X syndrome has been developed, which should be stable over many years and available to all diagnostic laboratories. Immortalized cell lines were produced by Epstein-Barr virus transformation of lymphocytes from consenting patients. Genomic DNA was extracted in bulk and RM aliquots were freeze-dried in glass ampoules. Twenty-one laboratories from seventeen countries participated in a collaborative study to assess their suitability. Participants evaluated the samples (blinded, in triplicate) in their routine methods alongside in-house and commercial controls. The panel of five genomic DNA samples was endorsed by the European Society of Human Genetics and approved as an International Standard by the Expert Committee on Biological Standardization at the World Health Organization.

Impact of gene patents and licensing practices on access to genetic testing for long QT syndrome

Genetic testing for long QT syndrome exemplifies patenting and exclusive licensing with different outcomes at different times. Exclusive licensing from the University of Utah changed the business model from sole provider to two US providers of long QT syndrome testing. Long QT syndrome is associated with mutations in many genes, 12 of which are now tested by two competing firms in the United States, PGxHealth and GeneDx. Until 2009, PGxHealth was the sole provider, based largely on exclusive rights to patents from the University of Utah and elsewhere. University of Utah patents were initially licensed to DNA Sciences, whose patent rights were acquired by Genaissance, and then by Clinical Data, Inc., which owns PGxHealth. In 2002, DNA Sciences, Inc., "cleared the market" by sending cease-and-desist patent enforcement letters to university and reference laboratories offering long QT syndrome genetic testing. There was no test on the market for a 1- to 2-year period. From 2005-2008, most long QT syndrome-related patents were controlled by Clinical Data, Inc., and its subsidiary PGxHealth. Bio-Reference Laboratories, Inc., secured countervailing exclusive patent rights starting in 2006, also from the University of Utah, and broke the PGxHealth monopoly in early 2009, creating a duopoly for genetic testing in the United States and expanding the number of genes for which commercial testing is available from 5 to 12.

The Italian external quality control program for familial adenomatous polyposis of the colon: five years of experience

Familial adenomatous polyposis is a rare autosomal dominant inherited disease (incidence, 1/8000). More than 90% of families affected by familial adenomatous polyposis have a mutation in the tumor suppressor gene adenomatous polyposis coli (APC). Mutations in this gene are characterized by 100% penetrance, although there is a variation in phenotypic expression of the disease. According to a 2004 survey of the Italian Human Genetic Society, about 264 APC gene molecular genetic tests were performed by Italian laboratories per year. The Italian External Quality Assessment (IEQA), financially supported by the Ministry of Health and coordinated by the Istituto Superiore di Sanità, was started in 2000 to improve the quality of molecular genetic tests in Italy. In the frame of the IEQA, about 50% of public laboratories performing APC gene tests have been monitored. The number of responding public laboratories during the 5 years was 6, 7, 7, 7, and 5 from 2001 to 2006, respectively; on average, 96.3% of samples completely analyzed were correctly genotyped. Methods used by laboratories to detect mutation were direct sequencing, single-strand conformation polymorphism, protein truncation test, and denaturing high-performance liquid chromatography. Written reports were not homogeneous among laboratories, although a new form of written report was proposed to laboratories in 2004. It will be interesting to monitor the effects of the reporting model and the output of this educational action in the future.

Quality assurance in medical and public health genetics services: a systematic review

As genetic services grow in scope, issues of quality assessment in genetic services are emerging. These efforts are well developed for molecular and cytogenetic testing and laboratories, and newborn screening programs, but assessing quality in clinical services has lagged, perhaps owing to the small work force and the recent evolution from a few large training programs to multiple training sites. We surveyed the English language, peer-reviewed literature to summarize the knowledge-base of quality assessment of genetics services, organized into the tripartite categories of the Donabedian model of "structure," "process," and "outcome." MEDLINE searches from 1990 to July 2008, yielded 2,143 articles that addressed both "medical/genetic screening and counseling" and "quality indicators, control, and assurance." Of the 2,143 titles, 131 articles were extracted for in-depth analysis, and 55 were included in this review. Twenty-nine articles focused on structure, 19 on process, and seven on outcomes. Our review underscored the urgent need for a coherent model that will provide health care organizations with tools to assess, report, monitor, and improve quality. The structure, process, and outcomes domains that make up the quality framework provide a comprehensive lens through which to examine quality in medical genetics.

Variability in the use of CE-marked assays for in vitro diagnostics of CFTR gene mutations in European genetic testing laboratories

DNA diagnostics of genetic diseases increasingly shifts towards utilization of commercial assays. Cystic fibrosis (CF)-related DNA diagnostics were used as a model for a pilot survey of the variability in the utilization of qualitative CE-marked in vitro diagnostic (IVD) assays and the scale of their modification by end users. A structured questionnaire, developed in the context of the EuroGentest project, was distributed within the frame of the 2005 annual CF external quality assessment (EQA) scheme. Its aim was to evaluate the variability in the use of different CE-marked IVD assays in routine CF DNA diagnostics. Survey results were analysed and sequentially discussed with respective users and/or manufacturers. In total, 125 responses from EQA scheme participants were received. Almost half of the respondents modified manufacturer-recommended protocols. They also reported sporadic and/or recurrent problems with assay performance and genotyping of particular alleles. Nonetheless, only half of the respondents performed in-house verification before the implementation of the assay in clinical diagnostics and/or after modification of the recommended protocol. Results of this survey substantiate the importance of guidelines for proper verification of CE-marked IVD assays in DNA diagnostics, using CF as a model.

The Italian External Quality Assessment scheme for fragile x syndrome: the results of a 5-year survey

The Italian External Quality Assessment scheme for fragile X syndrome started in 2001 as an activity funded by the National Health System and coordinated by the National Institute of Public Health. The aim of this work is to present the data of 5 years (2001--2004 and 2006) of survey. The External Quality Assessment scheme was designed to cover the following points: (a) genotyping and (b) interpretation and reporting of results. Overall, the scheme covered about 65% of all Italian public laboratories. The average reporting of results was 91.6%, with an overall success rate of 76%. The rate of diagnostic errors observed was on average 5%. Inaccuracy in sizing of CGG repeats of normal and premutated alleles was reported. During the survey the proportion of laboratories using a Southern blotting, polymerase chain reaction, and ABI sizing kit in combination rose from 36.8% to 70.6%. The reports from laboratories showed incompleteness and considerable variations in expected outcomes. For this reason, in 2004 a model for written reports was introduced. In conclusion, these data underscore the need to participate in External Quality Assessment schemes as an educational resource to ensure quality in molecular genetic testing.

Discrepant DNA analysis in three patients with inherited arrhythmia: molecular genetic test results deserve a second glance

Molecular results provide a basis for diagnosis, risk assessment, medical management and genetic counseling. Unlike other areas of laboratory medicine, molecular genetic tests are rarely repeated. We describe three patients with suspected inherited arrhythmia in whom genetic testing was arranged via clinical and/or research laboratories. In all three instances, initial test results appeared falsely negative, with no deleterious mutations detected by various methodologies in selected long-QT or catecholaminergic polymorphic ventricular tachycardia-related genes. Discordant results emerged upon repeat analysis in separate laboratories. The cases highlight the importance of clinical judgment and assessment of genetic test results and methodology, in addition to the role of re-testing in molecular genetic medicine, particularly in the case of uninformative negative results.

Experience and outcome of 3 years of a European EQA scheme for genetic testing of the spinocerebellar ataxias

The European Molecular Genetics Quality Network (EMQN) has been organizing an external quality assessment (EQA) scheme for molecular genetic testing of trinucleotide repeat mutations in the spinocerebellar ataxias (SCAs) since 2004. DNA samples were validated by at least two independent labs and two different methods. Together with mock clinical case descriptions and requests for specific SCA gene analyses, these were sent to registered participants each year. Laboratories were asked to use their routine procedures and protocols. A panel of assessors reviewed the final returns, including genotype results and reports, to assess the quality of (1) genotyping and (2) interpretation and reporting. A description of methods and raw data were also requested and were very useful for the final analysis. Altogether, during 3 years, 239 reports were received from the laboratories. Overall genotype error rate ranged 1.1-5.2%, a significant cause of concern. Scores for interpretation and reporting also showed that there is still much room for progress, although performance has improved over this period of assessment. The consequences of suboptimal laboratory practices, genotyping errors and misdiagnosis and of incorrect or incomplete interpretation and reporting have wide implications for patient lives, as well as for health management and counselling of relatives. EQA schemes are an important part of quality assurance in molecular genetic laboratories, and their use should become a routine part of laboratory diagnostic practice. Current evidence shows also that it is important that laboratories participate on a yearly basis and that this becomes mandatory for reference laboratories.

External quality assessment of rapid prenatal detection of numerical chromosomal aberrations using molecular genetic techniques: 3 years experience

OBJECTIVES

Prenatal diagnosis using rapid molecular genetic techniques is now a widely used method for detecting the most prevalent chromosomal aneuploidies. The object of this work was to develop a methodology for delivering external quality assessment (EQA) appropriate to the needs of routine diagnostic testing laboratories.

METHODS

We have provided three rounds of EQA using 15 different samples over 3 years. The scheme has developed to assess both the genotyping accuracy of the results and the appropriateness of the clinical reports issued to the referring clinician.

RESULTS

Participation in the EQA scheme has increased from 9 to 27 laboratories from across Europe over the three sample distributions. All laboratories have used quantitative fluorescence-PCR (QF-PCR) to analyse these samples except for a sole participant in 2006 who used multiplex ligation-dependent probe amplification (MLPA). In total 265 samples have been distributed, of which four (1.5%) were not reported due to technical failures and one (0.4%) was reported incorrectly and must be regarded as a genotyping error.

CONCLUSIONS

We have demonstrated a significant and increasing demand for EQA in the rapid detection of aneuploidies in UK and other European laboratories. Using the methodologies described, we have had a very low rate of technical failures and demonstrated a high level of genotyping accuracy. However, the quality of the clinical reports was variable and suggestions are made for improvement.