External quality assessment (EQA) and alternative assessment procedures (AAPs) in molecular diagnostics: findings of an international survey

The development and implementation of a proficiency testing program for SARS-CoV-2 using dried tube specimens in resource-limited countries

INTRODUCTION

When COVID-19 hit the world in 2019, an enhanced focus on diagnostic testing for SARS-CoV-2 was essential for a successful pandemic response. Testing laboratories stretched their capabilities for the new coronavirus by adopting different test methods. The necessity of having external quality assurance (EQA) mechanisms was even more critical due to this rapid expansion. However, there was a lack of experience in providing the necessary SARS-CoV-2 EQA materials, especially in locations with constrained resources.

OBJECTIVE

We aimed to create a PT (Proficiency testing) programme based on the Dried Tube Specimens (DTS) method that would be a practical option for molecular based SARS-CoV-2 EQA in Low- and Middle-Income Countries.

METHODS

Based on previous ISO/IEC 17043:2010 accreditation experiences and with assistance from the US Centers for Disease Control and Prevention, The Supranational Reference Laboratory of Uganda (adapted the DTS sample preparation method and completed a pilot EQA program between 2020 and 2021. Stability and panel validation testing was conducted on the designed materials before shipping to pilot participants in six African countries. Participants received a panel containing five SARS-CoV-2 DTS samples, transported at ambient conditions. Results submitted by participants were compared to validation results. Participants were graded as satisfactory (≥ 80%) or unsatisfactory (< 80%) and performance reports disseminated.

RESULTS

Our SARS-CoV-2 stability experiments showed that SARS-CoV-2 RNA was stable (-15 to -25 °C, 4 to 8 °C, (18 to 28 °C) room temperature and 35 to 38 °C) as well as DTS panels (4 to 8 °C, 18 to 28 °C, 35 to 38 °C and 45 °C) for a period of 4 weeks. The SARS-CoV-2 DTS panels were successfully piloted in 35 test sites from Zambia, Malawi, Mozambique, Nigeria, and Seychelles. The pilot results of the participants showed good accuracy, with an average of 86% (30/35) concordance with the original SARS CoV-2 expectations.

CONCLUSION

The SARS-CoV-2 DTS PT panel is reliable, stable at ambient temperature, simple to prepare and requires minimal resources.

External quality assessment practices in medical laboratories: an IFCC global survey of member societies

OBJECTIVES

Clinical laboratory results are required for critical medical decisions, underscoring the importance of quality results. As part of total quality management, external quality assessment (EQA) is a vital component to ensure laboratory accuracy. The goal of this survey was to evaluate the current status of global laboratory quality systems and assess the need for implementation, expansion, or harmonization of EQA programs (EQAP) for Clinical Chemistry and Laboratory Medicine.

METHODS

The International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) Task Force on Global Laboratory Quality (TF-GLQ) conducted a survey of IFCC full and affiliate members (n=110) on laboratory quality practice. A total of 41 (37.3%) countries representing all IFCC regions except North America provided responses about EQA availability and practices.

RESULTS

All 41 countries perform EQA, 38 reported that their laboratories had EQA policies and procedures, and 39 further act/evaluate unacceptable EQA results. 39 countries indicated they have international and/or national EQAP and 30 use alternative performance assessments. EQA frequency varied among countries. Generally, an EQAP provided the EQA materials (40/41) with four countries indicating that they did not have an EQAP in their country.

CONCLUSIONS

Globally, most laboratories participate in an EQAP and have defined quality procedures for EQA. There remain gaps in EQA material availability and implementation of EQA as a part of a total laboratory quality system. This survey highlights the need for education, training, and harmonization and will guide efforts of the IFCC TF-GLQ in identifying areas for enhancing global laboratory quality practices.

Tumor BRCA testing in ovarian cancer and EQA scheme: our experience of a critical evaluation

Next generation sequencing (NGS) is a widespread molecular biology method integrated into clinical practice to detect genetic variants, for diagnostic and prognostic purposes. The scheduled external quality assessments (EQA) is integral part of clinical molecular laboratory quality assurance. The EQA provides an efficient system to compare analytic test performances among different laboratories, which is essential to evaluate consistency of molecular test. EQA failures demands targeted corrective action plans. In this context, the complexity of the NGS techniques requires careful and continuous quality control procedures. We report a tumor BRCA1/2 (tBRCA) testing benchmark discrepancy provided by the European Molecular Genetics Quality Network in our laboratory during a round of EQA for somatic mutation testing of BRCA genes in relation to ovarian cancer. The critical analysis emerging from the tBRCA EQA is presented. We underline that harmonization processes are still required for the EQA in the molecular biology field, especially if applied to the evaluation of methods characterized by high complexity.

External quality assessment in the absence of proficiency testing: A split-sample testing program experience

In the field of laboratory medicine, proficiency testing is a vehicle used to improve the reliability of reported results. When proficiency tests are unavailable for a given analyte, an alternative approach is required to ensure adherence to the International Organization for Standardization (ISO) 15189:2012 standard. In this study, we report the results of a split-sample testing program performed as an alternative to a formal PT. This testing method was based on recommendations provided in the Clinical and Laboratory Standards Institute (CLSI) QMS24 guideline. Two different laboratories measured, in duplicate, the heparan sulfate concentration in five samples using ultra-performance liquid chromatography and tandem mass spectrometry. The data analysis to determine the criterion used for the comparability assessment between the two laboratories was based on Appendix E of the QMS24 guideline. Mean interlaboratory differences fell within the maximum allowable differences calculated from the application of the QMS24 guideline, indicating that the results obtained by the two laboratories were comparable across the concentrations tested. Application of the QMS24 split-sample testing procedure allows laboratories to objectively assess test results, thus providing the evidence needed to face an accreditation audit with confidence. However, due to the limitations of statistical analyses in small samples (participants and/or materials), laboratory specialists should assess whether the maximum allowable differences obtained are suitable for the intended use, and make adjustments if necessary.

Current and future challenges in quality assurance in molecular diagnostics

The development and performance of molecular genetic assays has required increasingly complex quality assurance in recent years and continues to pose new challenges. Quality management officers, as well as academic and technical personnel are confronted with new molecular genetic parameters, methods, changing regulatory environments, questions regarding appropriate validation, and quality control for these innovative assays that are increasingly applying quantification and/or multiplex formats. Yet, quality assurance and quality control guidelines are still not widely available or in some circumstances have become outdated. For these reasons, the need for solutions to provide test confidence continues to grow. In order to integrate new test procedures into existing quality assurance measures, the ISO 15189 guideline can serve as an orientation. The ISO 15189 guideline describes requirements for medical laboratories and thus includes those performing molecular diagnostics. This article gives an overview of the possibilities and challenges in quality assurance of molecular parameters and shows possible solutions.

The Development of a Standardized Quality Assessment Material to Support Xpert® HIV-1 Viral Load Testing for ART Monitoring in South Africa

The tiered laboratory framework for human immunodeficiency virus (HIV) viral load monitoring accommodates a range of HIV viral load testing platforms, with quality assessment critical to ensure quality patient testing. HIV plasma viral load testing is challenged by the instability of viral RNA. An approach using an RNA stabilizing buffer is described for the Xpert^® HIV-1 Viral Load (Cepheid) assay and was tested in remote laboratories in South Africa. Plasma panels with known HIV viral titres were prepared in PrimeStore molecular transport medium for per-module verification and per-instrument external quality assessment. The panels were transported at ambient temperatures to 13 testing laboratories during 2017 and 2018, tested according to standard procedures and uploaded to a web portal for analysis. A total of 275 quality assessment specimens (57 verification panels and two EQA cycles) were tested. All participating laboratories met study verification criteria (n = 171 specimens) with an overall concordance correlation coefficient (ρ_c) of 0.997 (95% confidence interval (CI): 0.996 to 0.998) and a mean bias of −0.019 log copies per milliliter (cp/mL) (95% CI: −0.044 to 0.063). The overall EQA ρ_c (n = 104 specimens) was 0.999 (95% CI: 0.998 to 0.999), with a mean bias of 0.03 log cp/mL (95% CI: 0.02 to 0.05). These panels are suitable for use in quality monitoring of Xpert^® HIV-1 VL and are applicable to laboratories in remote settings.