Nationwide External Quality Assessment of SARS-CoV-2 Molecular Testing, South Korea

External quality assessment survey for SARS-CoV-2 nucleic acid amplification tests in clinical laboratories in Tokyo, 2021

INTRODUCTION

Nucleic acid amplification tests (NAATs) play a pivotal role in clinical laboratories for diagnosing COVID-19. This study aimed to elucidate the accuracy of these tests.

METHODS

In 2021, an external quality assessment of NAATs for SARS-CoV-2 was conducted in 47 laboratories in Tokyo, Japan. In open testing, where the laboratories knew that the samples were intended for the survey, a simulated nasopharyngeal swab suspension sample was used, featuring a positive sample A with a viral concentration of 50 copies/μL, positive sample B with 5 copies/μL, and a negative sample. Laboratories employing real-time RT-PCR were required to report cycle threshold (Ct) values. In blind testing, where the samples were processed as normal test samples, a positive sample C with 50 copies/μL was prepared using a simulated saliva sample.

RESULTS

Of the 47 laboratories, 41 were engaged in open testing. For sample A, all 41 laboratories yielded positive results, whereas for sample B, 36 laboratories reported positive results, 3 laboratories reported "test decision pending", 1 laboratory reported "suspected positive", and 1 laboratory did not respond. All 41 laboratories correctly identified the negative samples as negative. The mean Ct values were 32.2 for sample A and 35.2 for sample B. In the blind test, six laboratories received samples. Sample C was identified as positive by five laboratories and negative by one laboratory.

CONCLUSIONS

The nature of the specimen, specifically the saliva, may have influenced the blind test outcomes. The identified issues must be meticulously investigated and rectified to ensure accurate results.

External Quality Assessment Program for SARS-COV-2 Molecular Detection in Pakistan

INTRODUCTION

Amid coronavirus disease 2019 (COVID-19) pandemic, accurate detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is critical for diagnosis management and breaking down transmission chains. We designed a national external quality assessment panel (EQAP) for SARS-CoV-2 molecular detection comprising working laboratories nationwide.

METHODS

A molecular diagnostic EQA panel that consists of five samples for SARS CoV-2 testing was distributed to 141 public and private sector laboratories across country. These samples contain different concentrations of SARS-CoV-2 to evaluate the sensitivity of commercial kits available.

RESULTS

Sensitivity among public and private sector laboratories was variable, particularly lower SARS-CoV-2 concentrations significantly increased the risk of false-negative tests, whereas Ct values of accurately tested SARS-CoV-2 specimens increased as concentration decreased. These findings highlighted that performance of used commercial kits was not significantly correlated to various extraction or PCR methods.

CONCLUSION

This study highlights the need for a national external quality assessment panel (EQAP) in the country to improve the quality of the healthcare system while ensuring the accuracy and reliability of results. Furthermore, EQAPs can help laboratories meet accreditation and regulatory requirements. However, continued participation in EQAP is recommended for quality enhancement of laboratories.

Current status of pathogen handling in European laboratories: focus on viral inactivation process

For handling safely infectious agents, European laboratories must comply with specific EC Directives, national regulations and recommendations from the World Health Organization (WHO). To prevent laboratory acquired infections (LAIs) and pathogens dissemination, a key biosafety rule requires that any infectious material (clinical specimens or research samples) manipulated outside a biosafety cabinet (BSC) must be inactivated unless the lack of infectivity is proven. This inactivation process is a crucial step for biosafety and must be guided by a rigorous experimental qualification and validation procedure. However, for diagnostic or research laboratories, this process is not harmonized with common standard operation procedures (SOPs) but based on individual risk assessment and general international guidelines which can pose problems in emergency situations such as major outbreaks or pandemics. This review focuses on viral inactivation method, outlining the current regulatory framework, its limitations and a number of ways in which biosafety can be improved.

External Quality Assessment (EQA) for SARS-CoV-2 RNA Point-of-Care Testing in Primary Healthcare Services: Analytical Performance over Seven EQA Cycles

In April 2020, the Aboriginal and Torres Strait Islander COVID-19 Point-of-Care (POC) Testing Program was initiated to improve access to rapid molecular-based SARS-CoV-2 detection in First Nations communities. At capacity, the program reached 105 health services across Australia. An external review estimated the program contributed to averting between 23,000 and 122,000 COVID-19 infections within 40 days of the first infection in a remote community, equating to cost savings of between AU$337 million and AU$1.8 billion. Essential to the quality management of this program, a customised External Quality Assessment (EQA) program was developed with the Royal College of Pathologists of Australasia Quality Assurance Programs (RCPAQAP). From July 2020 to May 2022, SARS-CoV-2 EQA participation ranged from 93 to 100%. Overall concordance of valid EQA results was high (98%), with improved performance following the first survey. These results are consistent with those reported by 12 Australian and 4 New Zealand laboratories for three SARS-CoV-2 RNA EQA surveys in March 2020, demonstrating that SARS-CoV-2 RNA POC testing in primary care settings can be performed to an equivalent laboratory analytical standard. More broadly, this study highlights the value of quality management practices in real-world testing environments and the benefits of ongoing EQA program participation.

Optimizing heat inactivation for SARS-CoV-2 at 95 °C and its implications: A standardized approach

Background

Standardized and validated heat inactivation procedure for Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) are not available. For heat inactivation, various protocols were reported to prepare External Quality Assessment Programme (EQAP) samples without direct comparison between different durations.

Objective

To assess the heat inactivation procedures against SARS-CoV-2. The efficacy of the optimized condition was reflected by the results from laboratories testing the EQAP samples.

Study design

The SARS-CoV-2 strain was exposed to 95 °C in a water bath for three different time intervals, 5 min, 10 min and 15 min, respectively. The efficacy of inactivation was confirmed by the absence of cytopathic effects and decreasing viral load in 3 successive cell line passages. The viral stock inactivated by the optimal time interval was dispatched to EQAP participants and the result returned were analyzed.

Results

All of the three conditions were capable of inactivating the SARS-CoV-2 of viral load at around cycle threshold value of 10. When the 95 °C 10 min condition was chosen to prepare SARS-CoV-2 EQAP samples, they showed sufficient homogeneity and stability. High degree of consensus was observed among EQAP participants in all samples dispatched.

Conclusions

The conditions evaluated in the present study could be helpful for laboratories in preparing SARS-CoV-2 EQAP samples.

Evaluation of diagnostic performance of SARS-CoV-2 infection using digital droplet polymerase chain reaction in individuals with or without COVID-19 symptoms

BACKGROUND

Reverse transcription-quantitative PCR (RT-qPCR) is commonly used to diagnose SARS-CoV-2, but it has limited sensitivity in detecting the virus in asymptomatic close contacts and convalescent patients. In this study, we propose the use of reverse transcription-digital droplet PCR (RT-ddPCR) to detect SARS-CoV-2 in clinical samples.

METHODS

The clinical performance of RT-ddPCR targeting of ORF1ab and N genes was evaluated in parallel with RT-qPCR using 200 respiratory samples collected from close contacts and patients at different phases of infection.

RESULTS

The limits of detection (LODs) for RT-ddPCR assays were determined using six dilutions of ACCUPLEX SARS-Cov-2 reference material. The LODs of ORF1ab and N genes were 3.7 copies/reaction and 2.2 copies/reaction, respectively. Compared to RT-qPCR, RT-ddPCR increased the positive rate by 12.0% in 142 samples from SARS-CoV-2-infected patients. Additionally, RT-ddPCR detected SARS-CoV-2 in three of 26 specimens from close contacts that tested negative by RT-qPCR, and infection was confirmed using follow-up samples. Finally, RT-ddPCR improved the equivocal results from RT-qPCR in 56.3% (9/16) of convalescent patient samples.

CONCLUSIONS

Detecting SARS-CoV-2 in samples with low viral loads using RT-qPCR can be challenging. However, our study suggests that RT-ddPCR, with its higher sensitivity and accuracy, is better suited for detecting low viral copies in samples, particularly those from close contacts and convalescent patients.

High quality of SARS-CoV-2 molecular diagnostics in a diverse laboratory landscape through supported benchmark testing and External Quality Assessment

A two-step strategy combining assisted benchmark testing (entry controls) and External Quality Assessments (EQAs) with blinded simulated clinical specimens to enhance and maintain the quality of nucleic acid amplification testing was developed. This strategy was successfully applied to 71 diagnostic laboratories in The Netherlands when upscaling the national diagnostic capacity during the SARS-CoV-2 pandemic. The availability of benchmark testing in combination with advice for improvement substantially enhanced the quality of the laboratory testing procedures for SARS-CoV-2 detection. The three subsequent EQA rounds demonstrated high quality testing with regard to specificity (99.6% correctly identified) and sensitivity (93.3% correctly identified). Even with the implementation of novel assays, changing workflows using diverse equipment and a high degree of assay heterogeneity, the overall high quality was maintained using this two-step strategy. We show that in contrast to the limited value of Cq value for absolute proxies of viral load, these Cq values can, in combination with metadata on strategies and techniques, provide valuable information for laboratories to improve their procedures. In conclusion, our two-step strategy (preparation phase followed by a series of EQAs) is a rapid and flexible system capable of scaling, improving, and maintaining high quality diagnostics even in a rapidly evolving (e.g. pandemic) situation.

Ensuring diagnostic testing accuracy for patient care and public health- COVID-19 testing scale-up from an EQA provider's perspective

In response to the coronavirus pandemic (COVID-19) and scale up of diagnostic testing, the Canadian Microbiology Proficiency Testing program created a new proficiency testing (PT) program for the molecular and antigen detection of SARS-CoV-2. The program was geared to point of care testing (POCT) sites located in each of the eight provincial Health Authorities across British Columbia, Canada, with the intention to monitor testing quality. The PT program consisted of 6 shipments in a year, each containing a set of 4 samples either positive for SARS-CoV-2 virus or negative. The program began with initial 23 sites enrolling in March 2021, expanding to >100 participants by December 2021. After the first two surveys, it was observed that testing performance (accuracy) was consistently acceptable for sites using nucleic acid technology (NAT), however performance by sites using rapid antigen detection (RAD) methods was poor, especially when testing the weakly positive samples. A root cause investigation of poor testing performance revealed gaps in the execution of testing methods and also in results interpretation. These quality issues were most commonly associated with new testers who lacked experience with diagnostic testing. Tester training and mentoring was reinforced as was retraining of personnel; sample processing instructions were modified, and a training video was also created for testing sites. As a result of these interventions, sites improved their testing accuracy and the performance of POCT sites using RAD methods came to more closely match the performance of sites utilizing NAT. Overall, the PT program was highly successfully and improved quality of testing in the province. This work demonstrates the critical value of an external quality assessment (EQA) partner towards improving patient and public health and safety, especially when testing is conducted outside of an accredited medical laboratory setting.

Comparative study between virus neutralisation testing and other serological methods detecting anti-SARS-CoV-2 antibodies in Europe, 2021

One consequence of the ongoing coronavirus disease pandemic was the rapid development of both in-house and commercial serological assays detecting anti-SARS-CoV-2 antibodies, in an effort to reliably detect acute and past SARS-CoV-2 infections. It is crucial to evaluate the quality of these serological tests and consequently the sero-epidemiological studies that are performed with the respective tests. Here, we describe the set-up and results of a comparative study, in which a laboratory contracted by the European Centre for Disease Prevention and Control offered a centralised service to EU/EEA Member and pre-accession Member States to test representative serum specimens with known serological results, with the gold standard technique (virus neutralisation tests) to determine the presence of neutralising antibodies. Laboratories from 12 European countries shared 719 serum specimens with the contractor laboratory. We found that in-house serological tests detecting neutralising antibodies showed the highest percent agreement, both positive and negative, with the virus neutralisation test results. Despite extensive differences in virus neutralisation protocols neutralisation titres showed a strong correlation. From the commercial assays, the best positive percent agreement was found for SARS-CoV-2 IgG (sCOVG) (Siemens - Atellica IM Analyzer). Despite lower positive percent agreement of LIAISON SARS-CoV-2 TrimericS IgG kit (Diasorin Inc.), the obtained results showed relatively good correlation with neutralisation titres. The set-up of this study allowed for high comparability between laboratories and enabled laboratories that do not have the capacity or capability to perform VNTs themselves. Given the variety of in-house protocols detecting SARS-CoV-2 specific neutralising antibodies, including the virus strain, it could be of interest to select reference isolates for SARS-CoV-2 diagnostic to be made available for interested EU Member States and pre-accession countries.

External quality assessment for laboratories in pan-India ILI/SARI surveillance for simultaneous detection of influenza virus and SARS-CoV-2

Introduction

The Indian Council of Medical Research has set up a nationwide network of 28 laboratories for simultaneous surveillance of influenza virus and SARS-CoV-2 in ILI/SARI patients, using an in-house developed and validated multiplex real-time RTPCR assay. The aim of this study was to ensure the quality of testing by these laboratories by implementing an external quality assessment program (EQAP).

Methods

For this EQAP, a proficiency test (PT) panel comprising tissue-culture or egg-grown influenza virus and SARS-CoV-2 was developed. The PT panel was distributed to all the participant laboratories, which tested the panel and submitted the qualitative results online to the EQAP provider. The performance of the laboratories was evaluated on qualitative criteria but cycle threshold (Ct) values were also gathered for each sample.

Results

On a qualitative basis, all the laboratories achieved the criteria of 90% concordance with the results of the PT panel provider. Ct values of different samples across the laboratories were within ≤ ±3 cycles of the corresponding mean values of the respective sample. The results of this EQAP affirmed the quality and reliability of testing being done for simultaneous surveillance of influenza virus and SARS-CoV-2 in India.

Development of a national proficiency test for SARS-CoV-2 detection by PCR in Colombia

Background

Proficiency testing (PT) is a tool for ensuring the validity of results of testing laboratories and is essential when laboratories are working with assays authorised for emergency use or implementing novel techniques for detecting emerging pathogens.

Methods

In collaboration with the National Health Institute of Colombia and with international support, we developed a qualitative PT for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) by reverse transcription polymerase chain reaction (RT-PCR). A proficiency test item (PTI) based on reference material (research grade) produced by the National Institute of Standards and Technologies (NIST) was prepared and characterised using three positive samples with varying concentrations of SARS-CoV-2 ribonucleic acid (RNA) and two negative (control) samples. Tests were distributed to 121 laboratories across the national network of public health laboratories in Colombia.

Results

Positive samples had varying concentrations of SARS-CoV-2 RNA and were quantified by digital PCR (RT-ddPCR) assays for the E gene of SARS-CoV-2. We tested the ability of laboratories to detect low and high levels of viral RNA using samples with SARS-CoV-2 RNA concentrations of 1417 ± 216, 146 ± 28, and 14 ± 10 copies /uL (expanded uncertainty, k = 2, 95% confidence level) We also performed a semiquantitative analysis of instrumental responses (Ct values) reported by participating laboratories and homogeneity, stability, and characterisation studies of the produced materials to determine the adequacy of these materials and methods for use in the qualitative PT scheme. The PT evaluated reports for individual target genes from each laboratory; 98.3% of laboratories had satisfactory performance and the remaining 1.7% of laboratories had unsatisfactory performance for the detection of at least one of the reported genes.

Conclusions

This PT scheme identified the potential metrological weaknesses of laboratories in the detection of SARS-CoV-2 by RT-PCR and may facilitate improvements in the quality of measurements from the perspective of public health surveillance.

How South Africa Used National Cycle Threshold (Ct) Values to Continuously Monitor SARS-CoV-2 Laboratory Test Quality

The high demand for SARS-CoV-2 tests but limited supply to South African laboratories early in the COVID-19 pandemic resulted in a heterogenous diagnostic footprint of open and closed molecular testing platforms being implemented. Ongoing monitoring of the performance of these multiple and varied systems required novel approaches, especially during the circulation of variants. The National Health Laboratory Service centrally collected cycle threshold (Ct) values from 1,497,669 test results reported from 6 commonly used PCR assays in 36 months, and visually monitored changes in their median Ct within a 28-day centered moving average for each assays' gene targets. This continuous quality monitoring rapidly identified delayed hybridization of RdRp in the Allplex™ SARS-CoV-2 assay due to the Delta (B.1.617.2) variant; S-gene target failure in the TaqPath™ COVID-19 assay due to B.1.1.7 (Alpha) and the B.1.1.529 (Omicron); and recently E-gene delayed hybridization in the Xpert® Xpress SARS-CoV-2 due to XBB.1.5. This near "real-time" monitoring helped inform the need for sequencing and the importance of multiplex molecular nucleic acid amplification technology designs used in diagnostics for patient care. This continuous quality monitoring approach at the granularity of Ct values should be included in ongoing surveillance and with application to other disease use cases that rely on molecular diagnostics.

Design of external quality assessment schemes and definition of the roles of their providers in future epidemics

During an epidemic, individual test results form the basis of epidemiological indicators such as case numbers or incidence. Therefore, the accuracy of measures derived from these indicators depends on the reliability of individual results. In the COVID-19 pandemic, monitoring and evaluating the performance of the unprecedented number of testing facilities in operation, and novel testing systems in use, was urgently needed. External quality assessment (EQA) schemes are unique sources of data reporting on testing performance, and their providers are recognised contacts and support for test facilities (for technical-analytical topics) and health authorities (for planning the monitoring of infection diagnostics). To identify information provided by SARS-CoV-2 genome detection EQA schemes that is relevant for public health microbiology, we reviewed the current literature published in PubMed between January, 2020, and July, 2022. We derived recommendations for EQA providers and their schemes for best practices to monitor pathogen-detection performance in future epidemics. We also showed laboratories, test facilities, and health authorities the information and benefits they can derive from EQA data, and from the non-EQA services of their providers.

Using a multiplex serological assay to estimate time since SARS-CoV-2 infection and past clinical presentation in malagasy patients

Background

The world is facing a 2019 coronavirus (COVID-19) pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). In this context, efficient serological assays are needed to accurately describe the humoral responses against the virus. These tools could potentially provide temporal and clinical characteristics and are thus paramount in developing-countries lacking sufficient ongoing COVID-19 epidemic descriptions.

Methods

We developed and validated a Luminex xMAP® multiplex serological assay targeting specific IgM and IgG antibodies against the SARS-CoV-2 Spike subunit 1 (S1), Spike subunit 2 (S2), Spike Receptor Binding Domain (RBD) and the Nucleocapsid protein (N). Blood samples collected periodically for 12 months from 43 patients diagnosed with COVID-19 in Madagascar were tested for these antibodies. A random forest algorithm was used to build a predictive model of time since infection and symptom presentation.

Findings

The performance of the multiplex serological assay was evaluated for the detection of SARS-CoV-2 anti-IgG and anti-IgM antibodies. Both sensitivity and specificity were equal to 100% (89.85-100) for S1, RBD and N (S2 had a lower specificity = 95%) for IgG at day 14 after enrolment. This multiplex assay compared with two commercialized ELISA kits, showed a higher sensitivity. Principal Component Analysis was performed on serologic data to group patients according to time of sample collection and clinical presentations. The random forest algorithm built by this approach predicted symptom presentation and time since infection with an accuracy of 87.1% (95% CI = 70.17-96.37, p-value = 0.0016), and 80% (95% CI = 61.43-92.29, p-value = 0.0001) respectively.

Interpretation

This study demonstrates that the statistical model predicts time since infection and previous symptom presentation using IgM and IgG response to SARS-CoV2. This tool may be useful for global surveillance, discriminating recent- and past- SARS-CoV-2 infection, and assessing disease severity.

Fundings

This study was funded by the French Ministry for Europe and Foreign Affairs through the REPAIR COVID-19-Africa project coordinated by the Pasteur International Network association. WANTAI reagents were provided by WHO AFRO as part of a Sero-epidemiological "Unity" Study Grant/Award Number: 2020/1,019,828-0 P·O 202546047 and Initiative 5% grant n°AP-5PC-2018-03-RO.

First Round of External Quality Assessment Scheme for SARS-CoV-2 Laboratories During the COVID-19 Pandemic in Thailand

The emergence of SARS-CoV-2 necessitated the rapid deployment of tests to diagnose COVID-19. To monitor the accuracy of testing across the COVID-19 laboratory network in Thailand, the Department of Medical Sciences under the Ministry of Public Health launched a national external quality assessment (EQA) scheme using samples containing inactivated SARS-CoV-2 culture supernatant from a predominant strain in the early phase of the Thailand outbreak. All 197 laboratories in the network participated; 93% (n=183) of which reported correct results for all 6 EQA samples. Ten laboratories reported false-negative results, mostly for samples with low viral concentrations, and 5 laboratories reported false-positive results (1 laboratory reported false positives and false negatives). An intralaboratory investigation of 14 laboratories reporting incorrect results revealed 2 main causes of error: (1) RNA contamination of the rRT-PCR reaction and (2) poor-quality RNA extraction. Specific reagent combinations were significantly associated with false-negative reports. Thailand's approach to national EQA for SARS-CoV-2 can serve as a roadmap for other countries interested in implementing a national EQA program to ensure laboratories provide accurate testing results, which is crucial in diagnosis, prevention, and control strategies. A national EQA program can be less costly and thus more sustainable than commercial EQA programs. National EQA is recommended to detect and correct testing errors and provide postmarket surveillance for diagnostic test performance.

Comparison of fifteen SARS-CoV-2 nucleic acid amplification test assays used during the Canadian Laboratory Response Network's National SARS-CoV-2 Proficiency Program, May 2020 to June 2021

Background

On March 11, 2020, the World Health Organization declared a pandemic caused by the recently emerged severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). This led to increased clinical testing and decentralizing of this testing from provincial health laboratories to regional and private facilities. Leveraging the results from the Canadian Laboratory Response Network's National SARS-CoV-2 Proficiency Test (PT) Program, this study compares multiple commercial and laboratory-developed nucleic acid amplification tests, assessing both sensitivity and specificity across multiple users.

Methods

Each panel consisted of six blinded, contrived-clinical samples. Panels were distributed to international, provincial and territorial laboratories and subsequently to partner facilities. Participating laboratories were asked to run these sample through their respective extraction/PCR workflows and submit results to the National Microbiology Laboratory, outlining the nucleic acid extraction platform and nucleic acid amplification test employed, as well as the viral gene target and Ct values or equivalent obtained. Data were compiled for each molecular platform and gene target used.

Results

The PT schemes were deployed in May 2020, November 2020 and June 2021, resulting in 683 data sets using 37 different nucleic acid amplification tests. Over the course of three PT schemes, the average score obtained was 99.3% by participants demonstrating consistent testing between laboratories and testing platforms.

Conclusion

This study confirmed the rapid and successful implementation of a Canadian PT Program and provided comparative analysis of the various emergency use authorized and laboratory developed tests employed for the detection of SARS-CoV-2 and demonstrated an overall 99.3% test concordance nationwide.

Relationship between viral load and symptoms in children infected with SARS-CoV-2

BACKGROUND

The purpose of this study is to evaluate the association between SARS-CoV-2 viral load in respiratory secretions of infected children and signs/symptoms of COVID-19.

METHODS

We reported the clinical characteristics of SARS-CoV-2-infected children during the study period. We compared viral load for several clinical variables, performed a predictive linear regression analysis to identify signs and symptoms significantly associated with viral load, and searched for discriminant viral load thresholds for symptomatic versus asymptomatic infections based on receiver-operating characteristics.

RESULTS

A total of 570 patients were included. The median age was 4.75 years. Comparison of CT values by dichotomous variable showed higher viral loads in children with fever, respiratory symptoms, and previous exposure to SARS-CoV-2. The linear regression analysis confirmed a significant relationship between the CT value with these variables and with age, other symptoms, and asymptomaticity. In particular, infants with fever and SARS-CoV-2 exposure had higher viral loads. No viral load cut-offs were found to distinguish symptomatic from asymptomatic patients.

CONCLUSION

Our study shows that fever, SARS-CoV-2 exposure, and respiratory symptoms are associated with higher viral load in children, especially infants, while age, presence of nonrespiratory symptoms, or absence of any symptoms are associated with lower viral load.

IMPACT

Key message: the clinical variables that best predict viral load in infected children are history of previous exposure to a SARS-CoV-2-infected person and presence of fever and respiratory symptoms (higher viral load). Added value to the current literature: this is the first article to prove this point.

IMPACT

SARS-CoV-2 viral load should not be used as a measure of clinical severity of COVID-19 in the pediatric population; however, lower viral load appears to be associated with asymptomatic COVID-19 in older children.

Tracing and testing multiple generations of contacts to COVID-19 cases: cost-benefit trade-offs

Traditional contact tracing tests the direct contacts of those who test positive. But, by the time an infected individual is tested, the infection starting from the person may have infected a chain of individuals. Hence, why should the testing stop at direct contacts, and not test secondary, tertiary contacts or even contacts further down? One deterrent in testing long chains of individuals right away may be that it substantially increases the testing load, or does it? We investigate the costs and benefits of such multi-hop contact tracing for different number of hops. Considering diverse contact networks, we show that the cost-benefit trade-off can be characterized in terms of a single measurable attribute, the initial epidemic growth rate. Once this growth rate crosses a threshold, multi-hop contact tracing substantially reduces the outbreak size compared with traditional tracing. Multi-hop even incurs a lower cost compared with the traditional tracing for a large range of values of the growth rate. The cost-benefit trade-offs can be classified into three phases depending on the value of the growth rate. The need for choosing a larger number of hops becomes greater as the growth rate increases or the environment becomes less conducive toward containing the disease.

External quality assessment of SARS-CoV-2 serology in European expert laboratories, April 2021

Background

Countries worldwide are focusing to mitigate the ongoing SARS-CoV-2 pandemic by employing public health measures. Laboratories have a key role in the control of SARS-CoV-2 transmission. Serology for SARS-CoV-2 is of critical importance to support diagnosis, define the epidemiological framework and evaluate immune responses to natural infection and vaccine administration.

Aim

The aim of this study was the assessment of the actual capability among laboratories involved in sero-epidemiological studies on COVID-19 in EU/EEA and EU enlargement countries to detect SARS-CoV-2 antibodies through an external quality assessment (EQA) based on proficiency testing.

Methods

The EQA panels were composed of eight different, pooled human serum samples (all collected in 2020 before the vaccine roll-out), addressing sensitivity and specificity of detection. The panels and two EU human SARS-CoV-2 serological standards were sent to 56 laboratories in 30 countries.

Results

The overall performance of laboratories within this EQA indicated a robust ability to establish past SARS-CoV-2 infections via detection of anti-SARS-CoV-2 antibodies, with 53 of 55 laboratories using at least one test that characterised all EQA samples correctly. IgM-specific test methods provided most incorrect sample characterisations (24/208), while test methods detecting total immunoglobulin (0/119) and neutralising antibodies (2/230) performed the best. The semiquantitative assays used by the EQA participants also showed a robust performance in relation to the standards.

Conclusion

Our EQA showed a high capability across European reference laboratories for reliable diagnostics for SARS-CoV-2 antibody responses. Serological tests that provide robust and reliable detection of anti-SARS-CoV-2 antibodies are available.

Digital PCR Applications in the SARS-CoV-2/COVID-19 Era: a Roadmap for Future Outbreaks

The ongoing coronavirus disease 2019 (COVID-19) pandemic, caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has led to a global public health disaster. The current gold standard for the diagnosis of infected patients is real-time reverse transcription-quantitative PCR (RT-qPCR). As effective as this method may be, it is subject to false-negative and -positive results, affecting its precision, especially for the detection of low viral loads in samples. In contrast, digital PCR (dPCR), the third generation of PCR, has been shown to be more effective than the gold standard, RT-qPCR, in detecting low viral loads in samples. In this review article, we selected publications to show the broad-spectrum applications of dPCR, including the development of assays and reference standards, environmental monitoring, mutation detection, and clinical diagnosis of SARS-CoV-2, while comparing it analytically to the gold standard, RT-qPCR. In summary, it is evident that the specificity, sensitivity, reproducibility, and detection limits of RT-dPCR are generally unaffected by common factors that may affect RT-qPCR. As this is the first time that dPCR is being tested in an outbreak of such a magnitude, knowledge of its applications will help chart a course for future diagnosis and monitoring of infectious disease outbreaks.

Laboratory Considerations for Reporting Cycle Threshold Value in COVID-19

The Coronavirus Disease 2019 (COVID-19) pandemic is caused by the SARS-CoV-2 RNA virus. Nucleic acid amplification testing (NAAT) is the mainstay to confirm infection. A large number of reverse transcriptase polymerase chain reaction (RT-PCR) assays are currently available for qualitatively assessing SARS-CoV-2 infection. Although these assays show variation in cycle threshold values (Ct), advocacy for reporting Ct values (in addition to the qualitative result) is tabled to guide patient clinical management decisions. This article provides critical commentary on qualitative RT-PCR laboratory and clinical considerations for Ct value reporting. Factors contributing to Ct variation are discussed by considering relevant viral life-cycle factors, patient factors and the laboratory total testing processes that contribute to the Ct variation and mitigate against the reporting of Ct values by qualitative NAAT.

Update of Guidelines for Laboratory Diagnosis of COVID-19 in Korea

Korean Society for Laboratory Medicine and the Korea Disease Prevention and Control Agency have announced guidelines for diagnosing coronavirus disease (COVID-19) in clinical laboratories in Korea. With the ongoing pandemic, we propose an update of the previous guidelines based on new scientific data. This update includes recommendations for tests that were not included in the previous guidelines, including the rapid molecular test, antigen test, antibody test, and self-collected specimens, and a revision of the previous recommendations. This update will aid clinical laboratories in performing laboratory tests for diagnosing COVID-19.

An external quality assessment for the molecular testing of the SARS-CoV-2 virus genome in Zhejiang Province, China

The COVID-19 pandemic has necessitated the rapid expansion of laboratories that conduct SARS-CoV-2 tests. A provincial external quality assessment (EQA) scheme on SARS-CoV-2 tests was organized by Zhejiang Provincial CDC to assess the accuracy of the tests in individual CDC municipal and county laboratories in Zhejiang Province, China. Three positive samples in high, medium, and low concentrations, respectively, were prepared using the serial dilutions from the culture with the viral titer concentration of 1×10^6.3 TCID50/mL, and one negative sample were included. A total of 93 laboratories participated, contributing results from 36 distinct combinations of nucleic acid extraction methods and PCR reagents. There was 100% concordance among all laboratories for all EQA samples, and no false-positive or false-negative results were observed. The EQA survey provides confidence in the identification of infected individuals or asymptomatic populations and assurance for clinical and public health decision-making based on test results.

SARS-CoV-2 Molecular Diagnostics in China

The COVID-19 pandemic remains a significant problem involving health systems worldwide. Several diagnostic methods are reported for detecting the coronavirus in clinical, research, and public health laboratories. rRT-PCR is considered the gold standard; however, as it required skilled personnel and special equipment, rapid antigen tests have been developed and used as first-line screening. The serologic testing of antibodies can also be used to enhance the detection sensitivity and accuracy, which are used to assess the overall infection rate. This review summarizes the molecular techniques and serologic assays widely used in China and discusses the advantages and disadvantages of these techniques.

RNA reference materials with defined viral RNA loads of SARS-CoV-2-A useful tool towards a better PCR assay harmonization

SARS-CoV-2, the cause of COVID-19, requires reliable diagnostic methods to track the circulation of this virus. Following the development of RT-qPCR methods to meet this diagnostic need in January 2020, it became clear from interlaboratory studies that the reported Ct values obtained for the different laboratories showed high variability. Despite this the Ct values were explored as a quantitative cut off to aid clinical decisions based on viral load. Consequently, there was a need to introduce standards to support estimation of SARS-CoV-2 viral load in diagnostic specimens. In a collaborative study, INSTAND established two reference materials (RMs) containing heat-inactivated SARS-CoV-2 with SARS-CoV-2 RNA loads of ~107 copies/mL (RM 1) and ~106 copies/mL (RM 2), respectively. Quantification was performed by RT-qPCR using synthetic SARS-CoV-2 RNA standards and digital PCR. Between November 2020 and February 2021, German laboratories were invited to use the two RMs to anchor their Ct values measured in routine diagnostic specimens, with the Ct values of the two RMs. A total of 305 laboratories in Germany were supplied with RM 1 and RM 2. The laboratories were requested to report their measured Ct values together with details on the PCR method they used to INSTAND. This resultant 1,109 data sets were differentiated by test system and targeted gene region. Our findings demonstrate that an indispensable prerequisite for linking Ct values to SARS-CoV-2 viral loads is that they are treated as being unique to an individual laboratory. For this reason, clinical guidance based on viral loads should not cite Ct values. The RMs described were a suitable tool to determine the specific laboratory Ct for a given viral load. Furthermore, as Ct values can also vary between runs when using the same instrument, such RMs could be used as run controls to ensure reproducibility of the quantitative measurements.

Inter-laboratory testing as a strategy for external quality assessment for qualitative detection of SARS-CoV-2 by real-time RT-PCR testing in India

To implement the strategy of test, track and treat to tackle the ongoing COVID-19 pandemic, the number of real-time RT-PCR-based testing laboratories was increased for diagnosis of SARS-CoV-2 in the country. To ensure reliability of the laboratory results, the Indian Council of Medical Research initiated external quality assessment (EQA) by deploying inter-laboratory quality control (ILQC) activity for these laboratories by nominating 34 quality control (QC) laboratories. This report presents the results of this activity for a period of September 2020 till November 2020. A total of 597 laboratories participated in this activity and 86 per cent of these scored ≥90 per cent concordance with QC laboratories. This ILQC activity showcased India's preparedness in quality diagnosis of SARS-CoV-2.

OUP accepted manuscript

Objective

This study aimed to examine the intra- and interlaboratory variations of cycle threshold (Ct) values using the nationwide proficiency testing for SARS-CoV-2.

Methods

Triplicated strong-positive contrived samples duplicated weak-positive contrived samples, and 2 negative samples were transported to participating laboratories in October 2021.

Results

A total of 232 laboratories responded. All except 4 laboratories correctly answered. Six false-negative results, including 2 false-negatives with Ct values beyond the threshold and 1 clerical error, were noted from weak-positive samples. Intralaboratory variations of Ct values of weak-positive and strong-positive samples were not acceptable (Ct > 1.66) in 17 and 7 laboratories, respectively. High interlaboratory variations of Ct values (up to 7 cycles) for the 2 commonly used polymerase chain reaction (PCR) reagents were observed.

Conclusion

The overall qualitative performance was acceptable; intralaboratory variation was acceptable. However, interlaboratory variations of Ct values were remarkable even when the same PCR reagents were used.

A localized small-scale external quality assessment (EQA) for PCR testing of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in the molecular laboratories

The aim of this study was to estimate the PCR results for SARS-CoV-2 testing in 32 participating laboratories in a localized small-scale external quality assessment (EQA) scheme. EQA samples were distributed to the participants and detected immediately on the day of delivery. Qualitative results were submitted to the EQA provider, including negative or positive results along with cycle threshold (Ct) values for different target genes. Although the variability of Ct values differed among the laboratories in the EQA, a total of 32 (100 %) participants reported correct qualitative results. The study showed that the mean loads of N or E gene were higher than those of ORF1ab in SARS-CoV-2 RNA samples. Regardless of the analyzed gene target, the mean Ct values for weak positive and positive samples varied by fewer than 1.74 and 1.91 cycles, respectively. Less than 12 % of reported Ct values for ORF1ab and N genes deviated by more than ±4 cycles (maximum: −9.92 cycles), while none deviated by more than ±4 cycles for the E gene. The current EQA program can provide a robust practical basis for follow-up planning to conduct evaluations for SARS-CoV-2 PCR testing and other novel emerging pathogens in the future.

Nationwide external quality assessment of SARS-CoV-2 nucleic acid amplification tests in Japan

Objectives

We conducted a nationwide external quality assessment (EQA) study of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) nucleic acid amplification testing in Japan.

Methods

A total of 563 public health and private sector laboratories participated. The EQA samples comprised 6 RNA and full-process controls.

Results

The overall agreements were 99.3% and 97.9% for the RNA and full-process controls, respectively. A total of 530/563 (94.1%) laboratories reported correct results; public health laboratories had the highest accuracy. Thirty-three laboratories reported at least one incorrect result (26 laboratories of medical facilities, 5 commercial laboratories, 1 public health laboratory, and 1 other). Sixteen laboratories of medical facilities that used a fully automated assay system failed to detect the presence of the full-process control, due to inherent insufficiency in the limit of detection (LOD). Other causes of incorrect results included failure to ensure the LOD (n = 13), error in result judging or reporting (n = 3), and error in sample handling (n = 1).

Conclusions

Performance was mostly dependent on the laboratory category and assay evaluation, particularly the LOD. Guidance should be developed based on these results, particularly in the phase of new entry into laboratory services for SARS-CoV-2.

A study of quality assessment in SARS-CoV-2 pathogen nucleic acid amplification tests performance; from the results of external quality assessment survey of clinical laboratories in the Tokyo Metropolitan Government external quality assessment program in 2020

Introduction

The Tokyo Metropolitan Government (TMG) conducted an external quality assessment (EQA) survey of pathogen nucleic acid amplification tests (NAATs) as a TMG EQA program for SARS-CoV-2 for clinical laboratories in Tokyo.

Methods

We diluted and prepared a standard product manufactured by Company A to about 2,500 copies/mL to make a positive control and distribute it with a negative control. The participants reported the use of the NAATs methods for SARS-CoV-2, the name of the real-time RT-PCR kit, the name of the detection device, the target gene(s), nucleic acid extraction kit, Threshold Cycle value in the case of RT-PCR and the Threshold time value and Differential calculation value in the case of Loop-Mediated Isothermal Amplification (LAMP) method.

Results

As a result, 17 laboratories using fully automated equipment and 34 laboratories using the RT-PCR method reported generally appropriate results in this EQA survey. On the other hand, among the laboratories that adopted the LAMP method, there were a plurality of laboratories that judged positive samples to be negative.

Conclusion

The false negative result is considered to be due to the fact that the amount of virus genome contained in the quality control reagent used this time was below the detection limit of the LAMP method combined with the rapid extraction reagent for influenza virus. On the other hand, false positive results are considered to be due to the non-specific reaction of the NAATs. The EQA program must be continued for the proper implementation of the pathogen NAATs.

Inadequate design of mutation detection panels prevents interpretation of variants of concern: results of an external quality assessment for SARS-CoV-2 variant detection

OBJECTIVES

Mutation-specific PCR assays have quickly found their way into laboratory diagnostics due to their capacity to be a fast, easy to implement and high-throughput method for the detection of known SARS-CoV-2 variants of concern (VoCs). However, little is known about the performance of such assays in routine laboratory analysis.

METHODS

The results reported in a recent round of an external quality assessment (EQA) scheme for SARS-CoV-2 mutation-specific PCR were retrospectively analyzed. For the determination of individual variant-specific sequences as well as for the interpretation results for certain virus variants, correct, incorrect, and unreported results were evaluated, and their possible causes were investigated.

RESULTS

A total of 34 laboratories participated in this study. For five samples containing the VoC Alpha + E484K, Beta, Gamma, Delta, or B.1.1.318 (as a variant of interest), 848 results for SARS-2-CoV mutation detection were reported, 824 (97.2%, range per sample 88-100%) of which were correct. Melting curve assays gave 99% correct results, real-time RT-qPCR 94%, microarray-based assays 100%, and MALDI-TOF MS 96%. A total of 122/167 (73%) reported results for SARS-CoV-2 variant determination were correct. Of the 45 inconclusive or incorrect results, 33 (73%) were due to inadequate selection of targets that did not allow identification of contemporary VoC, 11 (24%) were due to incorrect results, and one (3%) was due to correct results of mutation-specific PCR.

CONCLUSIONS

Careful and up-to-date selection of the targets used in mutation-specific PCR is essential for successful detection of current SARS-CoV-2 variants.

The versatility of external quality assessment for the surveillance of laboratory and in vitro diagnostic performance: SARS-CoV-2 viral genome detection in Austria

OBJECTIVES

External quality assessment (EQA) schemes provide information on individual and general analytical performance of participating laboratories and test systems. The aim of this study was to investigate the use and performance of SARS-CoV-2 virus genome detection systems in Austrian laboratories and their preparedness to face challenges associated with the pandemic.

METHODS

Seven samples were selected to evaluate performance and estimate variability of reported results. Notably, a dilution series was included in the panel as a measure of reproducibility and sensitivity. Several performance criteria were evaluated for individual participants as well as in the cohort of all participants.

RESULTS

A total of 109 laboratories participated and used 134 platforms, including 67 different combinations of extraction and PCR platforms and corresponding reagents. There were no false positives and 10 (1.2%) false negative results, including nine in the weakly positive sample (C _t ∼35.9, ∼640 copies/mL). Twenty (22%) laboratories reported results of mutation detection. Twenty-five (19%) test systems included amplification of human RNA as evidence of proper sampling. The overall linearity of C _t values from individual test systems for the dilution series was good, but inter-assay variability was high. Both operator-related and systematic failures appear to have caused incorrect results.

CONCLUSIONS

Beyond providing certification for participating laboratories, EQA provides the opportunity for participants to evaluate their performance against others so that they may improve operating procedures and test systems. Well-selected EQA samples offer additional inferences to be made about assay sensitivity and reproducibility, which have practical applications.

Tools and Techniques for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2)/COVID-19 Detection

The coronavirus disease 2019 (COVID-19) pandemic, caused by severe acute respiratory disease coronavirus 2 (SARS-CoV-2), has led to millions of confirmed cases and deaths worldwide. Efficient diagnostic tools are in high demand, as rapid and large-scale testing plays a pivotal role in patient management and decelerating disease spread. This paper reviews current technologies used to detect SARS-CoV-2 in clinical laboratories as well as advances made for molecular, antigen-based, and immunological point-of-care testing, including recent developments in sensor and biosensor devices. The importance of the timing and type of specimen collection is discussed, along with factors such as disease prevalence, setting, and methods. Details of the mechanisms of action of the various methodologies are presented, along with their application span and known performance characteristics. Diagnostic imaging techniques and biomarkers are also covered, with an emphasis on their use for assessing COVID-19 or monitoring disease severity or complications. While the SARS-CoV-2 literature is rapidly evolving, this review highlights topics of interest that have occurred during the pandemic and the lessons learned throughout. Exploring a broad armamentarium of techniques for detecting SARS-CoV-2 will ensure continued diagnostic support for clinicians, public health, and infection prevention and control for this pandemic and provide advice for future pandemic preparedness.

The fate of SARS-COV-2 in WWTPS points out the sludge line as a suitable spot for detection of COVID-19

SARS-CoV-2 genetic material is detectable in the faeces of a considerable part of COVID-19 cases and hence, in municipal wastewater. This fact was confirmed early during the spread of the COVID-19 pandemic and prompted several studies that proposed monitoring its incidence by wastewater. This paper studies the fate of SARS-CoV-2 genetic material in wastewater treatment plants using RT-qPCR with a two-fold goal: i) to check its presence in the water effluent and in the produced sludge and ii) based on the understanding of the virus particles fate, to identify the most suitable spots for detecting the incidence of COVID-19 and monitor its evolution. On the grounds of the affinity of enveloped virus towards biosolids, we hypothesized that the sludge line acts as a concentrator of SARS-CoV-2 genetic material. Sampling several spots in primary, secondary and sludge treatment at the Ourense (Spain) WWTP in 5 different days showed that, in effect, most of SARS-CoV-2 particles cannot be detected in the water effluent as they are retained by the sludge line. We identified the sludge thickener as a suitable spot for detecting SARS-CoV-2 particles thanks to its higher solids concentration (more virus particles) and longer residence time (less sensitive to dilution caused by precipitation). These findings could be useful to develop a suitable strategy for early warning of COVID-19 incidence based on WWTP monitoring.

The fate of SARS-COV-2 in WWTPS points out the sludge line as a suitable spot for detection of COVID-19

SARS-CoV-2 genetic material is detectable in the faeces of a considerable part of COVID-19 cases and hence, in municipal wastewater. This fact was confirmed early during the spread of the COVID-19 pandemic and prompted several studies that proposed monitoring its incidence by wastewater. This paper studies the fate of SARS-CoV-2 genetic material in wastewater treatment plants using RT-qPCR with a two-fold goal: i) to check its presence in the water effluent and in the produced sludge and ii) based on the understanding of the virus particles fate, to identify the most suitable spots for detecting the incidence of COVID-19 and monitor its evolution. On the grounds of the affinity of enveloped virus towards biosolids, we hypothesized that the sludge line acts as a concentrator of SARS-CoV-2 genetic material. Sampling several spots in primary, secondary and sludge treatment at the Ourense (Spain) WWTP in 5 different days showed that, in effect, most of SARS-CoV-2 particles cannot be detected in the water effluent as they are retained by the sludge line. We identified the sludge thickener as a suitable spot for detecting SARS-CoV-2 particles thanks to its higher solids concentration (more virus particles) and longer residence time (less sensitive to dilution caused by precipitation). These findings could be useful to develop a suitable strategy for early warning of COVID-19 incidence based on WWTP monitoring.

The fate of SARS-COV-2 in WWTPS points out the sludge line as a suitable spot for detection of COVID-19

SARS-CoV-2 genetic material is detectable in the faeces of a considerable part of COVID-19 cases and hence, in municipal wastewater. This fact was confirmed early during the spread of the COVID-19 pandemic and prompted several studies that proposed monitoring its incidence by wastewater. This paper studies the fate of SARS-CoV-2 genetic material in wastewater treatment plants using RT-qPCR with a two-fold goal: i) to check its presence in the water effluent and in the produced sludge and ii) based on the understanding of the virus particles fate, to identify the most suitable spots for detecting the incidence of COVID-19 and monitor its evolution. On the grounds of the affinity of enveloped virus towards biosolids, we hypothesized that the sludge line acts as a concentrator of SARS-CoV-2 genetic material. Sampling several spots in primary, secondary and sludge treatment at the Ourense (Spain) WWTP in 5 different days showed that, in effect, most of SARS-CoV-2 particles cannot be detected in the water effluent as they are retained by the sludge line. We identified the sludge thickener as a suitable spot for detecting SARS-CoV-2 particles thanks to its higher solids concentration (more virus particles) and longer residence time (less sensitive to dilution caused by precipitation). These findings could be useful to develop a suitable strategy for early warning of COVID-19 incidence based on WWTP monitoring.

Variable Sensitivity of SARS-CoV-2 Molecular Detection in European Expert Laboratories: External Quality Assessment, June and July 2020

During the ongoing coronavirus disease 2019 (COVID-19) outbreak, robust detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is a key element for clinical management and to interrupt transmission chains. We organized an external quality assessment (EQA) of molecular detection of SARS-CoV-2 for European expert laboratories. An EQA panel composed of 12 samples, containing either SARS-CoV-2 at different concentrations to evaluate sensitivity or other respiratory viruses to evaluate specificity of SARS-CoV-2 testing, was distributed to 68 laboratories in 35 countries. Specificity samples included seasonal human coronaviruses hCoV-229E, hCoV-NL63, and hCoV-OC43, as well as Middle East respiratory syndrome coronavirus (MERS-CoV), SARS-CoV, and human influenza viruses A and B. Sensitivity results differed among laboratories, particularly for low-concentration SARS-CoV-2 samples. Results indicated that performance was mostly independent of the selection of specific extraction or PCR methods.

Residual SARS-CoV-2 RNA in nasal swabs of convalescent COVID-19 patients: Is prolonged quarantine always justified?

Real-time reverse transcription PCR is currently the most sensitive method to detect severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Defining whether a patient could be contagious or not contagious in the presence of residual SARS-CoV-2 RNA is of extreme importance in the context of public health. In this prospective multicenter study, virus isolation was prospectively attempted in 387 nasal swabs from clinically recovered patients showing low viral load (quantification cycle, Cq, value greater than 30). The median Cq value was 36.8 (range 30.0-39.4). Overall, a cytopathic effect was detected in nine samples, corresponding to a culture positivity rate of 2.3% (9/387). The results of this study help to dissect true virus replication and residual viral RNA detection in recovered patients.