Assessing the Quality of Serological Testing in the COVID-19 Pandemic: Results of a European External Quality Assessment (EQA) Scheme for Anti-SARS-CoV-2 Antibody Detection

Clinical and laboratory considerations: determining an antibody-based composite correlate of risk for reinfection with SARS-CoV-2 or severe COVID-19

Much of the global population now has some level of adaptive immunity to SARS-CoV-2 induced by exposure to the virus (natural infection), vaccination, or a combination of both (hybrid immunity). Key questions that subsequently arise relate to the duration and the level of protection an individual might expect based on their infection and vaccination history. A multi-component composite correlate of risk (CoR) could inform individuals and stakeholders about protection and aid decision making. This perspective evaluates the various elements that need to be accommodated in the development of an antibody-based composite CoR for reinfection with SARS-CoV-2 or development of severe COVID-19, including variation in exposure dose, transmission route, viral genetic variation, patient factors, and vaccination status. We provide an overview of antibody dynamics to aid exploration of the specifics of SARS-CoV-2 antibody testing. We further discuss anti-SARS-CoV-2 immunoassays, sample matrices, testing formats, frequency of sampling and the optimal time point for such sampling. While the development of a composite CoR is challenging, we provide our recommendations for each of these key areas and highlight areas that require further work to be undertaken.

Three rounds of a national external quality assessment reveal a link between disharmonic anti-SARS-CoV-2 antibody quantifications and the infection stage

OBJECTIVES

The WHO's standardized measuring unit, "binding antibody units per milliliter (BAU/mL)," should allow the harmonization of quantitative results by different commercial Anti-SARS-CoV-2 immunoassays. However, multiple studies demonstrate inter-assay discrepancies. The antigenic changes of the Omicron variant affect the performance of Spike-specific immunoassays. This study evaluated the variation of quantitative Anti-SARS-CoV-2-Spike antibody measurements among 46, 50, and 44 laboratories in three rounds of a national external quality assessment (EQA) prior to and after the emergence of the Omicron variant in a diagnostic near-to-real-life setting.

METHODS

We analyzed results reported by the EQA participant laboratories from single and sequential samples from SARS-CoV-2 convalescent, acutely infected, and vaccinated individuals, including samples obtained after primary and breakthrough infections with the Omicron variant.

RESULTS

The three immunoassays most commonly used by the participants displayed a low intra-assay and inter-laboratory variation with excellent reproducibility using identical samples sent to the participants in duplicates. In contrast, the inter-assay variation was very high with all samples. Notably, the ratios of BAU/mL levels quantified by different immunoassays were not equal among all samples but differed between vaccination, past, and acute infection, including primary infection with the Omicron variant. The antibody kinetics measured in vaccinated individuals strongly depended on the applied immunoassay.

CONCLUSIONS

Measured BAU/mL levels are only inter-changeable among different laboratories when the same assay was used for their assessment. Highly variable ratios of BAU/mL quantifications among different immunoassays and infection stages argue against the usage of universal inter-assay conversion factors.

A Prototype Assay Multiplexing SARS-CoV-2 3CL-Protease and Angiotensin-Converting Enzyme 2 for Saliva-Based Diagnostics in COVID-19

With the current state of COVID-19 changing from a pandemic to being more endemic, the priorities of diagnostics will likely vary from rapid detection to stratification for the treatment of the most vulnerable patients. Such patient stratification can be facilitated using multiple markers, including SARS-CoV-2-specific viral enzymes, like the 3CL protease, and viral-life-cycle-associated host proteins, such as ACE2. To enable future explorations, we have developed a fluorescent and Raman spectroscopic SARS-CoV-2 3CL protease assay that can be run sequentially with a fluorescent ACE2 activity measurement within the same sample. Our prototype assay functions well in saliva, enabling non-invasive sampling. ACE2 and 3CL protease activity can be run with minimal sample volumes in 30 min. To test the prototype, a small initial cohort of eight clinical samples was used to check if the assay could differentiate COVID-19-positive and -negative samples. Though these small clinical cohort samples did not reach statistical significance, results trended as expected. The high sensitivity of the assay also allowed the detection of a low-activity 3CL protease mutant.

Subsequent COVID-19 Prophylaxis in COVID-19 Associated Glomerulopathies

Successful vaccination has been the decisive factor in the overall decline of SARS-CoV2 infection related morbidity and mortality. However, global effects of the COVID-19 pandemic are ongoing, with reports of glomerular disease occurring in relation to both infection and vaccination. A particular rise in anti-GBM disease has been identified. Information is still emerging regarding the optimal management of such cases. We reviewed anti-GBM antibody detection rates at our test center over the past 5 years. We followed three patients with biopsy confirmed glomerular disease temporally related to COVID-19 vaccination. Each patient proceeded to receive subsequent COVID-19 vaccination as per immunologist recommendations. Further assessment included COVID-19 antibody testing in each case. A three-fold increase in significant anti-GBM antibody results noted at our center was associated with COVID infection in 10% of cases, and COVID vaccination in 25% of cases. We demonstrated that subsequent vaccination did not appear to lead to adverse effects including relapse in our three cases of COVID-19 vaccine-associated GN. We also identified positive COVID-19 antibody levels in two out of three cases, despite immunosuppression. We report a rise in anti-GBM antibody disease incidence. Our small study suggests that COVID-19 antibody testing can help determine COVID prophylaxis requirements, and subsequent vaccination with an alternative vaccine type appears safe.

External quality assessment of SARS-CoV-2 serology in European expert laboratories, April 2021

Background

Countries worldwide are focusing to mitigate the ongoing SARS-CoV-2 pandemic by employing public health measures. Laboratories have a key role in the control of SARS-CoV-2 transmission. Serology for SARS-CoV-2 is of critical importance to support diagnosis, define the epidemiological framework and evaluate immune responses to natural infection and vaccine administration.

Aim

The aim of this study was the assessment of the actual capability among laboratories involved in sero-epidemiological studies on COVID-19 in EU/EEA and EU enlargement countries to detect SARS-CoV-2 antibodies through an external quality assessment (EQA) based on proficiency testing.

Methods

The EQA panels were composed of eight different, pooled human serum samples (all collected in 2020 before the vaccine roll-out), addressing sensitivity and specificity of detection. The panels and two EU human SARS-CoV-2 serological standards were sent to 56 laboratories in 30 countries.

Results

The overall performance of laboratories within this EQA indicated a robust ability to establish past SARS-CoV-2 infections via detection of anti-SARS-CoV-2 antibodies, with 53 of 55 laboratories using at least one test that characterised all EQA samples correctly. IgM-specific test methods provided most incorrect sample characterisations (24/208), while test methods detecting total immunoglobulin (0/119) and neutralising antibodies (2/230) performed the best. The semiquantitative assays used by the EQA participants also showed a robust performance in relation to the standards.

Conclusion

Our EQA showed a high capability across European reference laboratories for reliable diagnostics for SARS-CoV-2 antibody responses. Serological tests that provide robust and reliable detection of anti-SARS-CoV-2 antibodies are available.

Results of a European-Wide External Quality Assessment (EQA) Scheme for Serological Detection of Anti-SARS-CoV-2 (CoVimm)—Pitfalls of Routine Application

Background: During the last two years, a variety of assays for the serological detection of antibodies to the new SARS-CoV-2 virus have been launched and used as part of standard care in many laboratories. The pace with which these tests have been introduced into routine care emphasizes the importance of quality measures for analytical methods, particularly with regard to the implications of results for clinical and epidemiologic decisions. Accuracy, reliability and comparability of analytical test results are thus essential, and here external quality assessment (EQA) is the most important quality assurance tool. It allows us to achieve harmonization of test methods as a prerequisite for a high standard of performance for laboratory and analytical techniques and their interpretation. Methods: This EQA scheme consisted of pre-characterized clinical biospecimens dedicated to the analysis of anti-SARS-CoV-2 IgG total antibodies and differentiation into spike protein-specific IgG antibodies against SARS-CoV-2 (anti-S-SARS-CoV-2) and nucleocapsid-specific IgG antibodies against SARS-CoV-2 (anti-N-SARS-CoV-2). Results: A total of 239 laboratories across Europe participated in this scheme, called CoVimm. In detail, 536 results for anti-SARS-CoV-2 IgG, 431 results for anti-S-SARS-CoV-2 IgG, and 200 results for anti-N-SARS-CoV-2 IgG were reported. Based on the pre-defined thresholds, the success rates for the determination of anti-S-SARS-CoV-2 IgG and anti-N-SARS-CoV-2 IgG were 96% and 90%, respectively. Interestingly, only 64% of the participating laboratories successfully passed the EQA scheme for the determination of total anti-SARS-CoV-2 IgG. Conclusions: This EQA revealed serious concerns regarding the reliability and appropriate use of anti-SARS-CoV-2 antibody assays in routine care. In addition to the wide heterogeneity of different assays used by participating laboratories, a lack of standardization and harmonization is also evident. This is of particular importance for reliable and clinically meaningful interpretation of test results.

The Significance of External Quality Assessment Schemes for Molecular Testing in Clinical Laboratories

Simple Summary

Patients and clinicians often rely on the outcome of laboratory tests, but can we really trust these test results? Good quality management is key for laboratories to guarantee reliable test results. This review focusses on external quality assessment (EQA) schemes which are a tool for laboratories to examine and improve the quality of their testing routines. In this review, an overview of the role and importance of EQA schemes for clinical laboratories is given, and different types of EQA schemes and EQA providers available on the market are discussed, as well as recent developments in the EQA landscape.

Abstract

External quality assessment (EQA) schemes are a tool for clinical laboratories to evaluate and manage the quality of laboratory practice with the support of an independent party (i.e., an EQA provider). Depending on the context, there are different types of EQA schemes available, as well as various EQA providers, each with its own field of expertise. In this review, an overview of the general requirements for EQA schemes and EQA providers based on international guidelines is provided. The clinical and scientific value of these kinds of schemes for clinical laboratories, clinicians and patients are highlighted, in addition to the support EQA can provide to other types of laboratories, e.g., laboratories affiliated to biotech companies. Finally, recent developments and challenges in laboratory medicine and quality management, for example, the introduction of artificial intelligence in the laboratory and the shift to a more individual-approach instead of a laboratory-focused approach, are discussed. EQA schemes should represent current laboratory practice as much as possible, which poses the need for EQA providers to introduce latest laboratory innovations in their schemes and to apply up-to-date guidelines. By incorporating these state-of-the-art techniques, EQA aims to contribute to continuous learning.