Harmonization of antineutrophil cytoplasmic antibodies (ANCA) testing by reporting test result-specific likelihood ratios: position paper

Toward harmonized interpretation of anticardiolipin and anti-β2-glycoprotein I antibody detection for diagnosis of antiphospholipid syndrome using defined level intervals and likelihood ratios: communication from the ISTH SSC Subcommittee on Lupus Anticoagulant/Antiphospholipid Antibodies

BACKGROUND

Improving harmonization of the clinical interpretation of anticardiolipin (aCL) and anti-β2-glycoprotein I (aβ2GPI) antibodies immunoglobulin G (IgG)/immunoglobulin M (IgM) in the diagnosis of antiphospholipid syndrome (APS) is desirable. Likelihood ratios (LRs) with corresponding test-result intervals can identify the power of a test to discriminate between a diseased and nondiseased patient and may be useful for the semiquantitative interpretation of aCL/aβ2GPI results.

OBJECTIVES

To determine moderate and high thresholds for aCL and aβ2GPI IgG/IgM measured with chemiluminescent immunoassay, enzyme-linked immunosorbent assay, fluorescence enzyme immunoassay, and multiplex flow immunoassay.

METHODS

aCL and aβ2GPI antibodies IgG/IgM were determined with 4 solid-phase systems in a case-control study population including 381 APS patients and 727 controls. Interval-specific LRs (IS-LR) were calculated for ranges determined by prespecified specificity and sensitivity levels. Three methods were used for determining thresholds that separated low, moderate, and high positive antibody levels. Interassay agreement was checked with Cohen's kappa statistics.

RESULTS

Assay- and antibody-specific thresholds demonstrated increasing IS-LR, reflecting different clinical significance for low, moderate, and high levels, especially for IgG aCL and aβ2GPI and in thrombotic APS. IS-LRs per antibody and unit range were comparable across solid-phase platforms resulting in enhanced harmonization of result interpretation. Agreement between assays for identifying high levels was improved by semiquantitative interpretation compared with that by quantitative reporting.

CONCLUSION

aCL and aβ2GPI IgG/IgM moderate and high thresholds were determined for 4 analytical platforms. Thresholds improve harmonized interpretation of aCL/aβ2GPI levels across platforms. The proposed thresholds should be verified in an independent case-control study to check interlaboratory transferability.

From autoantibody test results to decision making: Incorporating likelihood ratios within medical practice

Autoantibodies are important laboratory markers to support diagnosis of autoimmune diseases. Interpretation of autoantibodies is classically done in a dichotomous way (positive versus negative). Yet, interpretation of autoantibody test results can be improved by reporting likelihood ratios. Likelihood ratios convey information on how much more/less likely a test result is in individuals with the disease compared to individuals without the disease. It incorporates information on the antibody level (the higher the antibody level, the higher the association with the disease), which is helpful for (differential) diagnosis. Likelihood ratios are unit-independent and allow users to harmonize test result interpretation. When the likelihood ratio is combined with information on the pre-test probability, post-test probability can be appraised. In this review, the applicability of likelihood ratio in autoimmune diagnostics will be reviewed from the perspective of the clinician, the laboratory professional and the in vitro diagnostic industry.

Inter-assay diagnostic accuracy of cerebrospinal fluid kappa free light chains for the diagnosis of multiple sclerosis

Background

Cerebrospinal fluid (CSF) kappa free light chain (κFLC) measures gained increasing interest as diagnostic markers in multiple sclerosis (MS). However, the lack of studies comparing assay-dependent diagnostic cutoff values hinders their use in clinical practice. Additionally, the optimal κFLC parameter for identifying MS remains a subject of ongoing debate.

Objectives

The aim of this study was to compare same-sample diagnostic accuracies of the κFLC index, κIgG index, CSF κFLC/IgG ratio, and isolated CSF κFLC (iCSF-κFLC) between two reference centers using different methods.

Methods

Paired serum and CSF samples were analyzed for κFLC and albumin concentrations by Freelite®-Optilite (Sint-Jan Bruges hospital) and N Latex®-BNII (Ghent University hospital). Diagnostic performance to differentiate MS from controls was assessed using ROC curve analysis.

Results

A total of 263 participants were included (MS, n = 80). Optimal diagnostic cutoff values for the κFLC index (Freelite®-Optilite: 7.7; N Latex®-BNII: 4.71), κIgG index (Freelite®-Optilite: 14.15, N Latex®-BNII: 12.19), and CSF κFLC/IgG ratio (Freelite®-Optilite: 2.27; N Latex®-BNII: 1.44) differed between the two methods. Sensitivities related to optimal cutoff values were 89.9% (Freelite®-Optilite) versus 94.6% (N Latex®-BNII) for the κFLC index, 91% (Freelite®-Optilite) versus 92.2% (N Latex®-BNII) for the κIgG index, and 81.3% (Freelite®-Optilite) versus 91.4% (N Latex®-BNII) for the CSF κFLC/IgG ratio. However, for iCSF-κFLC, optimal diagnostic cutoff values (0.36 mg/L) and related specificities (81.8%) were identical with a related diagnostic sensitivity of 89.9% for Freelite®-Optilite and 90.5% for N Latex®-BNII. The diagnostic performance of the κFLC index [area under the curve (AUC) Freelite®-Optilite: 0.924; N Latex®-BNII: 0.962] and κIgG index (AUC Freelite®-Optilite: 0.929; N Latex®-BNII: 0.961) was superior compared to CSF oligoclonal bands (AUC: 0.898, sensitivity: 83.8%, specificity: 95.9%).

Conclusions

The κFLC index and the κIgG index seem to be excellent markers for identifying MS, irrespective of the method used for κFLC quantification. Based on the AUC, they appear to be the measures of choice. For all measures, optimal cutoff values differed between methods except for iCSF-κFLC. iCSF-κFLC might therefore serve as a method-independent, more cost-efficient, initial screening measure for MS. These findings are particularly relevant for clinical practice given the potential future implementation of intrathecal κFLC synthesis in MS diagnostic criteria and for future multicentre studies pooling data on κFLC measures.

Verification, implementation and harmonization of automated chemiluminescent immunoassays for MPO- and PR3-ANCA detection

OBJECTIVES

Antineutrophil cytoplasmic antibody (ANCA) testing assists clinicians diagnose ANCA-associated vasculitis (AAV). We aimed to verify and harmonize chemiluminescent immunoassays for the detection of myeloperoxidase (MPO)- and proteinase 3 (PR3)-ANCA.

METHODS

An in-house ELISA, a capture ELISA, and a chemiluminescent assay QUANTA Flash on a BIO-FLASH analyzer were used to detect MPO- and PR3-ANCA in sera from 39 patients with AAV, 55 patients with various non-AAV, and 66 patients with connective tissue diseases. The results of the assays were evaluated, and their clinical performance was assessed. The precision and linearity of the QUANTA Flash assays were determined, and likelihood ratios (LRs) for AAV at diagnosis were calculated.

RESULTS

The precision and linearity of the QUANTA Flash assays were confirmed. Overall agreement between 97.5 and 98.8 % and Cohen's kappa coefficients between 0.861 and 0.947 were observed for the results of the QUANTA Flash assays and ELISAs. The diagnostic sensitivity, specificity, and ROC analysis of the assays for AAV were statistically similar (in-house ELISA 89.7 %, 95.0 %, and 0.937; capture ELISA 92.3 %, 98.3 %, and 0.939; and QUANTA Flash 89.7 %, 95.9 %, and 0.972). For the QUANTA Flash assay results, the interval-specific LRs for AAV at diagnosis were: 0-8 CU had LR 0.08, 8-29 CU had LR 1.03, 29-121 CU had LR 7.76, 121-191 CU had LR 12.4, and >191 CU had LR ∞.

CONCLUSIONS

The QUANTA Flash MPO and PR3 assays provide precise and consistent results and have comparable clinical utility for AAV. The calculated LRs were consistent with published LRs, confirming the utility of LRs for harmonization of ANCA results.

ANCA detection with solid phase chemiluminescence assay: diagnostic and severity association in vasculitis

ANCA-associated vasculitis (AAV) comprises a group of necrotizing vasculitis that mainly affects small- and medium-sized vessels. Serum anti-neutrophil cytoplasmic antibodies (ANCA), mainly anti-myeloperoxidase (anti-MPO) and anti-proteinase 3 (anti-PR3), levels may correlate to severity, prognosis, and recurrence of the disease. A retrospective analysis of 101 patients with MPO-positive and 54 PR3-positive vasculitis was performed, using laboratory established cut-off value, measured by chemiluminescence. Furthermore, data of renal disease and pulmonary involvement were collected at vasculitis diagnosis, as well as the progress, requiring dialysis, transplant, or mortality. For anti-MPO antibodies with a diagnosis of vasculitis (n = 77), an area under the curve (AUC) was calculated (AUC = 0.8084), and a cut-off point of 41.5 IU/ml was determined. There were significant differences in anti-MPO levels between patients with renal or pulmonary dysfunction (n = 65) versus those without them (n = 36) (p = 0.0003), and a cut-off threshold of 60 IU/ml was established. For anti-PR3 antibodies with a diagnosis of vasculitis (n = 44), an area under the curve (AUC) was calculated (AUC = 0.7318), and a cut-off point of 20.5 IU/ml was determined. Significant differences in anti-PR3 levels were observed between those patients with renal or pulmonary dysfunction (n = 30) and those without them (n = 24) (p = 0.0048), and a cut-off threshold of 41.5 IU/ml was established. No significant differences between those patients who had a worse disease progression and those who did not were found for anti-MPO and anti-PR3. Anti-MPO and anti-PR3 levels at the moment of vasculitis diagnosis are related with disease severity but not with disease outcome or vasculitis recurrence.

Autoantibodies to dsDNA in the diagnosis, classification and follow-up of patients with systemic lupus erythematosus

Autoantibodies, in particular anti-dsDNA antibodies, are increasingly used for diagnosis, classification and follow-up of patients with SLE. Since standardization of autoantibody assays is a major challenge, more attention should be paid to harmonization initiatives and better definition of required test characteristics in classification criteria. For diagnosis and follow-up separate multi-center studies are required to establish test characteristics of distinct immuno-assays for both purposes. Finally, such studies should consider not to evaluate SLE as a single disease, but as a disease with distinct subtypes.

The harmonization issue in laboratory medicine: the commitment of CCLM

The analytical quality of the clinical laboratory results has shown a significant improvement over the past decades, thanks to the joint efforts of different stakeholders, while the comparability among the results produced by different laboratories and methods still presents some critical issues. During these years, Clinical Chemistry and Laboratory Medicine (CCLM) published several papers on the harmonization issue over all steps in the Total Testing Process, training an important number of laboratory professionals in evaluating and monitoring all the criticisms inherent to the pre-analytical, as well as analytical and post analytical phases: from the consensus statement on the most informative testing in emergency setting, to the prevention and detection of hemolysis or to patients identification and tube labeling procedures, as far as to different approaches to harmonize hormones measurements or to describe new reference methods or to harmonize the laboratory report. During these years the commitment of the journal, devoted to the harmonization processes has allowed to improve the awareness on the topic and to provide specific instruments to monitor the rate of errors and to improve patients safety.

Repository of intra- and inter-run variations of quantitative autoantibody assays: a European multicenter study

OBJECTIVES

No reference data are available on repositories to measure precision of autoantibody assays. The scope of this study was to document inter- and intra-run variations of quantitative autoantibody assays based on a real-world large international data set.

METHODS

Members of the European Autoimmunity Standardisation Initiative (EASI) group collected the data of intra- and inter-run variability obtained with assays quantifying 15 different autoantibodies in voluntary participating laboratories from their country. We analyzed the impact on the assay performances of the type of immunoassay, the number of measurements used to calculate the coefficient of variation (CVs), the nature and the autoantibody level of the internal quality control (IQC).

RESULTS

Data were obtained from 64 laboratories from 15 European countries between February and October 2021. We analyzed 686 and 1,331 values of intra- and inter-run CVs, respectively. Both CVs were significantly dependent on: the method of immunoassay, the level of IQC with higher imprecision observed when the antibody levels were lower than 2-fold the threshold for positivity, and the nature of the IQC with commercial IQCs having lower CVs than patients-derived IQCs. Our analyses also show that the type of autoantibody has low impact on the assay' performances and that 15 measurements are sufficient to establish reliable intra- and inter-run variations.

CONCLUSIONS

This study provides for the first time an international repository yielding values of intra- and inter-run variation for quantitative autoantibody assays. These data could be useful for ISO 15189 accreditation requirements and will allow clinical diagnostic laboratories to assure quality of patient results.

Standardisation of ACPA tests: evaluation of a new candidate reference preparation

INTRODUCTION

Commercial assays measuring antibodies to citrullinated protein/peptide (ACPA) show poor quantitative agreement. The diagnostic industry has never adopted the International Union of Immunological Societies-Centers for Disease Control and Prevention (IUIS-CDC) ACPA reference standard. Recently, the National Institute for Biological Standards and Control (NIBSC) prepared a new candidate ACPA standard (18/204). We evaluated both reference materials using different commercially available ACPA assays.

MATERIALS AND METHODS

This is an international study in which the NIBSC candidate ACPA standard and the IUIS-CDC ACPA reference material were analysed together with 398 diagnostic samples from individuals with rheumatoid arthritis (RA) and in 1073 individuals who did not have RA using nine commercial ACPA assays.

RESULTS

For both reference materials and samples from individuals with RA and individuals who did not have RA, there were large differences in quantitative ACPA results between assays. For most assays, values for the IUIS-CDC standard were lower than values for NIBSC 18/204 and the IUIS-CDC/NIBSC ratio was comparable for several, but not all assays. When NIBSC 18/204 was used as a calibrator, an improvement in alignment of ACPA results across several of the evaluated assays was obtained. Moreover, NIBSC 18/204 could align clinical interpretation for some but not all assays.

CONCLUSION

Adoption of an international standard for ACPA determination is highly desirable. The candidate NIBSC 18/204 standard improved the standardisation and alignment of most ACPA assays and might therefore be recommended to be used as reference in commercial assays.

Multicentre study to improve clinical interpretation of rheumatoid factor and anti-citrullinated protein/peptide antibodies test results

BACKGROUND

Rheumatoid factor (RF) and anti-citrullinated protein/peptide antibodies (ACPA) are important biomarkers for diagnosis of rheumatoid arthritis (RA). However, there is poor harmonisation of RF and ACPA assays. The aim of this study was to refine RF and ACPA interpretation across commercial assays.

MATERIALS AND METHODS

Six total RF isotype-non-specific assays, 3 RF IgM isotype-specific assays and 9 ACPA immunoglobulin G assays of 13 different companies were evaluated using 398 diagnostic samples from patients with RA and 1073 disease controls.

RESULTS

Using cut-offs proposed by the manufacturer, there was a large variability in diagnostic sensitivity and specificity between assays. Thresholds of antibody levels were determined based on predefined specificities and used to define test result intervals. Test result interval-specific likelihood ratios (LRs) were concordant across the different RF and ACPA assays. For all assays, the LR for RA increased with increasing antibody level. Higher LRs were found for ACPA than for RF. ACPA levels associated with LRs >80 were found in a substantial fraction (>22%) of patients with RA.

CONCLUSION

Defining thresholds for antibody levels and assigning test result interval-specific LRs allows alignment of clinical interpretation for all RF and ACPA assays.

Anti-dsDNA antibodies in the classification criteria of systemic lupus erythematosus

Anti-double stranded DNA (dsDNA) antibodies play an important role in the diagnosis, classification and management of systemic lupus erythematosus (SLE), an autoimmune disease characterized by heterogeneous clinical manifestations and a wide range of autoantibodies, which makes the diagnosis quite challenging. In the absence of diagnostic criteria, classification criteria have been used for many decades. The first classification criteria for SLE were formulated in 1971 by the American College of Rheumatology (ACR), followed by two revisions in 1982 and 1997. In order to improve their clinical performance and to reflect new knowledge on autoantibodies, new classification criteria for SLE were issued in 2012 by the Systemic Lupus International Collaborating Clinics (SLICC). These criteria proposed to classify only patients that have at least one immunologic criterion, overcoming SLE classification based solely on clinical manifestations. In 2019, the European League Against Rheumatism (EULAR)/ACR proposed new criteria that aimed to maintain the high specificity of the ACR criteria with a sensitivity close to the SLICC 2012 criteria. These 2019 criteria reinforced the importance of autoantibodies in SLE diagnosis, assigning the highest score (6 points) to anti-dsDNA antibodies in the fully weighted scoring of the disease. The current criteria require the use of an anti-dsDNA assay with at least 90% specificity, such as the Crithidia luciliae immunofluorescence test (CLIFT) or FARR assay. However, the criteria do not comment on all the tests currently widely used in clinical laboratories. Neither do they consider the technological evolutions, nor standardization issues. Since strict adherence to any of the classification criteria, including the serological items, could lead to possible misclassification of SLE and/or delayed diagnosis, test characteristics of the distinct immunoassays should be taken into consideration.

Laboratory evaluation of anti-dsDNA antibodies

Antibodies to dsDNA are an important laboratory parameter for diagnosis, monitoring and classification of systemic lupus erythematosus (SLE). In clinical laboratories, several techniques are used to detect and quantify anti-dsDNA antibodies. Each technique has its advantages and disadvantages regarding sensitivity, specificity, avidity and assay procedure. Assays differ with respect to the antigen source (native versus synthetic versus molecular biological) used and the way the antigen is presented (e.g. in solution, covalently linked to a solid phase,…). Consequently, correlation between assays can be poor and standardization of anti-dsDNA antibody tests is challenging. We here provide an overview of the currently available anti-dsDNA tests frequently used in clinical laboratories [Crithidiae luciliae immunofluorescence test (CLIFT), Enzyme linked immune sorbent assay (ELISA), fluoroenzyme immunoassay (FEIA), chemiluminescence (CIA), multiplexed bead-based assays and Farr-RIA] and their performance characteristics. From this literature study, we concluded that performance characteristics differ between assays. Often, a combination of techniques is necessary for the best result interpretation.

Laboratory-Developed Tests: Design of a Regulatory Strategy in Compliance with the International State-of-the-Art and the Regulation (EU) 2017/746 (EU IVDR [In Vitro Diagnostic Medical Device Regulation])

PURPOSE

This study aimed at the development of a regulatory strategy for compliance of laboratory-developed tests (LDTs) with requirements of the Regulation (EU) 2017/746 ("EU-IVDR") under consideration of international requirements for LDTs as established in major regulatory regions. Furthermore, it was analysed in how far elements of current LDT regulation could qualify for an internationally harmonised concept ensuring quality, safety and performance of LDTs.

METHODS

A review of regulatory literature including legislation as well as guidance documents was performed. The regulatory strategy was adapted from international guidance concepts used for commercially marketed IVD. It was then applied to the example of a large medical laboratory in the EU. A high-level comparison was conducted to identify gaps and matches between the different international regulatory requirements for LDTs.

RESULTS

A four-step strategy for compliance of LDTs with the EU IVDR was implemented in an exemplary medical laboratory. On the basis of an internationally used LDT definition, LDTs constitute nearly 50% of the total IVD devices used in the laboratory. While an ISO 15189-compliant QMS is a major component, it should be accompanied by the application of appropriate processes for risk management, performance evaluation and continuous monitoring of LDTs. At least six criteria represent common characteristics of a potential, internationally convergent concept for the regulation/standardization of LDTs.

CONCLUSIONS

This study confirms the impact of LDTs for individualized and innovative medical laboratory testing. Prerequisites for LDT use as especially given by the IVDR and missing interpretation in the EU with regard to the scope of LDT definition, the application of standards and the extent of documentation for LDTs currently lead to uncertainties for both laboratories and regulatory bodies responsible for LDT oversight. The characteristics identified as common criteria for ensuring quality, safety and performance of LDTs may be considered as central elements of future international consensus guidance.

The mosaic of autoimmunity - A taste for more. The 12th international congress of autoimmunity 2021 (AUTO12) virtual

Notwithstanding the fact that the 12th international congress of autoimmunity (AUTO12) was held virtual this year, the number of the abstracts submitted and those presented crossed the thousand marks. Leading investigators and researchers from all over the world presented the latest developments of their research in the domain of autoimmunity and its correlation with various diseases. In terms of mechanisms of autoimmunity, an update on the mechanisms behind the association of autoimmunity with systemic diseases focusing on hyperstimulation was presented during AUTO12. In addition, a new mechanism of ASIA syndrome caused by an intrauterine contraceptive device was revealed demonstrating a complete resolution of symptoms following device removal. In regard to the correlation between autoimmunity and neurogenerative diseases, the loss of structural protein integrity as the trigger of immunological response was shown. Schizophrenia as well, and its correlation to pro-inflammatory cytokines was also addressed. Furthermore, and as it was said AUTO12 virtual due to COVID-19 pandemic, various works were dedicated to SARS-CoV-2 infection and COVID-19 in terms of autoimmune mechanisms involved in the pathogenesis, treatment and complications of COVID-19. For instance, the correlation between autoimmunity and the severity of COVID-19 was viewed. Moreover, the presence and association of autoantibodies in COVID-19 was also demonstrated, as well as the clinical outcomes of COVID-19 in patients with rheumatic diseases. Finally, immune-mediated reactions and processes secondary to SARS-CoV-2 vaccination was displayed. Due to the immense importance of all of the topics addressed and while several hundreds of works were presented which cannot be summed up in one paper, we aimed hereby to highlight some of the outstanding abstracts and presentations during AUTO12.

Autoantibodies in Rheumatoid Arthritis - Laboratory and Clinical Perspectives

Measurement of two groups of autoantibodies, rheumatoid factor (RF) and anti-citrullinated protein/peptide antibodies (ACPA) have gained increasing significance in the diagnosis and classification of rheumatoid arthritis (RA) over the last 65 years. Despite this rising importance of autoimmune serology in RA, there is a palpable lack of harmonization between different commercial RF and ACPA tests. While a minimal diagnostic specificity has been defined for RF tests, which almost always are related to an international reference preparation, neither of this applies to ACPA. Especially assays with low diagnostic specificity are associated with very low positive predictive values or post-test probabilities in real world settings. In this review we focus on issues of practical bearing for the clinical physician diagnosing patients who potentially have RA, or treating patients diagnosed with RA. We advocate that all clinically used assays for RF and ACPA should be aligned to a common diagnostic specificity of 98-99% compared to healthy controls. This high and rather narrow interval corresponds to the diagnostic specificity seen for many commercial ACPA tests, and represents a specificity that is higher than what is customary for most RF assays. Data on antibody occurrence harmonized in this way should be accompanied by test result-specific likelihood ratios for the target diagnosis RA on an ordinal or interval scale, which will provide the clinical physician with more granular and richer information than merely relating numerical values to a single cut-off point. As many physicians today are used to evaluate autoantibodies as positive or negative on a nominal scale, the introduction of test result-specific likelihood ratios will require a change in clinical mindset. We also discuss the use of autoantibodies to prognosticate future arthritis development in at-risk patients as well as predict severe disease course and outcome of pharmacological treatment.

ANCA Testing in Clinical Practice: From Implementation to Quality Control and Harmonization

Analyses for the presence of anti-neutrophil cytoplasmic antibodies (ANCA) are important in the diagnostic work-up of patients with small vessel vasculitis. Since current immuno-assays are predominantly designed for diagnosis of patients with ANCA-associated vasculitis (AAV), implementation in routine clinical practice, internal and external quality control, and harmonization are focused on this particular use. However, ANCA testing may also be relevant for monitoring therapy efficacy and for predicting a clinical relapse in AAV patients, and even for diagnostic purposes in other clinical situations. In the current review, the topics of implementation, quality control, and standardization vs. harmonization are discussed while taking into account the different applications of the ANCA assays in the context of AAV.