Quality and best practice in medical laboratories: specific requests for autoimmunity testing

Evaluation of a New Multiparametric Microdot Array-Based Immunoassay Panel for Systemic Autoimmune Disease Diagnosis

BACKGROUND

The early reliable detection and quantification of autoantibodies play an important role in autoimmune disease diagnosis and in disease-course monitoring. New technologies, such as the multiplexed determination of autoantibodies, have recently been introduced and are being adopted more frequently. The aim of this study was to evaluate the ability of a new microdot array-based multiparametric assay (ZENIT AMiDot CTD panel, A. Menarini Diagnostics, Firenze, Italy) to correctly classify patients with autoimmune rheumatic diseases (ARDs) and compare it to a fluorescence enzyme immunoassay (FEIA) for the detection of anti-ENAs.

METHODS

The study included 69 consecutive samples from patients with ARDs that were analyzed using two different methods (FEIA and AMiDot) to detect anti-CENP B and six anti-ENA antibodies: anti-Scl-70, anti-SSB/La, anti-Jo-1, anti-U1-RNP, anti-Ro52, and anti-Ro60. The control group sera came from sixty-eight blood donors. Tests were run on the automated slide processor ZENIT FLOW, and then the slides were imaged and analyzed using ZENIT fast.

RESULTS

Since the samples were selected for at least one antibody positivity with an ARD diagnosis, we did not calculate clinical sensitivity but only specificity, which was 98.53%, ranging from 90% for anti-SSB/La antibodies to 100% for anti-CENP B ones. Mean agreement among the methods assessed by Cohen's kappa was 0.816 ± 0.240.

CONCLUSIONS

The assay demonstrated good clinical performance and may be considered a valuable aid in detecting ARD patients, offering an alternative to methods such as FEIA which are largely in use today.

Harmonization of ANA testing challenge: quantification strategy to accurately predict end-point titers avoiding serial dilution

Despite the advantages of automated systems for antinuclear antibody (ANA) analysis, the prediction of end-point titers avoiding serial dilutions is still in progress. The aims of this study were to set a conversion table providing discriminant ranges of fluorescence signal intensity values (FI) corresponding to the end-point titers and validate this tool in a real-life laboratory setting. Eight hundred ninety-four serum samples were analyzed for ANA using Image Navigator System. In order to classify FI into non-overlapping groups corresponding to conventional end-point titers, statistical discriminant analysis was used. Validation study was performed calculating agreement and error rates between visual readings and conversion table of 1119 routine ANA positive samples. Setting of FI ranges corresponding to the end-point titers for different staining patterns was computed. For samples showing single pattern, the overall agreement between visual readings and conversion table was 98.4% for all titers ranging from 1:160 to 1:2560, of which 68.0% had the same titer and 30.4% were within ± one titer difference. Concordance rates according to ANA patterns were as follows: (1) nuclear 98.4%, of which 67.0% had the same titer and 31.4% ± one titer; (2) cytoplasmic 100%, of which 72.7% had the same titer and 27.3% than ± one titer; (3) mitotic 66.6%, of which 33.3% had more ± one titer. Our study developed a quantification method for autoantibodies titers assessment based on just one single sample dilution instead of traditional serial dilution approach, providing significant advantages in routine laboratory in terms of reduction in hand-on time and harmonization of results.

Analytical aspects of the antinuclear antibody test by HEp-2 indirect immunofluorescence: EFLM report on an international survey

OBJECTIVES

Detection of antinuclear antibodies (ANA) by indirect immunofluorescence assay using HEp-2 cells (HEp-2 IFA) is used to screen for various autoimmune diseases. HEp-2 IFA suffers from variability, which hampers harmonization.

METHODS

A questionnaire was developed to collect information on HEp-2 IFA methodology, computer-assisted diagnosis (CAD) systems, training, inter-observer variability, quality assessment, reagent lot change control, and method verification. The questionnaire was distributed to laboratories by Sciensano (Belgium), national EASI groups (Italy, Croatia, Portugal, Estonia, Greece) and ICAP (worldwide). Answers were obtained by 414 laboratories. The results were analysed in the framework of the recent EFLM/EASI/ICAP ANA recommendations (companion paper).

RESULTS

Laboratories used either HEp-2, HEp-2000, or HEp-20-10 cells and most laboratories (80%) applied the same screening dilution for children and adults. The conjugate used varied between laboratories [IgG-specific (in 57% of laboratories) vs. polyvalent]. Sixty-nine percent of CAD users reviewed the automatic nuclear pattern and 53% of CAD users did not fully exploit the fluorescence intensity for quality assurance. Internal quality control was performed by 96% of the laboratories, in 52% of the laboratories only with strongly positive samples. Interobserver variation was controlled by 79% of the laboratories. Limited lot-to-lot evaluation was performed by 68% of the laboratories. Method verification was done by 80% of the respondents.

CONCLUSIONS

Even though many laboratories embrace high-quality HEp-2 IFA, substantial differences in how HEp-2 IFA is performed and controlled remain. Acting according to the EFLM/EASI/ICAP ANA recommendations can improve the global performance and quality of HEp-2 IFA and nurture harmonization.

Detection of antinuclear antibodies: recommendations from EFLM, EASI and ICAP

OBJECTIVES

Antinuclear antibodies (ANA) are important for the diagnosis of various autoimmune diseases. ANA are usually detected by indirect immunofluorescence assay (IFA) using HEp-2 cells (HEp-2 IFA). There are many variables influencing HEp-2 IFA results, such as subjective visual reading, serum screening dilution, substrate manufacturing, microscope components and conjugate. Newer developments on ANA testing that offer novel features adopted by some clinical laboratories include automated computer-assisted diagnosis (CAD) systems and solid phase assays (SPA).

METHODS

A group of experts reviewed current literature and established recommendations on methodological aspects of ANA testing. This process was supported by a two round Delphi exercise. International expert groups that participated in this initiative included (i) the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group "Autoimmunity Testing"; (ii) the European Autoimmune Standardization Initiative (EASI); and (iii) the International Consensus on ANA Patterns (ICAP).

RESULTS

In total, 35 recommendations/statements related to (i) ANA testing and reporting by HEp-2 IFA; (ii) HEp-2 IFA methodological aspects including substrate/conjugate selection and the application of CAD systems; (iii) quality assurance; (iv) HEp-2 IFA validation/verification approaches and (v) SPA were formulated. Globally, 95% of all submitted scores in the final Delphi round were above 6 (moderately agree, agree or strongly agree) and 85% above 7 (agree and strongly agree), indicating strong international support for the proposed recommendations.

CONCLUSIONS

These recommendations are an important step to achieve high quality ANA testing.

Repository of intra- and inter-run variations of quantitative autoantibody assays: a European multicenter study

OBJECTIVES

No reference data are available on repositories to measure precision of autoantibody assays. The scope of this study was to document inter- and intra-run variations of quantitative autoantibody assays based on a real-world large international data set.

METHODS

Members of the European Autoimmunity Standardisation Initiative (EASI) group collected the data of intra- and inter-run variability obtained with assays quantifying 15 different autoantibodies in voluntary participating laboratories from their country. We analyzed the impact on the assay performances of the type of immunoassay, the number of measurements used to calculate the coefficient of variation (CVs), the nature and the autoantibody level of the internal quality control (IQC).

RESULTS

Data were obtained from 64 laboratories from 15 European countries between February and October 2021. We analyzed 686 and 1,331 values of intra- and inter-run CVs, respectively. Both CVs were significantly dependent on: the method of immunoassay, the level of IQC with higher imprecision observed when the antibody levels were lower than 2-fold the threshold for positivity, and the nature of the IQC with commercial IQCs having lower CVs than patients-derived IQCs. Our analyses also show that the type of autoantibody has low impact on the assay' performances and that 15 measurements are sufficient to establish reliable intra- and inter-run variations.

CONCLUSIONS

This study provides for the first time an international repository yielding values of intra- and inter-run variation for quantitative autoantibody assays. These data could be useful for ISO 15189 accreditation requirements and will allow clinical diagnostic laboratories to assure quality of patient results.

Rational development and application of biomarkers in the field of autoimmunity: A conceptual framework guiding clinicians and researchers

Clear guidance is needed in the development and implementation of laboratory biomarkers in medicine. So far, no standardized phased approach is established that would pilot researchers and clinicians in this process. This leads to often incompletely validated biomarkers, which can bear the consequence of wrong applications, misinterpretation and inadequate management in the clinical context.

In this conceptual article, we describe a stepwise approach to develop and comprehensively validate laboratory biomarkers. We will delineate basic steps including technical performance, pre-analytical issues, and biological variation, as well as advanced aspects of biomarker utility comprising interpretability, diagnostic and prognostic accuracy, and health-care outcomes. These aspects will be illustrated by using well-known examples from the field of immunology.

The application of this conceptual framework will guide researchers in conducting meaningful projects to develop and evaluate biomarkers for the use in clinical practice. Furthermore, clinicians will be able to adequately interpret pre-clinical and clinical diagnostic literature and rationally apply biomarkers in clinical practice. Improvement in the implementation and application of biomarkers might relevantly change the management and outcomes of our patients for the better.

Impact of the COVID-19 Pandemic on the Appropriateness of Diagnostic Pathways of Autoimmune Rheumatic Diseases

OBJECTIVE

Early diagnosis of autoimmune rheumatic diseases (ARDs) is key to achieving effective treatment and improving prognosis. The coronavirus disease 2019 (COVID-19) pandemic has led to major changes in clinical practice on a global scale. We aimed to evaluate the impact of the COVID-19 pandemic on rheumatological clinical practice and autoimmunity testing demands.

METHODS

Data regarding the first rheumatological visits and new diagnoses, together with the autoimmunity laboratory testing volumes related to the COVID-19 pandemic phase (January-December 2020), were collected from medical records and the laboratory information system of a regional reference hospital (Basilicata, Italy) and compared with those obtained during the corresponding period in 2019.

RESULTS

A significant decrease in the 2020 autoimmunity laboratory test volume was found when compared with the same period in 2019 (9912 vs 14,100; P < 0.05). A significant decrease in first rheumatological visits and diagnosis (1272 vs 2336; P < 0.05) was also observed. However, an equivalent or higher percentage of positive autoimmunity results from outpatient services was recorded during 2020 when compared to the prepandemic state. Of note, COVID-19-associated decline in new diagnoses affected mainly less severe diseases. In contrast, ARDs with systemic involvement were diagnosed at the same levels as in the prepandemic period.

CONCLUSION

The COVID-19 pandemic has affected access to health services. However, our study highlighted that during the outbreak, greater appropriateness of the requests for laboratory tests and visits emerged, as shown by a greater percentage of positive test results and new diagnoses of more severe ARDs compared to the prepandemic period.

How to report the antinuclear antibodies (anti-cell antibodies) test on HEp-2 cells: guidelines from the ICAP initiative

Results of the anti-nuclear antibodies-indirect immunofluorescence assay (anti-cell antibodies test) on HEp-2 cell substrates should be communicated to clinicians in a standardized way, adding value to laboratory findings and helping with critical clinical decisions. This paper proposes a test report based on the practices informed by 118 laboratories in 68 countries, with recommendations from the International Consensus on ANA Patterns (ICAP) group. Major focus is placed on the report format containing endpoint titers, immunofluorescence patterns together with anti-cell (AC) nomenclature, remarks on follow-up or reflex testing, and possible other autoantibody associations. ISO 15,189 directives were integrated into the test report. Special situations addressed include serum screening dilutions and endpoint titers, relevance of immunofluorescence patterns with special attention to cytoplasmic patterns, mixed and compound patterns, and how to report different titers corresponding to multiple patterns or autoantibodies in the same sample. This paper suggests a subtitle for the HEp-2-IIFA, namely anti-cell antibodies test, which could gradually substitute the original outdated ANA nomenclature. This ICAP pro forma report represents a further step in harmonizing the way relevant clinical information could be provided by laboratories.

Autoantibodies in Rheumatoid Arthritis - Laboratory and Clinical Perspectives

Measurement of two groups of autoantibodies, rheumatoid factor (RF) and anti-citrullinated protein/peptide antibodies (ACPA) have gained increasing significance in the diagnosis and classification of rheumatoid arthritis (RA) over the last 65 years. Despite this rising importance of autoimmune serology in RA, there is a palpable lack of harmonization between different commercial RF and ACPA tests. While a minimal diagnostic specificity has been defined for RF tests, which almost always are related to an international reference preparation, neither of this applies to ACPA. Especially assays with low diagnostic specificity are associated with very low positive predictive values or post-test probabilities in real world settings. In this review we focus on issues of practical bearing for the clinical physician diagnosing patients who potentially have RA, or treating patients diagnosed with RA. We advocate that all clinically used assays for RF and ACPA should be aligned to a common diagnostic specificity of 98-99% compared to healthy controls. This high and rather narrow interval corresponds to the diagnostic specificity seen for many commercial ACPA tests, and represents a specificity that is higher than what is customary for most RF assays. Data on antibody occurrence harmonized in this way should be accompanied by test result-specific likelihood ratios for the target diagnosis RA on an ordinal or interval scale, which will provide the clinical physician with more granular and richer information than merely relating numerical values to a single cut-off point. As many physicians today are used to evaluate autoantibodies as positive or negative on a nominal scale, the introduction of test result-specific likelihood ratios will require a change in clinical mindset. We also discuss the use of autoantibodies to prognosticate future arthritis development in at-risk patients as well as predict severe disease course and outcome of pharmacological treatment.

ANCA Testing in Clinical Practice: From Implementation to Quality Control and Harmonization

Analyses for the presence of anti-neutrophil cytoplasmic antibodies (ANCA) are important in the diagnostic work-up of patients with small vessel vasculitis. Since current immuno-assays are predominantly designed for diagnosis of patients with ANCA-associated vasculitis (AAV), implementation in routine clinical practice, internal and external quality control, and harmonization are focused on this particular use. However, ANCA testing may also be relevant for monitoring therapy efficacy and for predicting a clinical relapse in AAV patients, and even for diagnostic purposes in other clinical situations. In the current review, the topics of implementation, quality control, and standardization vs. harmonization are discussed while taking into account the different applications of the ANCA assays in the context of AAV.

Standardization and Quality Assessment Under the Perspective of Automated Computer-Assisted HEp-2 Immunofluorescence Assay Systems

The recent availability of automated computer-assisted diagnosis (CAD) systems for the reading and interpretation of the anti-nuclear antibody (ANA) test performed with the indirect immunofluorescence (IIF) method on HEp-2 cells, has improved the reproducibility of the results and initiated a process of harmonization of this test. Furthermore, CAD systems provide quantitative expression of fluorescence intensity, allowing the introduction of objective quality control procedures to the monitoring of the entire process. The calibration of the reading systems and the automated image interpretation are essential prerequisites for obtaining reproducible and harmonized IIF test results and form the basis for standardization, regardless of the computer algorithms used in the different systems. The use of automated CAD systems, facilitating control procedures, represents a step forward for the quality certification of the laboratory.

Integrating quality assurance in autoimmunity: the changing face of the automated ANA IIF test

OBJECTIVES

Currently available computer-aided diagnosis (CAD) systems for the detection of anti-nuclear antibodies (ANA) by indirect immunofluorescence (IIF) assay enable a standardized measurement of system-specific fluorescent intensity (FI) measures. We aimed to evaluate an internal quality control (iQC) program that controls the total ANA IIF process in routine practice.

METHODS

In addition to the kit iQC materials, supplemental quality indicators were integrated in a total quality assurance (QA) program: patient-derived iQC's samples (negative, 1/160 fine speckled and 1/160 homogeneous), median sample FI per run and percentage of ANA IIF positive samples per run. Analytical rejection criteria were based on the imprecision of the positivity index (PI) measure of the Zenit PRO system (Menarini). Clinical rejection criteria were based on changes in FI that correspond to a change in ANA IIF titer of ≥2. To evaluate the QA program, different artificial errors were introduced during the ANA IIF process. After every run, quality indicators were evaluated and compared to the pre-set target values.

RESULTS

Rescanning the ANA IIF slides five times, using an old conjugate and a needle obstruction resulted in analytically and even clinically relevant errors in ANA IIF results. All errors were correctly detected by the different defined quality indicators. Traditional Westgard rules, including analytically (and clinically) defined rejection limits were useful in monitoring quality indicators.

CONCLUSIONS

The integration of a total process iQC program in CAD systems, based on the specific FI measurands and performance criteria of the system, adds value to QA.