ANA IIF Automation: Moving towards Harmonization? Results of a Multicenter Study

A novel way to evaluate autoantibody interference in samples with mixed antinuclear antibody patterns in the HEp-2 cell based indirect immunofluorescence assay and comparison of conventional microscopic and computer-aided pattern recognition

BACKGROUND

A major challenge of the HEp-2 cell-based indirect immunofluorescence (IIF) assays is the correct identification of the individual anti-nuclear antibodies (ANAs) if more than one is present in a sample. We created artificial mixes by pooling two different samples with a single autoantibody in different titers. Comparison of the expected and observed patterns and titers clarifies the interference between the two tested ANAs.

METHODS

Serum samples with a single homogeneous or speckled ANA pattern were serially diluted and mixed in 16 combinations, providing end-point titers of 1:5,120 to 1:80 for both patterns. These mixes were tested by a HEp-2 IIF assay and were evaluated by conventional evaluation, the EUROPattern (EPa) system and on-screen analysis.

RESULTS

Homogeneous pattern can alter the identification of the speckled pattern much more than vice versa, but both has an interfering effect on the other. The effect of the interfering on the tested pattern was higher if the titer of the former one was higher. The pattern recognition efficacy of conventional and the on-screen evaluation was similar and superior compared to the EPa analysis.

CONCLUSIONS

The application of artificial mixed samples can help the evaluation of the efficacy of manual and computer-aided ANA HEp-2 pattern recognition.

Charting the Next Road Map for CSF Biomarkers in Alzheimer's Disease and Related Dementias

Clinical prediction of underlying pathologic substrates in people with Alzheimer's disease (AD) dementia or related dementia syndromes (ADRD) has limited accuracy. Etiologic biomarkers - including cerebrospinal fluid (CSF) levels of AD proteins and cerebral amyloid PET imaging - have greatly modernized disease-modifying clinical trials in AD, but their integration into medical practice has been slow. Beyond core CSF AD biomarkers (including beta-amyloid 1-42, total tau, and tau phosphorylated at threonine 181), novel biomarkers have been interrogated in single- and multi-centered studies with uneven rigor. Here, we review early expectations for ideal AD/ADRD biomarkers, assess these goals' future applicability, and propose study designs and performance thresholds for meeting these ideals with a focus on CSF biomarkers. We further propose three new characteristics: equity (oversampling of diverse populations in the design and testing of biomarkers), access (reasonable availability to 80% of people at risk for disease, along with pre- and post-biomarker processes), and reliability (thorough evaluation of pre-analytical and analytical factors influencing measurements and performance). Finally, we urge biomarker scientists to balance the desire and evidence for a biomarker to reflect its namesake function, indulge data- as well as theory-driven associations, re-visit the subset of rigorously measured CSF biomarkers in large datasets (such as Alzheimer's disease neuroimaging initiative), and resist the temptation to favor ease over fail-safe in the development phase. This shift from discovery to application, and from suspended disbelief to cogent ingenuity, should allow the AD/ADRD biomarker field to live up to its billing during the next phase of neurodegenerative disease research.

Analytical aspects of the antinuclear antibody test by HEp-2 indirect immunofluorescence: EFLM report on an international survey

OBJECTIVES

Detection of antinuclear antibodies (ANA) by indirect immunofluorescence assay using HEp-2 cells (HEp-2 IFA) is used to screen for various autoimmune diseases. HEp-2 IFA suffers from variability, which hampers harmonization.

METHODS

A questionnaire was developed to collect information on HEp-2 IFA methodology, computer-assisted diagnosis (CAD) systems, training, inter-observer variability, quality assessment, reagent lot change control, and method verification. The questionnaire was distributed to laboratories by Sciensano (Belgium), national EASI groups (Italy, Croatia, Portugal, Estonia, Greece) and ICAP (worldwide). Answers were obtained by 414 laboratories. The results were analysed in the framework of the recent EFLM/EASI/ICAP ANA recommendations (companion paper).

RESULTS

Laboratories used either HEp-2, HEp-2000, or HEp-20-10 cells and most laboratories (80%) applied the same screening dilution for children and adults. The conjugate used varied between laboratories [IgG-specific (in 57% of laboratories) vs. polyvalent]. Sixty-nine percent of CAD users reviewed the automatic nuclear pattern and 53% of CAD users did not fully exploit the fluorescence intensity for quality assurance. Internal quality control was performed by 96% of the laboratories, in 52% of the laboratories only with strongly positive samples. Interobserver variation was controlled by 79% of the laboratories. Limited lot-to-lot evaluation was performed by 68% of the laboratories. Method verification was done by 80% of the respondents.

CONCLUSIONS

Even though many laboratories embrace high-quality HEp-2 IFA, substantial differences in how HEp-2 IFA is performed and controlled remain. Acting according to the EFLM/EASI/ICAP ANA recommendations can improve the global performance and quality of HEp-2 IFA and nurture harmonization.

Detection of antinuclear antibodies: recommendations from EFLM, EASI and ICAP

OBJECTIVES

Antinuclear antibodies (ANA) are important for the diagnosis of various autoimmune diseases. ANA are usually detected by indirect immunofluorescence assay (IFA) using HEp-2 cells (HEp-2 IFA). There are many variables influencing HEp-2 IFA results, such as subjective visual reading, serum screening dilution, substrate manufacturing, microscope components and conjugate. Newer developments on ANA testing that offer novel features adopted by some clinical laboratories include automated computer-assisted diagnosis (CAD) systems and solid phase assays (SPA).

METHODS

A group of experts reviewed current literature and established recommendations on methodological aspects of ANA testing. This process was supported by a two round Delphi exercise. International expert groups that participated in this initiative included (i) the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group "Autoimmunity Testing"; (ii) the European Autoimmune Standardization Initiative (EASI); and (iii) the International Consensus on ANA Patterns (ICAP).

RESULTS

In total, 35 recommendations/statements related to (i) ANA testing and reporting by HEp-2 IFA; (ii) HEp-2 IFA methodological aspects including substrate/conjugate selection and the application of CAD systems; (iii) quality assurance; (iv) HEp-2 IFA validation/verification approaches and (v) SPA were formulated. Globally, 95% of all submitted scores in the final Delphi round were above 6 (moderately agree, agree or strongly agree) and 85% above 7 (agree and strongly agree), indicating strong international support for the proposed recommendations.

CONCLUSIONS

These recommendations are an important step to achieve high quality ANA testing.

Standardization and Quality Assessment Under the Perspective of Automated Computer-Assisted HEp-2 Immunofluorescence Assay Systems

The recent availability of automated computer-assisted diagnosis (CAD) systems for the reading and interpretation of the anti-nuclear antibody (ANA) test performed with the indirect immunofluorescence (IIF) method on HEp-2 cells, has improved the reproducibility of the results and initiated a process of harmonization of this test. Furthermore, CAD systems provide quantitative expression of fluorescence intensity, allowing the introduction of objective quality control procedures to the monitoring of the entire process. The calibration of the reading systems and the automated image interpretation are essential prerequisites for obtaining reproducible and harmonized IIF test results and form the basis for standardization, regardless of the computer algorithms used in the different systems. The use of automated CAD systems, facilitating control procedures, represents a step forward for the quality certification of the laboratory.

Integrating quality assurance in autoimmunity: the changing face of the automated ANA IIF test

OBJECTIVES

Currently available computer-aided diagnosis (CAD) systems for the detection of anti-nuclear antibodies (ANA) by indirect immunofluorescence (IIF) assay enable a standardized measurement of system-specific fluorescent intensity (FI) measures. We aimed to evaluate an internal quality control (iQC) program that controls the total ANA IIF process in routine practice.

METHODS

In addition to the kit iQC materials, supplemental quality indicators were integrated in a total quality assurance (QA) program: patient-derived iQC's samples (negative, 1/160 fine speckled and 1/160 homogeneous), median sample FI per run and percentage of ANA IIF positive samples per run. Analytical rejection criteria were based on the imprecision of the positivity index (PI) measure of the Zenit PRO system (Menarini). Clinical rejection criteria were based on changes in FI that correspond to a change in ANA IIF titer of ≥2. To evaluate the QA program, different artificial errors were introduced during the ANA IIF process. After every run, quality indicators were evaluated and compared to the pre-set target values.

RESULTS

Rescanning the ANA IIF slides five times, using an old conjugate and a needle obstruction resulted in analytically and even clinically relevant errors in ANA IIF results. All errors were correctly detected by the different defined quality indicators. Traditional Westgard rules, including analytically (and clinically) defined rejection limits were useful in monitoring quality indicators.

CONCLUSIONS

The integration of a total process iQC program in CAD systems, based on the specific FI measurands and performance criteria of the system, adds value to QA.

Evaluation of a Fully Automated Antinuclear Antibody Indirect Immunofluorescence Assay in Routine Use

Indirect immunofluorescence assay (IFA) using HEp-2 cells as a substrate is the gold standard for detecting antinuclear antibodies (ANA) in patient serum. However, the ANA IFA has labor-intensive nature of the procedure and lacks adequate standardization. To overcome these drawbacks, the automation has been developed and implemented to the clinical laboratory. The purposes of this study were to evaluate the analytical performance of a fully automated Helios ANA IFA analyzer in a real-life laboratory setting, and to compare the time and the cost of ANA IFA testing before and after adopting the Helios system. A total of 3,276 consecutive serum samples were analyzed for ANA using the Helios system from May to August 2019. The positive/negative results, staining patterns, and endpoint titers were compared between Helios and visual readings. Furthermore, the turnaround time and the number of wells used were compared before and after the introduction of Helios system. Of the 3,276 samples tested, 748 were positive and 2,528 were negative based on visual readings. Using visual reading as the reference standard, the overall relative sensitivity, relative specificity, and concordance of Helios reading were 73.3, 99.4, and 93.4% (κ = 0.80), respectively. For pattern recognition, the overall agreement was 70.1% (298/425) for single patterns, and 72.4% (89/123) for mixed patterns. For titration, there was an agreement of 75.9% (211/278) between automated and classical endpoint titers by regarding within ± one titer difference as acceptable. Helios significantly shortened the median turnaround time from 100.6 to 55.7 h (P < 0.0001). Furthermore, routine use of the system reduced the average number of wells used per test from 4 to 1.5. Helios shows good agreement in distinguishing between positive and negative results. However, it still has limitations in positive/negative discrimination, pattern recognition, and endpoint titer prediction, requiring additional validation of results by human observers. Helios provides significant advantages in routine laboratory ANA IFA work in terms of labor, time, and cost savings. We hope that upgrading and developing softwares with more reliable capabilities will allow automated ANA IFA analyzers to be fully integrated into the routine operations of the clinical laboratory.

Antinuclear Antibodies Testing Method Variability: A Survey of Participants in the College of American Pathologists' Proficiency Testing Program

OBJECTIVE

This study was conducted to determine the spectrum of laboratory practices in antinuclear antibody (ANA) test target, performance, and result reporting.

METHODS

A questionnaire on ANA testing was distributed by the Diagnostic Immunology and Flow Cytometry Committee of the College of American Pathologists (CAP) to laboratories participating in the 2016 CAP ANA proficiency survey.

RESULTS

Of 5847 survey kits distributed, 1206 (21%) responded. ANA screening method varied: 55% indirect immunofluorescence assay, 21% ELISA, 12% multibead immunoassay, and 18% other methods. The name of the test indicated the method used in only 32% of laboratories; only 39% stated the method used on the report. Of 644 laboratories, 80% used HEp-2 cell substrate, 18% HEp-2000 (HEp-2 cell line engineered to overexpress SSA antigen, Ro60), and 2% other. Slides were prepared manually (67%) or on an automated platform (33%) and examined by direct microscopy (84%) or images captured by an automated platform (16%). Only 50% reported a positive result at the customary 1:40 dilution. Titer was reported to endpoint routinely by 43%, only upon request by 23%, or never by 35%. Of the laboratories, 8% did not report dual patterns. Of those reporting multiple patterns, 23% did not report a titer with each pattern.

CONCLUSION

ANA methodology and practice, and test naming and reporting varies significantly between laboratories. Lack of uniformity in testing and reporting practice and lack of transparency in communicating the testing method may misdirect clinicians in their management of patients.

Harmonizing by reducing inter-run variability: performance evaluation of a quality assurance program for antinuclear antibody detection by indirect immunofluorescence

Background

The introduction of automated anti-nuclear antibody (ANA) indirect immunofluorescence (IIF) analysis may allow for more harmonized ANA IIF reporting, provided that a thorough quality assurance program controls this process. The aim of this study was to evaluate various quality indicators used for ANA IIF analysis with the final goal of optimizing the iQC program.

Methods

In an experimental setup, we introduced artificial errors, mimicking plausible problems during routine practice on a QUANTA-Lyser-NOVA View® system (Inova Diagnostics, San Diego, CA, USA). Predetermined quality indicators were evaluated against predefined acceptance criteria. In addition, we retrospectively investigated the applicability of the selected quality indicators in the daily routine practice during three pre-defined periods.

Results

Both the experimental as the retrospective study revealed that pre-analytical, analytical and post-analytical errors were not highlighted by company internal quality control (iQC) materials. The use of patient derived iQC samples, median fluorescence intensity results per run and the percentage of positive ANA IIF results as additional quality indicators ensured a more adequate ANA IIF quality assurance. Furthermore, negative and moderate positive sample iQC materials merit clinical validation, as titer changes of >1 correspond to clinically important shifts. Traditional Westgard rules, including a clinically defined stop limit, revealed to be useful in monitoring of the supplemental quality indicators.

Conclusions

A thorough ANA IIF quality assurance for daily routine practice necessitates the addition of supplemental quality indicators in combination with well-defined acceptance criteria.

Performance analysis of automated evaluation of antinuclear antibody indirect immunofluorescent tests in a routine setting

Purpose

Indirect immunofluorescence (IIF) on the human epithelial cell-line HEp-2 (or derivatives) serves as the gold standard in antinuclear antibody (ANA) screening. IIF, and its evaluation, is a labor-intensive method, making ANA testing a major challenge for present clinical laboratories. Nowadays, several automated ANA pattern recognition systems are on the market. In the current study, the EUROPattern Suite is evaluated for its use in daily practice in a routine setting.

Methods

A total of 1033 consecutive routine samples was used to screen for ANA. Results (positive/negative ANA screening, pattern identification and titer) were compared between software-generated results (EUROPattern) and visual interpretation (observer) of automatically acquired digital images.

Results

Considering the visual interpretation as reference, a relative sensitivity of 99.3% and a relative specificity of 88.9% were obtained for negative and positive discrimination by the software (EPa). A good agreement between visual and software-based interpretation was observed with respect to pattern recognition (mean kappa: for 7 patterns: 0.7). Interestingly, EPa software distinguished more patterns per positive sample than the observer (on average 1.5 and 1.2, respectively). Finally, a concordance of 99.3% was observed within the range of 1 titer step difference between EPa and observer.

Conclusions

The ANA IIF results reported by the EPa software are in very good agreement with the results reported by the observer with respect to being negative/positive, pattern recognition and titer, making automated ANA IIF evaluation an objective and time-efficient tool for routine testing.

Electronic supplementary material

The online version of this article (10.1007/s13317-018-0108-y) contains supplementary material, which is available to authorized users.

Recent Approaches To Optimize Laboratory Assessment of Antinuclear Antibodies

The presence of antinuclear antibodies (ANAs) is a hallmark of a number of systemic autoimmune rheumatic diseases, and testing is usually performed as part of the initial diagnostic workup when suspicion of an underlying autoimmune disorder is high. The indirect immunofluorescence antibody (IFA) technique is the preferred method for detecting ANAs, as it demonstrates binding to specific intracellular structures within the cells, resulting in a number of staining patterns that are usually categorized based on the cellular components recognized and the degree of binding, as reflected by the fluorescence intensity or titer. As a screening tool, the ANA patterns can guide confirmatory testing useful in elucidating a specific clinical diagnosis or prognosis. However, routine use of ANA IFA testing as a global screening test is hampered by its labor-intensiveness, subjectivity, and limited diagnostic specificity, among other factors. This review focuses on current efforts to standardize the nomenclature of ANA patterns and on alternative methods for ANA determination, as well as on recent advances in image-based computer algorithms to automate IFA testing in clinical laboratories.