1
|
Silva MJ, Dellavance A, Baldo DC, Rodrigues SH, Grecco M, Prado MS, Agustinelli R, Andrade LEC. Interkit Reproducibility of the Indirect Immunofluorescence Assay on HEp-2 Cells Depends on the Immunofluorescence Reactivity Intensity and Pattern. Front Immunol 2022; 12:798322. [PMID: 35126363 PMCID: PMC8807640 DOI: 10.3389/fimmu.2021.798322] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Accepted: 12/20/2021] [Indexed: 11/16/2022] Open
Abstract
Introduction The indirect immunofluorescence assay on HEp-2 cells (HEp-2/IFA) is used worldwide for screening for autoantibodies to cellular antigens. Cell culture and fixation methods influence the cell distribution of autoantigens and the preservation of epitopes. Therefore, discrepancy of results obtained using different HEp-2/IFA kits (interkit nonreproducibility) is a common phenomenon in the clinical laboratory routine. Objective This study evaluated the interkit nonreproducibility of HEp-2/IFA results using samples from patients with systemic autoimmune disease (SAD), nonautoimmune diseases (NAD), and healthy blood donors (HBD). Methods Serum from 275 SAD patients, 293 NAD patients, and 300 HBD were processed at 1:80 dilution using four HEp-2 kits according to the manufacturers’ instructions. Interkit reproducibility was determined for positive/negative results and patterns. The agreement of positive/negative results among kits for each sample was determined as the reactivity agreement score (RAS). The pattern reproducibility score (PRS) in each sample was calculated as a function of the number of kits showing equivalent patterns. Qualitative variables and ordinal variables were analyzed by the Chi-square and Mann-Whitney U tests, respectively. Results A total of 402 samples were nonreactive in all kits and were considered devoid of autoantibodies. Further analysis included the 466 reactive samples (238 SAD, 119 NAD, 109 HBD). Reactivity to the nucleus had the highest interkit reproducibility (RAS = 83.6), followed by the metaphase plate (RAS = 78.9), cytoplasm (RAS = 77.4), and nucleolus (RAS = 72.4). Interkit reproducibility was higher in SAD (RAS = 78.0) than in NAD (RAS = 70.6) and HBD (RAS = 71.3) groups. Samples with strong reactivity (++++/4 and +++/4) had higher interkit reproducibility than those with weak reactivity (+/4). In the SAD group, RAS for nuclear reactivity was 87.5% for strongly reactive samples as opposed to 4.4% for weakly reactive samples, and the same was observed for NAD and HBD samples. The most robust patterns were the centromere AC-3 (PRS = 78.4), multiple nuclear dots AC-6 (PRS = 73.6), nuclear coarse speckled AC-5 (PRS = 71.3), nuclear homogeneous AC-1 (PRS = 67.9), and the reticular cytoplasmic AC-21 (PRS = 68.6). Conclusion Interkit nonreproducibility in HEp-2/IFA is prevalent and occurs with the highest frequency with weakly reactive samples. International initiatives with the engagement of in vitro diagnostic industry are encouraged to promote the harmonization of the properties and performance of HEp-2/IFA commercial kits.
Collapse
Affiliation(s)
- Mônica Jesus Silva
- Rheumatology Division, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Alessandra Dellavance
- Research and Development Division, Fleury Medicine and Health Laboratories, São Paulo, Brazil
| | | | - Silvia Helena Rodrigues
- Rheumatology Division, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Marcelle Grecco
- Rheumatology Division, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Monica Simon Prado
- Rheumatology Division, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Renan Agustinelli
- Rheumatology Division, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Luís Eduardo Coelho Andrade
- Rheumatology Division, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
- *Correspondence: Luís Eduardo Coelho Andrade,
| |
Collapse
|
2
|
Cinquanta L, Bizzaro N, Pesce G. Standardization and Quality Assessment Under the Perspective of Automated Computer-Assisted HEp-2 Immunofluorescence Assay Systems. Front Immunol 2021; 12:638863. [PMID: 33717188 PMCID: PMC7947926 DOI: 10.3389/fimmu.2021.638863] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 01/18/2021] [Indexed: 12/11/2022] Open
Abstract
The recent availability of automated computer-assisted diagnosis (CAD) systems for the reading and interpretation of the anti-nuclear antibody (ANA) test performed with the indirect immunofluorescence (IIF) method on HEp-2 cells, has improved the reproducibility of the results and initiated a process of harmonization of this test. Furthermore, CAD systems provide quantitative expression of fluorescence intensity, allowing the introduction of objective quality control procedures to the monitoring of the entire process. The calibration of the reading systems and the automated image interpretation are essential prerequisites for obtaining reproducible and harmonized IIF test results and form the basis for standardization, regardless of the computer algorithms used in the different systems. The use of automated CAD systems, facilitating control procedures, represents a step forward for the quality certification of the laboratory.
Collapse
Affiliation(s)
- Luigi Cinquanta
- Laboratorio di Patologia Clinica, IRCCS S.D.N., Napoli, Italy
| | - Nicola Bizzaro
- Laboratorio di Patologia Clinica, Ospedale San Antonio, Tolmezzo—Azienda Sanitaria Universitaria Integrata di Udine, Udine, Italy
| | - Giampaola Pesce
- Laboratorio Diagnostico di Autoimmunologia, IRCCS Ospedale Policlinico San Martino, Genova, Italy
- Dipartimento di Medicina Interna e Specialità Mediche (DIMI), Università Degli Studi di Genova, Genova, Italy
| |
Collapse
|
3
|
Pisetsky DS, Bossuyt X, Meroni PL. ANA as an entry criterion for the classification of SLE. Autoimmun Rev 2019; 18:102400. [PMID: 31639513 DOI: 10.1016/j.autrev.2019.102400] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Accepted: 06/25/2019] [Indexed: 12/13/2022]
Abstract
Systemic lupus erythematosus (SLE) is a prototypic autoimmune disease with highly variable clinical and immunological manifestations. In the classification of patients with this condition, the presence of an antinuclear antibody (ANA) is an important element, with new criteria from the American College of Rheumatology and European League against Rheumatism positioning ANA positivity by an immunofluorescence assay on HEp2-cells (HEp2-IFA) or by an equivalent solid phase assay as the entry criterion. This positioning is based on assumptions about the frequency of ANA positivity in SLE as well as the reliability of the assays. Studies indicate that these assumptions are still a matter of uncertainty since both types of assay show considerable variability and patients with SLE may display negative results in ANA testing. These findings suggest caution in positioning ANA positivity as an entry criterion for classification and point to the value of alternative serological approaches for ANA determinations.
Collapse
Affiliation(s)
- David S Pisetsky
- Departments of Medicine and Immunology, Duke University Medical Center and Medical Research Service, Veterans Administration Medical Center, Durham, NC, USA.
| | - Xavier Bossuyt
- Department of Laboratory Medicine, University Hospital Leuven, Leuven, Belgium
| | - Pier Luigi Meroni
- Immunorheumatology Research Laboratory, IRCCS Instituto Auxologico Italiano, Milan, Italy
| |
Collapse
|
4
|
Pisetsky DS, Rovin BH, Lipsky PE. New Perspectives in Rheumatology: Biomarkers as Entry Criteria for Clinical Trials of New Therapies for Systemic Lupus Erythematosus: The Example of Antinuclear Antibodies and Anti-DNA. Arthritis Rheumatol 2019; 69:487-493. [PMID: 27899010 DOI: 10.1002/art.40008] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2016] [Accepted: 11/22/2016] [Indexed: 12/12/2022]
Affiliation(s)
- David S Pisetsky
- Duke University Medical Center and Medical Research Service, Durham VA Medical Center, Durham, North Carolina
| | - Brad H Rovin
- The Ohio State University, Wexner Medical Center, Columbus
| | | |
Collapse
|
5
|
Infantino M, Meacci F, Grossi V, Manfredi M, Benucci M, Merone M, Soda P. The burden of the variability introduced by the HEp-2 assay kit and the CAD system in ANA indirect immunofluorescence test. Immunol Res 2018; 65:345-354. [PMID: 27456204 DOI: 10.1007/s12026-016-8845-3] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
According to the recent recommendations of the American College of Rheumatology, ANA Task Force, IIF technique should be considered the gold standard in antinuclear antibodies (ANAs) testing. To overcome the lack of standardization, biomedical industries have developed several computer-aided diagnosis (CAD) systems. Two hundred and sixty-one consecutive samples with suspected autoimmune diseases were tested for ANA by means of IIF on routinely HEp-2 assay kit (Euroimmun AG). Assignment of result was made if consensus for positive/negative was reached by at least 2 out of 3 expert physicians. ANA-IIF was also carried out using 3 CAD systems: Zenit G-Sight (n = 84), Helios (n = 85) and NOVA View (n = 92); human evaluation was repeated on the same substrate of each CAD system (Immco, Aesku and Inova HEp-2 cells, respectively). To anonymize the results, we randomly named these three systems as A, B and C. We ran a statistical analysis computing several measures of agreement between the ratings, and we also improved the evaluation by using the Wilcoxon's test for nonparametric data. Agreement between the human readings on routinely HEp-2 assay kit and human readings on CAD HEp-2 assay was substantial for A (k = 0.82) and B (k = 0.72), and almost perfect for C (k = 0.89). Such readings were statistically different only in case A. Comparing experts' readings with the readings of CAD systems, when the samples were prepared using CAD HEp-2 assay kits, we found almost perfect agreement for B and C (k = 0.86; k = 0.82) and substantial agreement for A (k = 0.73). Again, human and CAD readings were statistically different only in A. When we compared the readings of medical experts on routinely HEp-2 assay kit with the output of the CAD systems that worked using their own slides, we found substantial agreement for all the systems (A: k = 0.62; B: k = 0.65; C: k = 0.71). Such readings were not statistically different. The change of the assay kit and/or the introduction of a CAD system affect the laboratory reporting, with an evident impact on the autoimmune laboratory workflow. The CAD systems may represent one of the most important novel elements of harmonization in the autoimmunity field, reducing intra- and inter-laboratory variability in a new vision of the diagnostic autoimmune platform.
Collapse
Affiliation(s)
- M Infantino
- Immunology and Allergy Laboratory, S.Giovanni di Dio Hospital, Via Torregalli, 3, 50143, Florence, Italy.
| | - F Meacci
- Immunology and Allergy Laboratory, S.Giovanni di Dio Hospital, Via Torregalli, 3, 50143, Florence, Italy
| | - V Grossi
- Immunology and Allergy Laboratory, S.Giovanni di Dio Hospital, Via Torregalli, 3, 50143, Florence, Italy
| | - M Manfredi
- Immunology and Allergy Laboratory, S.Giovanni di Dio Hospital, Via Torregalli, 3, 50143, Florence, Italy
| | - M Benucci
- Rheumatology Unit, S.Giovanni di Dio Hospital, Via Torregalli, 3, 50143, Florence, Italy
| | - M Merone
- Computer Systems & Bioinformatics Laboratory, Department of Engineering, University Campus Bio-Medico, Rome, Italy
| | - P Soda
- Computer Systems & Bioinformatics Laboratory, Department of Engineering, University Campus Bio-Medico, Rome, Italy
| |
Collapse
|
6
|
Pisetsky DS, Spencer DM, Lipsky PE, Rovin BH. Assay variation in the detection of antinuclear antibodies in the sera of patients with established SLE. Ann Rheum Dis 2018; 77:911-913. [PMID: 29440000 DOI: 10.1136/annrheumdis-2017-212599] [Citation(s) in RCA: 68] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2017] [Revised: 01/16/2018] [Accepted: 01/18/2018] [Indexed: 01/28/2023]
Abstract
OBJECTIVE The expression of antinuclear antibodies (ANA) is considered almost constant in systemic lupus erythematosus (SLE), although recent experience has suggested that many subjects with SLE considered for clinical trials are ANA negative at screening. The objective of this study is to determine whether assay variation can influence ANA detection in patients with established SLE. METHODS Sera from 103 patients with established SLE were tested using three different immunofluorescence assays (IFA) for ANA determination. ANA determinations were also performed by an ELISA and bead-based multiplex assay. RESULTS With IFA kits, the frequency of ANA negativity varied from 5 to 23 of 103 samples (4.9%-22.3%). The ELISA and multiplex assays showed that 12 (11.7%) and 14 (13.6%) samples were negative, respectively. Samples positive in all assays differed from those with discordant assay results in the frequency of historical anti-double-stranded DNA positivity and low complement levels at the time of blood sampling. DISCUSSION These findings indicate that ANA negativity occurs in patients with established SLE although the frequency varies depending on the assay kit. Given the range of negativity with well-validated assays, these findings raise questions about whether ANA positivity should be employed to determine eligibility for clinical trials.
Collapse
Affiliation(s)
- David S Pisetsky
- Department of Medicine and Immunology, Duke University Medical Center and Medical Research Service, VA Medical Center, Durham, North Carolina, USA
| | - Diane M Spencer
- Department of Medicine and Immunology, Duke University Medical Center and Medical Research Service, VA Medical Center, Durham, North Carolina, USA
| | - Peter E Lipsky
- RILITE Research Institute, Charlottesville, Virginia, USA
| | - Brad H Rovin
- Division of Nephrology, The Ohio State University, Wexner Medical Center, Columbus, Ohio, USA
| |
Collapse
|
7
|
Copple SS, Giles SR, Jaskowski TD, Gardiner AE, Wilson AM, Hill HR. Screening for IgG antinuclear autoantibodies by HEp-2 indirect fluorescent antibody assays and the need for standardization. Am J Clin Pathol 2012; 137:825-30. [PMID: 22523223 DOI: 10.1309/ajcpicnfg7uces1s] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Abstract
We evaluated 5 commercially available HEp-2 antinuclear antibody (ANA) indirect fluorescent antibody (IFA) assays using patient serum samples from 45 patients with rheumatoid arthritis, 50 with systemic lupus erythematosus (SLE), 35 with scleroderma, 20 with Sjögren syndrome, 10 with polymyositis, and 100 healthy control subjects. In addition, 12 defined serum samples from the Centers for Disease Control and Prevention and 100 patient serum samples sent to ARUP Laboratories (Salt Lake City, UT) for ANA IFA testing were also examined (n = 372). Standardization among the HEp-2 IFA assays occurred when they exhibited the same titer ± 1 doubling dilution. Agreement of the 5 assays was 78%. Within the specific groups of serum samples, agreement ranged from 44% in scleroderma serum samples to 93% in healthy control subjects, with 72% agreement in the SLE group. Variations in slide and substrate quality were also noted (ie, clarity, consistency of fluorescence, cell size, number and quality of mitotic cells). Along with subjectivity of interpretation, HEp-2 IFA assays are also vulnerable to standardization issues similar to other methods for ANA screening.
Collapse
|
8
|
Forster J, Maier O, Löbbert J, Kaufmehl K, Streckert HJ, Werchau H. Prevalence of antibodies against HEp-2 cell antigen in infants and children hospitalized with respiratory syncytial virus infection. Infection 1996; 24:407-11. [PMID: 9007586 DOI: 10.1007/bf01713039] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Infants with respiratory syncytial virus (RSV) infection were shown to have antibodies against HEp-2 cell antigen present in RSV-antigen preparation used for immunoblot analysis. The prevalence of anti HEp-2 cell antibodies was examined in infants hospitalized for RSV infection (n = 49, median age 121 days) compared to rotavirus infected children (n = 30, median age 114 days) and to healthy controls (n = 20, median age 150 days). The immunoblot analysis with RSV-infected and non-infected HEp-2 cells as antigen revealed the expected age-dependent low prevalence of G protein antibodies and clear seroconversion of N and P protein antibodies. HEp-2 antibody prevalence was higher in RSV antigen-positive infants (33/49) than in rotavirus antigen-positive (5/30) and RSV antigen-negative infants (4/20), respectively (p < 0.001). Anti HEp-2 antibodies were mostly directed against 47, 46, 33, 30 kD antigens. A multiple regression analysis found the following correlations (odds ratio; 95% confidence interval): 42 kD RSV antibodies (N protein) with pneumonia (7.58; 1.43-40), 94 kD RSV antibodies (G protein) with bronchiolitis (0.064; 0.006-0.686). This study shows repeated well-known features of humoral immunity in RSV infection. The data on anti HEp-2 antibodies point to a role for these pre-existing autoreactive antibodies in the pathogenesis of RSV infection.
Collapse
Affiliation(s)
- J Forster
- Universtitäts-Kinderklinik, Albert-Ludwigs-Universität, Freiburg, Germany
| | | | | | | | | | | |
Collapse
|