1
|
Zeng J, Gao X, Gao L, Yu Y, Shen L, Pan X. Recognition of rare antinuclear antibody patterns based on a novel attention-based enhancement framework. Brief Bioinform 2024; 25:bbad531. [PMID: 38279651 PMCID: PMC10818137 DOI: 10.1093/bib/bbad531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 12/17/2023] [Accepted: 12/19/2023] [Indexed: 01/28/2024] Open
Abstract
Rare antinuclear antibody (ANA) pattern recognition has been a widely applied technology for routine ANA screening in clinical laboratories. In recent years, the application of deep learning methods in recognizing ANA patterns has witnessed remarkable advancements. However, the majority of studies in this field have primarily focused on the classification of the most common ANA patterns, while another subset has concentrated on the detection of mitotic metaphase cells. To date, no prior research has been specifically dedicated to the identification of rare ANA patterns. In the present paper, we introduce a novel attention-based enhancement framework, which was designed for the recognition of rare ANA patterns in ANA-indirect immunofluorescence images. More specifically, we selected the algorithm with the best performance as our target detection network by conducting comparative experiments. We then further developed and enhanced the chosen algorithm through a series of optimizations. Then, attention mechanism was introduced to facilitate neural networks in expediting the learning process, extracting more essential and distinctive features for the target features that belong to the specific patterns. The proposed approach has helped to obtained high precision rate of 86.40%, 82.75% recall, 84.24% F1 score and 84.64% mean average precision for a 9-category rare ANA pattern detection task on our dataset. Finally, we evaluated the potential of the model as medical technologist assistant and observed that the technologist's performance improved after referring to the results of the model prediction. These promising results highlighted its potential as an efficient and reliable tool to assist medical technologists in their clinical practice.
Collapse
Affiliation(s)
- Junxiang Zeng
- Department of Clinical Laboratory, Xinhua Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
- Faculty of Medical Laboratory Science, College of Health Science and Technology, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Institute of Artificial Intelligence Medicine, Shanghai Academy of Experimental Medicine, Shanghai, China
| | - Xiupan Gao
- Department of Clinical Laboratory, Xinhua Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Limei Gao
- Department of Immunology and Rheumatology, Xinhua Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Youyou Yu
- Department of Clinical Laboratory, Xinhua Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Lisong Shen
- Department of Clinical Laboratory, Xinhua Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
- Faculty of Medical Laboratory Science, College of Health Science and Technology, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Institute of Artificial Intelligence Medicine, Shanghai Academy of Experimental Medicine, Shanghai, China
| | - Xiujun Pan
- Department of Clinical Laboratory, Xinhua Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
2
|
Ostrov BE. Reliability and reproducibility of antinuclear antibody testing in pediatric rheumatology practice. Front Med (Lausanne) 2023; 9:1071115. [PMID: 36714114 PMCID: PMC9875300 DOI: 10.3389/fmed.2022.1071115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Accepted: 12/13/2022] [Indexed: 01/11/2023] Open
Abstract
Antinuclear antibody (ANA) testing is common practice among health care practitioners when evaluating children and adolescents with non-specific symptoms including fatigue and aches and pains. When positive, ANA results often lead to referrals to pediatric rheumatologists as these antibodies may be key indicators for specific pediatric rheumatologic diagnoses. The reliability and reproducibility of ANA tests varies with assay techniques and validation and interpretation of results. In the following article, review of ANA testing in pediatrics is provided along with case examples that demonstrate the reliability and reproducibility of these results in specific scenarios common in the practice of pediatric rheumatology. Guidelines for more accurate utilization of ANA testing are presented with the aim to improve testing and interpretation by ordering clinicians.
Collapse
|
3
|
Matza MA, Rincon SP, Yucel E, Jorge AM, Singhal AB, Coleman CA, Uljon SN. Case 12-2022: A 41-Year-Old Woman with Transient Ischemic Attack and Mitral Valve Masses. N Engl J Med 2022; 386:1560-1570. [PMID: 35443111 DOI: 10.1056/nejmcpc2115855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Affiliation(s)
- Mark A Matza
- From the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Massachusetts General Hospital, and the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Harvard Medical School - both in Boston
| | - Sandra P Rincon
- From the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Massachusetts General Hospital, and the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Harvard Medical School - both in Boston
| | - Evin Yucel
- From the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Massachusetts General Hospital, and the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Harvard Medical School - both in Boston
| | - April M Jorge
- From the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Massachusetts General Hospital, and the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Harvard Medical School - both in Boston
| | - Aneesh B Singhal
- From the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Massachusetts General Hospital, and the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Harvard Medical School - both in Boston
| | - Carrie A Coleman
- From the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Massachusetts General Hospital, and the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Harvard Medical School - both in Boston
| | - Sacha N Uljon
- From the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Massachusetts General Hospital, and the Departments of Medicine (M.A.M., E.Y., A.M.J.), Radiology (S.P.R.), Neurology (A.B.S.), Obstetrics and Gynecology (C.A.C.), and Pathology (S.N.U.), Harvard Medical School - both in Boston
| |
Collapse
|
4
|
Storwick JA, Brett A, Buhler K, Chin A, Schmeling H, Johnson N, Fritzler MJ, Choi MY. Prevalence and titres of antinuclear antibodies in juvenile idiopathic arthritis: A systematic review and meta-analysis. Clin Exp Rheumatol 2022; 21:103086. [DOI: 10.1016/j.autrev.2022.103086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Accepted: 04/05/2022] [Indexed: 11/02/2022]
|
5
|
Wener MH, Fink SL, Morishima C, Chaudhary A, Hutchinson K. Anti-Nuclear Antibody Quantitation: Calibration and Harmonization Adjustment via Population Interrogation. J Appl Lab Med 2022; 7:46-56. [PMID: 34996081 DOI: 10.1093/jalm/jfab142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 10/21/2021] [Indexed: 11/14/2022]
Abstract
BACKGROUND The 2019 classification criteria for systemic lupus erythematosus (SLE) includes an initial criterion requiring the presence of an antinuclear antibody (ANA), positive at a titer of at least 1:80 on HEp-2 cells, or equivalent. However, results of ANA tests performed on HEp-2 cells vary when tested in different laboratories. Calibration of ANA assays by achieving a common specificity in healthy control populations offers the possibility of achieving harmonization via population interrogation, but the expected specificity in a healthy control population is not known. METHODS The studies used to determine the use of ANAs performed by immunofluorescence microscopy on HEp-2 cells as the entry criterion for classification of SLE were reanalyzed by a meta-analysis to determine the expected frequency of positive ANAs in healthy control populations at serum dilutions of 1:40 and 1:80. RESULTS Our meta-analysis demonstrated that the expected specificity in a healthy control population of ANA performed using serum diluted 1:80 is 91.3% (CI 86.1-94.7%). The expected specificity of ANA performed at 1:40 serum dilution is 79.2% (CI 72.3-84.8%). CONCLUSION One approach to achieving harmonization of ANA assays from different laboratories with each other and with expected performance would involve adjusting assays so that about 10% of a healthy control population has a positive ANA when tested at 1:80 dilution, and about 20% of the healthy control population has a positive ANA when tested at 1:40 dilution. This pragmatic approach to calibration and harmonization adjustment via population interrogation offers an opportunity for individual laboratories to be aligned with each other and with ANA performance expected for consistent categorization of patients with SLE.
Collapse
Affiliation(s)
- Mark H Wener
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, WA
- Rheumatology Division, Department of Medicine, University of Washington, Seattle, WA
| | - Susan L Fink
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, WA
| | - Chihiro Morishima
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, WA
| | - Anu Chaudhary
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, WA
| | - Kathleen Hutchinson
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, WA
| |
Collapse
|
6
|
In vitro diagnostics for the medical dermatologist. Part I: Autoimmune tests. J Am Acad Dermatol 2021; 85:287-298. [PMID: 33852926 DOI: 10.1016/j.jaad.2021.02.090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 02/10/2021] [Accepted: 02/24/2021] [Indexed: 11/24/2022]
Abstract
Despite the expansion of available in vitro laboratory tests at a rate far exceeding that of dermatologic pharmaceuticals, the existing literature is dominated by discussion of the latter. With the advent of numerous new tests, it can be difficult for practicing dermatologists to stay up-to-date on the available options, methodologies, and recommendations for when to order one test over another. Understanding the inherent strengths and weaknesses of these options is necessary to inform appropriate ordering and proper interpretation of the results. The first article in this continuing medical education series summarizes information on methodology, test characteristics, and limitations of several in vitro laboratory tests used for the work up of undifferentiated patients suspected of having dermatologic autoimmune diseases and it provides a general guide to ordering these tests.
Collapse
|
7
|
Application of Supervised Machine Learning to Recognize Competent Level and Mixed Antinuclear Antibody Patterns Based on ICAP International Consensus. Diagnostics (Basel) 2021; 11:diagnostics11040642. [PMID: 33916234 PMCID: PMC8066559 DOI: 10.3390/diagnostics11040642] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 03/16/2021] [Accepted: 03/28/2021] [Indexed: 01/18/2023] Open
Abstract
Background: Antinuclear antibody pattern recognition is vital for autoimmune disease diagnosis but labor-intensive for manual interpretation. To develop an automated pattern recognition system, we established machine learning models based on the International Consensus on Antinuclear Antibody Patterns (ICAP) at a competent level, mixed patterns recognition, and evaluated their consistency with human reading. Methods: 51,694 human epithelial cells (HEp-2) cell images with patterns assigned by experienced medical technologists collected in a medical center were used to train six machine learning algorithms and were compared by their performance. Next, we choose the best performing model to test the consistency with five experienced readers and two beginners. Results: The mean F1 score in each classification of the best performing model was 0.86 evaluated by Testing Data 1. For the inter-observer agreement test on Testing Data 2, the average agreement was 0.849 (κ) among five experienced readers, 0.844 between the best performing model and experienced readers, 0.528 between experienced readers and beginners. The results indicate that the proposed model outperformed beginners and achieved an excellent agreement with experienced readers. Conclusions: This study demonstrated that the developed model could reach an excellent agreement with experienced human readers using machine learning methods.
Collapse
|
8
|
Naides SJ. Dr. Naides replies. J Rheumatol 2021; 48:1190. [PMID: 33722940 DOI: 10.3899/jrheum.210093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
We thank Dr. Russell for raising the issue of reporting the false positivity rate of antinuclear antibody (ANA) indirect immunofluorescent assay (IFA) testing.1 It is difficult, however, for a laboratory to state a false positive rate, per se, as the determination of “falseness” is dependent on clinical evaluation that is typically not available to most laboratories.
Collapse
Affiliation(s)
- Stanley J Naides
- Consultant SJN receives consultancy fees from AlphaSights, EUROIMMUN US, Guidepoint, Laboratory Corporation of America.
| |
Collapse
|
9
|
Russell AS. The Variability of Antinuclear Antibody Testing. J Rheumatol 2021; 48:1190. [PMID: 33722942 DOI: 10.3899/jrheum.210039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
The group from the College of American Pathologists1 have carried out an extensive survey of the approaches to antinuclear antibody testing by different laboratories, predominantly in the USA. They reviewed the techniques used and possible reasons for the variations in results.
Collapse
Affiliation(s)
- Anthony S Russell
- Division of Rheumatology, University of Alberta, Edmonton, Alberta, Canada.
| |
Collapse
|
10
|
Pashnina IA, Krivolapova IM, Fedotkina TV, Ryabkova VA, Chereshneva MV, Churilov LP, Chereshnev VA. Antinuclear Autoantibodies in Health: Autoimmunity Is Not a Synonym of Autoimmune Disease. Antibodies (Basel) 2021; 10:9. [PMID: 33668697 PMCID: PMC8006153 DOI: 10.3390/antib10010009] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Revised: 12/26/2020] [Accepted: 02/07/2021] [Indexed: 12/11/2022] Open
Abstract
The incidence of autoimmune diseases is increasing. Antinuclear antibody (ANA) testing is a critical tool for their diagnosis. However, ANA prevalence in healthy persons has increased over the last decades, especially among young people. ANA in health occurs in low concentrations, with a prevalence up to 50% in some populations, which demands a cutoff revision. This review deals with the origin and probable physiological or compensatory function of ANA in health, according to the concept of immunological clearance, theory of autoimmune regulation of cell functions, and the concept of functional autoantibodies. Considering ANA titers ≤1:320 as a serological marker of autoimmune diseases seems inappropriate. The role of anti-DFS70/LEDGFp75 autoantibodies is highlighted as a possible anti-risk biomarker for autoimmune rheumatic disorders. ANA prevalence in health is different in various regions due to several underlying causes discussed in the review, all influencing additive combinations according to the concept of the mosaic of autoimmunity. Not only are titers, but also HEp-2 IFA) staining patterns, such as AC-2, important. Accepting autoantibodies as a kind of bioregulator, not only the upper, but also the lower borders of their normal range should be determined; not only their excess, but also a lack of them or "autoimmunodeficiency" could be the reason for disorders.
Collapse
Affiliation(s)
- Irina A. Pashnina
- Regional Children’s Clinical Hospital, 620149 Yekaterinburg, Russia;
| | - Irina M. Krivolapova
- Regional Children’s Clinical Hospital, 620149 Yekaterinburg, Russia;
- Institute of Immunology and Physiology of the Ural Branch of the Russian Academy of Sciences, 620049 Yekaterinburg, Russia; (M.V.C.); (V.A.C.)
| | - Tamara V. Fedotkina
- Laboratory of the Mosaics of Autoimmunity, Saint Petersburg State University, 199034 Saint Petersburg, Russia; (T.V.F.); (V.A.R.); (L.P.C.)
| | - Varvara A. Ryabkova
- Laboratory of the Mosaics of Autoimmunity, Saint Petersburg State University, 199034 Saint Petersburg, Russia; (T.V.F.); (V.A.R.); (L.P.C.)
| | - Margarita V. Chereshneva
- Institute of Immunology and Physiology of the Ural Branch of the Russian Academy of Sciences, 620049 Yekaterinburg, Russia; (M.V.C.); (V.A.C.)
| | - Leonid P. Churilov
- Laboratory of the Mosaics of Autoimmunity, Saint Petersburg State University, 199034 Saint Petersburg, Russia; (T.V.F.); (V.A.R.); (L.P.C.)
- Saint Petersburg Research Institute of Phthisiopulmonology, 191036 Saint Petersburg, Russia
| | - Valeriy A. Chereshnev
- Institute of Immunology and Physiology of the Ural Branch of the Russian Academy of Sciences, 620049 Yekaterinburg, Russia; (M.V.C.); (V.A.C.)
| |
Collapse
|