1
|
Wang HS, Liang WY. Combining Artificial Intelligence and Simplified Image Processing for the Automatic Detection of Mycobacterium tuberculosis in Acid-fast Stain : A Cross-institute Training and Validation Study. Am J Surg Pathol 2024; 48:866-873. [PMID: 38595262 DOI: 10.1097/pas.0000000000002223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/11/2024]
Abstract
Tuberculosis (TB) poses a significant health threat in Taiwan, necessitating efficient detection methods. Traditional screening for acid-fast positive bacilli in acid-fast stain is time-consuming and prone to human error due to staining artifacts. To address this, we present an automated TB detection platform leveraging deep learning and image processing. Whole slide images from 2 hospitals were collected and processed on a high-performance system. The system utilizes an image processing technique to highlight red, rod-like regions and a modified EfficientNet model for binary classification of TB-positive regions. Our approach achieves a 97% accuracy in tile-based TB image classification, with minimal loss during the image processing step. By setting a 0.99 threshold, false positives are significantly reduced, resulting in a 94% detection rate when assisting pathologists, compared with 68% without artificial intelligence assistance. Notably, our system efficiently identifies artifacts and contaminants, addressing challenges in digital slide interpretation. Cross-hospital validation demonstrates the system's adaptability. The proposed artificial intelligence-assisted pipeline improves both detection rates and time efficiency, making it a promising tool for routine pathology work in TB detection.
Collapse
Affiliation(s)
- Hsiang Sheng Wang
- Department of Pathology, Chang Gung Memorial Hospital, Linkou Taoyuan, Taiwan-Ling Ko
| | - Wen-Yih Liang
- Department of Pathology, Taipei Veteran General Hospital
- School of Medicine, National Yang-Ming Chiao Tung University, Taipei, Taiwan, Republic of China
| |
Collapse
|
2
|
Du J, Su Y, Qiao J, Gao S, Dong E, Wang R, Nie Y, Ji J, Wang Z, Liang J, Gong W. Application of artificial intelligence in diagnosis of pulmonary tuberculosis. Chin Med J (Engl) 2024; 137:559-561. [PMID: 38369956 DOI: 10.1097/cm9.0000000000003018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Indexed: 02/20/2024] Open
Affiliation(s)
- Jingli Du
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Yue Su
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Juan Qiao
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Shang Gao
- Department of Computer Science and Technology, College of Management Science and Engineering, Capital University of Economics and Business, Beijing 100071, China
| | - Enjun Dong
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Ruilan Wang
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Yanhui Nie
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Jing Ji
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Zhendong Wang
- Tuberculosis Control Team, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Jianqin Liang
- The Second Ward of Tuberculosis Department, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| | - Wenping Gong
- Beijing Key Laboratory of New Techniques of Tuberculosis Diagnosis and Treatment, Senior Department of Tuberculosis, The Eighth Medical Center of PLA General Hospital, Beijing 100091, China
| |
Collapse
|
3
|
Rabaan AA, Bakhrebah MA, Alotaibi J, Natto ZS, Alkhaibari RS, Alawad E, Alshammari HM, Alwarthan S, Alhajri M, Almogbel MS, Aljohani MH, Alofi FS, Alharbi N, Al-Adsani W, Alsulaiman AM, Aldali J, Ibrahim FA, Almaghrabi RS, Al-Omari A, Garout M. Unleashing the power of artificial intelligence for diagnosing and treating infectious diseases: A comprehensive review. J Infect Public Health 2023; 16:1837-1847. [PMID: 37769584 DOI: 10.1016/j.jiph.2023.08.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 07/19/2023] [Accepted: 08/27/2023] [Indexed: 10/03/2023] Open
Abstract
Infectious diseases present a global challenge, requiring accurate diagnosis, effective treatments, and preventive measures. Artificial intelligence (AI) has emerged as a promising tool for analysing complex molecular data and improving the diagnosis, treatment, and prevention of infectious diseases. Computer-aided detection (CAD) using convolutional neural networks (CNN) has gained prominence for diagnosing tuberculosis (TB) and other infectious diseases such as COVID-19, HIV, and viral pneumonia. The review discusses the challenges and limitations associated with AI in this field and explores various machine-learning models and AI-based approaches. Artificial neural networks (ANN), recurrent neural networks (RNN), support vector machines (SVM), multilayer neural networks (MLNN), CNN, long short-term memory (LSTM), and random forests (RF) are among the models discussed. The review emphasizes the potential of AI to enhance the accuracy and efficiency of diagnosis, treatment, and prevention of infectious diseases, highlighting the need for further research and development in this area.
Collapse
Affiliation(s)
- Ali A Rabaan
- Molecular Diagnostic Laboratory, Johns Hopkins Aramco Healthcare, Dhahran 31311, Saudi Arabia; College of Medicine, Alfaisal University, Riyadh 11533, Saudi Arabia; Department of Public Health and Nutrition, The University of Haripur, Haripur 22610, Pakistan.
| | - Muhammed A Bakhrebah
- Life Science and Environment Research Institute, King Abdulaziz City for Science and Technology (KACST), Riyadh 11442, Saudi Arabia
| | - Jawaher Alotaibi
- Infectious Diseases Unit, Department of Medicine, King Faisal Specialist Hospital and Research Center, Riyadh 11564, Saudi Arabia
| | - Zuhair S Natto
- Department of Dental Public Health, Faculty of Dentistry, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Rahaf S Alkhaibari
- Molecular Diagnostic Laboratory, Dammam Regional Laboratory and Blood Bank, Dammam 31411, Saudi Arabia
| | - Eman Alawad
- Adult Infectious Diseases Department, Prince Mohammed Bin Abdulaziz Hospital, Riyadh 11474, Saudi Arabia
| | - Huda M Alshammari
- Clinical Pharmacy Department, College of Pharmacy, Northern Border University, Arar 9280, Saudi Arabia
| | - Sara Alwarthan
- Department of Internal Medicine, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam 34212, Saudi Arabia
| | - Mashael Alhajri
- Department of Internal Medicine, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam 34212, Saudi Arabia
| | - Mohammed S Almogbel
- Department of Medical Laboratory Sciences, College of Applied Medical Sciences, University of Hail, Hail 4030, Saudi Arabia
| | - Maha H Aljohani
- Department of Infectious Diseases, King Fahad Hospital, Madinah 42351, Saudi Arabia
| | - Fadwa S Alofi
- Department of Infectious Diseases, King Fahad Hospital, Madinah 42351, Saudi Arabia
| | - Nada Alharbi
- Department of Basic Medical Sciences, College of Medicine, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia.
| | - Wasl Al-Adsani
- Department of Medicine, Infectious Diseases Hospital, Kuwait City 63537, Kuwait; Department of Infectious Diseases, Hampton Veterans Administration Medical Center, Hampton, VA 23667, USA
| | | | - Jehad Aldali
- Department of Pathology, College of Medicine, Imam Mohammad Ibn Saud Islamic University, Riyadh 13317, Saudi Arabia
| | - Fatimah Al Ibrahim
- Infectious Disease Division, Department of Internal Medicine, Dammam Medical Complex, Dammam 32245, Saudi Arabia
| | - Reem S Almaghrabi
- Organ Transplant Center of Excellence, King Faisal Specialist Hospital and Research Center, Riyadh 11211, Saudi Arabia
| | - Awad Al-Omari
- College of Medicine, Alfaisal University, Riyadh 11533, Saudi Arabia; Research Center, Dr. Sulaiman Al Habib Medical Group, Riyadh 11372, Saudi Arabia
| | - Mohammed Garout
- Department of Community Medicine and Health Care for Pilgrims, Faculty of Medicine, Umm Al-Qura University, Makkah 21955, Saudi Arabia.
| |
Collapse
|
4
|
Bychkov A, Yoshikawa A, Munkhdelger J, Hori T, Fukuoka J. Integrating cytology into routine digital pathology workflow: a 5-year journey. Virchows Arch 2023; 483:555-559. [PMID: 37119336 DOI: 10.1007/s00428-023-03547-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2023] [Revised: 03/13/2023] [Accepted: 04/20/2023] [Indexed: 05/01/2023]
Abstract
Despite recent advances in digital imaging, the adoption of digital cytology is challenging due to technical limitations. This study describes our 5-year institutional experience with the implementation of digital cytology. The routine cytology workflow included conventional two-step screening by cytotechnologists, followed by sign out by pathologists. We introduced sign out of cytologic cases using a microscopic digital imaging platform operated by cytotechnologists, which allowed for remote review of slides by cytopathologists via video streaming. We also provided cytologic correlation to support the virtual slide-based sign out of histopathological specimens and for a weekly pathology-radiology conference. In addition, positive cytology cases were archived for integration into the laboratory information system and for prospective computational pathology studies. We also summarized lessons learned over the years and outlined our vision for future developments. This unique experience may serve as a role model for other institutions.
Collapse
Affiliation(s)
- Andrey Bychkov
- Department of Pathology, Kameda Medical Center, Kamogawa, 929 Higashi-Cho, Kamogawa, Chiba, Japan.
| | - Akira Yoshikawa
- Department of Pathology, Kameda Medical Center, Kamogawa, 929 Higashi-Cho, Kamogawa, Chiba, Japan
| | - Jijgee Munkhdelger
- Department of Pathology, Kameda Medical Center, Kamogawa, 929 Higashi-Cho, Kamogawa, Chiba, Japan
| | - Takashi Hori
- Department of Pathology, Kameda Medical Center, Kamogawa, 929 Higashi-Cho, Kamogawa, Chiba, Japan
| | - Junya Fukuoka
- Department of Pathology, Kameda Medical Center, Kamogawa, 929 Higashi-Cho, Kamogawa, Chiba, Japan
- Department of Pathology Informatics, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| |
Collapse
|
5
|
Lee J, Lee J. A Study of Mycobacterium tuberculosis Detection Using Different Neural Networks in Autopsy Specimens. Diagnostics (Basel) 2023; 13:2230. [PMID: 37443624 DOI: 10.3390/diagnostics13132230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 06/22/2023] [Accepted: 06/26/2023] [Indexed: 07/15/2023] Open
Abstract
Tuberculosis (TB) presents a substantial health risk to autopsy staff, given its three to five times higher incidence of TB compared to clinical staff. This risk is notably accentuated in South Korea, which reported the highest TB incidence rate and the third highest TB mortality rate among OECD member countries in 2020. The standard TB diagnostic method, histopathological examination of sputum or tissue for acid-fast bacilli (AFB) using Ziehl-Neelsen staining, demands microscopic examination of slides at 1000× magnification, which is labor-intensive and time-consuming. This article proposes a computer-aided diagnosis (CAD) system designed to enhance the efficiency of TB diagnosis at magnification less than 1000×. By training nine neural networks with images taken from 30 training slides and 10 evaluation slides at 400× magnification, we evaluated their ability to detect M. tuberculosis. The N model achieved the highest accuracy, with 99.77% per patch and 90% per slide. We discovered that the model could aid pathologists in preliminary TB screening, thereby reducing diagnostic time. We anticipate that this research will contribute to minimizing autopsy staff's infection risk and rapidly determining the cause of death.
Collapse
Affiliation(s)
- Joong Lee
- Institute of AI and Big Data in Medicine, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea
| | - Junghye Lee
- Postmortem Investigation Division, Department of Forensic Medicine, National Forensic Service, Wonju 26460, Republic of Korea
| |
Collapse
|
6
|
Li Y, Zheng X, Xie F, Ye L, Bignami E, Tandon YK, Rodríguez M, Gu Y, Sun J. Development and validation of the artificial intelligence (AI)-based diagnostic model for bronchial lumen identification. Transl Lung Cancer Res 2022; 11:2261-2274. [PMID: 36519015 PMCID: PMC9742630 DOI: 10.21037/tlcr-22-761] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 11/08/2022] [Indexed: 08/29/2023]
Abstract
BACKGROUND Bronchoscopy is a key step in the diagnosis and treatment of respiratory diseases. However, the level of expertise varies among different bronchoscopists. Artificial intelligence (AI) may help them identify bronchial lumens. Thus, a bronchoscopy quality-control system based on AI was built to improve the performance of bronchoscopists. METHODS This single-center observational study consecutively collected bronchoscopy videos from Shanghai Chest Hospital and segmented each video into 31 different anatomical locations to develop an AI-assisted system based on a convolutional neural network (CNN) model. We then designed a single-center trial to compare the accuracy of lumen recognition by bronchoscopists with and without the assistance of the AI system. RESULTS A total of 28,441 qualified images of bronchial lumen were used to train the CNNs. In the cross-validation set, the optimal accuracy of the six models was between 91.83% and 96.62%. In the test set, the visual geometry group 16 (VGG-16) achieved optimal performance with an accuracy of 91.88%, and an area under the curve of 0.995. In the clinical evaluation, the accuracy rate of the AI system alone was 54.30% (202/372). For the identification of bronchi except for segmental bronchi, the accuracy was 82.69% (129/156). In group 1, the recognition accuracy rates of doctors A, B, a and b alone were 42.47%, 34.68%, 28.76%, and 29.57%, respectively, but increased to 57.53%, 54.57%, 54.57%, and 46.24% respectively when combined with the AI system. Similarly, in group 2, the recognition accuracy rates of doctors C, D, c, and d were 37.90%, 41.40%, 30.91%, and 33.60% respectively, but increased to 51.61%, 47.85%, 53.49%, and 54.30% respectively, when combined with the AI system. Except for doctor D, the accuracy of doctors in recognizing lumen was significantly higher with AI assistance than without AI assistance, regardless of their experience (P<0.001). CONCLUSIONS Our AI system could better recognize bronchial lumen and reduce differences in the operation levels of different bronchoscopists. It could be used to improve the quality of everyday bronchoscopies.
Collapse
Affiliation(s)
- Ying Li
- Department of Respiratory Endoscopy, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Department of Respiratory and Critical Care Medicine, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Shanghai Engineering Research Center of Respiratory Endoscopy, Shanghai, China
| | - Xiaoxuan Zheng
- Department of Respiratory Endoscopy, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Department of Respiratory and Critical Care Medicine, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Shanghai Engineering Research Center of Respiratory Endoscopy, Shanghai, China
| | - Fangfang Xie
- Department of Respiratory Endoscopy, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Department of Respiratory and Critical Care Medicine, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Shanghai Engineering Research Center of Respiratory Endoscopy, Shanghai, China
| | - Lin Ye
- Department of Respiratory Endoscopy, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Department of Respiratory and Critical Care Medicine, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Shanghai Engineering Research Center of Respiratory Endoscopy, Shanghai, China
| | - Elena Bignami
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Parma, Italy
| | | | - María Rodríguez
- Department of Thoracic Surgery, Clínica Universidad de Navarra, Madrid, Spain
| | - Yun Gu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
- Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, China
| | - Jiayuan Sun
- Department of Respiratory Endoscopy, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Department of Respiratory and Critical Care Medicine, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
- Shanghai Engineering Research Center of Respiratory Endoscopy, Shanghai, China
| |
Collapse
|
7
|
AI-Assisted Tuberculosis Detection and Classification from Chest X-Rays Using a Deep Learning Normalization-Free Network Model. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:2399428. [PMID: 36225551 PMCID: PMC9550434 DOI: 10.1155/2022/2399428] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 08/24/2022] [Accepted: 09/01/2022] [Indexed: 11/29/2022]
Abstract
Tuberculosis (TB) is an airborne disease caused by Mycobacterium tuberculosis. It is imperative to detect cases of TB as early as possible because if left untreated, there is a 70% chance of a patient dying within 10 years. The necessity for supplementary tools has increased in mid to low-income countries due to the rise of automation in healthcare sectors. The already limited resources are being heavily allocated towards controlling other dangerous diseases. Modern digital radiography (DR) machines, used for screening chest X-rays of potential TB victims are very practical. Coupled with computer-aided detection (CAD) with the aid of artificial intelligence, radiologists working in this field can really help potential patients. In this study, progressive resizing is introduced for training models to perform automatic inference of TB using chest X-ray images. ImageNet fine-tuned Normalization-Free Networks (NFNets) are trained for classification and the Score-Cam algorithm is utilized to highlight the regions in the chest X-Rays for detailed inference on the diagnosis. The proposed method is engineered to provide accurate diagnostics for both binary and multiclass classification. The models trained with this method have achieved 96.91% accuracy, 99.38% AUC, 91.81% sensitivity, and 98.42% specificity on a multiclass classification dataset. Moreover, models have also achieved top-1 inference metrics of 96% accuracy and 98% AUC for binary classification. The results obtained demonstrate that the proposed method can be used as a secondary decision tool in a clinical setting for assisting radiologists.
Collapse
|
8
|
A New Artificial Intelligence-Based Method for Identifying Mycobacterium Tuberculosis in Ziehl–Neelsen Stain on Tissue. Diagnostics (Basel) 2022; 12:diagnostics12061484. [PMID: 35741294 PMCID: PMC9221616 DOI: 10.3390/diagnostics12061484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Revised: 06/14/2022] [Accepted: 06/15/2022] [Indexed: 11/16/2022] Open
Abstract
Mycobacteria identification is crucial to diagnose tuberculosis. Since the bacillus is very small, finding it in Ziehl–Neelsen (ZN)-stained slides is a long task requiring significant pathologist’s effort. We developed an automated (AI-based) method of identification of mycobacteria. We prepared a training dataset of over 260,000 positive and over 700,000,000 negative patches annotated on scans of 510 whole slide images (WSI) of ZN-stained slides (110 positive and 400 negative). Several image augmentation techniques coupled with different custom computer vision architectures were used. WSIs automatic analysis was followed by a report indicating areas more likely to present mycobacteria. Our model performs AI-based diagnosis (the final decision of the diagnosis of WSI belongs to the pathologist). The results were validated internally on a dataset of 286,000 patches and tested in pathology laboratory settings on 60 ZN slides (23 positive and 37 negative). We compared the pathologists’ results obtained by separately evaluating slides and WSIs with the results given by a pathologist aided by automatic analysis of WSIs. Our architecture showed 0.977 area under the receiver operating characteristic curve. The clinical test presented 98.33% accuracy, 95.65% sensitivity, and 100% specificity for the AI-assisted method, outperforming any other AI-based proposed methods for AFB detection.
Collapse
|