1
|
Katzman BD, Alabousi M, Islam N, Zha N, Patlas MN. Deep Learning for Pneumothorax Detection on Chest Radiograph: A Diagnostic Test Accuracy Systematic Review and Meta Analysis. Can Assoc Radiol J 2024; 75:525-533. [PMID: 38189265 DOI: 10.1177/08465371231220885] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2024] Open
Abstract
BACKGROUND Pneumothorax is a common acute presentation in healthcare settings. A chest radiograph (CXR) is often necessary to make the diagnosis, and minimizing the time between presentation and diagnosis is critical to deliver optimal treatment. Deep learning (DL) algorithms have been developed to rapidly identify pathologic findings on various imaging modalities. PURPOSE The purpose of this systematic review and meta-analysis was to evaluate the overall performance of studies utilizing DL algorithms to detect pneumothorax on CXR. METHODS A study protocol was created and registered a priori (PROSPERO CRD42023391375). The search strategy included studies published up until January 10, 2023. Inclusion criteria were studies that used adult patients, utilized computer-aided detection of pneumothorax on CXR, dataset was evaluated by a qualified physician, and sufficient data was present to create a 2 × 2 contingency table. Risk of bias was assessed using the QUADAS-2 tool. Bivariate random effects meta-analyses and meta-regression modeling were performed. RESULTS Twenty-three studies were selected, including 34 011 patients and 34 075 CXRs. The pooled sensitivity and specificity were 87% (95% confidence interval, 81%, 92%) and 95% (95% confidence interval, 92%, 97%), respectively. The study design, use of an institutional/public data set and risk of bias had no significant effect on the sensitivity and specificity of pneumothorax detection. CONCLUSIONS The relatively high sensitivity and specificity of pneumothorax detection by deep-learning showcases the vast potential for implementation in clinical settings to both augment the workflow of radiologists and assist in more rapid diagnoses and subsequent patient treatment.
Collapse
Affiliation(s)
- Benjamin D Katzman
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Mostafa Alabousi
- Department of Medical Imaging, McMaster University, Hamilton, ON, Canada
| | - Nabil Islam
- Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Nanxi Zha
- Department of Medical Imaging, McMaster University, Hamilton, ON, Canada
| | - Michael N Patlas
- Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
2
|
Lin FCF, Wei CJ, Bai ZR, Chang CC, Chiu MC. Developing an explainable diagnosis system utilizing deep learning model: a case study of spontaneous pneumothorax. Phys Med Biol 2024; 69:145017. [PMID: 38955331 DOI: 10.1088/1361-6560/ad5e31] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Accepted: 07/01/2024] [Indexed: 07/04/2024]
Abstract
Objective.The trend in the medical field is towards intelligent detection-based medical diagnostic systems. However, these methods are often seen as 'black boxes' due to their lack of interpretability. This situation presents challenges in identifying reasons for misdiagnoses and improving accuracy, which leads to potential risks of misdiagnosis and delayed treatment. Therefore, how to enhance the interpretability of diagnostic models is crucial for improving patient outcomes and reducing treatment delays. So far, only limited researches exist on deep learning-based prediction of spontaneous pneumothorax, a pulmonary disease that affects lung ventilation and venous return.Approach.This study develops an integrated medical image analysis system using explainable deep learning model for image recognition and visualization to achieve an interpretable automatic diagnosis process.Main results.The system achieves an impressive 95.56% accuracy in pneumothorax classification, which emphasizes the significance of the blood vessel penetration defect in clinical judgment.Significance.This would lead to improve model trustworthiness, reduce uncertainty, and accurate diagnosis of various lung diseases, which results in better medical outcomes for patients and better utilization of medical resources. Future research can focus on implementing new deep learning models to detect and diagnose other lung diseases that can enhance the generalizability of this system.
Collapse
Affiliation(s)
- Frank Cheau-Feng Lin
- Department of Thoracic Surgery, Chung Shan Medical University Hospital, No. 110, Sec. 1, Jianguo N. Rd., South Dist., Taichung 40201, Taiwan, R.O.C
- School of Medicine, Chung Shan Medical University, No. 110, Sec. 1, Jianguo N. Rd., South Dist., Taichung 40201, Taiwan, R.O.C
| | - Chia-Jung Wei
- Department of Industrial Engineering and Industrial Management, National Tsing Hua University, Engineering BuildingⅠ, No. 101, Section 2, Kuang-Fu Road, Hsinchu 30013, Taiwan, R.O.C
| | - Zhe-Rui Bai
- Department of Industrial Engineering and Industrial Management, National Tsing Hua University, Engineering BuildingⅠ, No. 101, Section 2, Kuang-Fu Road, Hsinchu 30013, Taiwan, R.O.C
| | - Chi-Chang Chang
- Department of Medical Informatics, Chung Shan Medical University, No. 110, Sec. 1, Jianguo N. Rd., South Dist., Taichung 402306, Taiwan, R.O.C
- IT Office, Chung Shan Medical University Hospital, No. 110, Sec. 1, Jianguo N. Rd., South Dist., Taichung 402306, Taiwan, R.O.C
- Department of Information Management, Ming Chuan University, No. 5, De Ming Rd., Taoyuan 333000, Taiwan, R.O.C
| | - Ming-Chuan Chiu
- Department of Industrial Engineering and Industrial Management, National Tsing Hua University, Engineering BuildingⅠ, No. 101, Section 2, Kuang-Fu Road, Hsinchu 30013, Taiwan, R.O.C
| |
Collapse
|
3
|
Guha A, Halder S, Shinde SH, Gawde J, Munnolli S, Talole S, Goda JS. How does deep learning/machine learning perform in comparison to radiologists in distinguishing glioblastomas (or grade IV astrocytomas) from primary CNS lymphomas?: a meta-analysis and systematic review. Clin Radiol 2024; 79:460-472. [PMID: 38614870 DOI: 10.1016/j.crad.2024.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 03/05/2024] [Accepted: 03/07/2024] [Indexed: 04/15/2024]
Abstract
BACKGROUND Several studies have been published comparing deep learning (DL)/machine learning (ML) to radiologists in differentiating PCNSLs from GBMs with equivocal results. We aimed to perform this meta-analysis to evaluate the diagnostic accuracy of ML/DL versus radiologists in classifying PCNSL versus GBM using MRI. METHODOLOGY The study was performed in accordance with PRISMA guidelines. Data was extracted and interpreted by two researchers with 12 and 23 years' experience, respectively, and QUADAS-2 tool was used for quality and risk-bias assessment. We constructed contingency tables to derive sensitivity, specificity accuracy, summary receiver operating characteristic (SROC) curve, and the area under the curve (AUC). RESULTS Our search identified 11 studies, of which 8 satisfied our inclusion criteria and restricted the analysis in each study to reporting the model showing highest accuracy, with a total sample size of 1159 patients. The random effects model showed a pooled sensitivity of 0.89 [95% CI:0.84-0.92] for ML and 0.82 [95% CI:0.76-0.87] for radiologists. Pooled specificity was 0.88 [95% CI: 0.84-0.91] for ML and 0.90 [95% CI: 0.81-0.95] for radiologists. Pooled accuracy was 0.88 [95% CI: 0.86-0.90] for ML and 0.86 [95% CI: 0.78-0.91] for radiologists. Pooled AUC of ML was 0.94 [95% CI:0.92-0.96]and for radiologists, it was 0.90 [95% CI: 0.84-0.93]. CONCLUSIONS MRI-based ML/DL techniques can complement radiologists to improve the accuracy of classifying GBMs from PCNSL, possibly reduce the need for a biopsy, and avoid any unwanted neurosurgical resection of a PCNSL.
Collapse
Affiliation(s)
- A Guha
- Department of Radio-diagnosis, Tata Memorial Hospital, Parel, Mumbai, 400012, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India.
| | - S Halder
- Centre for Cancer Epidemiology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - S H Shinde
- Department of Radio-diagnosis, Tata Memorial Hospital, Parel, Mumbai, 400012, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - J Gawde
- Centre for Cancer Epidemiology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - S Munnolli
- Librarian and Officer In-Charge, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - S Talole
- Biostatistician, Centre for Cancer Epidemiology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India
| | - J S Goda
- Department of Radiation Oncology, Advanced Centre for Treatment Research & Education in Cancer, Tata Memorial Centre, Kharghar, Navi Mumbai, 410210, India; Homi Bhabha National Institute, Anushakti Nagar, Trombay, 400094, India.
| |
Collapse
|
4
|
Chiu MC, Tsai SCS, Bai ZR, Lin A, Chang CC, Wang GZ, Lin FCF. Radiographic chest wall abnormalities in primary spontaneous pneumothorax identified by artificial intelligence. Heliyon 2024; 10:e30023. [PMID: 38726131 PMCID: PMC11078867 DOI: 10.1016/j.heliyon.2024.e30023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 04/18/2024] [Accepted: 04/18/2024] [Indexed: 05/12/2024] Open
Abstract
Primary spontaneous pneumothorax (PSP) primarily affects slim and tall young males. Exploring the etiological link between chest wall structural characteristics and PSP is crucial for advancing treatment methods. In this case-control study, chest computed tomography (CT) images from patients undergoing thoracic surgery, with or without PSP, were analyzed using Artificial Intelligence. Convolutional Neural Network (CNN) model of EfficientNetB3 and InceptionV3 were used with transfer learning on the Imagenet to compare the images of both groups. A heatmap was created on the chest CT scans to enhance interoperability, and the scale-invariant feature transform (SIFT) was adopted to further compare the image level. A total of 2,312 CT images of 26 non-PSP patients and 1,122 CT images of 26 PSP patients were selected. Chest-wall apex pit (CAP) was found in 25 PSP and three non-PSP patients (p < 0.001). The CNN achieved a testing accuracy of 93.47 % in distinguishing PSP from non-PSP based on chest wall features by identifying the existence of CAP. Heatmap analysis demonstrated CNN's precision in targeting the upper chest wall, accurately identifying CAP without undue influence from similar structures, or inappropriately expanding or minimizing the test area. SIFT results indicated a 10.55 % higher mean similarity within the groups compared to between PSP and non-PSP (p < 0.001). In conclusion, distinctive radiographic chest wall configurations were observed in PSP patients, with CAP potentially serving as an etiological factor linked to PSP. This study accentuates the potential of AI-assisted analysis in refining diagnostic approaches and treatment strategies for PSP.
Collapse
Affiliation(s)
- Ming-Chuan Chiu
- Department of Industrial Engineering and Industrial Management, National Tsing Hua University, Hsinchu, 300044, Taiwan
| | - Stella Chin-Shaw Tsai
- Superintendent Office, Tungs' Taichung MetroHarbor Hospital, Taichung, Taiwan
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan
| | - Zhe-Rui Bai
- Department of Industrial Engineering and Industrial Management, National Tsing Hua University, Hsinchu, 300044, Taiwan
| | - Abraham Lin
- Engineering Management, Cornell University, Ithaca, NY, USA
| | - Chi-Chang Chang
- Department of Medical Informatics, Chung Shan Medical University Hospital, Taichung, Taiwan
| | - Guo-Zhi Wang
- Department of Thoracic Surgery, Chung Shan Medical University Hospital, Taichung, Taiwan
| | - Frank Cheau-Feng Lin
- Department of Thoracic Surgery, Chung Shan Medical University Hospital, Taichung, Taiwan
- School of Medicine, Chung Shan Medical University, Taichung, Taiwan
| |
Collapse
|
5
|
Hashimoto DA, Sambasastry SK, Singh V, Kurada S, Altieri M, Yoshida T, Madani A, Jogan M. A foundation for evaluating the surgical artificial intelligence literature. EUROPEAN JOURNAL OF SURGICAL ONCOLOGY 2024:108014. [PMID: 38360498 DOI: 10.1016/j.ejso.2024.108014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Revised: 01/06/2024] [Accepted: 02/09/2024] [Indexed: 02/17/2024]
Abstract
With increasing growth in applications of artificial intelligence (AI) in surgery, it has become essential for surgeons to gain a foundation of knowledge to critically appraise the scientific literature, commercial claims regarding products, and regulatory and legal frameworks that govern the development and use of AI. This guide offers surgeons a framework with which to evaluate manuscripts that incorporate the use of AI. It provides a glossary of common terms, an overview of prerequisite knowledge to maximize understanding of methodology, and recommendations on how to carefully consider each element of a manuscript to assess the quality of the data on which an algorithm was trained, the appropriateness of the methodological approach, the potential for reproducibility of the experiment, and the applicability to surgical practice, including considerations on generalizability and scalability.
Collapse
Affiliation(s)
- Daniel A Hashimoto
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, USA; Global Surgical AI Collaborative, Toronto, ON, USA.
| | - Sai Koushik Sambasastry
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Vivek Singh
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Sruthi Kurada
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Maria Altieri
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; Global Surgical AI Collaborative, Toronto, ON, USA
| | - Takuto Yoshida
- Surgical AI Research Academy, Department of Surgery, University Health Network, Toronto, ON, USA
| | - Amin Madani
- Global Surgical AI Collaborative, Toronto, ON, USA; Surgical AI Research Academy, Department of Surgery, University Health Network, Toronto, ON, USA
| | - Matjaz Jogan
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
6
|
Kwee TC, Roest C, Yakar D. Is radiology's future without medical images? Eur J Radiol 2024; 171:111296. [PMID: 38224634 DOI: 10.1016/j.ejrad.2024.111296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 01/07/2024] [Indexed: 01/17/2024]
Affiliation(s)
- Thomas C Kwee
- Medical Imaging Center, Department of Radiology, University Medical Center Groningen, University of Groningen, The Netherlands.
| | - Christian Roest
- Medical Imaging Center, Department of Radiology, University Medical Center Groningen, University of Groningen, The Netherlands
| | - Derya Yakar
- Medical Imaging Center, Department of Radiology, University Medical Center Groningen, University of Groningen, The Netherlands
| |
Collapse
|
7
|
Grenier PA, Brun AL, Mellot F. [The contribution of artificial intelligence (AI) subsequent to the processing of thoracic imaging]. Rev Mal Respir 2024; 41:110-126. [PMID: 38129269 DOI: 10.1016/j.rmr.2023.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 11/27/2023] [Indexed: 12/23/2023]
Abstract
The contribution of artificial intelligence (AI) to medical imaging is currently the object of widespread experimentation. The development of deep learning (DL) methods, particularly convolution neural networks (CNNs), has led to performance gains often superior to those achieved by conventional methods such as machine learning. Radiomics is an approach aimed at extracting quantitative data not accessible to the human eye from images expressing a disease. The data subsequently feed machine learning models and produce diagnostic or prognostic probabilities. As for the multiple applications of AI methods in thoracic imaging, they are undergoing evaluation. Chest radiography is a practically ideal field for the development of DL algorithms able to automatically interpret X-rays. Current algorithms can detect up to 14 different abnormalities present either in isolation or in combination. Chest CT is another area offering numerous AI applications. Various algorithms have been specifically formed and validated for the detection and characterization of pulmonary nodules and pulmonary embolism, as well as segmentation and quantitative analysis of the extent of diffuse lung diseases (emphysema, infectious pneumonias, interstitial lung disease). In addition, the analysis of medical images can be associated with clinical, biological, and functional data (multi-omics analysis), the objective being to construct predictive approaches regarding disease prognosis and response to treatment.
Collapse
Affiliation(s)
- P A Grenier
- Délégation à la recherche clinique et l'innovation, hôpital Foch, Suresnes, France.
| | - A L Brun
- Service de radiologie, hôpital Foch, Suresnes, France
| | - F Mellot
- Service de radiologie, hôpital Foch, Suresnes, France
| |
Collapse
|
8
|
Nho WY. Validation of the 35-mm rule in traumatic pneumothorax in an Asian population. Postgrad Med 2024; 136:60-66. [PMID: 38294228 DOI: 10.1080/00325481.2024.2313449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 01/30/2024] [Indexed: 02/01/2024]
Abstract
OBJECTIVES Thoracic injury crucially threatens human health. Recent studies have suggested using computed tomography (CT) to observe traumatic pneumothorax (PTX). However, cross-ethnic validation is required to overcome potential barriers for the global application of this method. This study aimed to validate the 35-mm rule in traumatic PTX in a Korean population. METHODS Data from the institutional registry were analyzed, and chest CT images were reviewed. Factors for observation failure were evaluated via logistic regression analysis, and a receiver-operating curve was created to calculate the optimal cutoff value. RESULTS In total, 286 participants were included in this study. The average PTX size was 8.2 (3.2-26.5) mm, and 210 of 213 (95.3%) initially observed patients with a PTX size of ≤35 mm successfully completed the safety observation. Multivariate regression analysis revealed that a PTX size of >35 mm is associated with observation failure and suggested a cutoff of 24.5 mm. CONCLUSION Most patients with traumatic PTX of ≤35 mm on CT had undergone successful 4-h observation without thoracostomy. Additionally, PTX of >35 mm was an independent risk factor for observation failure. Considering the lower optimal cutoff value and high failure rates observed in this study, the current guidelines need modifications.
Collapse
Affiliation(s)
- Woo Young Nho
- Department of Emergency Medicine, School of Medicine, Kyungpook National University, Daegu, South Korea
- Regional Trauma Center, Kyungpook National University Hospital, Daegu, South Korea
| |
Collapse
|
9
|
Ishiwata T, Yasufuku K. Artificial intelligence in interventional pulmonology. Curr Opin Pulm Med 2024; 30:92-98. [PMID: 37916605 DOI: 10.1097/mcp.0000000000001024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023]
Abstract
PURPOSE OF REVIEW In recent years, there has been remarkable progress in the field of artificial intelligence technology. Artificial intelligence applications have been extensively researched and actively implemented across various domains within healthcare. This study reviews the current state of artificial intelligence research in interventional pulmonology and engages in a discussion to comprehend its capabilities and implications. RECENT FINDINGS Deep learning, a subset of artificial intelligence, has found extensive applications in recent years, enabling highly accurate identification and labeling of bronchial segments solely from intraluminal bronchial images. Furthermore, research has explored the use of artificial intelligence for the analysis of endobronchial ultrasound images, achieving a high degree of accuracy in distinguishing between benign and malignant targets within ultrasound images. These advancements have become possible due to the increased computational power of modern systems and the utilization of vast datasets, facilitating detections and predictions with greater precision and speed. SUMMARY Artificial intelligence integration into interventional pulmonology has the potential to enhance diagnostic accuracy and patient safety, ultimately leading to improved patient outcomes. However, the clinical impacts of artificial intelligence enhanced procedures remain unassessed. Additional research is necessary to evaluate both the advantages and disadvantages of artificial intelligence in the field of interventional pulmonology.
Collapse
Affiliation(s)
- Tsukasa Ishiwata
- Division of Thoracic Surgery, Toronto General Hospital, University Health Network, Toronto, Ontario, Canada
| | | |
Collapse
|
10
|
Dundamadappa SK. AI tools in Emergency Radiology reading room: a new era of Radiology. Emerg Radiol 2023; 30:647-657. [PMID: 37420044 DOI: 10.1007/s10140-023-02154-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 06/20/2023] [Indexed: 07/09/2023]
Abstract
Artificial intelligence tools in radiology practices have surged, with modules developed to target specific findings becoming increasingly prevalent and proving valuable in the daily emergency room radiology practice. The number of US Food and Drug Administration-cleared radiology-related algorithms has soared from just 10 in early 2017 to over 200 presently. This review will concentrate on the present utilization of AI tools in clinical ER radiology setting, including a brief discussion of the limitations of the technique. As radiologists, it is essential that we embrace this technology, comprehend its constraints, and use it to improve patient care.
Collapse
|