1
|
Xiong L, Liu X, Qin X, Li W. Accurate pneumoconiosis staging via deep texture encoding and discriminative representation learning. Front Med (Lausanne) 2024; 11:1440585. [PMID: 39444812 PMCID: PMC11496156 DOI: 10.3389/fmed.2024.1440585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Accepted: 09/27/2024] [Indexed: 10/25/2024] Open
Abstract
Accurate pneumoconiosis staging is key to early intervention and treatment planning for pneumoconiosis patients. The staging process relies on assessing the profusion level of small opacities, which are dispersed throughout the entire lung field and manifest as fine textures. While conventional convolutional neural networks (CNNs) have achieved significant success in tasks such as image classification and object recognition, they are less effective for classifying fine-grained medical images due to the need for global, orderless feature representation. This limitation often results in inaccurate staging outcomes for pneumoconiosis. In this study, we propose a deep texture encoding scheme with a suppression strategy designed to capture the global, orderless characteristics of pneumoconiosis lesions while suppressing prominent regions such as the ribs and clavicles within the lung field. To further enhance staging accuracy, we incorporate an ordinal label distribution to capture the ordinal information among profusion levels of opacities. Additionally, we employ supervised contrastive learning to develop a more discriminative feature space for downstream classification tasks. Finally, in accordance with standard practices, we evaluate the profusion levels of opacities in each subregion of the lung, rather than relying on the entire chest X-ray image. Experimental results on the pneumoconiosis dataset demonstrate the superior performance of the proposed method confirming its effectiveness for accurate pneumoconiosis staging.
Collapse
Affiliation(s)
- Liang Xiong
- Chengdu Institute of Computer Applications, Chinese Academy of Sciences, Chengdu, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xin Liu
- School of Computer Science and Technology, Dongguan University of Technology, Dongguan, China
- Chongqing Prevention and Treatment Hospital for Occupation Diseases, Chongqing, China
| | - Xiaolin Qin
- Chengdu Institute of Computer Applications, Chinese Academy of Sciences, Chengdu, China
| | - Weiling Li
- School of Computer Science and Technology, Dongguan University of Technology, Dongguan, China
| |
Collapse
|
2
|
Liu C, Fang Y, Xie Y, Zheng H, Li X, Wu D, Zhang T. Deep learning pneumoconiosis staging and diagnosis system based on multi-stage joint approach. BMC Med Imaging 2024; 24:165. [PMID: 38956579 PMCID: PMC11221180 DOI: 10.1186/s12880-024-01337-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 06/14/2024] [Indexed: 07/04/2024] Open
Abstract
BACKGROUND Pneumoconiosis has a significant impact on the quality of patient survival due to its difficult staging diagnosis and poor prognosis. This study aimed to develop a computer-aided diagnostic system for the screening and staging of pneumoconiosis based on a multi-stage joint deep learning approach using X-ray chest radiographs of pneumoconiosis patients. METHODS In this study, a total of 498 medical chest radiographs were obtained from the Department of Radiology of West China Fourth Hospital. The dataset was randomly divided into a training set and a test set at a ratio of 4:1. Following histogram equalization for image enhancement, the images were segmented using the U-Net model, and staging was predicted using a convolutional neural network classification model. We first used Efficient-Net for multi-classification staging diagnosis, but the results showed that stage I/II of pneumoconiosis was difficult to diagnose. Therefore, based on clinical practice we continued to improve the model by using the Res-Net 34 Multi-stage joint method. RESULTS Of the 498 cases collected, the classification model using the Efficient-Net achieved an accuracy of 83% with a Quadratic Weighted Kappa (QWK) score of 0.889. The classification model using the multi-stage joint approach of Res-Net 34 achieved an accuracy of 89% with an area under the curve (AUC) of 0.98 and a high QWK score of 0.94. CONCLUSIONS In this study, the diagnostic accuracy of pneumoconiosis staging was significantly improved by an innovative combined multi-stage approach, which provided a reference for clinical application and pneumoconiosis screening.
Collapse
Affiliation(s)
- Chang Liu
- West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, 610041, PR China
- West China-PUMC C.C. Chen Institute of Health, Sichuan University, Chengdu, PR China
| | - Yeqi Fang
- College of Physics, Sichuan University, Chengdu, 610041, PR China
| | - YuHuan Xie
- West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, 610041, PR China
- West China-PUMC C.C. Chen Institute of Health, Sichuan University, Chengdu, PR China
| | - Hao Zheng
- College of Computer Science, Sichuan University, Chengdu, 610041, PR China
| | - Xin Li
- West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, 610041, PR China
- West China-PUMC C.C. Chen Institute of Health, Sichuan University, Chengdu, PR China
| | - Dongsheng Wu
- West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, 610041, PR China.
- West China-PUMC C.C. Chen Institute of Health, Sichuan University, Chengdu, PR China.
| | - Tao Zhang
- West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, 610041, PR China.
- West China-PUMC C.C. Chen Institute of Health, Sichuan University, Chengdu, PR China.
| |
Collapse
|
3
|
Zhang Y, Zheng B, Zeng F, Cheng X, Wu T, Peng Y, Zhang Y, Xie Y, Yi W, Chen W, Wu J, Li L. Potential of digital chest radiography-based deep learning in screening and diagnosing pneumoconiosis: An observational study. Medicine (Baltimore) 2024; 103:e38478. [PMID: 38905434 PMCID: PMC11191863 DOI: 10.1097/md.0000000000038478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 05/16/2024] [Indexed: 06/23/2024] Open
Abstract
The diagnosis of pneumoconiosis is complex and subjective, leading to inevitable variability in readings. This is especially true for inexperienced doctors. To improve accuracy, a computer-assisted diagnosis system is used for more effective pneumoconiosis diagnoses. Three models (Resnet50, Resnet101, and DenseNet) were used for pneumoconiosis classification based on 1250 chest X-ray images. Three experienced and highly qualified physicians read the collected digital radiography images and classified them from category 0 to category III in a double-blinded manner. The results of the 3 physicians in agreement were considered the relative gold standards. Subsequently, 3 models were used to train and test these images and their performance was evaluated using multi-class classification metrics. We used kappa values and accuracy to evaluate the consistency and reliability of the optimal model with clinical typing. The results showed that ResNet101 was the optimal model among the 3 convolutional neural networks. The AUC of ResNet101 was 1.0, 0.9, 0.89, and 0.94 for detecting pneumoconiosis categories 0, I, II, and III, respectively. The micro-average and macro-average mean AUC values were 0.93 and 0.94, respectively. The accuracy and Kappa values of ResNet101 were 0.72 and 0.7111 for quadruple classification and 0.98 and 0.955 for dichotomous classification, respectively, compared with the relative standard classification of the clinic. This study develops a deep learning based model for screening and staging of pneumoconiosis is using chest radiographs. The ResNet101 model performed relatively better in classifying pneumoconiosis than radiologists. The dichotomous classification displayed outstanding performance, thereby indicating the feasibility of deep learning techniques in pneumoconiosis screening.
Collapse
Affiliation(s)
- Yajuan Zhang
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Bowen Zheng
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Fengxia Zeng
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Xiaoke Cheng
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Tianqiong Wu
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Yuli Peng
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Yonliang Zhang
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Yuanlin Xie
- Department of Radiology, San shui District Institute for Disease Control and Prevention, Foshan Guangdong, China
| | - Wei Yi
- Department of Radiology, The Third People’s Hospital of Yunnan Province, Yunnan, China
| | - Weiguo Chen
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Jiefang Wu
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Long Li
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| |
Collapse
|
4
|
Shah IA, Mishra S. Artificial intelligence in advancing occupational health and safety: an encapsulation of developments. J Occup Health 2024; 66:uiad017. [PMID: 38334203 PMCID: PMC10878366 DOI: 10.1093/joccuh/uiad017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/29/2023] [Accepted: 12/06/2023] [Indexed: 02/10/2024] Open
Abstract
OBJECTIVES In an era characterized by dynamic technological advancements, the well-being of the workforce remains a cornerstone of progress and sustainability. The evolving industrial landscape in the modern world has had a considerable influence on occupational health and safety (OHS). Ensuring the well-being of workers and creating safe working environments are not only ethical imperatives but also integral to maintaining operational efficiency and productivity. We aim to review the advancements that have taken place with a potential to reshape workplace safety with integration of artificial intelligence (AI)-driven new technologies to prevent occupational diseases and promote safety solutions. METHODS The published literature was identified using scientific databases of Embase, PubMed, and Google scholar including a lower time bound of 1974 to capture chronological advances in occupational disease detection and technological solutions employed in industrial set-ups. RESULTS AI-driven technologies are revolutionizing how organizations approach health and safety, offering predictive insights, real-time monitoring, and risk mitigation strategies that not only minimize accidents and hazards but also pave the way for a more proactive and responsive approach to safeguarding the workforce. CONCLUSION As industries embrace the transformative potential of AI, a new frontier of possibilities emerges for enhancing workplace safety. This synergy between OHS and AI marks a pivotal moment in the quest for safer, healthier, and more sustainable workplaces.
Collapse
Affiliation(s)
- Immad A Shah
- Division of Health Sciences, ICMR-National Institute of Occupational Health, Ahmedabad, Gujarat, India
| | - SukhDev Mishra
- Department of Biostatistics, Division of Health Sciences, ICMR-National Institute of Occupational Health, Ahmedabad, Gujarat, India
| |
Collapse
|
5
|
Hussain A, Marlowe S, Ali M, Uy E, Bhopalwala H, Gullapalli D, Vangara A, Haroon M, Akbar A, Piercy J. A Systematic Review of Artificial Intelligence Applications in the Management of Lung Disorders. Cureus 2024; 16:e51581. [PMID: 38313926 PMCID: PMC10836179 DOI: 10.7759/cureus.51581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/02/2024] [Indexed: 02/06/2024] Open
Abstract
This systematic review examines the transformative impact of artificial intelligence (AI) in managing lung disorders through a comprehensive analysis of articles spanning 2014 to 2023. Evaluating AI's multifaceted roles in radiological imaging, disease burden prediction, detection, diagnosis, and molecular mechanisms, this review presents a critical synthesis of key insights from select articles. The findings underscore AI's significant strides in bolstering diagnostic accuracy, interpreting radiological imaging, predicting disease burdens, and deepening the understanding of tuberculosis (TB), chronic obstructive pulmonary disease (COPD), silicosis, pneumoconiosis, and lung fibrosis. The synthesis positions AI as a revolutionary tool within the healthcare system, offering vital implications for healthcare workers, policymakers, and researchers in comprehending and leveraging AI's pivotal role in lung disease management.
Collapse
Affiliation(s)
- Akbar Hussain
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Stanley Marlowe
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Muhammad Ali
- Pulmonary and Critical Care, Appalachian Regional Healthcare, Hazard, USA
| | - Edilfavia Uy
- Diabetes and Endocrinology, Appalachian Regional Healthcare, Whitesburg, USA
| | - Huzefa Bhopalwala
- Internal Medicine, Appalachian Regional Healthcare, Whitesburg, USA
- Cardiovascular, Mayo Clinic, Rochester, USA
| | | | - Avinash Vangara
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Moeez Haroon
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Aelia Akbar
- Public Health, Appalachian Regional Healthcare, Harlan, USA
| | - Jonathan Piercy
- Internal Medicine, Appalachian Regional Healthcare, Whitesburg, USA
| |
Collapse
|
6
|
Wang Y, Cui F, Ding X, Yao Y, Li G, Gui G, Shen F, Li B. Automated identification of the preclinical stage of coal workers' pneumoconiosis from digital chest radiography using three-stage cascaded deep learning model. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
|
7
|
Suganuma N, Yoshida S, Takeuchi Y, Nomura YK, Suzuki K. Artificial Intelligence in Quantitative Chest Imaging Analysis for Occupational Lung Disease. Semin Respir Crit Care Med 2023; 44:362-369. [PMID: 37072023 DOI: 10.1055/s-0043-1767760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/20/2023]
Abstract
Occupational lung disease manifests complex radiologic findings which have long been a challenge for computer-assisted diagnosis (CAD). This journey started in the 1970s when texture analysis was developed and applied to diffuse lung disease. Pneumoconiosis appears on radiography as a combination of small opacities, large opacities, and pleural shadows. The International Labor Organization International Classification of Radiograph of Pneumoconioses has been the main tool used to describe pneumoconioses and is an ideal system that can be adapted for CAD using artificial intelligence (AI). AI includes machine learning which utilizes deep learning or an artificial neural network. This in turn includes a convolutional neural network. The tasks of CAD are systematically described as classification, detection, and segmentation of the target lesions. Alex-net, VGG16, and U-Net are among the most common algorithms used in the development of systems for the diagnosis of diffuse lung disease, including occupational lung disease. We describe the long journey in the pursuit of CAD of pneumoconioses including our recent proposal of a new expert system.
Collapse
Affiliation(s)
- Narufumi Suganuma
- Department of Environmental Medicine, Kochi Medical School, Nankoku, Kochi, Japan
| | - Shinichi Yoshida
- School of Information, Kochi University of Technology, Nankoku, Kochi, Japan
| | - Yuma Takeuchi
- Department of Environmental Medicine, Kochi Medical School, Nankoku, Kochi, Japan
- Department of Radiology, Kochi Medical School Hospital, Nankoku, Kochi, Japan
| | - Yoshua K Nomura
- Department of Environmental Medicine, Kochi Medical School, Nankoku, Kochi, Japan
| | - Kazuhiro Suzuki
- Department of Radiology, School of Medicine, Juntendo University, Bunkyo City, Tokyo, Japan
| |
Collapse
|
8
|
de Godoy MF, Chatkin JM, Rodrigues RS, Forte GC, Marchiori E, Gavenski N, Barros RC, Hochhegger B. Artificial intelligence to predict the need for mechanical ventilation in cases of severe COVID-19. Radiol Bras 2023; 56:81-85. [PMID: 37168039 PMCID: PMC10165968 DOI: 10.1590/0100-3984.2022.0049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Accepted: 07/22/2022] [Indexed: 03/12/2023] Open
Abstract
Objective To determinate the accuracy of computed tomography (CT) imaging assessed by deep neural networks for predicting the need for mechanical ventilation (MV) in patients hospitalized with severe acute respiratory syndrome due to coronavirus disease 2019 (COVID-19). Materials and Methods This was a retrospective cohort study carried out at two hospitals in Brazil. We included CT scans from patients who were hospitalized due to severe acute respiratory syndrome and had COVID-19 confirmed by reverse transcription-polymerase chain reaction (RT-PCR). The training set consisted of chest CT examinations from 823 patients with COVID-19, of whom 93 required MV during hospitalization. We developed an artificial intelligence (AI) model based on convolutional neural networks. The performance of the AI model was evaluated by calculating its accuracy, sensitivity, specificity, and area under the receiver operating characteristic (ROC) curve. Results For predicting the need for MV, the AI model had a sensitivity of 0.417 and a specificity of 0.860. The corresponding area under the ROC curve for the test set was 0.68. Conclusion The high specificity of our AI model makes it able to reliably predict which patients will and will not need invasive ventilation. That makes this approach ideal for identifying high-risk patients and predicting the minimum number of ventilators and critical care beds that will be required.
Collapse
Affiliation(s)
| | - José Miguel Chatkin
- Pontifícia Universidade Católica do Rio Grande do Sul
(PUCRS), Porto Alegre, RS, Brazil
| | | | - Gabriele Carra Forte
- Pontifícia Universidade Católica do Rio Grande do Sul
(PUCRS), Porto Alegre, RS, Brazil
| | - Edson Marchiori
- Universidade Federal do Rio de Janeiro (UFRJ), Rio de Janeiro, RJ, Brazil
| | - Nathan Gavenski
- Pontifícia Universidade Católica do Rio Grande do Sul
(PUCRS), Porto Alegre, RS, Brazil
| | - Rodrigo Coelho Barros
- Pontifícia Universidade Católica do Rio Grande do Sul
(PUCRS), Porto Alegre, RS, Brazil
| | - Bruno Hochhegger
- Pontifícia Universidade Católica do Rio Grande do Sul
(PUCRS), Porto Alegre, RS, Brazil
| |
Collapse
|
9
|
Huang Y, Si Y, Hu B, Zhang Y, Wu S, Wu D, Wang Q. Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images. Comput Biol Med 2022; 150:106137. [PMID: 36191395 DOI: 10.1016/j.compbiomed.2022.106137] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Revised: 09/13/2022] [Accepted: 09/18/2022] [Indexed: 11/22/2022]
Abstract
In the past decade, deep learning methods have been implemented in the medical image fields and have achieved good performance. Recently, deep learning algorithms have been successful in the evaluation of diagnosis on lung images. Although chest radiography (CR) is the standard data modality for diagnosing pneumoconiosis, computed tomography (CT) typically provides more details of the lesions in the lung. Thus, a transformer-based factorized encoder (TBFE) was proposed and first applied for the classification of pneumoconiosis depicted on 3D CT images. Specifically, a factorized encoder consists of two transformer encoders. The first transformer encoder enables the interaction of intra-slice by encoding feature maps from the same slice of CT. The second transformer encoder explores the inter-slice interaction by encoding feature maps from different slices. In addition, the lack of grading standards on CT for labeling the pneumoconiosis lesions. Thus, an acknowledged CR-based grading system was applied to mark the corresponding pneumoconiosis CT stage. Then, we pre-trained the 3D convolutional autoencoder on the public LIDC-IDRI dataset and fixed the parameters of the last convolutional layer of the encoder to extract CT feature maps with underlying spatial structural information from our 3D CT dataset. Experimental results demonstrated the superiority of the TBFE over other 3D-CNN networks, achieving an accuracy of 97.06%, a recall of 89.33%, precision of 90%, and an F1-score of 93.33%, using 10-fold cross-validation.
Collapse
Affiliation(s)
- Yingying Huang
- Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119, Shanxi, China; University of Chinese Academy of Sciences, Beijing 100049, China; Key laboratory of Biomedical Spectroscopy, Xi'an 710119, Shanxi, China.
| | - Yang Si
- Sichuan Academy of Medical Science and Sichuan Provincial People's Hospital, Department of Neurology, Chengdu, Sichuan, China; University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | - Bingliang Hu
- Key laboratory of Biomedical Spectroscopy, Xi'an 710119, Shanxi, China.
| | - Yan Zhang
- Department of Radiology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, Sichuan, China.
| | - Shuang Wu
- Department of Radiology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, Sichuan, China.
| | - Dongsheng Wu
- Department of Radiology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, Sichuan, China; Research Center of Artificial Intelligence in Medicine, West China-PUMC C.C. Chen Institute of Health, Sichuan University, Chengdu, Sichuan, China.
| | - Quan Wang
- Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119, Shanxi, China; Key laboratory of Biomedical Spectroscopy, Xi'an 710119, Shanxi, China.
| |
Collapse
|
10
|
Devnath L, Fan Z, Luo S, Summons P, Wang D. Detection and Visualisation of Pneumoconiosis Using an Ensemble of Multi-Dimensional Deep Features Learned from Chest X-rays. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:11193. [PMID: 36141457 PMCID: PMC9517617 DOI: 10.3390/ijerph191811193] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 08/25/2022] [Accepted: 08/27/2022] [Indexed: 06/16/2023]
Abstract
Pneumoconiosis is a group of occupational lung diseases induced by mineral dust inhalation and subsequent lung tissue reactions. It can eventually cause irreparable lung damage, as well as gradual and permanent physical impairments. It has affected millions of workers in hazardous industries throughout the world, and it is a leading cause of occupational death. It is difficult to diagnose early pneumoconiosis because of the low sensitivity of chest radiographs, the wide variation in interpretation between and among readers, and the scarcity of B-readers, which all add to the difficulty in diagnosing these occupational illnesses. In recent years, deep machine learning algorithms have been extremely successful at classifying and localising abnormality of medical images. In this study, we proposed an ensemble learning approach to improve pneumoconiosis detection in chest X-rays (CXRs) using nine machine learning classifiers and multi-dimensional deep features extracted using CheXNet-121 architecture. There were eight evaluation metrics utilised for each high-level feature set of the associated cross-validation datasets in order to compare the ensemble performance and state-of-the-art techniques from the literature that used the same cross-validation datasets. It is observed that integrated ensemble learning exhibits promising results (92.68% accuracy, 85.66% Matthews correlation coefficient (MCC), and 0.9302 area under the precision-recall (PR) curve), compared to individual CheXNet-121 and other state-of-the-art techniques. Finally, Grad-CAM was used to visualise the learned behaviour of individual dense blocks within CheXNet-121 and their ensembles into three-color channels of CXRs. We compared the Grad-CAM-indicated ROI to the ground-truth ROI using the intersection of the union (IOU) and average-precision (AP) values for each classifier and their ensemble. Through the visualisation of the Grad-CAM within the blue channel, the average IOU passed more than 90% of the pneumoconiosis detection in chest radiographs.
Collapse
Affiliation(s)
- Liton Devnath
- School of Information and Physical Sciences, The University of Newcastle, Newcastle 2308, Australia
- British Columbia Cancer Research Centre, Vancouver, BC V5Z 1L3, Canada
| | - Zongwen Fan
- College of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
| | - Suhuai Luo
- School of Information and Physical Sciences, The University of Newcastle, Newcastle 2308, Australia
| | - Peter Summons
- School of Information and Physical Sciences, The University of Newcastle, Newcastle 2308, Australia
| | - Dadong Wang
- Quantitative Imaging, CSIRO Data61, Marsfield 2122, Australia
| |
Collapse
|
11
|
Multiple instance learning for lung pathophysiological findings detection using CT scans. Med Biol Eng Comput 2022; 60:1569-1584. [PMID: 35386027 DOI: 10.1007/s11517-022-02526-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Accepted: 01/17/2022] [Indexed: 10/18/2022]
Abstract
Lung diseases affect the lives of billions of people worldwide, and 4 million people, each year, die prematurely due to this condition. These pathologies are characterized by specific imagiological findings in CT scans. The traditional Computer-Aided Diagnosis (CAD) approaches have been showing promising results to help clinicians; however, CADs normally consider a small part of the medical image for analysis, excluding possible relevant information for clinical evaluation. Multiple Instance Learning (MIL) approach takes into consideration different small pieces that are relevant for the final classification and creates a comprehensive analysis of pathophysiological changes. This study uses MIL-based approaches to identify the presence of lung pathophysiological findings in CT scans for the characterization of lung disease development. This work was focus on the detection of the following: Fibrosis, Emphysema, Satellite Nodules in Primary Lesion Lobe, Nodules in Contralateral Lung and Ground Glass, being Fibrosis and Emphysema the ones with more outstanding results, reaching an Area Under the Curve (AUC) of 0.89 and 0.72, respectively. Additionally, the MIL-based approach was used for EGFR mutation status prediction - the most relevant oncogene on lung cancer, with an AUC of 0.69. The results showed that this comprehensive approach can be a useful tool for lung pathophysiological characterization.
Collapse
|
12
|
Computer-Aided Diagnosis of Coal Workers' Pneumoconiosis in Chest X-ray Radiographs Using Machine Learning: A Systematic Literature Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19116439. [PMID: 35682023 PMCID: PMC9180284 DOI: 10.3390/ijerph19116439] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 05/20/2022] [Accepted: 05/22/2022] [Indexed: 02/01/2023]
Abstract
Computer-aided diagnostic (CAD) systems can assist radiologists in detecting coal workers' pneumoconiosis (CWP) in their chest X-rays. Early diagnosis of the CWP can significantly improve workers' survival rate. The development of the CAD systems will reduce risk in the workplace and improve the quality of chest screening for CWP diseases. This systematic literature review (SLR) amis to categorise and summarise the feature extraction and detection approaches of computer-based analysis in CWP using chest X-ray radiographs (CXR). We conducted the SLR method through 11 databases that focus on science, engineering, medicine, health, and clinical studies. The proposed SLR identified and compared 40 articles from the last 5 decades, covering three main categories of computer-based CWP detection: classical handcrafted features-based image analysis, traditional machine learning, and deep learning-based methods. Limitations of this review and future improvement of the review are also discussed.
Collapse
|
13
|
Zhang Y. Computer-Aided Diagnosis for Pneumoconiosis Staging Based on Multi-scale Feature Mapping. INT J COMPUT INT SYS 2021. [DOI: 10.1007/s44196-021-00046-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
AbstractIn this research, we explored a method of multi-scale feature mapping to pre-screen radiographs quickly and accurately in the aided diagnosis of pneumoconiosis staging. We utilized an open dataset and a self-collected dataset as research datasets. We proposed a multi-scale feature mapping model based on deep learning feature extraction technology for detecting pulmonary fibrosis and a discrimination method for pneumoconiosis staging. The diagnostic accuracy was evaluated using under the curve (AUC) of the receiver operating characteristic (ROC) curve. The AUC value of our model was 0.84, which showed the best performance compared with previous work on datasets. The diagnosis results indicated that our method was highly consistent with that of clinical experts on real patient. Furthermore, the AUC value obtained through categories I–IV on the testing dataset demonstrated that categories I (AUC = 0.86) and IV (AUC = 0.82) obtained the best performance and achieved the level of clinician categorization. Our research could be applied to the pre-screening and diagnosis of pneumoconiosis in the clinic.
Collapse
|
14
|
Informatics Approaches for Recognition, Management, and Prevention of Occupational Respiratory Disease. Clin Chest Med 2021; 41:605-621. [PMID: 33153682 DOI: 10.1016/j.ccm.2020.08.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Computer and information systems can improve occupational respiratory disease prevention and surveillance by providing efficient resources for patients, workers, clinicians, and public health practitioners. Advances include interlinking electronic health records, autocoding surveillance data, clinical decision support systems, and social media applications for acquiring and disseminating information. Obstacles to advances include inflexible hierarchical coding schemes, inadequate occupational health electronic health record systems, and inadequate public focus on occupational respiratory disease. Potentially transformative approaches include machine learning, natural language processing, and improved ontologies.
Collapse
|
15
|
Zhang L, Rong R, Li Q, Yang DM, Yao B, Luo D, Zhang X, Zhu X, Luo J, Liu Y, Yang X, Ji X, Liu Z, Xie Y, Sha Y, Li Z, Xiao G. A deep learning-based model for screening and staging pneumoconiosis. Sci Rep 2021; 11:2201. [PMID: 33500426 PMCID: PMC7838184 DOI: 10.1038/s41598-020-77924-z] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2020] [Accepted: 11/09/2020] [Indexed: 11/09/2022] Open
Abstract
This study aims to develop an artificial intelligence (AI)-based model to assist radiologists in pneumoconiosis screening and staging using chest radiographs. The model, based on chest radiographs, was developed using a training cohort and validated using an independent test cohort. Every image in the training and test datasets were labeled by experienced radiologists in a double-blinded fashion. The computational model started by segmenting the lung field into six subregions. Then, convolutional neural network classification model was used to predict the opacity level for each subregion respectively. Finally, the diagnosis for each subject (normal, stage I, II, or III pneumoconiosis) was determined by summarizing the subregion-based prediction results. For the independent test cohort, pneumoconiosis screening accuracy was 0.973, with both sensitivity and specificity greater than 0.97. The accuracy for pneumoconiosis staging was 0.927, better than that achieved by two groups of radiologists (0.87 and 0.84, respectively). This study develops a deep learning-based model for screening and staging of pneumoconiosis using man-annotated chest radiographs. The model outperformed two groups of radiologists in the accuracy of pneumoconiosis staging. This pioneer work demonstrates the feasibility and efficiency of AI-assisted radiography screening and diagnosis in occupational lung diseases.
Collapse
Affiliation(s)
- Liuzhuo Zhang
- Shenzhen Prevention and Treatment Center for Occupational Diseases, Shenzhen, Guangdong, China
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Ruichen Rong
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Qiwei Li
- Department of Mathematical Sciences, The University of Texas at Dallas, Richardson, TX, 75080, USA
| | - Donghan M Yang
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Bo Yao
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Danni Luo
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Xiong Zhang
- Shenzhen Prevention and Treatment Center for Occupational Diseases, Shenzhen, Guangdong, China
| | - Xianfeng Zhu
- Institute of Occupational Medicine of Jiangxi, Nanchang, Jiangxi, China
| | - Jun Luo
- Shenzhen Prevention and Treatment Center for Occupational Diseases, Shenzhen, Guangdong, China
| | - Yongquan Liu
- Institute of Occupational Medicine of Jiangxi, Nanchang, Jiangxi, China
| | - Xinyue Yang
- Shenzhen Prevention and Treatment Center for Occupational Diseases, Shenzhen, Guangdong, China
- Shenzhen Association of Occupational Health, Shenzhen, Guangdong, China
| | - Xiang Ji
- Shenzhen Prevention and Treatment Center for Occupational Diseases, Shenzhen, Guangdong, China
| | - Zhidong Liu
- Huizhou Prevention and Treatment Center for Occupational Diseases, Huizhou, Guangdong, China
| | - Yang Xie
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Yan Sha
- Shenzhen Prevention and Treatment Center for Occupational Diseases, Shenzhen, Guangdong, China
| | - Zhimin Li
- Shenzhen Prevention and Treatment Center for Occupational Diseases, Shenzhen, Guangdong, China.
- Shenzhen Association of Occupational Health, Shenzhen, Guangdong, China.
| | - Guanghua Xiao
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA.
| |
Collapse
|
16
|
Wang X, Yu J, Zhu Q, Li S, Zhao Z, Yang B, Pu J. Potential of deep learning in assessing pneumoconiosis depicted on digital chest radiography. Occup Environ Med 2020; 77:597-602. [DOI: 10.1136/oemed-2019-106386] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2019] [Revised: 04/30/2020] [Accepted: 05/11/2020] [Indexed: 11/04/2022]
Abstract
ObjectivesTo investigate the potential of deep learning in assessing pneumoconiosis depicted on digital chest radiographs and to compare its performance with certified radiologists.MethodsWe retrospectively collected a dataset consisting of 1881 chest X-ray images in the form of digital radiography. These images were acquired in a screening setting on subjects who had a history of working in an environment that exposed them to harmful dust. Among these subjects, 923 were diagnosed with pneumoconiosis, and 958 were normal. To identify the subjects with pneumoconiosis, we applied a classical deep convolutional neural network (CNN) called Inception-V3 to these image sets and validated the classification performance of the trained models using the area under the receiver operating characteristic curve (AUC). In addition, we asked two certified radiologists to independently interpret the images in the testing dataset and compared their performance with the computerised scheme.ResultsThe Inception-V3 CNN architecture, which was trained on the combination of the three image sets, achieved an AUC of 0.878 (95% CI 0.811 to 0.946). The performance of the two radiologists in terms of AUC was 0.668 (95% CI 0.555 to 0.782) and 0.772 (95% CI 0.677 to 0.866), respectively. The agreement between the two readers was moderate (kappa: 0.423, p<0.001).ConclusionOur experimental results demonstrated that the deep leaning solution could achieve a relatively better performance in classification as compared with other models and the certified radiologists, suggesting the feasibility of deep learning techniques in screening pneumoconiosis.
Collapse
|
17
|
Singh R, Kalra MK, Nitiwarangkul C, Patti JA, Homayounieh F, Padole A, Rao P, Putha P, Muse VV, Sharma A, Digumarthy SR. Deep learning in chest radiography: Detection of findings and presence of change. PLoS One 2018; 13:e0204155. [PMID: 30286097 PMCID: PMC6171827 DOI: 10.1371/journal.pone.0204155] [Citation(s) in RCA: 107] [Impact Index Per Article: 17.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Accepted: 09/04/2018] [Indexed: 11/18/2022] Open
Abstract
Background Deep learning (DL) based solutions have been proposed for interpretation of several imaging modalities including radiography, CT, and MR. For chest radiographs, DL algorithms have found success in the evaluation of abnormalities such as lung nodules, pulmonary tuberculosis, cystic fibrosis, pneumoconiosis, and location of peripherally inserted central catheters. Chest radiography represents the most commonly performed radiological test for a multitude of non-emergent and emergent clinical indications. This study aims to assess accuracy of deep learning (DL) algorithm for detection of abnormalities on routine frontal chest radiographs (CXR), and assessment of stability or change in findings over serial radiographs. Methods and findings We processed 874 de-identified frontal CXR from 724 adult patients (> 18 years) with DL (Qure AI). Scores and prediction statistics from DL were generated and recorded for the presence of pulmonary opacities, pleural effusions, hilar prominence, and enlarged cardiac silhouette. To establish a standard of reference (SOR), two thoracic radiologists assessed all CXR for these abnormalities. Four other radiologists (test radiologists), unaware of SOR and DL findings, independently assessed the presence of radiographic abnormalities. A total 724 radiographs were assessed for detection of findings. A subset of 150 radiographs with follow up examinations was used to asses change over time. Data were analyzed with receiver operating characteristics analyses and post-hoc power analysis. Results About 42% (305/ 724) CXR had no findings according to SOR; single and multiple abnormalities were seen in 23% (168/724) and 35% (251/724) of CXR. There was no statistical difference between DL and SOR for all abnormalities (p = 0.2–0.8). The area under the curve (AUC) for DL and test radiologists ranged between 0.837–0.929 and 0.693–0.923, respectively. DL had lowest AUC (0.758) for assessing changes in pulmonary opacities over follow up CXR. Presence of chest wall implanted devices negatively affected the accuracy of DL algorithm for evaluation of pulmonary and hilar abnormalities. Conclusions DL algorithm can aid in interpretation of CXR findings and their stability over follow up CXR. However, in its present version, it is unlikely to replace radiologists due to its limited specificity for categorizing specific findings.
Collapse
Affiliation(s)
- Ramandeep Singh
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Chayanin Nitiwarangkul
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
- Division of Diagnostic Radiology, Department of Diagnostic and Therapeutic Radiology, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
| | - John A. Patti
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Fatemeh Homayounieh
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Atul Padole
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Pooja Rao
- Qure.ai, 101 Raheja Titanium, Goregaon East, Mumbai, India
| | - Preetham Putha
- Qure.ai, 101 Raheja Titanium, Goregaon East, Mumbai, India
| | - Victorine V. Muse
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Amita Sharma
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Subba R. Digumarthy
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
- * E-mail:
| |
Collapse
|
18
|
Computerized Classification of Pneumoconiosis on Digital Chest Radiography Artificial Neural Network with Three Stages. J Digit Imaging 2018; 30:413-426. [PMID: 28108817 DOI: 10.1007/s10278-017-9942-0] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022] Open
Abstract
It is difficult for radiologists to classify pneumoconiosis from category 0 to category 3 on chest radiographs. Therefore, we have developed a computer-aided diagnosis (CAD) system based on a three-stage artificial neural network (ANN) method for classification based on four texture features. The image database consists of 36 chest radiographs classified as category 0 to category 3. Regions of interest (ROIs) with a matrix size of 32 × 32 were selected from chest radiographs. We obtained a gray-level histogram, histogram of gray-level difference, gray-level run-length matrix (GLRLM) feature image, and gray-level co-occurrence matrix (GLCOM) feature image in each ROI. For ROI-based classification, the first ANN was trained with each texture feature. Next, the second ANN was trained with output patterns obtained from the first ANN. Finally, we obtained a case-based classification for distinguishing among four categories with the third ANN method. We determined the performance of the third ANN by receiver operating characteristic (ROC) analysis. The areas under the ROC curve (AUC) of the highest category (severe pneumoconiosis) case and the lowest category (early pneumoconiosis) case were 0.89 ± 0.09 and 0.84 ± 0.12, respectively. The three-stage ANN with four texture features showed the highest performance for classification among the four categories. Our CAD system would be useful for assisting radiologists in classification of pneumoconiosis from category 0 to category 3.
Collapse
|
19
|
Zaglam N, Cheriet F, Jouvet P. Computer-Aided Diagnosis for Chest Radiographs in Intensive Care. J Pediatr Intensive Care 2016; 5:113-121. [PMID: 31110895 DOI: 10.1055/s-0035-1569995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2015] [Accepted: 10/02/2015] [Indexed: 10/22/2022] Open
Abstract
The chest radiograph is an essential tool for the diagnosis of several lung diseases in intensive care units (ICU). However, several factors make the interpretation of the chest radiograph difficult including the number of X-rays done daily in ICU, the quality of the chest radiograph, and the lack of a standardized interpretation. To overcome these limitations in the interpretation of chest radiographs, researchers have developed computer-aided diagnosis (CAD) systems. In this review, the authors report the methodology used to develop CAD systems including identification of the region of interest, analysis of these regions, and classification. Currently, only a few CAD systems for chest X-ray interpretation are commercially available. Some promising research is ongoing, but the involvement of the pediatric research community is needed for the development and validation of such CAD systems dedicated to pediatric intensive care.
Collapse
Affiliation(s)
- Nesrine Zaglam
- Department of Computer Engineering, École Polytechnique, Montréal, Quebec, Canada.,Research Center, Sainte Justine University Hospital, Montreal, Quebec, Canada
| | - Farida Cheriet
- Department of Computer Engineering, École Polytechnique, Montréal, Quebec, Canada.,Research Center, Sainte Justine University Hospital, Montreal, Quebec, Canada
| | - Philippe Jouvet
- Research Center, Sainte Justine University Hospital, Montreal, Quebec, Canada.,Pediatric Intensive Care Unit, Sainte Justine University Hospital, Montreal, Quebec, Canada
| |
Collapse
|