1
|
Alam MS, Wang D, Sowmya A. AMFP-net: Adaptive multi-scale feature pyramid network for diagnosis of pneumoconiosis from chest X-ray images. Artif Intell Med 2024; 154:102917. [PMID: 38917599 DOI: 10.1016/j.artmed.2024.102917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 05/02/2024] [Accepted: 06/17/2024] [Indexed: 06/27/2024]
Abstract
Early detection of pneumoconiosis by routine health screening of workers in the mining industry is critical for preventing the progression of this incurable disease. Automated pneumoconiosis classification in chest X-ray images is challenging due to the low contrast of opacities, inter-class similarity, intra-class variation and the existence of artifacts. Compared to traditional methods, convolutional neural networks have shown significant improvement in pneumoconiosis classification tasks, however, accurate classification remains challenging due to mainly the inability to focus on semantically meaningful lesion opacities. Most existing networks focus on high level abstract information and ignore low level detailed object information. Different from natural images where an object occupies large space, the classification of pneumoconiosis depends on the density of small opacities inside the lung. To address this issue, we propose a novel two-stage adaptive multi-scale feature pyramid network called AMFP-Net for the diagnosis of pneumoconiosis from chest X-rays. The proposed model consists of 1) an adaptive multi-scale context block to extract rich contextual and discriminative information and 2) a weighted feature fusion module to effectively combine low level detailed and high level global semantic information. This two-stage network first segments the lungs to focus more on relevant regions by excluding irrelevant parts of the image, and then utilises the segmented lungs to classify pneumoconiosis into different categories. Extensive experiments on public and private datasets demonstrate that the proposed approach can outperform state-of-the-art methods for both segmentation and classification.
Collapse
Affiliation(s)
- Md Shariful Alam
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia.
| | | | - Arcot Sowmya
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
2
|
Hang W, Bu C, Cui Y, Chen K, Zhang D, Li H, Wang S. Research progress on the pathogenesis and prediction of pneumoconiosis among coal miners. ENVIRONMENTAL GEOCHEMISTRY AND HEALTH 2024; 46:319. [PMID: 39012521 DOI: 10.1007/s10653-024-02114-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Accepted: 07/02/2024] [Indexed: 07/17/2024]
Abstract
Pneumoconiosis is the most common occupational disease among coal miners, which is a lung disease caused by long-term inhalation of coal dust and retention in the lungs. The early stage of this disease is highly insidious, and pulmonary fibrosis may occur in the middle and late stages, leading to an increase in patient pain index and mortality rate. Currently, there is a lack of effective treatment methods. The pathogenesis of pneumoconiosis is complex and has many influencing factors. Although the characteristics of coal dust have been considered the main cause of different mechanisms of pneumoconiosis, the effects of coal dust composition, particle size and shape, and coal dust concentration on the pathogenesis of pneumoconiosis have not been systematically elucidated. Meanwhile, considering the irreversibility of pneumoconiosis progression, early prediction for pneumoconiosis patients is particularly important. However, there is no early prediction standard for pneumoconiosis among coal miners. This review summarizes the relevant research on the pathogenesis and prediction of pneumoconiosis in coal miners in recent years. Firstly, the pathogenesis of coal worker pneumoconiosis and silicosis was discussed, and the impact of coal dust characteristics on pneumoconiosis was analyzed. Then, the early diagnostic methods for pneumoconiosis have been systematically introduced, with a focus on image collaborative computer-aided diagnosis analysis and biomarker detection. Finally, the challenge of early screening technology for miners with pneumoconiosis was proposed.
Collapse
Affiliation(s)
- Wenlu Hang
- Department of Respiratory and Critical Care Medicine, Second Affiliated Hospital of Xuzhou Medical University, Xuzhou, 221000, Jiangsu Province, People's Republic of China
| | - Chunlu Bu
- Department of Respiratory and Critical Care Medicine, Second Affiliated Hospital of Xuzhou Medical University, Xuzhou, 221000, Jiangsu Province, People's Republic of China
| | - Yuming Cui
- School of Mechatronic Engineering, Jiangsu Normal University, Xuzhou, 221000, Jiangsu Province, People's Republic of China
| | - Kai Chen
- School of Materials Science and Physics, China University of Mining and Technology, Xuzhou, 221000, Jiangsu Province, People's Republic of China
| | - Dekun Zhang
- School of Materials Science and Physics, China University of Mining and Technology, Xuzhou, 221000, Jiangsu Province, People's Republic of China
| | - Haiquan Li
- Department of Respiratory and Critical Care Medicine, Second Affiliated Hospital of Xuzhou Medical University, Xuzhou, 221000, Jiangsu Province, People's Republic of China.
- School of Chemical Engineering & Technology, China University of Mining and Technology, Xuzhou, 221000, Jiangsu Province, People's Republic of China.
| | - Songquan Wang
- School of Mechatronic Engineering, Jiangsu Normal University, Xuzhou, 221000, Jiangsu Province, People's Republic of China.
| |
Collapse
|
3
|
Wang Y, Yan W, Feng Y, Qian F, Zhang T, Huang X, Wang D, Hu M. Deep Learning Models of Multi-Scale Lesion Perception Attention Networks for Diagnosis and Staging of Pneumoconiosis: A Comparative Study with Radiologists. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01125-7. [PMID: 38839674 DOI: 10.1007/s10278-024-01125-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 04/13/2024] [Accepted: 04/15/2024] [Indexed: 06/07/2024]
Abstract
Accurate prediction of pneumoconiosis is essential for individualized early prevention and treatment. However, the different manifestations and high heterogeneity among radiologists make it difficult to diagnose and stage pneumoconiosis accurately. Here, based on DR images collected from two centers, a novel deep learning model, namely Multi-scale Lesion-aware Attention Networks (MLANet), is proposed for diagnosis of pneumoconiosis, staging of pneumoconiosis, and screening of stage I pneumoconiosis. A series of indicators including area under the receiver operating characteristic curve, accuracy, recall, precision, and F1 score were used to comprehensively evaluate the performance of the model. The results show that the MLANet model can effectively improve the consistency and efficiency of pneumoconiosis diagnosis. The accuracy of the MLANet model for pneumoconiosis diagnosis on the internal test set, external validation set, and prospective test set reached 97.87%, 98.03%, and 95.40%, respectively, which was close to the level of qualified radiologists. Moreover, the model can effectively screen stage I pneumoconiosis with an accuracy of 97.16%, a recall of 98.25, a precision of 93.42%, and an F1 score of 95.59%, respectively. The built model performs better than the other four classification models. It is expected to be applied in clinical work to realize the automated diagnosis of pneumoconiosis digital chest radiographs, which is of great significance for individualized early prevention and treatment.
Collapse
Affiliation(s)
- Yi Wang
- Imaging Center, The Third Clinical College of Hefei of Anhui Medical University, The Third People's Hospital of Hefei, Hefei, China
| | - Wanying Yan
- Infervision Medical Technology Co., Ltd, Beijing, China
| | - Yibo Feng
- Infervision Medical Technology Co., Ltd, Beijing, China
| | - Fang Qian
- Anhui Second People's Hospital, Anhui Occupational Disease Prevention and Control Institute, Hefei, China
| | - Tiantian Zhang
- Imaging Center, The Third Clinical College of Hefei of Anhui Medical University, The Third People's Hospital of Hefei, Hefei, China
| | - Xin Huang
- Jinzhai County Hospital of Traditional Chinese Medicine, Lu'an, China
| | - Dawei Wang
- Infervision Medical Technology Co., Ltd, Beijing, China
| | - Maoneng Hu
- Imaging Center, The Third Clinical College of Hefei of Anhui Medical University, The Third People's Hospital of Hefei, Hefei, China.
| |
Collapse
|
4
|
Alam MS, Wang D, Sowmya A. DLA-Net: dual lesion attention network for classification of pneumoconiosis using chest X-ray images. Sci Rep 2024; 14:11616. [PMID: 38773153 PMCID: PMC11109256 DOI: 10.1038/s41598-024-61024-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Accepted: 04/30/2024] [Indexed: 05/23/2024] Open
Abstract
Accurate and early detection of pneumoconiosis using chest X-rays (CXR) is important for preventing the progression of this incurable disease. It is also a challenging task due to large variations in appearance, size and location of lesions in the lung regions as well as inter-class similarity and intra-class variance. Compared to traditional methods, Convolutional Neural Networks-based methods have shown improved results; however, these methods are still not applicable in clinical practice due to limited performance. In some cases, limited computing resources make it impractical to develop a model using whole CXR images. To address this problem, the lung fields are divided into six zones, each zone is classified separately and the zone classification results are then aggregated into an image classification score, based on state-of-the-art. In this study, we propose a dual lesion attention network (DLA-Net) for the classification of pneumoconiosis that can extract features from affected regions in a lung. This network consists of two main components: feature extraction and feature refinement. Feature extraction uses the pre-trained Xception model as the backbone to extract semantic information. To emphasise the lesion regions and improve the feature representation capability, the feature refinement component uses a DLA module that consists of two sub modules: channel attention (CA) and spatial attention (SA). The CA module focuses on the most important channels in the feature maps extracted by the backbone model, and the SA module highlights the spatial details of the affected regions. Thus, both attention modules combine to extract discriminative and rich contextual features to improve classification performance on pneumoconiosis. Experimental results show that the proposed DLA-Net outperforms state-of-the-art methods for pneumoconiosis classification.
Collapse
Affiliation(s)
- Md Shariful Alam
- School of Computer Science and Engineering, University of New South Wales, Sydney, Australia.
- CSIRO Data61, Sydney, Australia.
| | | | - Arcot Sowmya
- School of Computer Science and Engineering, University of New South Wales, Sydney, Australia
| |
Collapse
|
5
|
Li X, Xu M, Yan Z, Xia F, Li S, Zhang Y, Xing Z, Guan L. Deep convolutional network-based chest radiographs screening model for pneumoconiosis. Front Med (Lausanne) 2024; 11:1290729. [PMID: 38348336 PMCID: PMC10859417 DOI: 10.3389/fmed.2024.1290729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 01/08/2024] [Indexed: 02/15/2024] Open
Abstract
Background Pneumoconiosis is the most important occupational disease all over the world, with high prevalence and mortality. At present, the monitoring of workers exposed to dust and the diagnosis of pneumoconiosis rely on manual interpretation of chest radiographs, which is subjective and low efficiency. With the development of artificial intelligence technology, a more objective and efficient computer aided system for pneumoconiosis diagnosis can be realized. Therefore, the present study reported a novel deep learning (DL) artificial intelligence (AI) system for detecting pneumoconiosis in digital frontal chest radiographs, based on which we aimed to provide references for radiologists. Methods We annotated 49,872 chest radiographs from patients with pneumoconiosis and workers exposed to dust using a self-developed tool. Next, we used the labeled images to train a convolutional neural network (CNN) algorithm developed for pneumoconiosis screening. Finally, the performance of the trained pneumoconiosis screening model was validated using a validation set containing 495 chest radiographs. Results Approximately, 51% (25,435/49,872) of the chest radiographs were labeled as normal. Pneumoconiosis was detected in 49% (24,437/49,872) of the labeled radiographs, among which category-1, category-2, and category-3 pneumoconiosis accounted for 53.1% (12,967/24,437), 20.4% (4,987/24,437), and 26.5% (6,483/24,437) of the patients, respectively. The CNN DL algorithm was trained using these data. The validation set of 495 digital radiography chest radiographs included 261 cases of pneumoconiosis and 234 cases of non-pneumoconiosis. As a result, the accuracy of the AI system for pneumoconiosis identification was 95%, the area under the curve was 94.7%, and the sensitivity was 100%. Conclusion DL algorithm based on CNN helped screen pneumoconiosis in the chest radiographs with high performance; thus, it could be suitable for diagnosing pneumoconiosis automatically and improve the efficiency of radiologists.
Collapse
Affiliation(s)
- Xiao Li
- Peking University Third Hospital, Beijing, China
| | - Ming Xu
- Beijing Tianming Innovation Data Technology Co., Ltd., Beijing, China
| | - Ziye Yan
- Beijing Tianming Innovation Data Technology Co., Ltd., Beijing, China
| | - Fanbo Xia
- Beijing Tianming Innovation Data Technology Co., Ltd., Beijing, China
| | - Shuqiang Li
- Peking University Third Hospital, Beijing, China
| | - Yanlin Zhang
- Peking University Third Hospital, Beijing, China
| | | | - Li Guan
- Peking University Third Hospital, Beijing, China
| |
Collapse
|
6
|
Shah IA, Mishra S. Artificial intelligence in advancing occupational health and safety: an encapsulation of developments. J Occup Health 2024; 66:uiad017. [PMID: 38334203 PMCID: PMC10878366 DOI: 10.1093/joccuh/uiad017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/29/2023] [Accepted: 12/06/2023] [Indexed: 02/10/2024] Open
Abstract
OBJECTIVES In an era characterized by dynamic technological advancements, the well-being of the workforce remains a cornerstone of progress and sustainability. The evolving industrial landscape in the modern world has had a considerable influence on occupational health and safety (OHS). Ensuring the well-being of workers and creating safe working environments are not only ethical imperatives but also integral to maintaining operational efficiency and productivity. We aim to review the advancements that have taken place with a potential to reshape workplace safety with integration of artificial intelligence (AI)-driven new technologies to prevent occupational diseases and promote safety solutions. METHODS The published literature was identified using scientific databases of Embase, PubMed, and Google scholar including a lower time bound of 1974 to capture chronological advances in occupational disease detection and technological solutions employed in industrial set-ups. RESULTS AI-driven technologies are revolutionizing how organizations approach health and safety, offering predictive insights, real-time monitoring, and risk mitigation strategies that not only minimize accidents and hazards but also pave the way for a more proactive and responsive approach to safeguarding the workforce. CONCLUSION As industries embrace the transformative potential of AI, a new frontier of possibilities emerges for enhancing workplace safety. This synergy between OHS and AI marks a pivotal moment in the quest for safer, healthier, and more sustainable workplaces.
Collapse
Affiliation(s)
- Immad A Shah
- Division of Health Sciences, ICMR-National Institute of Occupational Health, Ahmedabad, Gujarat, India
| | - SukhDev Mishra
- Department of Biostatistics, Division of Health Sciences, ICMR-National Institute of Occupational Health, Ahmedabad, Gujarat, India
| |
Collapse
|
7
|
Hussain A, Marlowe S, Ali M, Uy E, Bhopalwala H, Gullapalli D, Vangara A, Haroon M, Akbar A, Piercy J. A Systematic Review of Artificial Intelligence Applications in the Management of Lung Disorders. Cureus 2024; 16:e51581. [PMID: 38313926 PMCID: PMC10836179 DOI: 10.7759/cureus.51581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/02/2024] [Indexed: 02/06/2024] Open
Abstract
This systematic review examines the transformative impact of artificial intelligence (AI) in managing lung disorders through a comprehensive analysis of articles spanning 2014 to 2023. Evaluating AI's multifaceted roles in radiological imaging, disease burden prediction, detection, diagnosis, and molecular mechanisms, this review presents a critical synthesis of key insights from select articles. The findings underscore AI's significant strides in bolstering diagnostic accuracy, interpreting radiological imaging, predicting disease burdens, and deepening the understanding of tuberculosis (TB), chronic obstructive pulmonary disease (COPD), silicosis, pneumoconiosis, and lung fibrosis. The synthesis positions AI as a revolutionary tool within the healthcare system, offering vital implications for healthcare workers, policymakers, and researchers in comprehending and leveraging AI's pivotal role in lung disease management.
Collapse
Affiliation(s)
- Akbar Hussain
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Stanley Marlowe
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Muhammad Ali
- Pulmonary and Critical Care, Appalachian Regional Healthcare, Hazard, USA
| | - Edilfavia Uy
- Diabetes and Endocrinology, Appalachian Regional Healthcare, Whitesburg, USA
| | - Huzefa Bhopalwala
- Internal Medicine, Appalachian Regional Healthcare, Whitesburg, USA
- Cardiovascular, Mayo Clinic, Rochester, USA
| | | | - Avinash Vangara
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Moeez Haroon
- Internal Medicine, Appalachian Regional Healthcare, Harlan, USA
| | - Aelia Akbar
- Public Health, Appalachian Regional Healthcare, Harlan, USA
| | - Jonathan Piercy
- Internal Medicine, Appalachian Regional Healthcare, Whitesburg, USA
| |
Collapse
|
8
|
Guetari R, Ayari H, Sakly H. Computer-aided diagnosis systems: a comparative study of classical machine learning versus deep learning-based approaches. Knowl Inf Syst 2023; 65:1-41. [PMID: 37361377 PMCID: PMC10205571 DOI: 10.1007/s10115-023-01894-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 04/23/2023] [Accepted: 04/25/2023] [Indexed: 06/28/2023]
Abstract
The diagnostic phase of the treatment process is essential for patient guidance and follow-up. The accuracy and effectiveness of this phase can determine the life or death of a patient. For the same symptoms, different doctors may come up with different diagnoses whose treatments may, instead of curing a patient, be fatal. Machine learning (ML) brings new solutions to healthcare professionals to save time and optimize the appropriate diagnosis. ML is a data analysis method that automates the creation of analytical models and promotes predictive data. There are several ML models and algorithms that rely on features extracted from, for example, a patient's medical images to indicate whether a tumor is benign or malignant. The models differ in the way they operate and the method used to extract the discriminative features of the tumor. In this article, we review different ML models for tumor classification and COVID-19 infection to evaluate the different works. The computer-aided diagnosis (CAD) systems, which we referred to as classical, are based on accurate feature identification, usually performed manually or with other ML techniques that are not involved in classification. The deep learning-based CAD systems automatically perform the identification and extraction of discriminative features. The results show that the two types of DAC have quite close performances but the use of one or the other type depends on the datasets. Indeed, manual feature extraction is necessary when the size of the dataset is small; otherwise, deep learning is used.
Collapse
Affiliation(s)
- Ramzi Guetari
- SERCOM Laboratory, Polytechnic School of Tunisia, University of Carthage, PO Box 743, La Marsa, 2078 Tunisia
| | - Helmi Ayari
- SERCOM Laboratory, Polytechnic School of Tunisia, University of Carthage, PO Box 743, La Marsa, 2078 Tunisia
| | - Houneida Sakly
- RIADI Laboratory, National School of Computer Sciences, University of Manouba, Manouba, 2010 Tunisia
| |
Collapse
|
9
|
Wang Y, Cui F, Ding X, Yao Y, Li G, Gui G, Shen F, Li B. Automated identification of the preclinical stage of coal workers' pneumoconiosis from digital chest radiography using three-stage cascaded deep learning model. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
|
10
|
Ng CKC. Diagnostic Performance of Artificial Intelligence-Based Computer-Aided Detection and Diagnosis in Pediatric Radiology: A Systematic Review. CHILDREN (BASEL, SWITZERLAND) 2023; 10:children10030525. [PMID: 36980083 PMCID: PMC10047006 DOI: 10.3390/children10030525] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 02/13/2023] [Accepted: 03/07/2023] [Indexed: 03/30/2023]
Abstract
Artificial intelligence (AI)-based computer-aided detection and diagnosis (CAD) is an important research area in radiology. However, only two narrative reviews about general uses of AI in pediatric radiology and AI-based CAD in pediatric chest imaging have been published yet. The purpose of this systematic review is to investigate the AI-based CAD applications in pediatric radiology, their diagnostic performances and methods for their performance evaluation. A literature search with the use of electronic databases was conducted on 11 January 2023. Twenty-three articles that met the selection criteria were included. This review shows that the AI-based CAD could be applied in pediatric brain, respiratory, musculoskeletal, urologic and cardiac imaging, and especially for pneumonia detection. Most of the studies (93.3%, 14/15; 77.8%, 14/18; 73.3%, 11/15; 80.0%, 8/10; 66.6%, 2/3; 84.2%, 16/19; 80.0%, 8/10) reported model performances of at least 0.83 (area under receiver operating characteristic curve), 0.84 (sensitivity), 0.80 (specificity), 0.89 (positive predictive value), 0.63 (negative predictive value), 0.87 (accuracy), and 0.82 (F1 score), respectively. However, a range of methodological weaknesses (especially a lack of model external validation) are found in the included studies. In the future, more AI-based CAD studies in pediatric radiology with robust methodology should be conducted for convincing clinical centers to adopt CAD and realizing its benefits in a wider context.
Collapse
Affiliation(s)
- Curtise K C Ng
- Curtin Medical School, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
- Curtin Health Innovation Research Institute (CHIRI), Faculty of Health Sciences, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
| |
Collapse
|
11
|
Alsabhan W. Human-Computer Interaction with a Real-Time Speech Emotion Recognition with Ensembling Techniques 1D Convolution Neural Network and Attention. SENSORS (BASEL, SWITZERLAND) 2023; 23:1386. [PMID: 36772427 PMCID: PMC9921095 DOI: 10.3390/s23031386] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 01/19/2023] [Accepted: 01/20/2023] [Indexed: 06/18/2023]
Abstract
Emotions have a crucial function in the mental existence of humans. They are vital for identifying a person's behaviour and mental condition. Speech Emotion Recognition (SER) is extracting a speaker's emotional state from their speech signal. SER is a growing discipline in human-computer interaction, and it has recently attracted more significant interest. This is because there are not so many universal emotions; therefore, any intelligent system with enough computational capacity can educate itself to recognise them. However, the issue is that human speech is immensely diverse, making it difficult to create a single, standardised recipe for detecting hidden emotions. This work attempted to solve this research difficulty by combining a multilingual emotional dataset with building a more generalised and effective model for recognising human emotions. A two-step process was used to develop the model. The first stage involved the extraction of features, and the second stage involved the classification of the features that were extracted. ZCR, RMSE, and the renowned MFC coefficients were retrieved as features. Two proposed models, 1D CNN combined with LSTM and attention and a proprietary 2D CNN architecture, were used for classification. The outcomes demonstrated that the suggested 1D CNN with LSTM and attention performed better than the 2D CNN. For the EMO-DB, SAVEE, ANAD, and BAVED datasets, the model's accuracy was 96.72%, 97.13%, 96.72%, and 88.39%, respectively. The model beat several earlier efforts on the same datasets, demonstrating the generality and efficacy of recognising multiple emotions from various languages.
Collapse
Affiliation(s)
- Waleed Alsabhan
- College of Engineering, Al Faisal University, P.O. Box 50927, Riyadh 11533, Saudi Arabia
| |
Collapse
|
12
|
Yadav AS, Kumar S, Karetla GR, Cotrina-Aliaga JC, Arias-Gonzáles JL, Kumar V, Srivastava S, Gupta R, Ibrahim S, Paul R, Naik N, Singla B, Tatkar NS. A Feature Extraction Using Probabilistic Neural Network and BTFSC-Net Model with Deep Learning for Brain Tumor Classification. J Imaging 2022; 9:jimaging9010010. [PMID: 36662108 PMCID: PMC9865827 DOI: 10.3390/jimaging9010010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 12/21/2022] [Accepted: 12/28/2022] [Indexed: 01/03/2023] Open
Abstract
BACKGROUND AND OBJECTIVES Brain Tumor Fusion-based Segments and Classification-Non-enhancing tumor (BTFSC-Net) is a hybrid system for classifying brain tumors that combine medical image fusion, segmentation, feature extraction, and classification procedures. MATERIALS AND METHODS to reduce noise from medical images, the hybrid probabilistic wiener filter (HPWF) is first applied as a preprocessing step. Then, to combine robust edge analysis (REA) properties in magnetic resonance imaging (MRI) and computed tomography (CT) medical images, a fusion network based on deep learning convolutional neural networks (DLCNN) is developed. Here, the brain images' slopes and borders are detected using REA. To separate the sick region from the color image, adaptive fuzzy c-means integrated k-means (HFCMIK) clustering is then implemented. To extract hybrid features from the fused image, low-level features based on the redundant discrete wavelet transform (RDWT), empirical color features, and texture characteristics based on the gray-level cooccurrence matrix (GLCM) are also used. Finally, to distinguish between benign and malignant tumors, a deep learning probabilistic neural network (DLPNN) is deployed. RESULTS according to the findings, the suggested BTFSC-Net model performed better than more traditional preprocessing, fusion, segmentation, and classification techniques. Additionally, 99.21% segmentation accuracy and 99.46% classification accuracy were reached using the proposed BTFSC-Net model. CONCLUSIONS earlier approaches have not performed as well as our presented method for image fusion, segmentation, feature extraction, classification operations, and brain tumor classification. These results illustrate that the designed approach performed more effectively in terms of enhanced quantitative evaluation with better accuracy as well as visual performance.
Collapse
Affiliation(s)
- Arun Singh Yadav
- Department of Computer Science, University of Lucknow, Lucknow 226007, Uttar Pradesh, India
| | - Surendra Kumar
- Department of Computer Application, Marwadi University, Rajkot 360003, Gujrat, India
| | - Girija Rani Karetla
- School of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, NSW 2751, Australia
| | | | - José Luis Arias-Gonzáles
- Department of Business, Pontificia Universidad Católica del Perú, Av. Universitaria 1801, San Miguel 15088, Peru
| | - Vinod Kumar
- Department of Computer Applications, ABES Engineering College, Ghaziabad 201009, Uttar Pradesh, India
| | - Satyajee Srivastava
- Department of Computer Science and Engineering, University of Engineering and Technology Roorkee, Roorkee 247667, Uttarakhand, India
| | - Reena Gupta
- Department of Pharmacognosy, Institute of Pharmaceutical Research, GLA University, Mathura 281406, Uttar Pradesh, India
| | - Sufyan Ibrahim
- Neuro-Informatics Laboratory, Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55905, USA
| | - Rahul Paul
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02115, USA
- iTRUE (International Training and Research in Uro-Oncology and Endourology) Group, Manipal 576104, Karnataka, India
| | - Nithesh Naik
- iTRUE (International Training and Research in Uro-Oncology and Endourology) Group, Manipal 576104, Karnataka, India
- Department of Mechanical and Industrial Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, Karnataka, India
- Curiouz TechLab Private Limited, BIRAC-BioNEST, Manipal Government of Karnataka Bioincubator, Manipal 576104, Karnataka, India
- Correspondence: ; Tel.: +91-83-1087-4339
| | - Babita Singla
- Chitkara Business School, Chitkara University, Chandigarh 140401, Punjab, India
| | - Nisha S. Tatkar
- Department of Postgraduate Diploma in Management, Institute of PGDM, Mumbai Education Trust, Mumbai 400050, Maharashtra, India
| |
Collapse
|
13
|
Liu R, Dai W, Wu T, Wang M, Wan S, Liu J. AIMIC: Deep Learning for Microscopic Image Classification. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 226:107162. [PMID: 36209624 DOI: 10.1016/j.cmpb.2022.107162] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2022] [Revised: 09/09/2022] [Accepted: 09/25/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND AND OBJECTIVE Deep learning techniques are powerful tools for image analysis. However, the lack of programming experience makes it difficult for novice users to apply this technology. This project aims to lower the barrier for clinical users to implement deep learning methods in microscopic image classification. METHODS In this study, an out-of-the-box software, AIMIC (artificial intelligence-based microscopy image classifier), was developed for users to apply deep learning technology in a code-free manner. The platform was equipped with state-of-the-art deep learning techniques and data preprocessing approaches. Furthermore, we evaluated the built-in networks on four benchmark microscopy image datasets to assist entry-level practitioners in selecting a suitable algorithm. RESULTS The entire deep learning pipeline, from training a new network to inferring unseen samples using the trained model, could be implemented on the proposed platform without the need for programming. In the evaluation experiments, the ResNeXt-50-32×4d outperformed other competitor algorithms in terms of average accuracy (96.83%) and average F1-score (96.82%). In addition, the MobileNet-V2 achieved a good balance between the performance (accuracy of 95.72%) and computational cost (inference time of 0.109s for identifying one sample). CONCLUSIONS The proposed AI platform allows people without programming experience to use artificial intelligence methods in microscopy image analysis. Besides, the ResNeXt-50-32×4d is a preferable solution for microscopic image classification, and MobileNet-V2 is most likely to be an alternative selection for the scenario when computing resources are limited.
Collapse
Affiliation(s)
- Rui Liu
- Department of Mechanical Engineering, City University of Hong Kong, Hong Kong, China
| | - Wei Dai
- Department of Mechanical Engineering, City University of Hong Kong, Hong Kong, China
| | - Tianyi Wu
- Department of Mechanical Engineering, City University of Hong Kong, Hong Kong, China
| | - Min Wang
- Department of Mechanical Engineering, City University of Hong Kong, Hong Kong, China
| | - Song Wan
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, China
| | - Jun Liu
- Department of Mechanical Engineering, City University of Hong Kong, Hong Kong, China; Shenzhen Research Institute, City University of Hong Kong, Shenzhen 518057, China.
| |
Collapse
|
14
|
Deep Ensemble Learning for the Automatic Detection of Pneumoconiosis in Coal Worker’s Chest X-ray Radiography. J Clin Med 2022; 11:jcm11185342. [PMID: 36142989 PMCID: PMC9506413 DOI: 10.3390/jcm11185342] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 08/27/2022] [Accepted: 09/07/2022] [Indexed: 11/19/2022] Open
Abstract
Globally, coal remains one of the natural resources that provide power to the world. Thousands of people are involved in coal collection, processing, and transportation. Particulate coal dust is produced during these processes, which can crush the lung structure of workers and cause pneumoconiosis. There is no automated system for detecting and monitoring diseases in coal miners, except for specialist radiologists. This paper proposes ensemble learning techniques for detecting pneumoconiosis disease in chest X-ray radiographs (CXRs) using multiple deep learning models. Three ensemble learning techniques (simple averaging, multi-weighted averaging, and majority voting (MVOT)) were proposed to investigate performances using randomised cross-folds and leave-one-out cross-validations datasets. Five statistical measurements were used to compare the outcomes of the three investigations on the proposed integrated approach with state-of-the-art approaches from the literature for the same dataset. In the second investigation, the statistical combination was marginally enhanced in the ensemble of multi-weighted averaging on a robust model, CheXNet. However, in the third investigation, the same model elevated accuracies from 87.80 to 90.2%. The investigated results helped us identify a robust deep learning model and ensemble framework that outperformed others, achieving an accuracy of 91.50% in the automated detection of pneumoconiosis.
Collapse
|
15
|
Devnath L, Fan Z, Luo S, Summons P, Wang D. Detection and Visualisation of Pneumoconiosis Using an Ensemble of Multi-Dimensional Deep Features Learned from Chest X-rays. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:11193. [PMID: 36141457 PMCID: PMC9517617 DOI: 10.3390/ijerph191811193] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 08/25/2022] [Accepted: 08/27/2022] [Indexed: 06/16/2023]
Abstract
Pneumoconiosis is a group of occupational lung diseases induced by mineral dust inhalation and subsequent lung tissue reactions. It can eventually cause irreparable lung damage, as well as gradual and permanent physical impairments. It has affected millions of workers in hazardous industries throughout the world, and it is a leading cause of occupational death. It is difficult to diagnose early pneumoconiosis because of the low sensitivity of chest radiographs, the wide variation in interpretation between and among readers, and the scarcity of B-readers, which all add to the difficulty in diagnosing these occupational illnesses. In recent years, deep machine learning algorithms have been extremely successful at classifying and localising abnormality of medical images. In this study, we proposed an ensemble learning approach to improve pneumoconiosis detection in chest X-rays (CXRs) using nine machine learning classifiers and multi-dimensional deep features extracted using CheXNet-121 architecture. There were eight evaluation metrics utilised for each high-level feature set of the associated cross-validation datasets in order to compare the ensemble performance and state-of-the-art techniques from the literature that used the same cross-validation datasets. It is observed that integrated ensemble learning exhibits promising results (92.68% accuracy, 85.66% Matthews correlation coefficient (MCC), and 0.9302 area under the precision-recall (PR) curve), compared to individual CheXNet-121 and other state-of-the-art techniques. Finally, Grad-CAM was used to visualise the learned behaviour of individual dense blocks within CheXNet-121 and their ensembles into three-color channels of CXRs. We compared the Grad-CAM-indicated ROI to the ground-truth ROI using the intersection of the union (IOU) and average-precision (AP) values for each classifier and their ensemble. Through the visualisation of the Grad-CAM within the blue channel, the average IOU passed more than 90% of the pneumoconiosis detection in chest radiographs.
Collapse
Affiliation(s)
- Liton Devnath
- School of Information and Physical Sciences, The University of Newcastle, Newcastle 2308, Australia
- British Columbia Cancer Research Centre, Vancouver, BC V5Z 1L3, Canada
| | - Zongwen Fan
- College of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
| | - Suhuai Luo
- School of Information and Physical Sciences, The University of Newcastle, Newcastle 2308, Australia
| | - Peter Summons
- School of Information and Physical Sciences, The University of Newcastle, Newcastle 2308, Australia
| | - Dadong Wang
- Quantitative Imaging, CSIRO Data61, Marsfield 2122, Australia
| |
Collapse
|
16
|
Hoang-Thi TN, Chassagnon G, Tran HD, Le-Dong NN, Dinh-Xuan AT, Revel MP. How Artificial Intelligence in Imaging Can Better Serve Patients with Bronchial and Parenchymal Lung Diseases? J Pers Med 2022; 12:jpm12091429. [PMID: 36143214 PMCID: PMC9505778 DOI: 10.3390/jpm12091429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 08/25/2022] [Accepted: 08/26/2022] [Indexed: 11/16/2022] Open
Abstract
With the rapid development of computing today, artificial intelligence has become an essential part of everyday life, with medicine and lung health being no exception. Big data-based scientific research does not mean simply gathering a large amount of data and letting the machines do the work by themselves. Instead, scientists need to identify problems whose solution will have a positive impact on patients’ care. In this review, we will discuss the role of artificial intelligence from both physiological and anatomical standpoints, starting with automatic quantitative assessment of anatomical structures using lung imaging and considering disease detection and prognosis estimation based on machine learning. The evaluation of current strengths and limitations will allow us to have a broader view for future developments.
Collapse
Affiliation(s)
- Trieu-Nghi Hoang-Thi
- Department of Diagnostic Imaging, Vinmec Healthcare System, Ho Chi Minh City 70000, Vietnam
| | - Guillaume Chassagnon
- AP-HP. Centre, Cochin Hospital, Department of Radiology, Université de Paris, 75005 Paris, France
| | - Hai-Dang Tran
- Department of Diagnostic Imaging, Vinmec Healthcare System, Ho Chi Minh City 70000, Vietnam
| | - Nhat-Nam Le-Dong
- AP-HP. Centre, Cochin Hospital, Department of Respiratory Physiology, Université de Paris, 75005 Paris, France
| | - Anh Tuan Dinh-Xuan
- AP-HP. Centre, Cochin Hospital, Department of Respiratory Physiology, Université de Paris, 75005 Paris, France
| | - Marie-Pierre Revel
- AP-HP. Centre, Cochin Hospital, Department of Radiology, Université de Paris, 75005 Paris, France
| |
Collapse
|
17
|
Li B, Zhang Y, Wu X. DLKN-MLC: A Disease Prediction Model via Multi-Label Learning. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:9771. [PMID: 35955125 PMCID: PMC9368602 DOI: 10.3390/ijerph19159771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 07/29/2022] [Accepted: 08/01/2022] [Indexed: 06/15/2023]
Abstract
With the increasingly available electronic health records (EHR), disease prediction has recently gained immense research attention, where an accurate classifier needs to be trained to map the input prediction signals (e.g., symptoms, auxiliary examination results, etc.) to the estimated diseases for each patient. However, most of the current disease prediction models focus on the prediction of a single disease; in the medical field, a patient often suffers from multiple diseases (especially multiple chronic diseases) at the same time. Therefore, multi-disease prediction is of greater significance for patients' early intervention and treatment, but there is no doubt that multi-disease prediction has higher requirements for data extraction ability and greater complexity of classification. In this paper, we propose a novel disease prediction model DLKN-MLC. The model extracts the information in EHR through deep learning combined with a disease knowledge network, quantifies the correlation between diseases through NodeRank, and completes multi-disease prediction. in addition, we distinguished the importance of common disease symptoms, occasional disease symptoms and auxiliary examination results in the process of disease diagnosis. In empirical and comparative experiments on real EHR datasets, the Hamming loss, one-error rate, ranking loss, average precision, and micro-F1 values of the DLKN-MLC model were 0.2624, 0.2136, 0.2190, 88.21%, and 87.86%, respectively, which were better compared with those from previous methods. Extensive experiments on a real-world EHR dataset have demonstrated the state-of-the-art performance of our proposed model.
Collapse
Affiliation(s)
- Bocheng Li
- Department of Medical Informatics, School of Public Health, Jilin University, Changchun 130021, China
| | - Yunqiu Zhang
- Department of Medical Informatics, School of Public Health, Jilin University, Changchun 130021, China
| | - Xusheng Wu
- Shenzhen Health Development Research and Data Management Center, Shenzhen 518028, China
| |
Collapse
|
18
|
Dong H, Zhu B, Zhang X, Kong X. Use data augmentation for a deep learning classification model with chest X-ray clinical imaging featuring coal workers' pneumoconiosis. BMC Pulm Med 2022; 22:271. [PMID: 35840945 PMCID: PMC9284687 DOI: 10.1186/s12890-022-02068-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 07/11/2022] [Indexed: 11/10/2022] Open
Abstract
PURPOSE This paper aims to develop a successful deep learning model with data augmentation technique to discover the clinical uniqueness of chest X-ray imaging features of coal workers' pneumoconiosis (CWP). PATIENTS AND METHODS We enrolled 149 CWP patients and 68 dust-exposure workers for a prospective cohort observational study between August 2021 and December 2021 at First Hospital of Shanxi Medical University. Two hundred seventeen chest X-ray images were collected for this study, obtaining reliable diagnostic results through the radiologists' team, and confirming clinical imaging features. We segmented regions of interest with diagnosis reports, then classified them into three categories. To identify these clinical features, we developed a deep learning model (ShuffleNet V2-ECA Net) with data augmentation through performances of different deep learning models by assessment with Receiver Operation Characteristics (ROC) curve and area under the curve (AUC), accuracy (ACC), and Loss curves. RESULTS We selected the ShuffleNet V2-ECA Net as the optimal model. The average AUC of this model was 0.98, and all classifications of clinical imaging features had an AUC above 0.95. CONCLUSION We performed a study on a small dataset to classify the chest X-ray clinical imaging features of pneumoconiosis using a deep learning technique. A deep learning model of ShuffleNet V2 and ECA-Net was successfully constructed using data augmentation, which achieved an average accuracy of 98%. This method uncovered the uniqueness of the chest X-ray imaging features of CWP, thus supplying additional reference material for clinical application.
Collapse
Affiliation(s)
- Hantian Dong
- The First College for Clinical Medicine, Shanxi Medical University, No. 56 Xinjian South Road, Taiyuan, 030001, Shanxi, People's Republic of China
| | - Biaokai Zhu
- Network Security Department, Shanxi Police College, No. 799 Qingdong Road, Qingxu Country, Taiyuan, 030021, Shanxi, People's Republic of China
| | - Xinri Zhang
- National Health Commission Key Laboratory of Pneumoconiosis, Shanxi Key Laboratory of Respiratory Diseases, Department of Respiratory and Critical Care Medicine, First Hospital of Shanxi Medical University, No. 85 Jiefang South Road, Taiyuan, 030001, Shanxi, People's Republic of China.
| | - Xiaomei Kong
- National Health Commission Key Laboratory of Pneumoconiosis, Shanxi Key Laboratory of Respiratory Diseases, Department of Respiratory and Critical Care Medicine, First Hospital of Shanxi Medical University, No. 85 Jiefang South Road, Taiyuan, 030001, Shanxi, People's Republic of China
| |
Collapse
|