1
|
Han H, Zhang Q, Li F, Du Y. Spatial oblivion channel attention targeting intra-class diversity feature learning. Neural Netw 2023; 167:10-21. [PMID: 37619510 DOI: 10.1016/j.neunet.2023.07.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 07/21/2023] [Accepted: 07/24/2023] [Indexed: 08/26/2023]
Abstract
Convolutional neural networks (CNNs) have successfully driven many visual recognition tasks including image classification. However, when dealing with classification tasks with intra-class sample style diversity, the network tends to be disturbed by more diverse features, resulting in limited feature learning. In this article, a spatial oblivion channel attention (SOCA) for intra-class diversity feature learning is proposed. Specifically, SOCA performs spatial structure oblivion in a progressive regularization for each channel after convolution, so that the network is not restricted to a limited feature learning, and pays attention to more regionally detailed features. Further, SOCA reassigns channel weights in the progressively oblivious feature space from top to bottom along the channel direction, to ensure the network learns more image details in an orderly manner while not falling into feature redundancy. Experiments are conducted on the standard classification dataset CIFAR-10/100 and two garbage datasets with intra-class diverse styles. SOCA improves SqueezeNet, MobileNet, BN-VGG-19, Inception and ResNet-50 in classification accuracy by 1.31%, 1.18%, 1.57%, 2.09% and 2.27% on average, respectively. The feasibility and effectiveness of intra-class diversity feature learning in SOCA-enhanced networks are verified. Besides, the class activation map shows that more local detail feature regions are activated by adding the SOCA module, which also demonstrates the interpretability of the method for intra-class diversity feature learning.
Collapse
Affiliation(s)
- Honggui Han
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China; Engineering Research Center of Digital Community Ministry of Education, Beijing University of Technology, Beijing 100124, China; Beijing Artificial Intelligence Institute and Beijing Laboratory for Intelligent Environmental Protection, Beijing 100124, China.
| | - Qiyu Zhang
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China
| | - Fangyu Li
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China; Engineering Research Center of Digital Community Ministry of Education, Beijing University of Technology, Beijing 100124, China; Beijing Artificial Intelligence Institute and Beijing Laboratory for Intelligent Environmental Protection, Beijing 100124, China
| | - Yongping Du
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China
| |
Collapse
|
2
|
Sethanan K, Pitakaso R, Srichok T, Khonjun S, Weerayuth N, Prasitpuriprecha C, Preeprem T, Jantama SS, Gonwirat S, Enkvetchakul P, Kaewta C, Nanthasamroeng N. Computer-aided diagnosis using embedded ensemble deep learning for multiclass drug-resistant tuberculosis classification. Front Med (Lausanne) 2023; 10:1122222. [PMID: 37441685 PMCID: PMC10333053 DOI: 10.3389/fmed.2023.1122222] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 05/23/2023] [Indexed: 07/15/2023] Open
Abstract
Introduction This study aims to develop a web application, TB-DRD-CXR, for the categorization of tuberculosis (TB) patients into subgroups based on their level of drug resistance. The application utilizes an ensemble deep learning model that classifies TB strains into five subtypes: drug sensitive tuberculosis (DS-TB), drug resistant TB (DR-TB), multidrug-resistant TB (MDR-TB), pre-extensively drug-resistant TB (pre-XDR-TB), and extensively drug-resistant TB (XDR-TB). Methods The ensemble deep learning model employed in the TB-DRD-CXR web application incorporates novel fusion techniques, image segmentation, data augmentation, and various learning rate strategies. The performance of the proposed model is compared with state-of-the-art techniques and standard homogeneous CNN architectures documented in the literature. Results Computational results indicate that the suggested method outperforms existing methods reported in the literature, providing a 4.0%-33.9% increase in accuracy. Moreover, the proposed model demonstrates superior performance compared to standard CNN models, including DenseNet201, NASNetMobile, EfficientNetB7, EfficientNetV2B3, EfficientNetV2M, and ConvNeXtSmall, with accuracy improvements of 28.8%, 93.4%, 2.99%, 48.0%, 4.4%, and 7.6% respectively. Conclusion The TB-DRD-CXR web application was developed and tested with 33 medical staff. The computational results showed a high accuracy rate of 96.7%, time-based efficiency (ET) of 4.16 goals/minutes, and an overall relative efficiency (ORE) of 100%. The system usability scale (SUS) score of the proposed application is 96.7%, indicating user satisfaction and a likelihood of recommending the TB-DRD-CXR application to others based on previous literature.
Collapse
Affiliation(s)
- Kanchana Sethanan
- Department of Industrial Engineer, Faculty of Engineering, Research Unit on System Modelling for Industry, Khon Kaen University, Khon Kaen, Thailand
| | - Rapeepan Pitakaso
- Department of Industrial Engineer, Faculty of Engineering, Artificial Intelligence Optimization SMART Laboratory, Ubon Ratchathani University, Ubon Ratchathani, Thailand
| | - Thanatkij Srichok
- Department of Industrial Engineer, Faculty of Engineering, Artificial Intelligence Optimization SMART Laboratory, Ubon Ratchathani University, Ubon Ratchathani, Thailand
| | - Surajet Khonjun
- Department of Industrial Engineer, Faculty of Engineering, Artificial Intelligence Optimization SMART Laboratory, Ubon Ratchathani University, Ubon Ratchathani, Thailand
| | - Nantawatana Weerayuth
- Ubon Ratchathani University, Department of Mechanical Engineer, Faculty of Engineering, Ubon Ratchathani, Thailand
| | - Chutinun Prasitpuriprecha
- Division of Biopharmacy, Faculty of Pharmaceutical Sciences, Ubon Ratchathani University, Ubon Ratchathani, Thailand
| | - Thanawadee Preeprem
- Division of Biopharmacy, Faculty of Pharmaceutical Sciences, Ubon Ratchathani University, Ubon Ratchathani, Thailand
| | - Sirima Suvarnakuta Jantama
- Ubon Ratchathani University, Division of Biopharmacy, Faculty of Pharmaceutical Sciences, Ubon Ratchathani, Thailand
| | - Sarayut Gonwirat
- Department of Industrial Engineer, Faculty of Engineering, Artificial Intelligence Optimization SMART Laboratory, Ubon Ratchathani University, Ubon Ratchathani, Thailand
- Department of Computer Engineering and Automation, Faculty of Engineering, Kalasin University, Kalasin, Thailand
| | - Prem Enkvetchakul
- Department of Industrial Engineer, Faculty of Engineering, Artificial Intelligence Optimization SMART Laboratory, Ubon Ratchathani University, Ubon Ratchathani, Thailand
- Department of Information Technology, Faculty of Sciences, Buriram Rajabhat University, Buriram, Thailand
| | - Chutchai Kaewta
- Department of Industrial Engineer, Faculty of Engineering, Artificial Intelligence Optimization SMART Laboratory, Ubon Ratchathani University, Ubon Ratchathani, Thailand
- Department of Computer Science, Faculty of Computer Sciences, Ubon Ratchathani Rajabhat University, Ubon Ratchathani, Thailand
| | - Natthapong Nanthasamroeng
- Department of Industrial Engineer, Faculty of Engineering, Artificial Intelligence Optimization SMART Laboratory, Ubon Ratchathani University, Ubon Ratchathani, Thailand
- Department of Engineering Technology, Faculty of Industrial Technology, Ubon Ratchathani Rajabhat University, Ubon Ratchathani, Thailand
| |
Collapse
|
3
|
Automatic COVID-19 prediction using explainable machine learning techniques. INTERNATIONAL JOURNAL OF COGNITIVE COMPUTING IN ENGINEERING 2023; 4:36-46. [PMCID: PMC9876019 DOI: 10.1016/j.ijcce.2023.01.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 01/11/2023] [Accepted: 01/22/2023] [Indexed: 05/29/2023]
Abstract
The coronavirus is considered this century's most disruptive catastrophe and global concern. This disease has prompted extreme social, psychological and economic impacts affecting millions of people around the globe. COVID-19 is transmitted from one infected person's body to another through respiratory droplets. This virus proliferates when people breathe in air-contaminated space with droplets and microscopic airborne particles. This research aims to analyze automatic COVID-19 detection using machine learning techniques to build an intelligent web application. The dataset has been preprocessed by dropping null values, feature engineering, and synthetic oversampling (SMOTE) techniques. Next, we trained and evaluated different classifiers, i.e., logistic regression, random forest, decision tree, k-nearest neighbor, support vector machine (SVM), ensemble models (adaptive boosting and extreme gradient boosting) and deep learning (artificial neural network, convolutional neural network and long short-term memory) techniques. Explainable AI with the LIME framework has been applied to interpret the prediction results. The hybrid CNN-LSTM algorithm with the SMOTE approach performed better than the other models on the employed open-source dataset obtained from the Israeli Ministry of Health website, with 96.34% accuracy and a 0.98 F1 score. Finally, this model was chosen to deploy the proposed prediction system to a website, where users may acquire an instantaneous COVID-19 prognosis based on their symptoms.
Collapse
|
4
|
Mortality prediction of COVID-19 patients using soft voting classifier. INTERNATIONAL JOURNAL OF COGNITIVE COMPUTING IN ENGINEERING 2022; 3:172-179. [PMCID: PMC9472476 DOI: 10.1016/j.ijcce.2022.09.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 09/07/2022] [Accepted: 09/11/2022] [Indexed: 05/29/2023]
Abstract
COVID-19 is a novel coronavirus that spread around the globe with the initial reports coming from Wuhan, China, turned into a pandemic and caused enormous casualties. Various countries have faced multiple COVID spikes which put the medical infrastructure of these countries under immense pressure with third-world countries being hit the hardest. It can be thus concluded that determining the likeliness of death of a patient helps in avoiding fatalities which inspired the authors to research the topic. There are various ways to approach the problem such as past medical records, chest X-rays, CT scans, and blood biomarkers. Since blood biomarkers are most easily available in emergency scenarios, blood biomarkers were used as the features for the model. The data was first imputed and the training data was oversampled to avoid class imbalance in the model training. The model is composed of a voting classifier that takes in outputs from multiple classifiers. The model was then compared to base models such as Random Forest, XGBoost, and Extra Trees Classifier on multiple evaluation criteria. The F1 score was the concerned evaluation criterion as it maximizes the use of the medical infrastructure with the minimum possible casualties by maximizing true positives and minimizing false negatives.
Collapse
|