1
|
Chen S, Ren S, Wang G, Huang M, Xue C. Interpretable CNN-Multilevel Attention Transformer for Rapid Recognition of Pneumonia From Chest X-Ray Images. IEEE J Biomed Health Inform 2024; 28:753-764. [PMID: 37027681 DOI: 10.1109/jbhi.2023.3247949] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023]
Abstract
Chest imaging plays an essential role in diagnosing and predicting patients with COVID-19 with evidence of worsening respiratory status. Many deep learning-based approaches for pneumonia recognition have been developed to enable computer-aided diagnosis. However, the long training and inference time makes them inflexible, and the lack of interpretability reduces their credibility in clinical medical practice. This paper aims to develop a pneumonia recognition framework with interpretability, which can understand the complex relationship between lung features and related diseases in chest X-ray (CXR) images to provide high-speed analytics support for medical practice. To reduce the computational complexity to accelerate the recognition process, a novel multi-level self-attention mechanism within Transformer has been proposed to accelerate convergence and emphasize the task-related feature regions. Moreover, a practical CXR image data augmentation has been adopted to address the scarcity of medical image data problems to boost the model's performance. The effectiveness of the proposed method has been demonstrated on the classic COVID-19 recognition task using the widespread pneumonia CXR image dataset. In addition, abundant ablation experiments validate the effectiveness and necessity of all of the components of the proposed method.
Collapse
|
2
|
Nizam NB, Siddiquee SM, Shirin M, Bhuiyan MIH, Hasan T. COVID-19 Severity Prediction from Chest X-ray Images Using an Anatomy-Aware Deep Learning Model. J Digit Imaging 2023; 36:2100-2112. [PMID: 37369941 PMCID: PMC10502002 DOI: 10.1007/s10278-023-00861-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 05/17/2023] [Accepted: 05/25/2023] [Indexed: 06/29/2023] Open
Abstract
The COVID-19 pandemic has been adversely affecting the patient management systems in hospitals around the world. Radiological imaging, especially chest x-ray and lung Computed Tomography (CT) scans, plays a vital role in the severity analysis of hospitalized COVID-19 patients. However, with an increasing number of patients and a lack of skilled radiologists, automated assessment of COVID-19 severity using medical image analysis has become increasingly important. Chest x-ray (CXR) imaging plays a significant role in assessing the severity of pneumonia, especially in low-resource hospitals, and is the most frequently used diagnostic imaging in the world. Previous methods that automatically predict the severity of COVID-19 pneumonia mainly focus on feature pooling from pre-trained CXR models without explicitly considering the underlying human anatomical attributes. This paper proposes an anatomy-aware (AA) deep learning model that learns the generic features from x-ray images considering the underlying anatomical information. Utilizing a pre-trained model and lung segmentation masks, the model generates a feature vector including disease-level features and lung involvement scores. We have used four different open-source datasets, along with an in-house annotated test set for training and evaluation of the proposed method. The proposed method improves the geographical extent score by 11% in terms of mean squared error (MSE) while preserving the benchmark result in lung opacity score. The results demonstrate the effectiveness of the proposed AA model in COVID-19 severity prediction from chest X-ray images. The algorithm can be used in low-resource setting hospitals for COVID-19 severity prediction, especially where there is a lack of skilled radiologists.
Collapse
Affiliation(s)
- Nusrat Binta Nizam
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Sadi Mohammad Siddiquee
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Mahbuba Shirin
- Department of Radiology and Imaging, Bangabandhu Sheikh Mujib Medical University, Shahbagh, Dhaka, 1000, Bangladesh
| | - Mohammed Imamul Hassan Bhuiyan
- Department of Electrical and Electronics Engineering (EEE), Bangladesh University of Engineering and Technology, Dhaka, 1205, Bangladesh
| | - Taufiq Hasan
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh.
- Center for Bioengineering Innovation and Design (CBID), Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| |
Collapse
|
3
|
Ahmed MAO, Abbas IA, AbdelSatar Y. HDSNE a new unsupervised multiple image database fusion learning algorithm with flexible and crispy production of one database: a proof case study of lung infection diagnose In chest X-ray images. BMC Med Imaging 2023; 23:134. [PMID: 37718458 PMCID: PMC10506286 DOI: 10.1186/s12880-023-01078-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Accepted: 08/16/2023] [Indexed: 09/19/2023] Open
Abstract
Continuous release of image databases with fully or partially identical inner categories dramatically deteriorates the production of autonomous Computer-Aided Diagnostics (CAD) systems for true comprehensive medical diagnostics. The first challenge is the frequent massive bulk release of medical image databases, which often suffer from two common drawbacks: image duplication and corruption. The many subsequent releases of the same data with the same classes or categories come with no clear evidence of success in the concatenation of those identical classes among image databases. This issue stands as a stumbling block in the path of hypothesis-based experiments for the production of a single learning model that can successfully classify all of them correctly. Removing redundant data, enhancing performance, and optimizing energy resources are among the most challenging aspects. In this article, we propose a global data aggregation scale model that incorporates six image databases selected from specific global resources. The proposed valid learner is based on training all the unique patterns within any given data release, thereby creating a unique dataset hypothetically. The Hash MD5 algorithm (MD5) generates a unique hash value for each image, making it suitable for duplication removal. The T-Distributed Stochastic Neighbor Embedding (t-SNE), with a tunable perplexity parameter, can represent data dimensions. Both the Hash MD5 and t-SNE algorithms are applied recursively, producing a balanced and uniform database containing equal samples per category: normal, pneumonia, and Coronavirus Disease of 2019 (COVID-19). We evaluated the performance of all proposed data and the new automated version using the Inception V3 pre-trained model with various evaluation metrics. The performance outcome of the proposed scale model showed more respectable results than traditional data aggregation, achieving a high accuracy of 98.48%, along with high precision, recall, and F1-score. The results have been proved through a statistical t-test, yielding t-values and p-values. It's important to emphasize that all t-values are undeniably significant, and the p-values provide irrefutable evidence against the null hypothesis. Furthermore, it's noteworthy that the Final dataset outperformed all other datasets across all metric values when diagnosing various lung infections with the same factors.
Collapse
Affiliation(s)
- Muhammad Atta Othman Ahmed
- Department of Computer Science, Faculty of Computers and Information, Luxor University, Luxor, 85951, Egypt.
| | - Ibrahim A Abbas
- Mathematics Department, Faculty of Science, Sohag University, Sohag, 82511, Egypt
| | - Yasser AbdelSatar
- Mathematics Department, Faculty of Science, Sohag University, Sohag, 82511, Egypt
| |
Collapse
|
4
|
Shahzadi T, Ali MU, Majeed F, Sana MU, Diaz RM, Samad MA, Ashraf I. Nerve Root Compression Analysis to Find Lumbar Spine Stenosis on MRI Using CNN. Diagnostics (Basel) 2023; 13:2975. [PMID: 37761342 PMCID: PMC10529899 DOI: 10.3390/diagnostics13182975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 09/14/2023] [Accepted: 09/14/2023] [Indexed: 09/29/2023] Open
Abstract
Lumbar spine stenosis (LSS) is caused by low back pain that exerts pressure on the nerves in the spine. Detecting LSS is a significantly important yet difficult task. It is detected by analyzing the area of the anteroposterior diameter of the patient's lumbar spine. Currently, the versatility and accuracy of LSS segmentation algorithms are limited. The objective of this research is to use magnetic resonance imaging (MRI) to automatically categorize LSS. This study presents a convolutional neural network (CNN)-based method to detect LSS using MRI images. Radiological grading is performed on a publicly available dataset. Four regions of interest (ROIs) are determined to diagnose LSS with normal, mild, moderate, and severe gradings. The experiments are performed on 1545 axial-view MRI images. Furthermore, two datasets-multi-ROI and single-ROI-are created. For training and testing, an 80:20 ratio of randomly selected labeled datasets is used, with fivefold cross-validation. The results of the proposed model reveal a 97.01% accuracy for multi-ROI and 97.71% accuracy for single-ROI. The proposed computer-aided diagnosis approach can significantly improve diagnostic accuracy in everyday clinical workflows to assist medical experts in decision making. The proposed CNN-based MRI image segmentation approach shows its efficacy on a variety of datasets. Results are compared to existing state-of-the-art studies, indicating the superior performance of the proposed approach.
Collapse
Affiliation(s)
- Turrnum Shahzadi
- Department of Information Technology, University of Gujrat, Gujrat 50700, Pakistan; (T.S.); (F.M.); (M.U.S.)
| | - Muhammad Usman Ali
- Department of Computer Science, University of Gujrat, Gujrat 50700, Pakistan;
| | - Fiaz Majeed
- Department of Information Technology, University of Gujrat, Gujrat 50700, Pakistan; (T.S.); (F.M.); (M.U.S.)
| | - Muhammad Usman Sana
- Department of Information Technology, University of Gujrat, Gujrat 50700, Pakistan; (T.S.); (F.M.); (M.U.S.)
| | - Raquel Martínez Diaz
- Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain;
- Universidad Internacional Iberoamericana, Campeche 24560, Mexico
- Universidad Internacional do Cuanza, Cuito EN250, Bié, Angola
| | - Md Abdus Samad
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea
| |
Collapse
|
5
|
Siddiqui HUR, Younas F, Rustam F, Flores ES, Ballester JB, Diez IDLT, Dudley S, Ashraf I. Enhancing Cricket Performance Analysis with Human Pose Estimation and Machine Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:6839. [PMID: 37571624 PMCID: PMC10422414 DOI: 10.3390/s23156839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 07/21/2023] [Accepted: 07/29/2023] [Indexed: 08/13/2023]
Abstract
Cricket has a massive global following and is ranked as the second most popular sport globally, with an estimated 2.5 billion fans. Batting requires quick decisions based on ball speed, trajectory, fielder positions, etc. Recently, computer vision and machine learning techniques have gained attention as potential tools to predict cricket strokes played by batters. This study presents a cutting-edge approach to predicting batsman strokes using computer vision and machine learning. The study analyzes eight strokes: pull, cut, cover drive, straight drive, backfoot punch, on drive, flick, and sweep. The study uses the MediaPipe library to extract features from videos and several machine learning and deep learning algorithms, including random forest (RF), support vector machine, k-nearest neighbors, decision tree, linear regression, and long short-term memory to predict the strokes. The study achieves an outstanding accuracy of 99.77% using the RF algorithm, outperforming the other algorithms used in the study. The k-fold validation of the RF model is 95.0% with a standard deviation of 0.07, highlighting the potential of computer vision and machine learning techniques for predicting batsman strokes in cricket. The study's results could help improve coaching techniques and enhance batsmen's performance in cricket, ultimately improving the game's overall quality.
Collapse
Affiliation(s)
- Hafeez Ur Rehman Siddiqui
- Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Abu Dhabi Road, Rahim Yar Khan 64200, Punjab, Pakistan; (H.U.R.S.); (F.Y.)
| | - Faizan Younas
- Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Abu Dhabi Road, Rahim Yar Khan 64200, Punjab, Pakistan; (H.U.R.S.); (F.Y.)
| | - Furqan Rustam
- School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland;
| | - Emmanuel Soriano Flores
- Engineering Research & Innovation Group, Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain; (E.S.F.); (J.B.B.)
- Department of Project Management, Universidad Internacional Iberoamericana Campeche, Campeche 24560, Mexico
- Department of Projects, Universidad Internacional Iberoamericana Arecibo, Puerto Rico, PR 00613, USA
| | - Julién Brito Ballester
- Engineering Research & Innovation Group, Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain; (E.S.F.); (J.B.B.)
- Project Management, Universidade Internacional do Cuanza, Cuito EN250, Angola
- Fundación Universitaria Internacional de Colombia Bogotá, Bogotá 11001, Colombia
| | - Isabel de la Torre Diez
- Department of Signal Theory, Communications and Telematics Engineering, University of Valladolid, Paseo de Belén, 15, 47011 Valladolid, Spain
| | - Sandra Dudley
- Bioengineering Research Centre, School of Engineering, London South Bank University, 103 Borough Road, London SE1 0AA, UK;
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyongsan-si 38541, Republic of Korea
| |
Collapse
|
6
|
Akila SM, Imanov E, Almezhghwi K. Investigating Beta-Variational Convolutional Autoencoders for the Unsupervised Classification of Chest Pneumonia. Diagnostics (Basel) 2023; 13:2199. [PMID: 37443592 DOI: 10.3390/diagnostics13132199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 06/21/2023] [Accepted: 06/22/2023] [Indexed: 07/15/2023] Open
Abstract
The world's population is increasing and so is the challenge on existing healthcare infrastructure to cope with the growing demand in medical diagnosis and evaluation. Although human experts are primarily tasked with the diagnosis of different medical conditions, artificial intelligence (AI)-assisted diagnoses have become considerably useful in recent times. One of the critical lung infections, which requires early diagnosis and subsequent treatment to reduce the mortality rate, is pneumonia. There are different methods for obtaining a pneumonia diagnosis; however, the adoption of chest X-rays is popular since it is non-invasive. The AI systems for a pneumonia diagnosis using chest X-rays are often built on supervised machine-learning (ML) models, which require labeled datasets for development. However, collecting labeled datasets is sometimes infeasible due to constraints such as human resources, cost, and time. As such, the problem that we address in this paper is the unsupervised classification of pneumonia using unsupervised ML models including the beta-variational convolutional autoencoder (β-VCAE) and other variants, such as convolutional autoencoders (CAE), denoising convolutional autoencoders (DCAE), and sparse convolutional autoencoders (SCAE). Namely, the pneumonia classification problem is cast into an anomaly detection to develop the aforementioned ML models. The experimental results show that pneumonia can be diagnosed with high recall, precision, f1-score, and f2-score using the proposed unsupervised models. In addition, we observe that the proposed models are competitive with the state-of-the-art models, which are trained on a labeled dataset.
Collapse
Affiliation(s)
- Serag Mohamed Akila
- Department of Biomedical Engineering, Near East University, Mersin 10, 99138 Nicosia, Turkey
| | - Elbrus Imanov
- Department of Computer Engineering, Near East University, Mersin 10, 99138 Nicosia, Turkey
| | - Khaled Almezhghwi
- Electrical and Electronics Engineering, College of Electronics Technology Tripoli, Tripoli 00000, Libya
| |
Collapse
|
7
|
Lee MH, Shomanov A, Kudaibergenova M, Viderman D. Deep Learning Methods for Interpretation of Pulmonary CT and X-ray Images in Patients with COVID-19-Related Lung Involvement: A Systematic Review. J Clin Med 2023; 12:jcm12103446. [PMID: 37240552 DOI: 10.3390/jcm12103446] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 04/25/2023] [Accepted: 05/06/2023] [Indexed: 05/28/2023] Open
Abstract
SARS-CoV-2 is a novel virus that has been affecting the global population by spreading rapidly and causing severe complications, which require prompt and elaborate emergency treatment. Automatic tools to diagnose COVID-19 could potentially be an important and useful aid. Radiologists and clinicians could potentially rely on interpretable AI technologies to address the diagnosis and monitoring of COVID-19 patients. This paper aims to provide a comprehensive analysis of the state-of-the-art deep learning techniques for COVID-19 classification. The previous studies are methodically evaluated, and a summary of the proposed convolutional neural network (CNN)-based classification approaches is presented. The reviewed papers have presented a variety of CNN models and architectures that were developed to provide an accurate and quick automatic tool to diagnose the COVID-19 virus based on presented CT scan or X-ray images. In this systematic review, we focused on the critical components of the deep learning approach, such as network architecture, model complexity, parameter optimization, explainability, and dataset/code availability. The literature search yielded a large number of studies over the past period of the virus spread, and we summarized their past efforts. State-of-the-art CNN architectures, with their strengths and weaknesses, are discussed with respect to diverse technical and clinical evaluation metrics to safely implement current AI studies in medical practice.
Collapse
Affiliation(s)
- Min-Ho Lee
- School of Engineering and Digital Sciences, Nazarbayev University, Kabanbay Batyr Ave. 53, Astana 010000, Kazakhstan
| | - Adai Shomanov
- School of Engineering and Digital Sciences, Nazarbayev University, Kabanbay Batyr Ave. 53, Astana 010000, Kazakhstan
| | - Madina Kudaibergenova
- School of Engineering and Digital Sciences, Nazarbayev University, Kabanbay Batyr Ave. 53, Astana 010000, Kazakhstan
| | - Dmitriy Viderman
- School of Medicine, Nazarbayev University, 5/1 Kerey and Zhanibek Khandar Str., Astana 010000, Kazakhstan
| |
Collapse
|
8
|
Bhattacharjee V, Priya A, Kumari N, Anwar S. DeepCOVNet Model for COVID-19 Detection Using Chest X-Ray Images. WIRELESS PERSONAL COMMUNICATIONS 2023; 130:1399-1416. [PMID: 37168437 PMCID: PMC10088652 DOI: 10.1007/s11277-023-10336-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 02/25/2023] [Indexed: 05/13/2023]
Abstract
COVID-19 is an epidemic disease that has threatened all the people at worldwide scale and eventually became a pandemic It is a crucial task to differentiate COVID-19-affected patients from healthy patient populations. The need for technology enabled solutions is pertinent and this paper proposes a deep learning model for detection of COVID-19 using Chest X-Ray (CXR) images. In this research work, we provide insights on how to build robust deep learning based models for COVID-19 CXR image classification from Normal and Pneumonia affected CXR images. We contribute a methodical escort on preparation of data to produce a robust deep learning model. The paper prepared datasets by refactoring, using images from several datasets for ameliorate training of deep model. These recently published datasets enable us to build our own model and compare by using pre-trained models. The proposed experiments show the ability to work effectively to classify COVID-19 patients utilizing CXR. The empirical work, which uses a 3 convolutional layer based Deep Neural Network called "DeepCOVNet" to classify CXR images into 3 classes: COVID-19, Normal and Pneumonia cases, yielded an accuracy of 96.77% and a F1-score of 0.96 on two different combination of datasets.
Collapse
Affiliation(s)
| | - Ankita Priya
- Birla Institute of Technology Mesra, Ranchi, 835215 India
| | - Nandini Kumari
- Birla Institute of Technology Mesra, Ranchi, 835215 India
- Department of Data Science & Computer Application, Manipal Institute of Technology, Manipal, Manipal Academy of Higher Education, Manipal, 576104 Karnataka India
| | - Shamama Anwar
- Birla Institute of Technology Mesra, Ranchi, 835215 India
| |
Collapse
|
9
|
Chaitanya MK, Sharma LD, Rahul J, Sharma D, Roy A. Artificial intelligence based approach for categorization of COVID-19 ECG images in presence of other cardiovascular disorders. Biomed Phys Eng Express 2023; 9. [PMID: 36805304 DOI: 10.1088/2057-1976/acbd53] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Accepted: 02/20/2023] [Indexed: 02/22/2023]
Abstract
Coronavirus disease (COVID-19) is a class of SARS-CoV-2 virus which is initially identified in the later half of the year 2019 and then evolved as a pandemic. If it is not identified in the early stage then the infection and mortality rates increase with time. A timely and reliable approach for COVID-19 identification has become important in order to prevent the disease from spreading rapidly. In recent times, many methods have been suggested for the detection of COVID-19 disease have various flaws, to increase diagnosis performance, fresh investigations are required. In this article, automatically diagnosing COVID-19 using ECG images and deep learning approaches like as Visual Geometry Group (VGG) and AlexNet architectures have been proposed. The proposed method is able to classify between COVID-19, myocardial infarction, normal sinus rhythm, and other abnormal heart beats using Lead-II ECG image only. The efficacy of the technique proposed is validated by using a publicly available ECG image database. We have achieved an accuracy of 77.42% using Alexnet model and 75% accuracy with the help of VGG19 model.
Collapse
Affiliation(s)
| | | | - Jagdeep Rahul
- Department of Electronics & Communication Engineering, Rajiv Gandhi University, India
| | - Diksha Sharma
- Department of Nanoscience & Technology, Central University of Jharkhand, India
| | - Amarjit Roy
- Department of Electrical Engineering, Ghani Khan Choudhury Institute of Engineering and Technology, India
| |
Collapse
|
10
|
Wali A, Ali S, Naseer A, Karim S, Alamgir Z. Computer-aided COVID-19 diagnosis: a possibility? J EXP THEOR ARTIF IN 2023. [DOI: 10.1080/0952813x.2023.2165722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Affiliation(s)
- Aamir Wali
- FAST School of Computing, National University of Computer and Emerging Sciences, Faisal Town, Lahore, Pakistan
| | - Shahroze Ali
- FAST School of Computing, National University of Computer and Emerging Sciences, Faisal Town, Lahore, Pakistan
| | - Asma Naseer
- FAST School of Computing, National University of Computer and Emerging Sciences, Faisal Town, Lahore, Pakistan
| | - Saira Karim
- FAST School of Computing, National University of Computer and Emerging Sciences, Faisal Town, Lahore, Pakistan
| | - Zareen Alamgir
- FAST School of Computing, National University of Computer and Emerging Sciences, Faisal Town, Lahore, Pakistan
| |
Collapse
|
11
|
Hybrid intelligent model for classifying chest X-ray images of COVID-19 patients using genetic algorithm and neutrosophic logic. Soft comput 2023; 27:3427-3442. [PMID: 34421342 PMCID: PMC8371596 DOI: 10.1007/s00500-021-06103-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/30/2021] [Indexed: 12/23/2022]
Abstract
The highly spreading virus, COVID-19, created a huge need for an accurate and speedy diagnosis method. The famous RT-PCR test is costly and not available for many suspected cases. This article proposes a neurotrophic model to diagnose COVID-19 patients based on their chest X-ray images. The proposed model has five main phases. First, the speeded up robust features (SURF) method is applied to each X-ray image to extract robust invariant features. Second, three sampling algorithms are applied to treat imbalanced dataset. Third, the neutrosophic rule-based classification system is proposed to generate a set of rules based on the three neutrosophic values < T; I; F>, the degrees of truth, indeterminacy falsity. Fourth, a genetic algorithm is applied to select the optimal neutrosophic rules to improve the classification performance. Fifth, in this phase, the classification-based neutrosophic logic is proposed. The testing rule matrix is constructed with no class label, and the goal of this phase is to determine the class label for each testing rule using intersection percentage between testing and training rules. The proposed model is referred to as GNRCS. It is compared with six state-of-the-art classifiers such as multilayer perceptron (MLP), support vector machines (SVM), linear discriminant analysis (LDA), decision tree (DT), naive Bayes (NB), and random forest classifiers (RFC) with quality measures of accuracy, precision, sensitivity, specificity, and F1-score. The results show that the proposed model is powerful for COVID-19 recognition with high specificity and high sensitivity and less computational complexity. Therefore, the proposed GNRCS model could be used for real-time automatic early recognition of COVID-19.
Collapse
|
12
|
Celik G. Detection of Covid-19 and other pneumonia cases from CT and X-ray chest images using deep learning based on feature reuse residual block and depthwise dilated convolutions neural network. Appl Soft Comput 2023; 133:109906. [PMID: 36504726 PMCID: PMC9726212 DOI: 10.1016/j.asoc.2022.109906] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2022] [Revised: 11/29/2022] [Accepted: 12/01/2022] [Indexed: 12/12/2022]
Abstract
Covid-19 has become a worldwide epidemic which has caused the death of millions in a very short time. This disease, which is transmitted rapidly, has mutated and different variations have emerged. Early diagnosis is important to prevent the spread of this disease. In this study, a new deep learning-based architecture is proposed for rapid detection of Covid-19 and other symptoms using CT and X-ray chest images. This method, called CovidDWNet, is based on a structure based on feature reuse residual block (FRB) and depthwise dilated convolutions (DDC) units. The FRB and DDC units efficiently acquired various features in the chest scan images and it was seen that the proposed architecture significantly improved its performance. In addition, the feature maps obtained with the CovidDWNet architecture were estimated with the Gradient boosting (GB) algorithm. With the CovidDWNet+GB architecture, which is a combination of CovidDWNet and GB, a performance increase of approximately 7% in CT images and between 3% and 4% in X-ray images has been achieved. The CovidDWNet+GB architecture achieved the highest success compared to other architectures, with 99.84% and 100% accuracy rates, respectively, on different datasets containing binary class (Covid-19 and Normal) CT images. Similarly, the proposed architecture showed the highest success with 96.81% accuracy in multi-class (Covid-19, Lung Opacity, Normal and Viral Pneumonia) X-ray images and 96.32% accuracy in the dataset containing X-ray and CT images. When the time to predict the disease in CT or X-ray images is examined, it is possible to say that it has a high speed because the CovidDWNet+GB method predicts thousands of images within seconds.
Collapse
Affiliation(s)
- Gaffari Celik
- Agri Ibrahim Cecen University, Department of Computer Technology, Agri, Turkey
| |
Collapse
|
13
|
Wadhwani GK, Varshney PK, Gupta A, Kumar S. Sentiment Analysis and Comprehensive Evaluation of Supervised Machine Learning Models Using Twitter Data on Russia-Ukraine War. SN COMPUTER SCIENCE 2023; 4:346. [PMID: 37125219 PMCID: PMC10120493 DOI: 10.1007/s42979-023-01790-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2023] [Accepted: 03/13/2023] [Indexed: 05/02/2023]
Abstract
The Russia-Ukrainian War refers to the ongoing hostilities between Russia and Ukraine. It was first focused on whether Crimea and the Donbass were formally recognised as being a part of Ukraine when Russia started it in February 2014. The conflict dramatically grew when Russia began its incursion of Ukraine on February 24, 2022, following a military build-up on the Russian-Ukrainian border that started in late 2021. Examining public perceptions of the crisis between Russia and Ukraine is the goal of this piece. These days, social media has taken on a significant role in communication, and as a result, opinions can be found on platforms like Facebook, Twitter, and Instagram. The study makes use of his 11,250 tweets about the war between Russia and Ukraine from his Twitter account. Techniques, including image processing, object identification, and natural language processing, have shown application, power, and potential for machine learning. The same applies to text analytics. For text analysis, sentiment analysis, and entity annotation, machine learning techniques are frequently employed. According to the applicability and efficacy of the machine learning model, natural language processing toolkit in python is utilised in to examine the textual polarity and subjectivity score of tweets. Moreover, because machine learning models have a high degree of classification accuracy, they have been widely utilised to categorise emotions. We have developed and test models using three feature extraction techniques: TF-IDF (term frequency-inverse document frequency), BoW (bag of words), and N-gram. Each model was assessed using a number of important performance indicators, including accuracy, precision, recall, and F1 score. Results show that the extra trees classifier (ETC) model achieves a highest accuracy of 0.84 in combination with the Bow property which is a measure to evaluate the efficacy of a machine learning algorithm. Logistic regression (LR), decision tree (DT), support vector machine (SVM), XGB, Gaussian naive base (GNB), ADA, and K-nearest neighbours (KNN) comparison have also been made.
Collapse
Affiliation(s)
| | | | - Anjali Gupta
- Department of Computer Science, IITM, GGSIPU, New Delhi, India
| | - Shrawan Kumar
- Department of Computer Science and Engineering, Shoolini University, Solan, Himachal Pradesh India
| |
Collapse
|
14
|
Lasker A, Obaidullah SM, Chakraborty C, Roy K. Application of Machine Learning and Deep Learning Techniques for COVID-19 Screening Using Radiological Imaging: A Comprehensive Review. SN COMPUTER SCIENCE 2022; 4:65. [PMID: 36467853 PMCID: PMC9702883 DOI: 10.1007/s42979-022-01464-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Accepted: 10/18/2022] [Indexed: 11/26/2022]
Abstract
Lung, being one of the most important organs in human body, is often affected by various SARS diseases, among which COVID-19 has been found to be the most fatal disease in recent times. In fact, SARS-COVID 19 led to pandemic that spreads fast among the community causing respiratory problems. Under such situation, radiological imaging-based screening [mostly chest X-ray and computer tomography (CT) modalities] has been performed for rapid screening of the disease as it is a non-invasive approach. Due to scarcity of physician/chest specialist/expert doctors, technology-enabled disease screening techniques have been developed by several researchers with the help of artificial intelligence and machine learning (AI/ML). It can be remarkably observed that the researchers have introduced several AI/ML/DL (deep learning) algorithms for computer-assisted detection of COVID-19 using chest X-ray and CT images. In this paper, a comprehensive review has been conducted to summarize the works related to applications of AI/ML/DL for diagnostic prediction of COVID-19, mainly using X-ray and CT images. Following the PRISMA guidelines, total 265 articles have been selected out of 1715 published articles till the third quarter of 2021. Furthermore, this review summarizes and compares varieties of ML/DL techniques, various datasets, and their results using X-ray and CT imaging. A detailed discussion has been made on the novelty of the published works, along with advantages and limitations.
Collapse
Affiliation(s)
- Asifuzzaman Lasker
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | - Sk Md Obaidullah
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | - Chandan Chakraborty
- Department of Computer Science & Engineering, National Institute of Technical Teachers’ Training & Research Kolkata, Kolkata, India
| | - Kaushik Roy
- Department of Computer Science, West Bengal State University, Barasat, India
| |
Collapse
|
15
|
Zhang Y, Yang D, Lam S, Li B, Teng X, Zhang J, Zhou T, Ma Z, Ying TC(M, Cai J. Radiomics-Based Detection of COVID-19 from Chest X-ray Using Interpretable Soft Label-Driven TSK Fuzzy Classifier. Diagnostics (Basel) 2022; 12:2613. [PMID: 36359456 PMCID: PMC9689330 DOI: 10.3390/diagnostics12112613] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 10/16/2022] [Accepted: 10/18/2022] [Indexed: 05/22/2024] Open
Abstract
The COVID-19 pandemic has posed a significant global public health threat with an escalating number of new cases and death toll daily. The early detection of COVID-related CXR abnormality potentially allows the early isolation of suspected cases. Chest X-Ray (CXR) is a fast and highly accessible imaging modality. Recently, a number of CXR-based AI models have been developed for the automated detection of COVID-19. However, most existing models are difficult to interpret due to the use of incomprehensible deep features in their models. Confronted with this, we developed an interpretable TSK fuzzy system in this study for COVID-19 detection using radiomics features extracted from CXR images. There are two main contributions. (1) When TSK fuzzy systems are applied to classification tasks, the commonly used binary label matrix of training samples is transformed into a soft one in order to learn a more discriminant transformation matrix and hence improve classification accuracy. (2) Based on the assumption that the samples in the same class should be kept as close as possible when they are transformed into the label space, the compactness class graph is introduced to avoid overfitting caused by label matrix relaxation. Our proposed model for a multi-categorical classification task (COVID-19 vs. No-Findings vs. Pneumonia) was evaluated using 600 CXR images from publicly available datasets and compared against five state-of-the-art AI models in aspects of classification accuracy. Experimental findings showed that our model achieved classification accuracy of over 83%, which is better than the state-of-the-art models, while maintaining high interpretability.
Collapse
Affiliation(s)
- Yuanpeng Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
- Department of Medical informatics, Nantong University, Nantong 226007, China
| | - Dongrong Yang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Saikit Lam
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Bing Li
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Ta Zhou
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Zongrui Ma
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Tin-Cheung (Michael) Ying
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| |
Collapse
|
16
|
Faragallah OS, El-Hoseny HM, El-Sayed HS. Efficient COVID-19 super pixel segmentation algorithm using MCFO-based SLIC. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2022; 14:9217-9232. [PMID: 36310644 PMCID: PMC9589839 DOI: 10.1007/s12652-022-04425-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 09/14/2022] [Indexed: 06/08/2023]
Abstract
In computer vision segmentation field, super pixel identity has become an important index in the recently segmentation algorithms especially in medical images. Simple Linear Iterative Clustering (SLIC) algorithm is one of the most popular super pixel methods as it has a great robustness, less sensitive to the image type and benefit to the boundary recall in different kinds of image processing. Recently, COVID-19 severity increased with the lack of an effective treatment or vaccine. As the Corona virus spreads in an unknown manner, th-ere is a strong need for segmenting the lungs infected regions for fast tracking and early detection, no matter how small. This may consider difficult to be achieved with traditional segmentation techniques. From this perspective, this paper presents an efficient modified central force optimization (MCFO)-based SLIC segmentation algorithm to discuss chest CT images for detecting the positive COVID-19 cases. The proposed MCFO-based SLIC segmentation algorithm performance is evaluated and compared with the thresholding segmentation algorithm using different evaluation metrics such as accuracy, boundary recall, F-measure, similarity index, MCC, Dice, and Jaccard. The outcomes demonstrated that the proposed MCFO-based SLIC segmentation algorithm has achieved better detection for the small infected regions in CT lung scans than the thresholding segmentation.
Collapse
Affiliation(s)
- Osama S. Faragallah
- Department of Information Technology, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif, 21944 Saudi Arabia
| | - Heba M. El-Hoseny
- Department of Computer Science, The Higher Future Institute for Specialized Technological Studies, El Shorouk, Egypt
| | - Hala S. El-Sayed
- Department of Electrical Engineering, Faculty of Engineering, Menoufia University, Shebin El-Kom, 32511 Egypt
| |
Collapse
|
17
|
Tao R, Guo Q. Artificial Intelligence Technology Driven Environmental Factors Extraction and Analysis Method in Traditional Clothing Handicraft. JOURNAL OF ENVIRONMENTAL AND PUBLIC HEALTH 2022; 2022:1883641. [PMID: 36275884 PMCID: PMC9581670 DOI: 10.1155/2022/1883641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Revised: 09/23/2022] [Accepted: 09/27/2022] [Indexed: 11/18/2022]
Abstract
The application of artificial intelligence (AI) technology in the field of clothes can provide a good development mode and system under the social context of AI technology development. AI provides help for the development of intelligent clothing. Intelligent clothing is a high-tech product that integrates intelligent technology and clothing. It combines cutting-edge technologies in electronic information technology, sensor technology, textile science, and material science. In the extraction and analysis of environmental factors in clothing handicraft, AI technology has a considerable application prospect and a certain development potential. In order to improve the accuracy of environmental factors extraction in clothing handicraft, this paper uses convolutional neural network (CNN) to extract and analyze environmental factors in traditional clothing handicraft. We carried out experiments on the extraction of environmental factors in clothing handicrafts with pure color, few patterns, patterns, and complex background. The experimental results show that the CNN has a good effect on the extraction of environmental factors in clothing handicraft under different backgrounds. In addition, the model in this paper has good stability, accuracy, and feature extraction speed, which has high practical value and research significance.
Collapse
Affiliation(s)
- Ran Tao
- Jilin Animation Institute, Changchun 130013, China
| | - Qi Guo
- Academy of Fine Arts, Northeast Normal University, Changchun 130117, China
| |
Collapse
|
18
|
Ahmad M, Sadiq S, Eshmawi AA, Alluhaidan AS, Umer M, Ullah S, Nappi M. Industry 4.0 technologies and their applications in fighting COVID-19 pandemic using deep learning techniques. Comput Biol Med 2022; 145:105418. [PMID: 35334315 PMCID: PMC8935962 DOI: 10.1016/j.compbiomed.2022.105418] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2021] [Revised: 03/16/2022] [Accepted: 03/16/2022] [Indexed: 12/16/2022]
Abstract
The disease known as COVID-19 has turned into a pandemic and spread all over the world. The fourth industrial revolution known as Industry 4.0 includes digitization, the Internet of Things, and artificial intelligence. Industry 4.0 has the potential to fulfil customized requirements during the COVID-19 emergency crises. The development of a prediction framework can help health authorities to react appropriately and rapidly. Clinical imaging like X-rays and computed tomography (CT) can play a significant part in the early diagnosis of COVID-19 patients that will help with appropriate treatment. The X-ray images could help in developing an automated system for the rapid identification of COVID-19 patients. This study makes use of a deep convolutional neural network (CNN) to extract significant features and discriminate X-ray images of infected patients from non-infected ones. Multiple image processing techniques are used to extract a region of interest (ROI) from the entire X-ray image. The ImageDataGenerator class is used to overcome the small dataset size and generate ten thousand augmented images. The performance of the proposed approach has been compared with state-of-the-art VGG16, AlexNet, and InceptionV3 models. Results demonstrate that the proposed CNN model outperforms other baseline models with high accuracy values: 97.68% for two classes, 89.85% for three classes, and 84.76% for four classes. This system allows COVID-19 patients to be processed by an automated screening system with minimal human contact.
Collapse
Affiliation(s)
- Muhammad Ahmad
- Department of Information Security, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
| | - Saima Sadiq
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
| | - Ala’ Abdulmajid Eshmawi
- Department of Cybersecurity, College of Computer Science and Engineering, University of Jeddah, Saudi Arabia
| | - Ala Saleh Alluhaidan
- Department of Information Systems, College of Computer and Information Science, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia
| | - Muhammad Umer
- Department of Computer Science & Information Technology, The Islamia University of Bahawalpur, Bahawalpur, 63100, Pakistan,Corresponding author. Department of Computer Science & Information Technology, The Islamia University of Bahawalpur, Bahawalpur, 63100, Pakistan
| | - Saleem Ullah
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
| | - Michele Nappi
- Department of Computer Science, University of Salerno, Fisciano, Italy,Corresponding author
| |
Collapse
|
19
|
New Optimized Deep Learning Application for COVID-19 Detection in Chest X-ray Images. Symmetry (Basel) 2022. [DOI: 10.3390/sym14051003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Due to false negative results of the real-time Reverse Transcriptase-Polymerase Chain Reaction (RT-PCR) test, the complemental practices such as computed tomography (CT) and X-ray in combination with RT-PCR are discussed to achieve a more accurate diagnosis of COVID-19 in clinical practice. Since radiology includes visual understanding as well as decision making under limited conditions such as uncertainty, urgency, patient burden, and hospital facilities, mistakes are inevitable. Therefore, there is an immediate requirement to carry out further investigation and develop new accurate detection and identification methods to provide automatically quantitative evaluation of COVID-19. In this paper, we propose a new computer-aided diagnosis application for COVID-19 detection using deep learning techniques. A new technique, which receives symmetric X-ray data as the input, is presented in this study by combining Convolutional Neural Networks (CNN) with Ant Lion Optimization Algorithm (ALO) and Multiclass Naïve Bayes Classifier (NB). Moreover, several other classifiers such as Softmax, Support Vector Machines (SVM), K-Nearest Neighbors (KNN) and Decision Tree (DT) are combined with CNN. The promising results of these classifiers are evaluated and presented for accuracy, precision, and F1-score metrics. NB classifier with Ant Lion Optimization Algorithm and CNN produced the best results with 98.31% accuracy, 100% precision and 98.25% F1-score and with the lowest execution time.
Collapse
|
20
|
Bozkurt F. A deep and handcrafted features-based framework for diagnosis of COVID-19 from chest x-ray images. CONCURRENCY AND COMPUTATION : PRACTICE & EXPERIENCE 2022; 34:e6725. [PMID: 34899079 PMCID: PMC8646664 DOI: 10.1002/cpe.6725] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Revised: 09/24/2021] [Accepted: 10/29/2021] [Indexed: 05/07/2023]
Abstract
Automatic early diagnosis of COVID-19 with computer-aided tools is crucial for disease treatment and control. Radiology images of COVID-19 and other lung diseases like bacterial pneumonia, viral pneumonia have common features. Thus, this similarity makes it difficult for radiologists to detect COVID-19 cases. A reliable method for classifying non-COVID-19 and COVID-19 chest x-ray images could be useful to reduce triage process and diagnose. In this study, we develop an original framework (HANDEFU) that supports handcrafted, deep, and fusion-based feature extraction techniques for feature engineering. The user interactively builds any model by selecting feature extraction technique and classification method through the framework. Any feature extraction technique and model could then be added dynamically to the library of software at a later time upon request. The novelty of this study is that image preprocessing and diverse feature extraction and classification techniques are assembled under an original framework. In this study, this framework is utilized for diagnosing COVID-19 from chest x-ray images on an open-access dataset. All of the experimental results and performance evaluations on this dataset are performed with this software. In experimental studies, COVID-19 prediction is performed by 27 different models through software. The superior performance with accuracy of 99.36% is obtained by LBP+SVM model.
Collapse
Affiliation(s)
- Ferhat Bozkurt
- Department of Computer Engineering, Faculty of EngineeringAtatürk UniversityErzurumTurkey
| |
Collapse
|
21
|
Matsuzaka Y, Uesawa Y. A Deep Learning-Based Quantitative Structure-Activity Relationship System Construct Prediction Model of Agonist and Antagonist with High Performance. Int J Mol Sci 2022; 23:ijms23042141. [PMID: 35216254 PMCID: PMC8877122 DOI: 10.3390/ijms23042141] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Revised: 02/12/2022] [Accepted: 02/14/2022] [Indexed: 01/27/2023] Open
Abstract
Molecular design and evaluation for drug development and chemical safety assessment have been advanced by quantitative structure–activity relationship (QSAR) using artificial intelligence techniques, such as deep learning (DL). Previously, we have reported the high performance of prediction models molecular initiation events (MIEs) on the adverse toxicological outcome using a DL-based QSAR method, called DeepSnap-DL. This method can extract feature values from images generated on a three-dimensional (3D)-chemical structure as a novel QSAR analytical system. However, there is room for improvement of this system’s time-consumption. Therefore, in this study, we constructed an improved DeepSnap-DL system by combining the processes of generating an image from a 3D-chemical structure, DL using the image as input data, and statistical calculation of prediction-performance. Consequently, we obtained that the three prediction models of agonists or antagonists of MIEs achieved high prediction-performance by optimizing the parameters of DeepSnap, such as the angle used in the depiction of the image of a 3D-chemical structure, data-split, and hyperparameters in DL. The improved DeepSnap-DL system will be a powerful tool for computer-aided molecular design as a novel QSAR system.
Collapse
Affiliation(s)
- Yasunari Matsuzaka
- Department of Medical Molecular Informatics, Meiji Pharmaceutical University, Kiyose 204-8588, Japan;
- Center for Gene and Cell Therapy, Division of Molecular and Medical Genetics, The Institute of Medical Science, University of Tokyo, Minato City 108-8639, Japan
| | - Yoshihiro Uesawa
- Department of Medical Molecular Informatics, Meiji Pharmaceutical University, Kiyose 204-8588, Japan;
- Correspondence: ; Tel.: +81-42-495-8983
| |
Collapse
|
22
|
A Fuzzy-enhanced Deep Learning Approach for Early Detection of Covid-19 Pneumonia from Portable Chest X-Ray Images. Neurocomputing 2022; 481:202-215. [PMID: 35079203 PMCID: PMC8776345 DOI: 10.1016/j.neucom.2022.01.055] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 12/17/2021] [Accepted: 01/14/2022] [Indexed: 12/20/2022]
Abstract
The Covid-19 pandemic is the defining global health crisis of our time. Chest X-Rays (CXR) have been an important imaging modality for assisting in the diagnosis and management of hospitalised Covid-19 patients. However, their interpretation is time intensive for radiologists. Accurate computer aided systems can facilitate early diagnosis of Covid-19 and effective triaging. In this paper, we propose a fuzzy logic based deep learning approach to differentiate between CXR images of patients with Covid-19 pneumonia and with interstitial pneumonias not related to Covid-19. The developed model here, referred to as CovNNet, is used to extract some relevant features from CXR images, combined with fuzzy images generated by a fuzzy edge detection algorithm. Experimental results show that using a combination of CXR and fuzzy features, within a deep learning approach by developing a deep network inputed to a Multilayer Perceptron (MLP), results in a higher classification performance (accuracy rate up to 81%), compared to benchmark deep learning approaches. The approach has been validated through additional datasets which are continously generated due to the spread of the virus and would help triage patients in acute settings. A permutation analysis is carried out, and a simple occlusion methodology for explaining decisions is also proposed. The proposed pipeline can be easily embedded into present clinical decision support systems.
Collapse
|
23
|
Gudigar A, Raghavendra U, Nayak S, Ooi CP, Chan WY, Gangavarapu MR, Dharmik C, Samanth J, Kadri NA, Hasikin K, Barua PD, Chakraborty S, Ciaccio EJ, Acharya UR. Role of Artificial Intelligence in COVID-19 Detection. SENSORS (BASEL, SWITZERLAND) 2021; 21:8045. [PMID: 34884045 PMCID: PMC8659534 DOI: 10.3390/s21238045] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 12/15/2022]
Abstract
The global pandemic of coronavirus disease (COVID-19) has caused millions of deaths and affected the livelihood of many more people. Early and rapid detection of COVID-19 is a challenging task for the medical community, but it is also crucial in stopping the spread of the SARS-CoV-2 virus. Prior substantiation of artificial intelligence (AI) in various fields of science has encouraged researchers to further address this problem. Various medical imaging modalities including X-ray, computed tomography (CT) and ultrasound (US) using AI techniques have greatly helped to curb the COVID-19 outbreak by assisting with early diagnosis. We carried out a systematic review on state-of-the-art AI techniques applied with X-ray, CT, and US images to detect COVID-19. In this paper, we discuss approaches used by various authors and the significance of these research efforts, the potential challenges, and future trends related to the implementation of an AI system for disease detection during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Sneha Nayak
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore;
| | - Wai Yee Chan
- Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur 50603, Malaysia;
| | - Mokshagna Rohit Gangavarapu
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chinmay Dharmik
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Jyothi Samanth
- Department of Cardiovascular Technology, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, India;
| | - Nahrizul Adib Kadri
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia;
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
| | - Edward J. Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY 10032, USA;
| | - U. Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
24
|
Deep Learning Based Early Detection Framework for Preliminary Diagnosis of COVID-19 via Onboard Smartphone Sensors. SENSORS 2021; 21:s21206853. [PMID: 34696066 PMCID: PMC8540424 DOI: 10.3390/s21206853] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Revised: 10/08/2021] [Accepted: 10/09/2021] [Indexed: 12/19/2022]
Abstract
The COVID-19 pandemic has affected almost every country causing devastating economic and social disruption and stretching healthcare systems to the limit. Furthermore, while being the current gold standard, existing test methods including NAAT (Nucleic Acid Amplification Tests), clinical analysis of chest CT (Computer Tomography) scan images, and blood test results, require in-person visits to a hospital which is not an adequate way to control such a highly contagious pandemic. Therefore, top priority must be given, among other things, to enlisting recent and adequate technologies to reduce the adverse impact of this pandemic. Modern smartphones possess a rich variety of embedded MEMS (Micro-Electro-Mechanical-Systems) sensors capable of recording movements, temperature, audio, and video of their carriers. This study leverages the smartphone sensors for the preliminary diagnosis of COVID-19. Deep learning, an important breakthrough in the domain of artificial intelligence in the past decade, has huge potential for extracting apt and appropriate features in healthcare. Motivated from these facts, this paper presents a new framework that leverages advanced machine learning and data analytics techniques for the early detection of coronavirus disease using smartphone embedded sensors. The proposal provides a simple to use and quickly deployable screening tool that can be easily configured with a smartphone. Experimental results indicate that the model can detect positive cases with an overall accuracy of 79% using only the data from the smartphone sensors. This means that the patient can either be isolated or treated immediately to prevent further spread, thereby saving more lives. The proposed approach does not involve any medical tests and is a cost-effective solution that provides robust results.
Collapse
|
25
|
Development and prospective validation of COVID-19 chest X-ray screening model for patients attending emergency departments. Sci Rep 2021; 11:20384. [PMID: 34650190 PMCID: PMC8516957 DOI: 10.1038/s41598-021-99986-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 10/05/2021] [Indexed: 01/08/2023] Open
Abstract
Chest X-rays (CXRs) are the first-line investigation in patients presenting to emergency departments (EDs) with dyspnoea and are a valuable adjunct to clinical management of COVID-19 associated lung disease. Artificial intelligence (AI) has the potential to facilitate rapid triage of CXRs for further patient testing and/or isolation. In this work we develop an AI algorithm, CovIx, to differentiate normal, abnormal, non-COVID-19 pneumonia, and COVID-19 CXRs using a multicentre cohort of 293,143 CXRs. The algorithm is prospectively validated in 3289 CXRs acquired from patients presenting to ED with symptoms of COVID-19 across four sites in NHS Greater Glasgow and Clyde. CovIx achieves area under receiver operating characteristic curve for COVID-19 of 0.86, with sensitivity and F1-score up to 0.83 and 0.71 respectively, and performs on-par with four board-certified radiologists. AI-based algorithms can identify CXRs with COVID-19 associated pneumonia, as well as distinguish non-COVID pneumonias in symptomatic patients presenting to ED. Pre-trained models and inference scripts are freely available at https://github.com/beringresearch/bravecx-covid.
Collapse
|
26
|
Sentiment Analysis and Topic Modeling on Tweets about Online Education during COVID-19. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11188438] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Amid the worldwide COVID-19 pandemic lockdowns, the closure of educational institutes leads to an unprecedented rise in online learning. For limiting the impact of COVID-19 and obstructing its widespread, educational institutions closed their campuses immediately and academic activities are moved to e-learning platforms. The effectiveness of e-learning is a critical concern for both students and parents, specifically in terms of its suitability to students and teachers and its technical feasibility with respect to different social scenarios. Such concerns must be reviewed from several aspects before e-learning can be adopted at such a larger scale. This study endeavors to investigate the effectiveness of e-learning by analyzing the sentiments of people about e-learning. Due to the rise of social media as an important mode of communication recently, people’s views can be found on platforms such as Twitter, Instagram, Facebook, etc. This study uses a Twitter dataset containing 17,155 tweets about e-learning. Machine learning and deep learning approaches have shown their suitability, capability, and potential for image processing, object detection, and natural language processing tasks and text analysis is no exception. Machine learning approaches have been largely used both for annotation and text and sentiment analysis. Keeping in view the adequacy and efficacy of machine learning models, this study adopts TextBlob, VADER (Valence Aware Dictionary for Sentiment Reasoning), and SentiWordNet to analyze the polarity and subjectivity score of tweets’ text. Furthermore, bearing in mind the fact that machine learning models display high classification accuracy, various machine learning models have been used for sentiment classification. Two feature extraction techniques, TF-IDF (Term Frequency-Inverse Document Frequency) and BoW (Bag of Words) have been used to effectively build and evaluate the models. All the models have been evaluated in terms of various important performance metrics such as accuracy, precision, recall, and F1 score. The results reveal that the random forest and support vector machine classifier achieve the highest accuracy of 0.95 when used with Bow features. Performance comparison is carried out for results of TextBlob, VADER, and SentiWordNet, as well as classification results of machine learning models and deep learning models such as CNN (Convolutional Neural Network), LSTM (Long Short Term Memory), CNN-LSTM, and Bi-LSTM (Bidirectional-LSTM). Additionally, topic modeling is performed to find the problems associated with e-learning which indicates that uncertainty of campus opening date, children’s disabilities to grasp online education, and lagging efficient networks for online education are the top three problems.
Collapse
|