1
|
Ran A, Liu H. Joint spatio-temporal features constrained self-supervised electrocardiogram representation learning. Biomed Eng Lett 2024; 14:209-220. [PMID: 38374910 PMCID: PMC10874354 DOI: 10.1007/s13534-023-00329-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 09/08/2023] [Accepted: 09/26/2023] [Indexed: 02/21/2024] Open
Abstract
The electrocardiogram (ECG) measurements with clinical diagnostic labels are intrinsically limited. We propose a generative learning based self-supervised method for general ECG representations applicable to various downstream tasks, thus achieving the goal of reducing the dependence on labeled data. However, existing self-supervised methods either fail to provide satisfactory ECG representations or require too much effort to curate a large amount of expert-annotated datasets. We propose a spatio-temporal joint detection based self-supervised method with little or no human supervision to label massive datasets. Considering the spatio-temporal characteristics of ECG signals, we dynamically randomly mask the original signal (temporal detection) and disrupt the order of leads (spatial detection) to complete the learning through reconstructing the original signal and predicting the lead numbers. To validate the effectiveness of the proposed method, we use several publicly available ECG databases as well as a private ECG data of ventricular tachycardia to pre-train our model. We use diagnostic classification of 27 arrhythmia types and localization of ventricular tachycardia origin sites as two downstream tasks, respectively. The results show that learning ECG representations with this method is effective. This effort demonstrates the feasibility of learning representations from ECG data by self-supervised learning. Our self-supervised method uses only 60% of the labeled data used by the supervised method to achieve the same performance. Using the same amount of data, our self-supervised approach shows 1.3% and 8.6% improvement in classification and localization accuracy compared to the model with random initialization on two types of downstream tasks, respectively.
Collapse
Affiliation(s)
- Ao Ran
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Zheda Road 38#, Hangzhou, 310027 China
| | - Huafeng Liu
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Zheda Road 38#, Hangzhou, 310027 China
| |
Collapse
|
2
|
Aarthy ST, Mazher Iqbal JL. A novel deep learning approach for early detection of cardiovascular diseases from ECG signals. Med Eng Phys 2024; 125:104111. [PMID: 38508789 DOI: 10.1016/j.medengphy.2024.104111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 12/18/2023] [Accepted: 01/17/2024] [Indexed: 03/22/2024]
Abstract
Cardiovascular diseases, often asymptomatic until severe, pose a significant challenge in medical diagnosis. Despite individuals' normal outward appearance and routine activities, subtle indications of these diseases can manifest in the electrocardiogram (ECG) signals, often overlooked by standard interpretation. Current machine learning models have been ineffective in discerning these minor variations due to the irregular and subtle nature of changes in the ECG patterns. This paper uses a novel deep-learning approach to predict slight variations in ECG signals by fine-tuning the learning rate of a deep convolutional neural network. The strategy involves segmenting ECG signals into separate data sequences, each evaluated for unique centroid points. Utilizing a clustering approach, this technique efficiently recognizes minute yet significant variations in the ECG signal characteristics. This method is estimated using a specific dataset from SRM College Hospital and Research Centre, Kattankulathur, Chennai, India, focusing on patients' ECG signals. The model aims to predict the ordinary and subtle variations in ECG signal patterns, which were subsequently mapped to a pre-trained feature set of cardiovascular diseases. The results suggest that the proposed method outperforms existing state-of-the-art approaches in detecting minor and irregular ECG signal variations. This advancement could significantly enhance the early detection of cardiovascular diseases, offering a promising new tool in predictive medical diagnostics.
Collapse
Affiliation(s)
- S T Aarthy
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R &D Institute of Science and Technology, Avadi, Chennai, Tamil Nadu, India; Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, Tamil Nadu, India.
| | - J L Mazher Iqbal
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R &D Institute of Science and Technology, Avadi, Chennai, Tamil Nadu, India
| |
Collapse
|
3
|
Terzi MB, Arikan O. Machine learning based hybrid anomaly detection technique for automatic diagnosis of cardiovascular diseases using cardiac sympathetic nerve activity and electrocardiogram. BIOMED ENG-BIOMED TE 2024; 69:79-109. [PMID: 37823386 DOI: 10.1515/bmt-2022-0406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Accepted: 08/25/2023] [Indexed: 10/13/2023]
Abstract
OBJECTIVES Coronary artery diseases (CADs) are the leading cause of death worldwide and early diagnosis is crucial for timely treatment. To address this, our study presents a novel automated Artificial Intelligence (AI)-based Hybrid Anomaly Detection (AIHAD) technique that combines various signal processing, feature extraction, supervised, and unsupervised machine learning methods. By jointly and simultaneously analyzing 12-lead cardiac sympathetic nerve activity (CSNA) and electrocardiogram (ECG) data, the automated AIHAD technique performs fast, early, and accurate diagnosis of CADs. METHODS In order to develop and evaluate the proposed automated AIHAD technique, we utilized the fully labeled STAFF III and PTBD databases, which contain the 12-lead wideband raw recordings non-invasively acquired from 260 subjects. Using these wideband raw recordings, we developed a signal processing technique that simultaneously detects the 12-lead CSNA and ECG signals of all subjects. Using the pre-processed 12-lead CSNA and ECG signals, we developed a time-domain feature extraction technique that extracts the statistical CSNA and ECG features critical for the reliable diagnosis of CADs. Using the extracted discriminative features, we developed a supervised classification technique based on Artificial Neural Networks (ANNs) that simultaneously detects anomalies in the 12-lead CSNA and ECG data. Furthermore, we developed an unsupervised clustering technique based on Gaussian mixture models (GMMs) and Neyman-Pearson criterion, which robustly detects outliers corresponding to CADs. RESULTS Using the automated AIHAD technique, we have, for the first time, demonstrated a significant association between the increase in CSNA signals and anomalies in ECG signals during CADs. The AIHAD technique achieved highly reliable detection of CADs with a sensitivity of 98.48 %, specificity of 97.73 %, accuracy of 98.11 %, positive predictive value of 97.74 %, negative predictive value of 98.47 %, and F1-score of 98.11 %. Hence, the automated AIHAD technique demonstrates superior performance compared to the gold standard diagnostic test ECG in the diagnosis of CADs. Additionally, it outperforms other techniques developed in this study that separately utilize either only CSNA data or only ECG data. Therefore, it significantly increases the detection performance of CADs by taking advantage of the diversity in different data types and leveraging their strengths. Furthermore, its performance is comparatively better than that of most previously proposed machine and deep learning methods that exclusively used ECG data to diagnose or classify CADs. Additionally, it has a very low implementation time, which is highly desirable for real-time detection of CADs. CONCLUSIONS The proposed automated AIHAD technique may serve as an efficient decision-support system to increase physicians' success in fast, early, and accurate diagnosis of CADs. It may be highly beneficial and valuable, particularly for asymptomatic patients, for whom the diagnostic information provided by ECG alone is not sufficient to reliably diagnose the disease. Hence, it may significantly improve patient outcomes by enabling timely treatments and considerably reducing the mortality of cardiovascular diseases (CVDs).
Collapse
Affiliation(s)
- Merve Begum Terzi
- Faculty of Engineering, Electrical and Electronics Engineering Department, Bilkent University, Ankara, Türkiye
| | - Orhan Arikan
- Faculty of Engineering, Electrical and Electronics Engineering Department, Bilkent University, Ankara, Türkiye
| |
Collapse
|
4
|
Kulkarni S, Rabidas R. Fully convolutional network for automated detection and diagnosis of mammographic masses. MULTIMEDIA TOOLS AND APPLICATIONS 2023:1-22. [PMID: 37362703 PMCID: PMC10169189 DOI: 10.1007/s11042-023-14757-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 01/19/2022] [Accepted: 02/05/2023] [Indexed: 06/28/2023]
Abstract
Breast cancer, though rare in male, is very frequent in female and has high mortality rate which can be reduced if detected and diagnosed at the early stage. Thus, in this paper, deep learning architecture based on U-Net is proposed for the detection of breast masses and its characterization as benign or malignant. The evaluation of the proposed architecture in detection is carried out on two benchmark datasets- INbreast and DDSM and achieved a true positive rate of 99.64% at 0.25 false positives per image for INbreast dataset while the same for DDSM are 97.36% and 0.38 FPs/I, respectively. For mass characterization, an accuracy of 97.39% with an AUC of 0.97 is obtained for INbreast while the same for DDSM are 96.81%, and 0.96, respectively. The measured results are further compared with the state-of-the-art techniques where the introduced scheme takes an edge over others.
Collapse
Affiliation(s)
- Sujata Kulkarni
- Department of Electronics & Communication Engineering, Assam University, Silchar, 788010 Assam India
| | - Rinku Rabidas
- Department of Electronics & Communication Engineering, Assam University, Silchar, 788010 Assam India
| |
Collapse
|
5
|
Sun Q, Xu Z, Liang C, Zhang F, Li J, Liu R, Chen T, Ji B, Chen Y, Wang C. A dynamic learning-based ECG feature extraction method for myocardial infarction detection. Physiol Meas 2023; 43. [PMID: 36595315 DOI: 10.1088/1361-6579/acaa1a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Accepted: 12/08/2022] [Indexed: 12/13/2022]
Abstract
Objective.Myocardial infarction (MI) is one of the leading causes of human mortality in all cardiovascular diseases globally. Currently, the 12-lead electrocardiogram (ECG) is widely used as a first-line diagnostic tool for MI. However, visual inspection of pathological ECG variations induced by MI remains a great challenge for cardiologists, since pathological changes are usually complex and slight.Approach.To have an accuracy of the MI detection, the prominent features extracted from in-depth mining of ECG signals need to be explored. In this study, a dynamic learning algorithm is applied to discover prominent features for identifying MI patients via mining the hidden inherent dynamics in ECG signals. Firstly, the distinctive dynamic features extracted from the multi-scale decomposition of dynamic modeling of the ECG signals effectively and comprehensibly represent the pathological ECG changes. Secondly, a few most important dynamic features are filtered through a hybrid feature selection algorithm based on filter and wrapper to form a representative reduced feature set. Finally, different classifiers based on the reduced feature set are trained and tested on the public PTB dataset and an independent clinical data set.Main results.Our proposed method achieves a significant improvement in detecting MI patients under the inter-patient paradigm, with an accuracy of 94.75%, sensitivity of 94.18%, and specificity of 96.33% on the PTB dataset. Furthermore, classifiers trained on PTB are verified on the test data set collected from 200 patients, yielding a maximum accuracy of 84.96%, sensitivity of 85.04%, and specificity of 84.80%.Significance.The experimental results demonstrate that our method performs distinctive dynamic feature extraction and may be used as an effective auxiliary tool to diagnose MI patients.
Collapse
Affiliation(s)
- Qinghua Sun
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China.,Center for Intelligent Medical Engineering, Shandong University, Jinan 250061, People's Republic of China
| | - Zhanfei Xu
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China
| | - Chunmiao Liang
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China
| | - Fukai Zhang
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China.,Center for Intelligent Medical Engineering, Shandong University, Jinan 250061, People's Republic of China
| | - Jiali Li
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China
| | - Rugang Liu
- Department of Emergency, Qilu Hospital of Shandong University, Jinan 250012, People's Republic of China
| | - Tianrui Chen
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China.,Center for Intelligent Medical Engineering, Shandong University, Jinan 250061, People's Republic of China
| | - Bing Ji
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China.,Center for Intelligent Medical Engineering, Shandong University, Jinan 250061, People's Republic of China
| | - Yuguo Chen
- Department of Emergency, Qilu Hospital of Shandong University, Jinan 250012, People's Republic of China
| | - Cong Wang
- School of Control Science and Engineering, Shandong University, Jinan 250061, People's Republic of China.,Center for Intelligent Medical Engineering, Shandong University, Jinan 250061, People's Republic of China
| |
Collapse
|
6
|
Yang M, Liu W, Zhang H. A robust multiple heartbeats classification with weight-based loss based on convolutional neural network and bidirectional long short-term memory. Front Physiol 2022; 13:982537. [PMID: 36545286 PMCID: PMC9760867 DOI: 10.3389/fphys.2022.982537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 11/18/2022] [Indexed: 12/09/2022] Open
Abstract
Background: Analysis of electrocardiogram (ECG) provides a straightforward and non-invasive approach for cardiologists to diagnose and classify the nature and severity of variant cardiac diseases including cardiac arrhythmia. However, the interpretation and analysis of ECG are highly working-load demanding, and the subjective may lead to false diagnoses and heartbeats classification. In recent years, many deep learning works showed an excellent role in accurate heartbeats classification. However, the imbalance of heartbeat classes is universal in most of the available ECG databases since abnormal heartbeats are always relatively rare in real life scenarios. In addition, many existing approaches achieved prominent results by removing noise and extracting features in data preprocessing, which relies heavily on powerful computers. It is a pressing need to develop efficient and automatic light weighted algorithms for accurate heartbeats classification that can be used in portable ECG sensors. Objective: This study aims at developing a robust and efficient deep learning method, which can be embedded into wearable or portable ECG monitors for classifying heartbeats. Methods: We proposed a novel and light weighted deep learning architecture with weight-based loss based on a convolutional neural network (CNN) and bidirectional long short-term memory (Bi-LSTM) that can automatically identify five types of ECG heartbeats according to the AAMI EC57 standard. It was also true that the raw ECG signals were simply segmented without noise removal and other feature extraction processing. Moreover, to tackle the challenge of classification bias due to imbalanced ECG datasets for different types of arrhythmias, we introduced a weight-based loss function to reduce the influence of over-weighted categories in the ECG dataset. For avoiding the influence of the division of validation dataset, k-fold method was adopted to improve the reliability of the model. Results: The proposed algorithm is trained and tested on MIT-BIH Arrhythmia Database, and achieves an average of 99.33% accuracy, 93.67% sensitivity, 99.18% specificity, 89.85% positive prediction, and 91.65% F1 score.
Collapse
Affiliation(s)
- Mengting Yang
- Key Laboratory of Medical Electrophysiology, Ministry of Education and Medical Electrophysiological Key Laboratory of Sichuan Province, (Collaborative Innovation Center for Prevention of Cardiovascular Diseases), Institute of Cardiovascular Research, Southwest Medical University, Luzhou, China,School of Medical Information and Engineering, Southwest Medical University, Luzhou, China,School of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China
| | - Weichao Liu
- Key Laboratory of Medical Electrophysiology, Ministry of Education and Medical Electrophysiological Key Laboratory of Sichuan Province, (Collaborative Innovation Center for Prevention of Cardiovascular Diseases), Institute of Cardiovascular Research, Southwest Medical University, Luzhou, China
| | - Henggui Zhang
- Key Laboratory of Medical Electrophysiology, Ministry of Education and Medical Electrophysiological Key Laboratory of Sichuan Province, (Collaborative Innovation Center for Prevention of Cardiovascular Diseases), Institute of Cardiovascular Research, Southwest Medical University, Luzhou, China,Department of Physics and Astronomy, The University of Manchester, Manchester, United Kingdom,*Correspondence: Henggui Zhang,
| |
Collapse
|
7
|
Ahmed M, Masood S, Ahmad M, A. Abd El-Latif A. Intelligent Driver Drowsiness Detection for Traffic Safety Based on Multi CNN Deep Model and Facial Subsampling. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 2022; 23:19743-19752. [DOI: 10.1109/tits.2021.3134222] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Affiliation(s)
- Muneeb Ahmed
- Department of Computer Engineering, Jamia Millia Islamia, New Delhi, India
| | - Sarfaraz Masood
- Department of Computer Engineering, Jamia Millia Islamia, New Delhi, India
| | - Musheer Ahmad
- Department of Computer Engineering, Jamia Millia Islamia, New Delhi, India
| | - Ahmed A. Abd El-Latif
- Department of Mathematics and Computer Science, Faculty of Science, Menoufia University, Shebeen El-Kom, Egypt
| |
Collapse
|
8
|
El-Rahiem BA, El-Samie FEA, Amin M. Multimodal biometric authentication based on deep fusion of electrocardiogram (ECG) and finger vein. MULTIMEDIA SYSTEMS 2022; 28:1325-1337. [DOI: 10.1007/s00530-021-00810-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Accepted: 05/13/2021] [Indexed: 09/01/2023]
|
9
|
An Explainable Classification Method of SPECT Myocardial Perfusion Images in Nuclear Cardiology Using Deep Learning and Grad-CAM. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157592] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Background: This study targets the development of an explainable deep learning methodology for the automatic classification of coronary artery disease, utilizing SPECT MPI images. Deep learning is currently judged as non-transparent due to the model’s complex non-linear structure, and thus, it is considered a «black box», making it hard to gain a comprehensive understanding of its internal processes and explain its behavior. Existing explainable artificial intelligence tools can provide insights into the internal functionality of deep learning and especially of convolutional neural networks, allowing transparency and interpretation. Methods: This study seeks to address the identification of patients’ CAD status (infarction, ischemia or normal) by developing an explainable deep learning pipeline in the form of a handcrafted convolutional neural network. The proposed RGB-CNN model utilizes various pre- and post-processing tools and deploys a state-of-the-art explainability tool to produce more interpretable predictions in decision making. The dataset includes cases from 625 patients as stress and rest representations, comprising 127 infarction, 241 ischemic, and 257 normal cases previously classified by a doctor. The imaging dataset was split into 20% for testing and 80% for training, of which 15% was further used for validation purposes. Data augmentation was employed to increase generalization. The efficacy of the well-known Grad-CAM-based color visualization approach was also evaluated in this research to provide predictions with interpretability in the detection of infarction and ischemia in SPECT MPI images, counterbalancing any lack of rationale in the results extracted by the CNNs. Results: The proposed model achieved 93.3% accuracy and 94.58% AUC, demonstrating efficient performance and stability. Grad-CAM has shown to be a valuable tool for explaining CNN-based judgments in SPECT MPI images, allowing nuclear physicians to make fast and confident judgments by using the visual explanations offered. Conclusions: Prediction results indicate a robust and efficient model based on the deep learning methodology which is proposed for CAD diagnosis in nuclear medicine.
Collapse
|
10
|
Chui KT, Gupta BB, Chi HR, Arya V, Alhalabi W, Ruiz MT, Shen CW. Transfer Learning-Based Multi-Scale Denoising Convolutional Neural Network for Prostate Cancer Detection. Cancers (Basel) 2022; 14:3687. [PMID: 35954350 PMCID: PMC9367349 DOI: 10.3390/cancers14153687] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 07/20/2022] [Accepted: 07/22/2022] [Indexed: 12/28/2022] Open
Abstract
BACKGROUND Prostate cancer is the 4th most common type of cancer. To reduce the workload of medical personnel in the medical diagnosis of prostate cancer and increase the diagnostic accuracy in noisy images, a deep learning model is desired for prostate cancer detection. METHODS A multi-scale denoising convolutional neural network (MSDCNN) model was designed for prostate cancer detection (PCD) that is capable of noise suppression in images. The model was further optimized by transfer learning, which contributes domain knowledge from the same domain (prostate cancer data) but heterogeneous datasets. Particularly, Gaussian noise was introduced in the source datasets before knowledge transfer to the target dataset. RESULTS Four benchmark datasets were chosen as representative prostate cancer datasets. Ablation study and performance comparison between the proposed work and existing works were performed. Our model improved the accuracy by more than 10% compared with the existing works. Ablation studies also showed average improvements in accuracy using denoising, multi-scale scheme, and transfer learning, by 2.80%, 3.30%, and 3.13%, respectively. CONCLUSIONS The performance evaluation and comparison of the proposed model confirm the importance and benefits of image noise suppression and transfer of knowledge from heterogeneous datasets of the same domain.
Collapse
Affiliation(s)
- Kwok Tai Chui
- Department of Electronic Engineering and Computer Science, School of Science and Technology, Hong Kong Metropolitan University, Hong Kong, China
| | - Brij B. Gupta
- International Center for AI and Cyber Security Research and Innovations, Department of Computer Science and Information Engineering, Asia University, Taichung 41354, Taiwan
- Research and Innovation Department, Skyline University College, Sharjah P.O. Box 1797, United Arab Emirates
- Department of Computer Science, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
- Lebanese American University, Beirut 1102, Lebanon
| | - Hao Ran Chi
- Instituto de Telecomunicações, 3810-193 Aveiro, Portugal;
| | | | - Wadee Alhalabi
- Department of Computer Science, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
| | - Miguel Torres Ruiz
- Instituto Politécnico Nacional, Centro de Investigacion en Computacion, UPALM-Zacatenco, Mexico City 07320, Mexico;
| | - Chien-Wen Shen
- Department of Business Administration, National Central University, Taoyuan City 320317, Taiwan;
| |
Collapse
|
11
|
Habib M, Ramzan M, Khan SA. A Deep Learning and Handcrafted Based Computationally Intelligent Technique for Effective COVID-19 Detection from X-ray/CT-scan Imaging. JOURNAL OF GRID COMPUTING 2022; 20:23. [PMID: 35874855 PMCID: PMC9294765 DOI: 10.1007/s10723-022-09615-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 06/27/2022] [Indexed: 06/15/2023]
Abstract
The world has witnessed dramatic changes because of the advent of COVID19 in the last few days of 2019. During the last more than two years, COVID-19 has badly affected the world in diverse ways. It has not only affected human health and mortality rate but also the economic condition on a global scale. There is an urgent need today to cope with this pandemic and its diverse effects. Medical imaging has revolutionized the treatment of various diseases during the last four decades. Automated detection and classification systems have proven to be of great assistance to the doctors and scientific community for the treatment of various diseases. In this paper, a novel framework for an efficient COVID-19 classification system is proposed which uses the hybrid feature extraction approach. After preprocessing image data, two types of features i.e., deep learning and handcrafted, are extracted. For Deep learning features, two pre-trained models namely ResNet101 and DenseNet201 are used. Handcrafted features are extracted using Weber Local Descriptor (WLD). The Excitation component of WLD is utilized and features are reduced using DCT. Features are extracted from both models, handcrafted features are fused, and significant features are selected using entropy. Experiments have proven the effectiveness of the proposed model. A comprehensive set of experiments have been performed and results are compared with the existing well-known methods. The proposed technique has performed better in terms of accuracy and time.
Collapse
Affiliation(s)
- Mohammed Habib
- Department of Computer Science, College of Computing and Informatics, Saudi Electronic University, 11673 Riyadh, Saudi Arabia
- Department of Electrical Engineering, Faculty of Engineering, PortSaid University, Port Said, 42526 Egypt
| | - Muhammad Ramzan
- Department of Computer Science, College of Computing and Informatics, Saudi Electronic University, 11673 Riyadh, Saudi Arabia
| | - Sajid Ali Khan
- Department of Software Engineering, Foundation University Islamabad, 44000 Islamabad, Pakistan
| |
Collapse
|
12
|
Hassannataj Joloudari J, Mojrian S, Nodehi I, Mashmool A, Kiani Zadegan Z, Khanjani Shirkharkolaie S, Alizadehsani R, Tamadon T, Khosravi S, Akbari Kohnehshari M, Hassannatajjeloudari E, Sharifrazi D, Mosavi A, Loh HW, Tan RS, Acharya UR. Application of artificial intelligence techniques for automated detection of myocardial infarction: a review. Physiol Meas 2022; 43. [PMID: 35803247 DOI: 10.1088/1361-6579/ac7fd9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Accepted: 07/08/2022] [Indexed: 11/11/2022]
Abstract
Myocardial infarction (MI) results in heart muscle injury due to receiving insufficient blood flow. MI is the most common cause of mortality in middle-aged and elderly individuals worldwide. To diagnose MI, clinicians need to interpret electrocardiography (ECG) signals, which requires expertise and is subject to observer bias. Artificial intelligence-based methods can be utilized to screen for or diagnose MI automatically using ECG signals. In this work, we conducted a comprehensive assessment of artificial intelligence-based approaches for MI detection based on ECG and some other biophysical signals, including machine learning (ML) and deep learning (DL) models. The performance of traditional ML methods relies on handcrafted features and manual selection of ECG signals, whereas DL models can automate these tasks. The review observed that deep convolutional neural networks (DCNNs) yielded excellent classification performance for MI diagnosis, which explains why they have become prevalent in recent years. To our knowledge, this is the first comprehensive survey of artificial intelligence techniques employed for MI diagnosis using ECG and some other biophysical signals.
Collapse
Affiliation(s)
- Javad Hassannataj Joloudari
- Computer Engineering, University of Birjand, South Khorasan Province, Birjand, Iran, Birjand, South Khorasan, 9717434765, Iran (the Islamic Republic of)
| | - Sanaz Mojrian
- Mazandaran University of Science and Technology, Mazandaran Province, Babol, Danesh 5, No. Sheykh Tabarasi, Iran, Babol, 47166-85635, Iran (the Islamic Republic of)
| | - Issa Nodehi
- University of Qom, Qom, shahid khodakaram blvd، Iran, Qom, Qom, 1519-37195, Iran (the Islamic Republic of)
| | - Amir Mashmool
- University of Geneva, Via del Molo, 65, 16128 Genova GE, Italy, Geneva, Geneva, 16121, ITALY
| | - Zeynab Kiani Zadegan
- University of Birjand, South Khorasan Province, Birjand, Iran, Birjand, 9717434765, Iran (the Islamic Republic of)
| | - Sahar Khanjani Shirkharkolaie
- Mazandaran University of Science and Technology, Mazandaran Province, Babol, Danesh 5, No. Sheykh Tabarasi, Iran, Babol, 47166-85635, Iran (the Islamic Republic of)
| | - Roohallah Alizadehsani
- Deakin University - Geelong Waterfront Campus, IISRI, Geelong, Victoria, 3220, AUSTRALIA
| | - Tahereh Tamadon
- University of Birjand, South Khorasan Province, Birjand, Iran, Birjand, 9717434765, Iran (the Islamic Republic of)
| | - Samiyeh Khosravi
- University of Birjand, South Khorasan Province, Birjand, Iran, Birjand, 9717434765, Iran (the Islamic Republic of)
| | - Mitra Akbari Kohnehshari
- Bu Ali Sina University, QFRQ+V8H District 2, Hamedan, Iran, Hamedan, Hamedan, 6516738695, Iran (the Islamic Republic of)
| | - Edris Hassannatajjeloudari
- Maragheh University of Medical Sciences, 87VG+9J6, Maragheh, East Azerbaijan Province, Iran, Maragheh, East Azerbaijan, 55158-78151, Iran (the Islamic Republic of)
| | - Danial Sharifrazi
- Islamic Azad University Shiraz, Shiraz University, Iran, Shiraz, Fars, 74731-71987, Iran (the Islamic Republic of)
| | - Amir Mosavi
- Faculty of Informatics, Obuda University, Faculty of Informatics, Obuda University, Budapest, Hungary, Budapest, 1034, HUNGARY
| | - Hui Wen Loh
- Singapore University of Social Sciences, SG, Clementi Rd, 463, Singapore 599494, Singapore, 599491, SINGAPORE
| | - Ru-San Tan
- Department of Cardiology, National Heart Centre Singapore, 5 Hospital Dr, Singapore 169609, Singapore, 168752, SINGAPORE
| | - U Rajendra Acharya
- Electronic Computer Engineering Division, Ngee Ann Polytechnic, 535 Clementi Road, Singapore 599489, Singapore, 599489, SINGAPORE
| |
Collapse
|
13
|
An MRI Scans-Based Alzheimer's Disease Detection via Convolutional Neural Network and Transfer Learning. Diagnostics (Basel) 2022; 12:diagnostics12071531. [PMID: 35885437 PMCID: PMC9318866 DOI: 10.3390/diagnostics12071531] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 06/20/2022] [Accepted: 06/21/2022] [Indexed: 02/04/2023] Open
Abstract
Alzheimer’s disease (AD) is the most common type (>60%) of dementia and can wreak havoc on the psychological and physiological development of sufferers and their carers, as well as the economic and social development. Attributed to the shortage of medical staff, automatic diagnosis of AD has become more important to relieve the workload of medical staff and increase the accuracy of medical diagnoses. Using the common MRI scans as inputs, an AD detection model has been designed using convolutional neural network (CNN). To enhance the fine-tuning of hyperparameters and, thus, the detection accuracy, transfer learning (TL) is introduced, which brings the domain knowledge from heterogeneous datasets. Generative adversarial network (GAN) is applied to generate additional training data in the minority classes of the benchmark datasets. Performance evaluation and analysis using three benchmark (OASIS-series) datasets revealed the effectiveness of the proposed method, which increases the accuracy of the detection model by 2.85−3.88%, 2.43−2.66%, and 1.8−40.1% in the ablation study of GAN and TL, as well as the comparison with existing works, respectively.
Collapse
|
14
|
Masood S, Khan R, Abd El-Latif AA, Ahmad M. An FCN-LSTM model for neurological status detection from non-invasive multivariate sensor data. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07117-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
15
|
Verma A, Amin SB, Naeem M, Saha M. Detecting COVID-19 from chest computed tomography scans using AI-driven android application. Comput Biol Med 2022; 143:105298. [PMID: 35220076 PMCID: PMC8858433 DOI: 10.1016/j.compbiomed.2022.105298] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 01/01/2022] [Accepted: 01/21/2022] [Indexed: 12/16/2022]
Abstract
The COVID-19 (coronavirus disease 2019) pandemic affected more than 186 million people with over 4 million deaths worldwide by June 2021. The magnitude of which has strained global healthcare systems. Chest Computed Tomography (CT) scans have a potential role in the diagnosis and prognostication of COVID-19. Designing a diagnostic system, which is cost-efficient and convenient to operate on resource-constrained devices like mobile phones would enhance the clinical usage of chest CT scans and provide swift, mobile, and accessible diagnostic capabilities. This work proposes developing a novel Android application that detects COVID-19 infection from chest CT scans using a highly efficient and accurate deep learning algorithm. It further creates an attention heatmap, augmented on the segmented lung parenchyma region in the chest CT scans which shows the regions of infection in the lungs through an algorithm developed as a part of this work, and verified through radiologists. We propose a novel selection approach combined with multi-threading for a faster generation of heatmaps on a Mobile Device, which reduces the processing time by about 93%. The neural network trained to detect COVID-19 in this work is tested with a F1 score and accuracy, both of 99.58% and sensitivity of 99.69%, which is better than most of the results in the domain of COVID diagnosis from CT scans. This work will be beneficial in high-volume practices and help doctors triage patients for the early diagnosis of COVID-19 quickly and efficiently.
Collapse
Affiliation(s)
- Aryan Verma
- Department of Computer Science and Engineering, National Institute of Technology, Hamirpur, HP, 177005, India.
| | - Sagar B Amin
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, GA, 30322, USA.
| | - Muhammad Naeem
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, GA, 30322, USA.
| | - Monjoy Saha
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA, 30322, USA.
| |
Collapse
|
16
|
Xiong P, Lee SMY, Chan G. Deep Learning for Detecting and Locating Myocardial Infarction by Electrocardiogram: A Literature Review. Front Cardiovasc Med 2022; 9:860032. [PMID: 35402563 PMCID: PMC8990170 DOI: 10.3389/fcvm.2022.860032] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Accepted: 02/18/2022] [Indexed: 12/24/2022] Open
Abstract
Myocardial infarction is a common cardiovascular disorder caused by prolonged ischemia, and early diagnosis of myocardial infarction (MI) is critical for lifesaving. ECG is a simple and non-invasive approach in MI detection, localization, diagnosis, and prognosis. Population-based screening with ECG can detect MI early and help prevent it but this method is too labor-intensive and time-consuming to carry out in practice unless artificial intelligence (AI) would be able to reduce the workload. Recent advances in using deep learning (DL) for ECG screening might rekindle this hope. This review aims to take stock of 59 major DL studies applied to the ECG for MI detection and localization published in recent 5 years, covering convolutional neural network (CNN), long short-term memory (LSTM), convolutional recurrent neural network (CRNN), gated recurrent unit (GRU), residual neural network (ResNet), and autoencoder (AE). In this period, CNN obtained the best popularity in both MI detection and localization, and the highest performance has been obtained from CNN and ResNet model. The reported maximum accuracies of the six different methods are all beyond 97%. Considering the usage of different datasets and ECG leads, the network that trained on 12 leads ECG data of PTB database has obtained higher accuracy than that on smaller number leads data of other datasets. In addition, some limitations and challenges of the DL techniques are also discussed in this review.
Collapse
Affiliation(s)
- Ping Xiong
- State Key Laboratory of Quality Research in Chinese Medicine, Institute of Chinese Medical Sciences, University of Macau, Taipa, Macau SAR, China
| | - Simon Ming-Yuen Lee
- State Key Laboratory of Quality Research in Chinese Medicine, Institute of Chinese Medical Sciences, University of Macau, Taipa, Macau SAR, China
| | - Ging Chan
- State Key Laboratory of Quality Research in Chinese Medicine, Institute of Chinese Medical Sciences, University of Macau, Taipa, Macau SAR, China
- Department of Public Health and Medicinal Administration, Faculty of Health Sciences, University of Macau, Taipa, Macau SAR, China
| |
Collapse
|
17
|
Biosensor-Assisted Method for Abdominal Syndrome Classification Using Machine Learning Algorithm. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4454226. [PMID: 35126492 PMCID: PMC8816582 DOI: 10.1155/2022/4454226] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 12/21/2021] [Accepted: 12/28/2021] [Indexed: 12/29/2022]
Abstract
The digestive system is one of the essential systems in human physiology where the stomach has a significant part to play with its accessories like the esophagus, duodenum, small intestines, and large intestinal tract. Many individuals across the globe suffer from gastric dysrhythmia in combination with dyspepsia (improper digestion), unexplained nausea (feeling), vomiting, abdominal discomfort, ulcer of the stomach, and gastroesophageal reflux illnesses. Some of the techniques used to identify anomalies include clinical analysis, endoscopy, electrogastrogram, and imaging. Electrogastrogram is the registration of electrical impulses that pass through the stomach muscles and regulate the contraction of the muscle. The electrode senses the electrical impulses from the stomach muscles, and the electrogastrogram is recorded. A computer analyzes the captured electrogastrogram (EGG) signals. The usual electric rhythm produces an enhanced current in the typical stomach muscle after a meal. Postmeal electrical rhythm is abnormal in those with stomach muscles or nerve anomalies. This study considers EGG of ordinary individuals, bradycardia, dyspepsia, nausea, tachycardia, ulcer, and vomiting for analysis. Data are collected in collaboration with the doctor for preprandial and postprandial conditions for people with diseases and everyday individuals. In CWT with a genetic algorithm, db4 is utilized to obtain an EGG signal wave pattern in a 3D plot using MATLAB. The figure shows that the existence of the peak reflects the EGG signal cycle. The number of present peaks categorizes EGG. Adaptive Resonance Classifier Network (ARCN) is utilized to identify EGG signals as normal or abnormal subjects, depending on the parameter of alertness (μ). This study may be used as a medical tool to diagnose digestive system problems before proposing invasive treatments. Accuracy of the proposed work comes up with 95.45%, and sensitivity and specificity range is added as 92.45% and 87.12%.
Collapse
|
18
|
Zhang H, Zhang H. LungSeek: 3D Selective Kernel residual network for pulmonary nodule diagnosis. THE VISUAL COMPUTER 2022; 39:679-692. [PMID: 35103029 PMCID: PMC8792456 DOI: 10.1007/s00371-021-02366-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 11/17/2021] [Indexed: 06/14/2023]
Abstract
Early detection and diagnosis of pulmonary nodules is the most promising way to improve the survival chances of lung cancer patients. This paper proposes an automatic pulmonary cancer diagnosis system, LungSeek. LungSeek is mainly divided into two modules: (1) Nodule detection, which detects all suspicious nodules from computed tomography (CT) scan; (2) Nodule Classification, classifies nodules as benign or malignant. Specifically, a 3D Selective Kernel residual network (SK-ResNet) based on the Selective Kernel Network and 3D residual network is located. A deep 3D region proposal network with SK-ResNet is designed for detection of pulmonary nodules while a multi-scale feature fusion network is designed for the nodule classification. Both networks use the SK-Net module to obtain different receptive field information, thereby effectively learning nodule features and improving diagnostic performance. Our method has been verified on the luna16 data set, reaching 89.06, 94.53% and 97.72% when the average number of false positives is 1, 2 and 4, respectively. Meanwhile, its performance is better than the state-of-the-art method and other similar networks and experienced doctors. This method has the ability to adaptively adjust the receptive field according to multiple scales of the input information, so as to better detect nodules of various sizes. The framework of LungSeek based on 3D SK-ResNet is proposed for nodule detection and nodule classification from chest CT. Our experimental results demonstrate the effectiveness of the proposed method in the diagnosis of pulmonary nodules.
Collapse
Affiliation(s)
- Haowan Zhang
- College of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, 430081 China
- Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System, Wuhan, China
| | - Hong Zhang
- College of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, 430081 China
- Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System, Wuhan, China
| |
Collapse
|
19
|
RDPVR: Random Data Partitioning with Voting Rule for Machine Learning from Class-Imbalanced Datasets. ELECTRONICS 2022. [DOI: 10.3390/electronics11020228] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Since most classifiers are biased toward the dominant class, class imbalance is a challenging problem in machine learning. The most popular approaches to solving this problem include oversampling minority examples and undersampling majority examples. Oversampling may increase the probability of overfitting, whereas undersampling eliminates examples that may be crucial to the learning process. We present a linear time resampling method based on random data partitioning and a majority voting rule to address both concerns, where an imbalanced dataset is partitioned into a number of small subdatasets, each of which must be class balanced. After that, a specific classifier is trained for each subdataset, and the final classification result is established by applying the majority voting rule to the results of all of the trained models. We compared the performance of the proposed method to some of the most well-known oversampling and undersampling methods, employing a range of classifiers, on 33 benchmark machine learning class-imbalanced datasets. The classification results produced by the classifiers employed on the generated data by the proposed method were comparable to most of the resampling methods tested, with the exception of SMOTEFUNA, which is an oversampling method that increases the probability of overfitting. The proposed method produced results that were comparable to the Easy Ensemble (EE) undersampling method. As a result, for solving the challenge of machine learning from class-imbalanced datasets, we advocate using either EE or our method.
Collapse
|
20
|
An Integrated Approach for Cancer Survival Prediction Using Data Mining Techniques. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2021:6342226. [PMID: 34992648 PMCID: PMC8727098 DOI: 10.1155/2021/6342226] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 11/27/2021] [Indexed: 12/31/2022]
Abstract
Ovarian cancer is the third most common gynecologic cancers worldwide. Advanced ovarian cancer patients bear a significant mortality rate. Survival estimation is essential for clinicians and patients to understand better and tolerate future outcomes. The present study intends to investigate different survival predictors available for cancer prognosis using data mining techniques. Dataset of 140 advanced ovarian cancer patients containing data from different data profiles (clinical, treatment, and overall life quality) has been collected and used to foresee cancer patients' survival. Attributes from each data profile have been processed accordingly. Clinical data has been prepared corresponding to missing values and outliers. Treatment data including varying time periods were created using sequence mining techniques to identify the treatments given to the patients. And lastly, different comorbidities were combined into a single factor by computing Charlson Comorbidity Index for each patient. After appropriate preprocessing, the integrated dataset is classified using appropriate machine learning algorithms. The proposed integrated model approach gave the highest accuracy of 76.4% using ensemble technique with sequential pattern mining including time intervals of 2 months between treatments. Thus, the treatment sequences and, most importantly, life quality attributes significantly contribute to the survival prediction of cancer patients.
Collapse
|
21
|
Chiang TA, Che ZH, Huang YL, Tsai CY. Using an Ontology-Based Neural Network and DEA to Discover Deficiencies of Hotel Services. INT J SEMANT WEB INF 2022. [DOI: 10.4018/ijswis.306748] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Companies can gain critical real-time insights into customer requirements and service evaluation by mining social media. To acquire the service performance and improve the service deficiencies for hotels, this research proposes a benchmark-based performance evaluation model for hotel service to enable hotel managers to assess the service performance. In the case of non-benchmark service hotels, the identification and improvement model for non-benchmark criteria can recognize and analyze the required quantities of performance improvements for non-benchmark criteria. For understanding the causes of service deficiencies, this research mines the online posts and creates a hierarchical ontology of service deficiencies for hotels. A hierarchical ontology-based neural network is proposed to automatically identify the causes of service deficiencies. This study employs an online forum as a case to achieve the identification accuracy of causes of service deficiencies of 92.68%. The analytical result can demonstrate the significant effectiveness and practical value of the proposed methodology.
Collapse
Affiliation(s)
| | - Z. H. Che
- National Taipei University of Technology, Taiwan
| | - Yi-Ling Huang
- Universal Global Scientific Industrial Co., Ltd., Taiwan
| | | |
Collapse
|
22
|
Wang YW, Chen CJ, Wang TC, Huang HC, Chen HM, Shih JY, Chen JS, Huang YS, Chang YC, Chang RF. Multi-energy level fusion for nodal metastasis classification of primary lung tumor on dual energy CT using deep learning. Comput Biol Med 2021; 141:105185. [PMID: 34986453 DOI: 10.1016/j.compbiomed.2021.105185] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 12/25/2021] [Accepted: 12/26/2021] [Indexed: 11/03/2022]
Abstract
Lymph node metastasis also called nodal metastasis (Nmet), is a clinically primary task for physicians. The survival and recurrence of lung cancer are related to the Nmet staging from Tumor-Node-Metastasis (TNM) reports. Furthermore, preoperative Nmet prediction is still a challenge for the patient in managing the surgical plan and making treatment decisions. We proposed a multi-energy level fusion model with a principal feature enhancement (PFE) block incorporating radiologist and computer science knowledge for Nmet prediction. The proposed model is custom-designed by gemstone spectral imaging (GSI) with different energy levels on dual-energy computer tomography (CT) from a primary tumor of lung cancer. In the experiment, we take three different energy level fusion datasets: lower energy level fusion (40, 50, 60, 70 keV), higher energy level fusion (110, 120, 130, 140 keV), and average energy level fusion (40, 70, 100, 140 keV). The proposed model is trained by lower energy level fusion that is 93% accurate and the value of Kappa is 86%. When we used the lower energy level images to train the fusion model, there has been a significant difference to other energy level fusion models. Hence, we apply 5-fold cross-validation, which is used to validate the performance result of the multi-keV model with different fusion datasets of energy level images in the pathology report. The cross-validation result also demonstrates that the model with the lower energy level dataset is more robust and suitable in predicting the Nmet of the primary tumor. The lower energy level shows more information of tumor angiogenesis or heterogeneity provided the proposed fusion model with a PFE block and channel attention blocks to predict Nmet from primary tumors.
Collapse
Affiliation(s)
- You-Wei Wang
- Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
| | - Chii-Jen Chen
- Department of Medical Imaging and Radiological Technology, Yuanpei University of Medical Technology, Hsinchu, Taiwan
| | - Teh-Chen Wang
- Department of Medical Imaging, Taipei City Hospital, Yangming Branch, Taipei, Taiwan
| | - Hsu-Cheng Huang
- Department of Medical Imaging, Taipei City Hospital, Yangming Branch, Taipei, Taiwan
| | - Hsin-Ming Chen
- Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan
| | - Jin-Yuan Shih
- Department of Internal Medicine, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan
| | - Jin-Shing Chen
- Department of Surgery, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan
| | - Yu-Sen Huang
- Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan
| | - Yeun-Chung Chang
- Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan.
| | - Ruey-Feng Chang
- Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan.
| |
Collapse
|
23
|
Arshad M, Khan MA, Tariq U, Armghan A, Alenezi F, Younus Javed M, Aslam SM, Kadry S. A Computer-Aided Diagnosis System Using Deep Learning for Multiclass Skin Lesion Classification. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:9619079. [PMID: 34912449 PMCID: PMC8668359 DOI: 10.1155/2021/9619079] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Revised: 10/28/2021] [Accepted: 11/10/2021] [Indexed: 11/28/2022]
Abstract
In the USA, each year, almost 5.4 million people are diagnosed with skin cancer. Melanoma is one of the most dangerous types of skin cancer, and its survival rate is 5%. The development of skin cancer has risen over the last couple of years. Early identification of skin cancer can help reduce the human mortality rate. Dermoscopy is a technology used for the acquisition of skin images. However, the manual inspection process consumes more time and required much cost. The recent development in the area of deep learning showed significant performance for classification tasks. In this research work, a new automated framework is proposed for multiclass skin lesion classification. The proposed framework consists of a series of steps. In the first step, augmentation is performed. For the augmentation process, three operations are performed: rotate 90, right-left flip, and up and down flip. In the second step, deep models are fine-tuned. Two models are opted, such as ResNet-50 and ResNet-101, and updated their layers. In the third step, transfer learning is applied to train both fine-tuned deep models on augmented datasets. In the succeeding stage, features are extracted and performed fusion using a modified serial-based approach. Finally, the fused vector is further enhanced by selecting the best features using the skewness-controlled SVR approach. The final selected features are classified using several machine learning algorithms and selected based on the accuracy value. In the experimental process, the augmented HAM10000 dataset is used and achieved an accuracy of 91.7%. Moreover, the performance of the augmented dataset is better as compared to the original imbalanced dataset. In addition, the proposed method is compared with some recent studies and shows improved performance.
Collapse
Affiliation(s)
- Mehak Arshad
- Department of Computer Science, HITEC University Taxila, Taxila, Pakistan
| | | | - Usman Tariq
- College of Computer Engineering and Science, Prince Sattam Bin Abdulaziz University, Al-Kharaj, Saudi Arabia
| | - Ammar Armghan
- Department of Electrical Engineering, Jouf University, Sakaka 75471, Saudi Arabia
| | - Fayadh Alenezi
- Department of Electrical Engineering, Jouf University, Sakaka 75471, Saudi Arabia
| | | | - Shabnam Mohamed Aslam
- Department of Information Technology, College of Computer and Information Sciences, Majmaah University, Al-Majmaah 11952, Saudi Arabia
| | - Seifedine Kadry
- Faculty of Applied Computing and Technology, Noroff University College, Kristiansand, Norway
| |
Collapse
|
24
|
A Smart Healthcare Recommendation System for Multidisciplinary Diabetes Patients with Data Fusion Based on Deep Ensemble Learning. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:4243700. [PMID: 34567101 PMCID: PMC8463188 DOI: 10.1155/2021/4243700] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Revised: 07/09/2021] [Accepted: 09/06/2021] [Indexed: 12/12/2022]
Abstract
The prediction of human diseases precisely is still an uphill battle task for better and timely treatment. A multidisciplinary diabetic disease is a life-threatening disease all over the world. It attacks different vital parts of the human body, like Neuropathy, Retinopathy, Nephropathy, and ultimately Heart. A smart healthcare recommendation system predicts and recommends the diabetic disease accurately using optimal machine learning models with the data fusion technique on healthcare datasets. Various machine learning models and methods have been proposed in the recent past to predict diabetes disease. Still, these systems cannot handle the massive number of multifeatures datasets on diabetes disease properly. A smart healthcare recommendation system is proposed for diabetes disease based on deep machine learning and data fusion perspectives. Using data fusion, we can eliminate the irrelevant burden of system computational capabilities and increase the proposed system's performance to predict and recommend this life-threatening disease more accurately. Finally, the ensemble machine learning model is trained for diabetes prediction. This intelligent recommendation system is evaluated based on a well-known diabetes dataset, and its performance is compared with the most recent developments from the literature. The proposed system achieved 99.6% accuracy, which is higher compared to the existing deep machine learning methods. Therefore, our proposed system is better for multidisciplinary diabetes disease prediction and recommendation. Our proposed system's improved disease diagnosis performance advocates for its employment in the automated diagnostic and recommendation systems for diabetic patients.
Collapse
|
25
|
A novel bio-inspired hybrid multi-filter wrapper gene selection method with ensemble classifier for microarray data. Neural Comput Appl 2021; 35:11531-11561. [PMID: 34539088 PMCID: PMC8435304 DOI: 10.1007/s00521-021-06459-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Accepted: 08/26/2021] [Indexed: 01/04/2023]
Abstract
Microarray technology is known as one of the most important tools for collecting DNA expression data. This technology allows researchers to investigate and examine types of diseases and their origins. However, microarray data are often associated with a small sample size, a significant number of genes, imbalanced data, etc., making classification models inefficient. Thus, a new hybrid solution based on a multi-filter and adaptive chaotic multi-objective forest optimization algorithm (AC-MOFOA) is presented to solve the gene selection problem and construct the Ensemble Classifier. In the proposed solution, a multi-filter model (i.e., ensemble filter) is proposed as preprocessing step to reduce the dataset's dimensions, using a combination of five filter methods to remove redundant and irrelevant genes. Accordingly, the results of the five filter methods are combined using a voting-based function. Additionally, the results of the proposed multi-filter indicate that it has good capability in reducing the gene subset size and selecting relevant genes. Then, an AC-MOFOA based on the concepts of non-dominated sorting, crowding distance, chaos theory, and adaptive operators is presented. AC-MOFOA as a wrapper method aimed at reducing dataset dimensions, optimizing KELM, and increasing the accuracy of the classification, simultaneously. Next, in this method, an ensemble classifier model is presented using AC-MOFOA results to classify microarray data. The performance of the proposed algorithm was evaluated on nine public microarray datasets, and its results were compared in terms of the number of selected genes, classification efficiency, execution time, time complexity, hypervolume indicator, and spacing metric with five hybrid multi-objective methods, and three hybrid single-objective methods. According to the results, the proposed hybrid method could increase the accuracy of the KELM in most datasets by reducing the dataset's dimensions and achieve similar or superior performance compared to other multi-objective methods. Furthermore, the proposed Ensemble Classifier model could provide better classification accuracy and generalizability in the seven of nine microarray datasets compared to conventional ensemble methods. Moreover, the comparison results of the Ensemble Classifier model with three state-of-the-art ensemble generation methods indicate its competitive performance in which the proposed ensemble model achieved better results in the five of nine datasets.
Collapse
|
26
|
Tan L, Yu K, Bashir AK, Cheng X, Ming F, Zhao L, Zhou X. Toward real-time and efficient cardiovascular monitoring for COVID-19 patients by 5G-enabled wearable medical devices: a deep learning approach. Neural Comput Appl 2021; 35:13921-13934. [PMID: 34248288 PMCID: PMC8255093 DOI: 10.1007/s00521-021-06219-9] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Accepted: 06/08/2021] [Indexed: 12/27/2022]
Abstract
Patients with deaths from COVID-19 often have co-morbid cardiovascular disease. Real-time cardiovascular disease monitoring based on wearable medical devices may effectively reduce COVID-19 mortality rates. However, due to technical limitations, there are three main issues. First, the traditional wireless communication technology for wearable medical devices is difficult to satisfy the real-time requirements fully. Second, current monitoring platforms lack efficient streaming data processing mechanisms to cope with the large amount of cardiovascular data generated in real time. Third, the diagnosis of the monitoring platform is usually manual, which is challenging to ensure that enough doctors online to provide a timely, efficient, and accurate diagnosis. To address these issues, this paper proposes a 5G-enabled real-time cardiovascular monitoring system for COVID-19 patients using deep learning. Firstly, we employ 5G to send and receive data from wearable medical devices. Secondly, Flink streaming data processing framework is applied to access electrocardiogram data. Finally, we use convolutional neural networks and long short-term memory networks model to obtain automatically predict the COVID-19 patient's cardiovascular health. Theoretical analysis and experimental results show that our proposal can well solve the above issues and improve the prediction accuracy of cardiovascular disease to 99.29%.
Collapse
Affiliation(s)
- Liang Tan
- College of Computer Science, Sichuan Normal University, Chengdu, 610101 China
- China and Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190 China
| | - Keping Yu
- Global Information and Telecommunication Institute, Waseda University, Tokyo, Japan
| | - Ali Kashif Bashir
- Department of Computing and Mathematics, Manchester Metropolitan University, Manchester, UK
- School of Information and Communication Engineering, University of Electronics Science and Technology of China (UESTC), Chengdu, China
| | - Xiaofan Cheng
- College of Computer Science, Sichuan Normal University, Chengdu, 610101 China
| | - Fangpeng Ming
- College of Computer Science, Sichuan Normal University, Chengdu, 610101 China
| | - Liang Zhao
- School of Computer Science, Shenyang Aerospace University, Shenyang, 110136 China
| | - Xiaokang Zhou
- Faculty of Data Science, Shiga University, Hikone, and RIKEN Center for Advanced Intelligence Project, Tokyo, Japan
| |
Collapse
|