1
|
Laffafchi S, Ebrahimi A, Kafan S. Efficient management of pulmonary embolism diagnosis using a two-step interconnected machine learning model based on electronic health records data. Health Inf Sci Syst 2024; 12:17. [PMID: 38464464 PMCID: PMC10917730 DOI: 10.1007/s13755-024-00276-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 01/17/2024] [Indexed: 03/12/2024] Open
Abstract
Pulmonary Embolism (PE) is a life-threatening clinical disease with no specific clinical symptoms and Computed Tomography Angiography (CTA) is used for diagnosis. Clinical decision support scoring systems like Wells and rGeneva based on PE risk factors have been developed to estimate the pre-test probability but are underused, leading to continuous overuse of CTA imaging. This diagnostic study aimed to propose a novel approach for efficient management of PE diagnosis using a two-step interconnected machine learning framework directly by analyzing patients' Electronic Health Records data. First, we performed feature importance analysis according to the result of LightGBM superiority for PE prediction, then four state-of-the-art machine learning methods were applied for PE prediction based on the feature importance results, enabling swift and accurate pre-test diagnosis. Throughout the study patients' data from different departments were collected from Sina educational hospital, affiliated with the Tehran University of medical sciences in Iran. Generally, the Ridge classification method obtained the best performance with an F1 score of 0.96. Extensive experimental findings showed the effectiveness and simplicity of this diagnostic process of PE in comparison with the existing scoring systems. The main strength of this approach centered on PE disease management procedures, which would reduce avoidable invasive CTA imaging and be applied as a primary prognosis of PE, hence assisting the healthcare system, clinicians, and patients by reducing costs and promoting treatment quality and patient satisfaction.
Collapse
Affiliation(s)
- Soroor Laffafchi
- Department of Business Administration and Entrepreneurship, Faculty of Management and Economics, Science and Research Branch, Islamic Azad University, Daneshgah Blvd, Simon Bulivar Blvd, Tehran, Iran
| | - Ahmad Ebrahimi
- Department of Industrial and Technology Management, Faculty of Management and Economics, Science and Research Branch, Islamic Azad University, Daneshgah Blvd, Simon Bulivar Blvd, Tehran, Iran
| | - Samira Kafan
- Department of Pulmonary Medicine, Sina Hospital, International Relations Office, Medical School, Tehran University of Medical Sciences, PourSina St., Tehran, 1417613151 Iran
| |
Collapse
|
2
|
Wang J, Chen Z. Factor-GAN: Enhancing stock price prediction and factor investment with Generative Adversarial Networks. PLoS One 2024; 19:e0306094. [PMID: 38917175 PMCID: PMC11198854 DOI: 10.1371/journal.pone.0306094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 06/11/2024] [Indexed: 06/27/2024] Open
Abstract
Deep learning, a pivotal branch of artificial intelligence, has increasingly influenced the financial domain with its advanced data processing capabilities. This paper introduces Factor-GAN, an innovative framework that utilizes Generative Adversarial Networks (GAN) technology for factor investing. Leveraging a comprehensive factor database comprising 70 firm characteristics, Factor-GAN integrates deep learning techniques with the multi-factor pricing model, thereby elevating the precision and stability of investment strategies. To explain the economic mechanisms underlying deep learning, we conduct a subsample analysis of the Chinese stock market. The findings reveal that the deep learning-based pricing model significantly enhances return prediction accuracy and factor investment performance in comparison to linear models. Particularly noteworthy is the superior performance of the long-short portfolio under Factor-GAN, demonstrating an annualized return of 23.52% with a Sharpe ratio of 1.29. During the transition from state-owned enterprises (SOEs) to non-SOEs, our study discerns shifts in factor importance, with liquidity and volatility gaining significance while fundamental indicators diminish. Additionally, A-share listed companies display a heightened emphasis on momentum and growth indicators relative to their dual-listed counterparts. This research holds profound implications for the expansion of explainable artificial intelligence research and the exploration of financial technology applications.
Collapse
Affiliation(s)
- Jiawei Wang
- School of Finance, Shanghai University of Finance and Economics, Shanghai, China
| | - Zhen Chen
- School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
3
|
Talib MA, Afadar Y, Nasir Q, Nassif AB, Hijazi H, Hasasneh A. A tree-based explainable AI model for early detection of Covid-19 using physiological data. BMC Med Inform Decis Mak 2024; 24:179. [PMID: 38915001 PMCID: PMC11194929 DOI: 10.1186/s12911-024-02576-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 06/13/2024] [Indexed: 06/26/2024] Open
Abstract
With the outbreak of COVID-19 in 2020, countries worldwide faced significant concerns and challenges. Various studies have emerged utilizing Artificial Intelligence (AI) and Data Science techniques for disease detection. Although COVID-19 cases have declined, there are still cases and deaths around the world. Therefore, early detection of COVID-19 before the onset of symptoms has become crucial in reducing its extensive impact. Fortunately, wearable devices such as smartwatches have proven to be valuable sources of physiological data, including Heart Rate (HR) and sleep quality, enabling the detection of inflammatory diseases. In this study, we utilize an already-existing dataset that includes individual step counts and heart rate data to predict the probability of COVID-19 infection before the onset of symptoms. We train three main model architectures: the Gradient Boosting classifier (GB), CatBoost trees, and TabNet classifier to analyze the physiological data and compare their respective performances. We also add an interpretability layer to our best-performing model, which clarifies prediction results and allows a detailed assessment of effectiveness. Moreover, we created a private dataset by gathering physiological data from Fitbit devices to guarantee reliability and avoid bias.The identical set of models was then applied to this private dataset using the same pre-trained models, and the results were documented. Using the CatBoost tree-based method, our best-performing model outperformed previous studies with an accuracy rate of 85% on the publicly available dataset. Furthermore, this identical pre-trained CatBoost model produced an accuracy of 81% when applied to the private dataset. You will find the source code in the link: https://github.com/OpenUAE-LAB/Covid-19-detection-using-Wearable-data.git .
Collapse
Affiliation(s)
- Manar Abu Talib
- Department of Computer Science, College of Computing and Informatics, University of Sharjah, P.O. Box 27272, Sharjah, UAE.
| | - Yaman Afadar
- Department of Computer Engineering, College of Computing and Informatics, University of Sharjah, Sharjah, UAE
| | - Qassim Nasir
- Department of Computer Engineering, College of Computing and Informatics, University of Sharjah, Sharjah, UAE
| | - Ali Bou Nassif
- Department of Computer Engineering, College of Computing and Informatics, University of Sharjah, Sharjah, UAE
| | - Haytham Hijazi
- Centre for Informatics and Systems of the University of Coimbra (CISUC), University of Coimbra, Coimbra, P-3030-290, Portugal
- Intelligent Systems Department, Ahliya University, Bethlehem, P-150-199, Palestine
| | - Ahmad Hasasneh
- Department of Natural, Engineering and Technology Sciences, Faculty of Graduate Studies, Arab American University, P.O. Box 240, Ramallah, Palestine
| |
Collapse
|
4
|
Rashid PQ, Türker İ. Lung Disease Detection Using U-Net Feature Extractor Cascaded by Graph Convolutional Network. Diagnostics (Basel) 2024; 14:1313. [PMID: 38928728 PMCID: PMC11202625 DOI: 10.3390/diagnostics14121313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Revised: 06/17/2024] [Accepted: 06/18/2024] [Indexed: 06/28/2024] Open
Abstract
Computed tomography (CT) scans have recently emerged as a major technique for the fast diagnosis of lung diseases via image classification techniques. In this study, we propose a method for the diagnosis of COVID-19 disease with improved accuracy by utilizing graph convolutional networks (GCN) at various layer formations and kernel sizes to extract features from CT scan images. We apply a U-Net model to aid in segmentation and feature extraction. In contrast with previous research retrieving deep features from convolutional filters and pooling layers, which fail to fully consider the spatial connectivity of the nodes, we employ GCNs for classification and prediction to capture spatial connectivity patterns, which provides a significant association benefit. We handle the extracted deep features to form an adjacency matrix that contains a graph structure and pass it to a GCN along with the original image graph and the largest kernel graph. We combine these graphs to form one block of the graph input and then pass it through a GCN with an additional dropout layer to avoid overfitting. Our findings show that the suggested framework, called the feature-extracted graph convolutional network (FGCN), performs better in identifying lung diseases compared to recently proposed deep learning architectures that are not based on graph representations. The proposed model also outperforms a variety of transfer learning models commonly used for medical diagnosis tasks, highlighting the abstraction potential of the graph representation over traditional methods.
Collapse
Affiliation(s)
| | - İlker Türker
- Department of Computer Engineering, Karabuk University, 78050 Karabuk, Turkey;
| |
Collapse
|
5
|
Wang L, Wang Q, Wang X, Ma Y, Zhang L, Liu M. Triplet-constrained deep hashing for chest X-ray image retrieval in COVID-19 assessment. Neural Netw 2024; 173:106182. [PMID: 38387203 DOI: 10.1016/j.neunet.2024.106182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Revised: 01/15/2024] [Accepted: 02/15/2024] [Indexed: 02/24/2024]
Abstract
Radiology images of the chest, such as computer tomography scans and X-rays, have been prominently used in computer-aided COVID-19 analysis. Learning-based radiology image retrieval has attracted increasing attention recently, which generally involves image feature extraction and finding matches in extensive image databases based on query images. Many deep hashing methods have been developed for chest radiology image search due to the high efficiency of retrieval using hash codes. However, they often overlook the complex triple associations between images; that is, images belonging to the same category tend to share similar characteristics and vice versa. To this end, we develop a triplet-constrained deep hashing (TCDH) framework for chest radiology image retrieval to facilitate automated analysis of COVID-19. The TCDH consists of two phases, including (a) feature extraction and (b) image retrieval. For feature extraction, we have introduced a triplet constraint and an image reconstruction task to enhance discriminative ability of learned features, and these features are then converted into binary hash codes to capture semantic information. Specifically, the triplet constraint is designed to pull closer samples within the same category and push apart samples from different categories. Additionally, an auxiliary image reconstruction task is employed during feature extraction to help effectively capture anatomical structures of images. For image retrieval, we utilize learned hash codes to conduct searches for medical images. Extensive experiments on 30,386 chest X-ray images demonstrate the superiority of the proposed method over several state-of-the-art approaches in automated image search. The code is now available online.
Collapse
Affiliation(s)
- Linmin Wang
- School of Mathematics Science, Liaocheng University, Liaocheng, Shandong, 252000, China
| | - Qianqian Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Xiaochuan Wang
- School of Mathematics Science, Liaocheng University, Liaocheng, Shandong, 252000, China
| | - Yunling Ma
- School of Mathematics Science, Liaocheng University, Liaocheng, Shandong, 252000, China
| | - Limei Zhang
- School of Computer Science and Technology, Shandong Jianzhu University, Jinan, Shandong, 250101, China.
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA.
| |
Collapse
|
6
|
Price BS, Khodaverdi M, Hendricks B, Smith GS, Kimble W, Halasz A, Guthrie S, Fraustino JD, Hodder SL. Enhanced SARS-CoV-2 case prediction using public health data and machine learning models. JAMIA Open 2024; 7:ooae014. [PMID: 38444986 PMCID: PMC10913390 DOI: 10.1093/jamiaopen/ooae014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 01/29/2024] [Accepted: 02/08/2024] [Indexed: 03/07/2024] Open
Abstract
Objectives The goal of this study is to propose and test a scalable framework for machine learning (ML) algorithms to predict near-term severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) cases by incorporating and evaluating the impact of real-time dynamic public health data. Materials and Methods Data used in this study include patient-level results, procurement, and location information of all SARS-CoV-2 tests reported in West Virginia as part of their mandatory reporting system from January 2021 to March 2022. We propose a method for incorporating and comparing widely available public health metrics inside of a ML framework, specifically a long-short-term memory network, to forecast SARS-CoV-2 cases across various feature sets. Results Our approach provides better prediction of localized case counts and indicates the impact of the dynamic elements of the pandemic on predictions, such as the influence of the mixture of viral variants in the population and variable testing and vaccination rates during various eras of the pandemic. Discussion Utilizing real-time public health metrics, including estimated Rt from multiple SARS-CoV-2 variants, vaccination rates, and testing information, provided a significant increase in the accuracy of the model during the Omicron and Delta period, thus providing more precise forecasting of daily case counts at the county level. This work provides insights on the influence of various features on predictive performance in rural and non-rural areas. Conclusion Our proposed framework incorporates available public health metrics with operational data on the impact of testing, vaccination, and current viral variant mixtures in the population to provide a foundation for combining dynamic public health metrics and ML models to deliver forecasting and insights in healthcare domains. It also shows the importance of developing and deploying ML frameworks in rural settings.
Collapse
Affiliation(s)
- Bradley S Price
- Department of Management Information Systems, West Virginia University, Morgantown, WV 26505, United States
- West Virginia Clinical and Translational Science Institute, Morgantown, WV 26506, United States
| | - Maryam Khodaverdi
- West Virginia Clinical and Translational Science Institute, Morgantown, WV 26506, United States
| | - Brian Hendricks
- West Virginia Clinical and Translational Science Institute, Morgantown, WV 26506, United States
- Department of Epidemiology and Biostatistics, West Virginia University, Morgantown, WV 26505, United States
| | - Gordon S Smith
- West Virginia Clinical and Translational Science Institute, Morgantown, WV 26506, United States
- Department of Epidemiology and Biostatistics, West Virginia University, Morgantown, WV 26505, United States
| | - Wes Kimble
- West Virginia Clinical and Translational Science Institute, Morgantown, WV 26506, United States
| | - Adam Halasz
- School of Mathematics and Data Science, West Virginia University, Morgantown, WV 26506, United States
| | - Sara Guthrie
- Department of Sociology and Anthropology, West Virginia University, Morgantown, WV 26505, United States
| | - Julia D Fraustino
- Department of Strategic Communication, Reed College of Media, West Virginia University, Morgantown, WV 26505, United States
| | - Sally L Hodder
- West Virginia Clinical and Translational Science Institute, Morgantown, WV 26506, United States
- Department of Medicine, West Virginia University, Morgantown, WV 26506, United States
| |
Collapse
|
7
|
Veluchamy S, Sudharson S, Annamalai R, Bassfar Z, Aljaedi A, Jamal SS. Automated Detection of COVID-19 from Multimodal Imaging Data Using Optimized Convolutional Neural Network Model. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01077-y. [PMID: 38499705 DOI: 10.1007/s10278-024-01077-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 12/19/2023] [Accepted: 01/14/2024] [Indexed: 03/20/2024]
Abstract
The incidence of COVID-19, a virus that is responsible for infections in the upper respiratory tract and lungs, witnessed a daily rise in fatalities throughout the pandemic. The timely identification of COVID-19 can contribute to the formulation of strategies to control the disease and the selection of an appropriate treatment pathway. Given the necessity for broader COVID-19 diagnosis, researchers have developed more advanced, rapid, and efficient detection methods. By conducting an initial comparative analysis of various widely used convolutional neural network (CNN) models, we determine an appropriate CNN model. Subsequently, we enhance the chosen CNN model using the feature fusion strategy from multi-modal imaging datasets. Moreover, the Jaya optimization technique is employed to determine the optimal weighting for merging these dual features into a single feature vector. An SVM classifier is employed to categorize samples as either COVID-19 positive or negative. For the purpose of experimentation, a standard dataset consisting of 10,000 samples is used, divided equally between COVID-19 positive and negative classes. The experimental outcomes demonstrate that the proposed fine-tuned system, coupled with optimization techniques for multi-modal data, exhibits superior performance, achieving accuracy rates of 98.7% as compared to the existing state-of-the-art network models.
Collapse
Affiliation(s)
- S Veluchamy
- Department of Computer Science and Engineering, Amrita School of Computing, Amrita Vishwa Vidyapeetham, Chennai, 601103, India
| | - S Sudharson
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, 600127, India.
| | - R Annamalai
- Department of Computer Science and Engineering, Amrita School of Computing, Amrita Vishwa Vidyapeetham, Chennai, 601103, India
| | - Zaid Bassfar
- Department of Information Technology, University of Tabuk, Tabuk, 71491, Saudi Arabia
| | - Amer Aljaedi
- College of Computing and Information Technology, University of Tabuk, Tabuk, 71491, Saudi Arabia
| | - Sajjad Shaukat Jamal
- Department of Mathematics, College of Science, King Khalid University, Abha, 61413, Saudi Arabia
| |
Collapse
|
8
|
Chatterjee S, Saad F, Sarasaen C, Ghosh S, Krug V, Khatun R, Mishra R, Desai N, Radeva P, Rose G, Stober S, Speck O, Nürnberger A. Exploration of Interpretability Techniques for Deep COVID-19 Classification Using Chest X-ray Images. J Imaging 2024; 10:45. [PMID: 38392093 PMCID: PMC10889835 DOI: 10.3390/jimaging10020045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 01/24/2024] [Accepted: 02/05/2024] [Indexed: 02/24/2024] Open
Abstract
The outbreak of COVID-19 has shocked the entire world with its fairly rapid spread, and has challenged different sectors. One of the most effective ways to limit its spread is the early and accurate diagnosing of infected patients. Medical imaging, such as X-ray and computed tomography (CT), combined with the potential of artificial intelligence (AI), plays an essential role in supporting medical personnel in the diagnosis process. Thus, in this article, five different deep learning models (ResNet18, ResNet34, InceptionV3, InceptionResNetV2, and DenseNet161) and their ensemble, using majority voting, have been used to classify COVID-19, pneumoniæ and healthy subjects using chest X-ray images. Multilabel classification was performed to predict multiple pathologies for each patient, if present. Firstly, the interpretability of each of the networks was thoroughly studied using local interpretability methods-occlusion, saliency, input X gradient, guided backpropagation, integrated gradients, and DeepLIFT-and using a global technique-neuron activation profiles. The mean micro F1 score of the models for COVID-19 classifications ranged from 0.66 to 0.875, and was 0.89 for the ensemble of the network models. The qualitative results showed that the ResNets were the most interpretable models. This research demonstrates the importance of using interpretability methods to compare different models before making a decision regarding the best performing model.
Collapse
Affiliation(s)
- Soumick Chatterjee
- Data and Knowledge Engineering Group, Otto von Guericke University, 39106 Magdeburg, Germany
- Faculty of Computer Science, Otto von Guericke University, 39106 Magdeburg, Germany
- Genomics Research Centre, Human Technopole, 20157 Milan, Italy
| | - Fatima Saad
- Institute for Medical Engineering, Otto von Guericke University, 39106 Magdeburg, Germany
- Research Campus STIMULATE, Otto von Guericke University, 39106 Magdeburg, Germany
| | - Chompunuch Sarasaen
- Institute for Medical Engineering, Otto von Guericke University, 39106 Magdeburg, Germany
- Research Campus STIMULATE, Otto von Guericke University, 39106 Magdeburg, Germany
- Biomedical Magnetic Resonance, Otto von Guericke University, 39106 Magdeburg, Germany
| | - Suhita Ghosh
- Faculty of Computer Science, Otto von Guericke University, 39106 Magdeburg, Germany
- Artificial Intelligence Lab, Otto von Guericke University, 39106 Magdeburg, Germany
| | - Valerie Krug
- Faculty of Computer Science, Otto von Guericke University, 39106 Magdeburg, Germany
- Artificial Intelligence Lab, Otto von Guericke University, 39106 Magdeburg, Germany
| | - Rupali Khatun
- Department of Mathematics and Computer Science, University of Barcelona, 08028 Barcelona, Spain
- Translational Radiobiology, Department of Radiation Oncology, Universitätsklinikum Erlangen, 91054 Erlangen, Germany
| | | | | | - Petia Radeva
- Department of Mathematics and Computer Science, University of Barcelona, 08028 Barcelona, Spain
- Computer Vision Centre, 08193 Cerdanyola, Spain
| | - Georg Rose
- Institute for Medical Engineering, Otto von Guericke University, 39106 Magdeburg, Germany
- Research Campus STIMULATE, Otto von Guericke University, 39106 Magdeburg, Germany
- Centre for Behavioural Brain Sciences, 39106 Magdeburg, Germany
| | - Sebastian Stober
- Faculty of Computer Science, Otto von Guericke University, 39106 Magdeburg, Germany
- Artificial Intelligence Lab, Otto von Guericke University, 39106 Magdeburg, Germany
| | - Oliver Speck
- Research Campus STIMULATE, Otto von Guericke University, 39106 Magdeburg, Germany
- Biomedical Magnetic Resonance, Otto von Guericke University, 39106 Magdeburg, Germany
- Centre for Behavioural Brain Sciences, 39106 Magdeburg, Germany
- German Centre for Neurodegenerative Diseases, 39106 Magdeburg, Germany
| | - Andreas Nürnberger
- Data and Knowledge Engineering Group, Otto von Guericke University, 39106 Magdeburg, Germany
- Faculty of Computer Science, Otto von Guericke University, 39106 Magdeburg, Germany
- Centre for Behavioural Brain Sciences, 39106 Magdeburg, Germany
| |
Collapse
|
9
|
Garg A, Alag S, Duncan D. CoSev: Data-Driven Optimizations for COVID-19 Severity Assessment in Low-Sample Regimes. Diagnostics (Basel) 2024; 14:337. [PMID: 38337853 PMCID: PMC10855975 DOI: 10.3390/diagnostics14030337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 01/06/2024] [Accepted: 01/19/2024] [Indexed: 02/12/2024] Open
Abstract
Given the pronounced impact COVID-19 continues to have on society-infecting 700 million reported individuals and causing 6.96 million deaths-many deep learning works have recently focused on the virus's diagnosis. However, assessing severity has remained an open and challenging problem due to a lack of large datasets, the large dimensionality of images for which to find weights, and the compute limitations of modern graphics processing units (GPUs). In this paper, a new, iterative application of transfer learning is demonstrated on the understudied field of 3D CT scans for COVID-19 severity analysis. This methodology allows for enhanced performance on the MosMed Dataset, which is a small and challenging dataset containing 1130 images of patients for five levels of COVID-19 severity (Zero, Mild, Moderate, Severe, and Critical). Specifically, given the large dimensionality of the input images, we create several custom shallow convolutional neural network (CNN) architectures and iteratively refine and optimize them, paying attention to learning rates, layer types, normalization types, filter sizes, dropout values, and more. After a preliminary architecture design, the models are systematically trained on a simplified version of the dataset-building models for two-class, then three-class, then four-class, and finally five-class classification. The simplified problem structure allows the model to start learning preliminary features, which can then be further modified for more difficult classification tasks. Our final model CoSev boosts classification accuracies from below 60% at first to 81.57% with the optimizations, reaching similar performance to the state-of-the-art on the dataset, with much simpler setup procedures. In addition to COVID-19 severity diagnosis, the explored methodology can be applied to general image-based disease detection. Overall, this work highlights innovative methodologies that advance current computer vision practices for high-dimension, low-sample data as well as the practicality of data-driven machine learning and the importance of feature design for training, which can then be implemented for improvements in clinical practices.
Collapse
Affiliation(s)
- Aksh Garg
- Computer Science Department, Stanford University, Stanford, CA 94305, USA; (A.G.); (S.A.)
| | - Shray Alag
- Computer Science Department, Stanford University, Stanford, CA 94305, USA; (A.G.); (S.A.)
| | - Dominique Duncan
- Laboratory of Neuro Imaging, USC Stevens Neuroimaging and Informatics Institute, University of Southern California, Los Angeles, CA 90033, USA
| |
Collapse
|
10
|
Zhou J, Zhou L, Wang D, Xu X, Li H, Chu Y, Han W, Gao X. Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMI. Comput Biol Med 2024; 169:107861. [PMID: 38141449 DOI: 10.1016/j.compbiomed.2023.107861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 12/13/2023] [Accepted: 12/14/2023] [Indexed: 12/25/2023]
Abstract
Heterogeneous data is endemic due to the use of diverse models and settings of devices by hospitals in the field of medical imaging. However, there are few open-source frameworks for federated heterogeneous medical image analysis with personalization and privacy protection without the demand to modify the existing model structures or to share any private data. Here, we proposed PPPML-HMI, a novel open-source learning paradigm for personalized and privacy-preserving federated heterogeneous medical image analysis. To our best knowledge, personalization and privacy protection were discussed simultaneously for the first time under the federated scenario by integrating the PerFedAvg algorithm and designing the novel cyclic secure aggregation with the homomorphic encryption algorithm. To show the utility of PPPML-HMI, we applied it to a simulated classification task namely the classification of healthy people and patients from the RAD-ChestCT Dataset, and one real-world segmentation task namely the segmentation of lung infections from COVID-19 CT scans. Meanwhile, we applied the improved deep leakage from gradients to simulate adversarial attacks and showed the strong privacy-preserving capability of PPPML-HMI. By applying PPPML-HMI to both tasks with different neural networks, a varied number of users, and sample sizes, we demonstrated the strong generalizability of PPPML-HMI in privacy-preserving federated learning on heterogeneous medical images.
Collapse
Affiliation(s)
- Juexiao Zhou
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia
| | - Longxi Zhou
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia
| | - Di Wang
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia
| | - Xiaopeng Xu
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia
| | - Haoyang Li
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia
| | - Yuetan Chu
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia
| | - Wenkai Han
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia
| | - Xin Gao
- Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia; Computational Bioscience Research Center, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Kingdom of Saudi Arabia.
| |
Collapse
|
11
|
Viderman D, Kotov A, Popov M, Abdildin Y. Machine and deep learning methods for clinical outcome prediction based on physiological data of COVID-19 patients: a scoping review. Int J Med Inform 2024; 182:105308. [PMID: 38091862 DOI: 10.1016/j.ijmedinf.2023.105308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 11/20/2023] [Accepted: 12/03/2023] [Indexed: 01/07/2024]
Abstract
INTRODUCTION Since the beginning of the COVID-19 pandemic, numerous machine and deep learning (MDL) methods have been proposed in the literature to analyze patient physiological data. The objective of this review is to summarize various aspects of these methods and assess their practical utility for predicting various clinical outcomes. METHODS We searched PubMed, Scopus, and Cochrane Library, screened and selected the studies matching the inclusion criteria. The clinical analysis focused on the characteristics of the patient cohorts in the studies included in this review, the specific tasks in the context of the COVID-19 pandemic that machine and deep learning methods were used for, and their practical limitations. The technical analysis focused on the details of specific MDL methods and their performance. RESULTS Analysis of the 48 selected studies revealed that the majority (∼54 %) of them examined the application of MDL methods for the prediction of survival/mortality-related patient outcomes, while a smaller fraction (∼13 %) of studies also examined applications to the prediction of patients' physiological outcomes and hospital resource utilization. 21 % of the studies examined the application of MDL methods to multiple clinical tasks. Machine and deep learning methods have been shown to be effective at predicting several outcomes of COVID-19 patients, such as disease severity, complications, intensive care unit (ICU) transfer, and mortality. MDL methods also achieved high accuracy in predicting the required number of ICU beds and ventilators. CONCLUSION Machine and deep learning methods have been shown to be valuable tools for predicting disease severity, organ dysfunction and failure, patient outcomes, and hospital resource utilization during the COVID-19 pandemic. The discovered knowledge and our conclusions and recommendations can also be useful to healthcare professionals and artificial intelligence researchers in managing future pandemics.
Collapse
Affiliation(s)
- Dmitriy Viderman
- Department of Surgery, School of Medicine, Nazarbayev University, Astana, Kazakhstan; Department of Anesthesiology, Intensive Care, and Pain Medicine, National Research Oncology Center, Astana, Kazakhstan.
| | - Alexander Kotov
- Department of Computer Science, College of Engineering, Wayne State University, Detroit, USA.
| | - Maxim Popov
- Department of Computer Science, School of Engineering and Digital Sciences, Nazarbayev University, Astana, Kazakhstan.
| | - Yerkin Abdildin
- Department of Mechanical and Aerospace Engineering, School of Engineering and Digital Sciences, Nazarbayev University, Astana, Kazakhstan.
| |
Collapse
|
12
|
Zhou Z, Tian D, Yang Y, Cui H, Li Y, Ren S, Han T, Gao Z. Machine learning assisted biosensing technology: An emerging powerful tool for improving the intelligence of food safety detection. Curr Res Food Sci 2024; 8:100679. [PMID: 38304002 PMCID: PMC10831501 DOI: 10.1016/j.crfs.2024.100679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 01/10/2024] [Accepted: 01/11/2024] [Indexed: 02/03/2024] Open
Abstract
Recently, the application of biosensors in food safety assessment has gained considerable research attention. Nevertheless, the evaluation of biosensors' sensitivity, accuracy, and efficiency is still ongoing. The advent of machine learning has enhanced the application of biosensors in food security assessment, yielding improved results. Machine learning has been preliminarily applied in combination with different biosensors in food safety assessment, with positive results. This review offers a comprehensive summary of the diverse machine learning methods employed in biosensors for food safety. Initially, the primary machine learning methods were outlined, and the integrated application of biosensors and machine learning in food safety was thoroughly examined. Lastly, the challenges and limitations of machine learning and biosensors in the realm of food safety were underscored, and potential solutions were explored. The review's findings demonstrated that algorithms grounded in machine learning can aid in the early detection of food safety issues. Furthermore, preliminary research suggests that biosensors could be optimized through machine learning for real-time, multifaceted analyses of food safety variables and their interactions. The potential of machine learning and biosensors in real-time monitoring of food quality has been discussed.
Collapse
Affiliation(s)
- Zixuan Zhou
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
| | - Daoming Tian
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
- Beidaihe Rest and Recuperation Center of PLA, Qinhuangdao, 066000, China
| | - Yingao Yang
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
| | - Han Cui
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
- State Key Laboratory of Food Nutrition and Safety, Tianjin University of Science & Technology, Tianjin, 300457, China
| | - Yanchun Li
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
| | - Shuyue Ren
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
| | - Tie Han
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
| | - Zhixian Gao
- Tianjin Key Laboratory of Risk Assessment and Control Technology for Environment and Food Safety, Tianjin Institute of Environmental and Operational Medicine, Tianjin, 300050, China
| |
Collapse
|
13
|
Antar S, Abd El-Sattar HKH, Abdel-Rahman MH, F M Ghaleb F. COVID-19 infection segmentation using hybrid deep learning and image processing techniques. Sci Rep 2023; 13:22737. [PMID: 38123587 PMCID: PMC10733411 DOI: 10.1038/s41598-023-49337-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Accepted: 12/07/2023] [Indexed: 12/23/2023] Open
Abstract
The coronavirus disease 2019 (COVID-19) epidemic has become a worldwide problem that continues to affect people's lives daily, and the early diagnosis of COVID-19 has a critical importance on the treatment of infected patients for medical and healthcare organizations. To detect COVID-19 infections, medical imaging techniques, including computed tomography (CT) scan images and X-ray images, are considered some of the helpful medical tests that healthcare providers carry out. However, in addition to the difficulty of segmenting contaminated areas from CT scan images, these approaches also offer limited accuracy for identifying the virus. Accordingly, this paper addresses the effectiveness of using deep learning (DL) and image processing techniques, which serve to expand the dataset without the need for any augmentation strategies, and it also presents a novel approach for detecting COVID-19 virus infections in lung images, particularly the infection prediction issue. In our proposed method, to reveal the infection, the input images are first preprocessed using a threshold then resized to 128 × 128. After that, a density heat map tool is used for coloring the resized lung images. The three channels (red, green, and blue) are then separated from the colored image and are further preprocessed through image inverse and histogram equalization, and are subsequently fed, in independent directions, into three separate U-Nets with the same architecture for segmentation. Finally, the segmentation results are combined and run through a convolution layer one by one to get the detection. Several evaluation metrics using the CT scan dataset were used to measure the performance of the proposed approach in comparison with other state-of-the-art techniques in terms of accuracy, sensitivity, precision, and the dice coefficient. The experimental results of the proposed approach reached 99.71%, 0.83, 0.87, and 0.85, respectively. These results show that coloring the CT scan images dataset and then dividing each image into its RGB image channels can enhance the COVID-19 detection, and it also increases the U-Net power in the segmentation when merging the channel segmentation results. In comparison to other existing segmentation techniques employing bigger 512 × 512 images, this study is one of the few that can rapidly and correctly detect the COVID-19 virus with high accuracy on smaller 128 × 128 images using the metrics of accuracy, sensitivity, precision, and dice coefficient.
Collapse
Affiliation(s)
- Samar Antar
- Computer Science Division, Department of Mathematics, Faculty of Science, Ain Shams University, Abbassia, Cairo, 11566, Egypt
| | | | - Mohammad H Abdel-Rahman
- Computer Science Division, Department of Mathematics, Faculty of Science, Ain Shams University, Abbassia, Cairo, 11566, Egypt
| | - Fayed F M Ghaleb
- Computer Science Division, Department of Mathematics, Faculty of Science, Ain Shams University, Abbassia, Cairo, 11566, Egypt
| |
Collapse
|
14
|
Kotseva B, Vianini I, Nikolaidis N, Faggiani N, Potapova K, Gasparro C, Steiner Y, Scornavacche J, Jacquet G, Dragu V, della Rocca L, Bucci S, Podavini A, Verile M, Macmillan C, Linge JP. Trend analysis of COVID-19 mis/disinformation narratives-A 3-year study. PLoS One 2023; 18:e0291423. [PMID: 37976242 PMCID: PMC10655972 DOI: 10.1371/journal.pone.0291423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 08/26/2023] [Indexed: 11/19/2023] Open
Abstract
To tackle the COVID-19 infodemic, we analysed 58,625 articles from 460 unverified sources, that is, sources that were indicated by fact checkers and other mis/disinformation experts as frequently spreading mis/disinformation, covering the period from 1 January 2020 to 31 December 2022. Our aim was to identify the main narratives of COVID-19 mis/disinformation, develop a codebook, automate the process of narrative classification by training an automatic classifier, and analyse the spread of narratives over time and across countries. Articles were retrieved with a customised version of the Europe Media Monitor (EMM) processing chain providing a stream of text items. Machine translation was employed to automatically translate non-English text to English and clustering was carried out to group similar articles. A multi-level codebook of COVID-19 mis/disinformation narratives was developed following an inductive approach; a transformer-based model was developed to classify all text items according to the codebook. Using the transformer-based model, we identified 12 supernarratives that evolved over the three years studied. The analysis shows that there are often real events behind mis/disinformation trends, which unverified sources misrepresent or take out of context. We established a process that allows for near real-time monitoring of COVID-19 mis/disinformation. This experience will be useful to analyse mis/disinformation about other topics, such as climate change, migration, and geopolitical developments.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | - Guillaume Jacquet
- European Commission, Joint Research Centre, Unit T.5, Ispra, VA, Italy
| | | | | | - Stefano Bucci
- European Commission, Joint Research Centre, Unit T.5, Ispra, VA, Italy
| | - Aldo Podavini
- European Commission, Joint Research Centre, Unit T.5, Ispra, VA, Italy
| | - Marco Verile
- European Commission, Joint Research Centre, Unit T.5, Ispra, VA, Italy
| | - Charles Macmillan
- European Commission, Joint Research Centre, Unit T.5, Ispra, VA, Italy
| | - Jens P. Linge
- European Commission, Joint Research Centre, Unit T.5, Ispra, VA, Italy
| |
Collapse
|
15
|
Williams AH, Zhan CG. Staying Ahead of the Game: How SARS-CoV-2 has Accelerated the Application of Machine Learning in Pandemic Management. BioDrugs 2023; 37:649-674. [PMID: 37464099 DOI: 10.1007/s40259-023-00611-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/28/2023] [Indexed: 07/20/2023]
Abstract
In recent years, machine learning (ML) techniques have garnered considerable interest for their potential use in accelerating the rate of drug discovery. With the emergence of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, the utilization of ML has become even more crucial in the search for effective antiviral medications. The pandemic has presented the scientific community with a unique challenge, and the rapid identification of potential treatments has become an urgent priority. Researchers have been able to accelerate the process of identifying drug candidates, repurposing existing drugs, and designing new compounds with desirable properties using machine learning in drug discovery. To train predictive models, ML techniques in drug discovery rely on the analysis of large datasets, including both experimental and clinical data. These models can be used to predict the biological activities, potential side effects, and interactions with specific target proteins of drug candidates. This strategy has proven to be an effective method for identifying potential coronavirus disease 2019 (COVID-19) and other disease treatments. This paper offers a thorough analysis of the various ML techniques implemented to combat COVID-19, including supervised and unsupervised learning, deep learning, and natural language processing. The paper discusses the impact of these techniques on pandemic drug development, including the identification of potential treatments, the understanding of the disease mechanism, and the creation of effective and safe therapeutics. The lessons learned can be applied to future outbreaks and drug discovery initiatives.
Collapse
Affiliation(s)
- Alexander H Williams
- Molecular Modeling and Biopharmaceutical Center, University of Kentucky, 789 South Limestone Street, Lexington, KY, 40536, USA
- Department of Pharmaceutical Sciences, College of Pharmacy, University of Kentucky, 789 South Limestone Street, Lexington, KY, 40536, USA
- GSK Upper Providence, 1250 S. Collegeville Road, Collegeville, PA, 19426, USA
| | - Chang-Guo Zhan
- Molecular Modeling and Biopharmaceutical Center, University of Kentucky, 789 South Limestone Street, Lexington, KY, 40536, USA.
- Department of Pharmaceutical Sciences, College of Pharmacy, University of Kentucky, 789 South Limestone Street, Lexington, KY, 40536, USA.
| |
Collapse
|
16
|
Santosh KC, GhoshRoy D, Nakarmi S. A Systematic Review on Deep Structured Learning for COVID-19 Screening Using Chest CT from 2020 to 2022. Healthcare (Basel) 2023; 11:2388. [PMID: 37685422 PMCID: PMC10486542 DOI: 10.3390/healthcare11172388] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/16/2023] [Accepted: 08/22/2023] [Indexed: 09/10/2023] Open
Abstract
The emergence of the COVID-19 pandemic in Wuhan in 2019 led to the discovery of a novel coronavirus. The World Health Organization (WHO) designated it as a global pandemic on 11 March 2020 due to its rapid and widespread transmission. Its impact has had profound implications, particularly in the realm of public health. Extensive scientific endeavors have been directed towards devising effective treatment strategies and vaccines. Within the healthcare and medical imaging domain, the application of artificial intelligence (AI) has brought significant advantages. This study delves into peer-reviewed research articles spanning the years 2020 to 2022, focusing on AI-driven methodologies for the analysis and screening of COVID-19 through chest CT scan data. We assess the efficacy of deep learning algorithms in facilitating decision making processes. Our exploration encompasses various facets, including data collection, systematic contributions, emerging techniques, and encountered challenges. However, the comparison of outcomes between 2020 and 2022 proves intricate due to shifts in dataset magnitudes over time. The initiatives aimed at developing AI-powered tools for the detection, localization, and segmentation of COVID-19 cases are primarily centered on educational and training contexts. We deliberate on their merits and constraints, particularly in the context of necessitating cross-population train/test models. Our analysis encompassed a review of 231 research publications, bolstered by a meta-analysis employing search keywords (COVID-19 OR Coronavirus) AND chest CT AND (deep learning OR artificial intelligence OR medical imaging) on both the PubMed Central Repository and Web of Science platforms.
Collapse
Affiliation(s)
- KC Santosh
- 2AI: Applied Artificial Intelligence Research Lab, Vermillion, SD 57069, USA
| | - Debasmita GhoshRoy
- School of Automation, Banasthali Vidyapith, Tonk 304022, Rajasthan, India;
| | - Suprim Nakarmi
- Department of Computer Science, University of South Dakota, Vermillion, SD 57069, USA;
| |
Collapse
|
17
|
Dou B, Zhu Z, Merkurjev E, Ke L, Chen L, Jiang J, Zhu Y, Liu J, Zhang B, Wei GW. Machine Learning Methods for Small Data Challenges in Molecular Science. Chem Rev 2023; 123:8736-8780. [PMID: 37384816 PMCID: PMC10999174 DOI: 10.1021/acs.chemrev.3c00189] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/01/2023]
Abstract
Small data are often used in scientific and engineering research due to the presence of various constraints, such as time, cost, ethics, privacy, security, and technical limitations in data acquisition. However, big data have been the focus for the past decade, small data and their challenges have received little attention, even though they are technically more severe in machine learning (ML) and deep learning (DL) studies. Overall, the small data challenge is often compounded by issues, such as data diversity, imputation, noise, imbalance, and high-dimensionality. Fortunately, the current big data era is characterized by technological breakthroughs in ML, DL, and artificial intelligence (AI), which enable data-driven scientific discovery, and many advanced ML and DL technologies developed for big data have inadvertently provided solutions for small data problems. As a result, significant progress has been made in ML and DL for small data challenges in the past decade. In this review, we summarize and analyze several emerging potential solutions to small data challenges in molecular science, including chemical and biological sciences. We review both basic machine learning algorithms, such as linear regression, logistic regression (LR), k-nearest neighbor (KNN), support vector machine (SVM), kernel learning (KL), random forest (RF), and gradient boosting trees (GBT), and more advanced techniques, including artificial neural network (ANN), convolutional neural network (CNN), U-Net, graph neural network (GNN), Generative Adversarial Network (GAN), long short-term memory (LSTM), autoencoder, transformer, transfer learning, active learning, graph-based semi-supervised learning, combining deep learning with traditional machine learning, and physical model-based data augmentation. We also briefly discuss the latest advances in these methods. Finally, we conclude the survey with a discussion of promising trends in small data challenges in molecular science.
Collapse
Affiliation(s)
- Bozheng Dou
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
| | - Zailiang Zhu
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
| | - Ekaterina Merkurjev
- Department of Mathematics, Michigan State University, East Lansing, Michigan 48824, United States
| | - Lu Ke
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
| | - Long Chen
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
| | - Jian Jiang
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
- Department of Mathematics, Michigan State University, East Lansing, Michigan 48824, United States
| | - Yueying Zhu
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
| | - Jie Liu
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
| | - Bengong Zhang
- Research Center of Nonlinear Science, School of Mathematical and Physical Sciences,Wuhan Textile University, Wuhan 430200, P, R. China
| | - Guo-Wei Wei
- Department of Mathematics, Michigan State University, East Lansing, Michigan 48824, United States
- Department of Electrical and Computer Engineering, Michigan State University, East Lansing, Michigan 48824, United States
- Department of Biochemistry and Molecular Biology, Michigan State University, East Lansing, Michigan 48824, United States
| |
Collapse
|
18
|
Velpula VK, Sharma LD. Multi-stage glaucoma classification using pre-trained convolutional neural networks and voting-based classifier fusion. Front Physiol 2023; 14:1175881. [PMID: 37383146 PMCID: PMC10293617 DOI: 10.3389/fphys.2023.1175881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 05/19/2023] [Indexed: 06/30/2023] Open
Abstract
Aim: To design an automated glaucoma detection system for early detection of glaucoma using fundus images. Background: Glaucoma is a serious eye problem that can cause vision loss and even permanent blindness. Early detection and prevention are crucial for effective treatment. Traditional diagnostic approaches are time consuming, manual, and often inaccurate, thus making automated glaucoma diagnosis necessary. Objective: To propose an automated glaucoma stage classification model using pre-trained deep convolutional neural network (CNN) models and classifier fusion. Methods: The proposed model utilized five pre-trained CNN models: ResNet50, AlexNet, VGG19, DenseNet-201, and Inception-ResNet-v2. The model was tested using four public datasets: ACRIMA, RIM-ONE, Harvard Dataverse (HVD), and Drishti. Classifier fusion was created to merge the decisions of all CNN models using the maximum voting-based approach. Results: The proposed model achieved an area under the curve of 1 and an accuracy of 99.57% for the ACRIMA dataset. The HVD dataset had an area under the curve of 0.97 and an accuracy of 85.43%. The accuracy rates for Drishti and RIM-ONE were 90.55 and 94.95%, respectively. The experimental results showed that the proposed model performed better than the state-of-the-art methods in classifying glaucoma in its early stages. Understanding the model output includes both attribution-based methods such as activations and gradient class activation map and perturbation-based methods such as locally interpretable model-agnostic explanations and occlusion sensitivity, which generate heatmaps of various sections of an image for model prediction. Conclusion: The proposed automated glaucoma stage classification model using pre-trained CNN models and classifier fusion is an effective method for the early detection of glaucoma. The results indicate high accuracy rates and superior performance compared to the existing methods.
Collapse
|
19
|
Sfayyih AH, Sulaiman N, Sabry AH. A review on lung disease recognition by acoustic signal analysis with deep learning networks. JOURNAL OF BIG DATA 2023; 10:101. [PMID: 37333945 PMCID: PMC10259357 DOI: 10.1186/s40537-023-00762-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 05/08/2023] [Indexed: 06/20/2023]
Abstract
Recently, assistive explanations for difficulties in the health check area have been made viable thanks in considerable portion to technologies like deep learning and machine learning. Using auditory analysis and medical imaging, they also increase the predictive accuracy for prompt and early disease detection. Medical professionals are thankful for such technological support since it helps them manage further patients because of the shortage of skilled human resources. In addition to serious illnesses like lung cancer and respiratory diseases, the plurality of breathing difficulties is gradually rising and endangering society. Because early prediction and immediate treatment are crucial for respiratory disorders, chest X-rays and respiratory sound audio are proving to be quite helpful together. Compared to related review studies on lung disease classification/detection using deep learning algorithms, only two review studies based on signal analysis for lung disease diagnosis have been conducted in 2011 and 2018. This work provides a review of lung disease recognition with acoustic signal analysis with deep learning networks. We anticipate that physicians and researchers working with sound-signal-based machine learning will find this material beneficial.
Collapse
Affiliation(s)
- Alyaa Hamel Sfayyih
- Department of Electrical and Electronic Engineering, Faculty of Engineering, Universiti Putra Malaysia, 43400 Serdang, Malaysia
| | - Nasri Sulaiman
- Department of Electrical and Electronic Engineering, Faculty of Engineering, Universiti Putra Malaysia, 43400 Serdang, Malaysia
| | - Ahmad H. Sabry
- Department of Computer Engineering, Al-Nahrain University, Al Jadriyah Bridge, 64074 Baghdad, Iraq
| |
Collapse
|
20
|
Morita PP, Zakir Hussain I, Kaur J, Lotto M, Butt ZA. Tweeting for Health Using Real-time Mining and Artificial Intelligence-Based Analytics: Design and Development of a Big Data Ecosystem for Detecting and Analyzing Misinformation on Twitter. J Med Internet Res 2023; 25:e44356. [PMID: 37294603 PMCID: PMC10337356 DOI: 10.2196/44356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Revised: 02/09/2023] [Accepted: 03/14/2023] [Indexed: 03/16/2023] Open
Abstract
BACKGROUND Digital misinformation, primarily on social media, has led to harmful and costly beliefs in the general population. Notably, these beliefs have resulted in public health crises to the detriment of governments worldwide and their citizens. However, public health officials need access to a comprehensive system capable of mining and analyzing large volumes of social media data in real time. OBJECTIVE This study aimed to design and develop a big data pipeline and ecosystem (UbiLab Misinformation Analysis System [U-MAS]) to identify and analyze false or misleading information disseminated via social media on a certain topic or set of related topics. METHODS U-MAS is a platform-independent ecosystem developed in Python that leverages the Twitter V2 application programming interface and the Elastic Stack. The U-MAS expert system has 5 major components: data extraction framework, latent Dirichlet allocation (LDA) topic model, sentiment analyzer, misinformation classification model, and Elastic Cloud deployment (indexing of data and visualizations). The data extraction framework queries the data through the Twitter V2 application programming interface, with queries identified by public health experts. The LDA topic model, sentiment analyzer, and misinformation classification model are independently trained using a small, expert-validated subset of the extracted data. These models are then incorporated into U-MAS to analyze and classify the remaining data. Finally, the analyzed data are loaded into an index in the Elastic Cloud deployment and can then be presented on dashboards with advanced visualizations and analytics pertinent to infodemiology and infoveillance analysis. RESULTS U-MAS performed efficiently and accurately. Independent investigators have successfully used the system to extract significant insights into a fluoride-related health misinformation use case (2016 to 2021). The system is currently used for a vaccine hesitancy use case (2007 to 2022) and a heat wave-related illnesses use case (2011 to 2022). Each component in the system for the fluoride misinformation use case performed as expected. The data extraction framework handles large amounts of data within short periods. The LDA topic models achieved relatively high coherence values (0.54), and the predicted topics were accurate and befitting to the data. The sentiment analyzer performed at a correlation coefficient of 0.72 but could be improved in further iterations. The misinformation classifier attained a satisfactory correlation coefficient of 0.82 against expert-validated data. Moreover, the output dashboard and analytics hosted on the Elastic Cloud deployment are intuitive for researchers without a technical background and comprehensive in their visualization and analytics capabilities. In fact, the investigators of the fluoride misinformation use case have successfully used the system to extract interesting and important insights into public health, which have been published separately. CONCLUSIONS The novel U-MAS pipeline has the potential to detect and analyze misleading information related to a particular topic or set of related topics.
Collapse
Affiliation(s)
- Plinio Pelegrini Morita
- School of Public Health Sciences, Faculty of Health, University of Waterloo, Waterloo, ON, Canada
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
- Research Institute for Aging, University of Waterloo, Waterloo, ON, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, ON, Canada
- Centre for Digital Therapeutics, Techna Institute, University Health Network, Toronto, ON, Canada
| | - Irfhana Zakir Hussain
- School of Public Health Sciences, Faculty of Health, University of Waterloo, Waterloo, ON, Canada
- Department of Data Science and Business Systems, School of Computing, College of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, India
| | - Jasleen Kaur
- School of Public Health Sciences, Faculty of Health, University of Waterloo, Waterloo, ON, Canada
| | - Matheus Lotto
- School of Public Health Sciences, Faculty of Health, University of Waterloo, Waterloo, ON, Canada
- Department of Pediatric Dentistry, Orthodontics and Public Health, Bauru School of Dentistry, University of São Paulo,, Bauru, Brazil
| | - Zahid Ahmad Butt
- School of Public Health Sciences, Faculty of Health, University of Waterloo, Waterloo, ON, Canada
| |
Collapse
|
21
|
Sultana A, Nahiduzzaman M, Bakchy SC, Shahriar SM, Peyal HI, Chowdhury MEH, Khandakar A, Arselene Ayari M, Ahsan M, Haider J. A Real Time Method for Distinguishing COVID-19 Utilizing 2D-CNN and Transfer Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094458. [PMID: 37177662 PMCID: PMC10181786 DOI: 10.3390/s23094458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 04/19/2023] [Accepted: 04/21/2023] [Indexed: 05/15/2023]
Abstract
Rapid identification of COVID-19 can assist in making decisions for effective treatment and epidemic prevention. The PCR-based test is expert-dependent, is time-consuming, and has limited sensitivity. By inspecting Chest R-ray (CXR) images, COVID-19, pneumonia, and other lung infections can be detected in real time. The current, state-of-the-art literature suggests that deep learning (DL) is highly advantageous in automatic disease classification utilizing the CXR images. The goal of this study is to develop models by employing DL models for identifying COVID-19 and other lung disorders more efficiently. For this study, a dataset of 18,564 CXR images with seven disease categories was created from multiple publicly available sources. Four DL architectures including the proposed CNN model and pretrained VGG-16, VGG-19, and Inception-v3 models were applied to identify healthy and six lung diseases (fibrosis, lung opacity, viral pneumonia, bacterial pneumonia, COVID-19, and tuberculosis). Accuracy, precision, recall, f1 score, area under the curve (AUC), and testing time were used to evaluate the performance of these four models. The results demonstrated that the proposed CNN model outperformed all other DL models employed for a seven-class classification with an accuracy of 93.15% and average values for precision, recall, f1-score, and AUC of 0.9343, 0.9443, 0.9386, and 0.9939. The CNN model equally performed well when other multiclass classifications including normal and COVID-19 as the common classes were considered, yielding accuracy values of 98%, 97.49%, 97.81%, 96%, and 96.75% for two, three, four, five, and six classes, respectively. The proposed model can also identify COVID-19 with shorter training and testing times compared to other transfer learning models.
Collapse
Affiliation(s)
- Abida Sultana
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Nahiduzzaman
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | - Sagor Chandro Bakchy
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Saleh Mohammed Shahriar
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Hasibul Islam Peyal
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | | | - Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | | | - Mominul Ahsan
- Department of Computer Science, University of York, Deramore Lane, Heslington, York YO10 5GH, UK
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Chester Street, Manchester M1 5GD, UK
| |
Collapse
|
22
|
Heredia Cacha I, Sáinz-Pardo Díaz J, Castrillo M, López García Á. Forecasting COVID-19 spreading through an ensemble of classical and machine learning models: Spain's case study. Sci Rep 2023; 13:6750. [PMID: 37185927 PMCID: PMC10127188 DOI: 10.1038/s41598-023-33795-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Accepted: 04/19/2023] [Indexed: 05/17/2023] Open
Abstract
In this work the applicability of an ensemble of population and machine learning models to predict the evolution of the COVID-19 pandemic in Spain is evaluated, relying solely on public datasets. Firstly, using only incidence data, we trained machine learning models and adjusted classical ODE-based population models, especially suited to capture long term trends. As a novel approach, we then made an ensemble of these two families of models in order to obtain a more robust and accurate prediction. We then proceed to improve machine learning models by adding more input features: vaccination, human mobility and weather conditions. However, these improvements did not translate to the overall ensemble, as the different model families had also different prediction patterns. Additionally, machine learning models degraded when new COVID variants appeared after training. We finally used Shapley Additive Explanation values to discern the relative importance of the different input features for the machine learning models' predictions. The conclusion of this work is that the ensemble of machine learning models and population models can be a promising alternative to SEIR-like compartmental models, especially given that the former do not need data from recovered patients, which are hard to collect and generally unavailable.
Collapse
Affiliation(s)
- Ignacio Heredia Cacha
- Instituto de Física de Cantabria (IFCA), CSIC-UC, Avda. los Castros s/n., 39005, Santander, Spain
| | - Judith Sáinz-Pardo Díaz
- Instituto de Física de Cantabria (IFCA), CSIC-UC, Avda. los Castros s/n., 39005, Santander, Spain
| | - María Castrillo
- Instituto de Física de Cantabria (IFCA), CSIC-UC, Avda. los Castros s/n., 39005, Santander, Spain
| | - Álvaro López García
- Instituto de Física de Cantabria (IFCA), CSIC-UC, Avda. los Castros s/n., 39005, Santander, Spain.
| |
Collapse
|
23
|
Lyu H, Imtiaz A, Zhao Y, Luo J. Human behavior in the time of COVID-19: Learning from big data. Front Big Data 2023; 6:1099182. [PMID: 37091459 PMCID: PMC10118015 DOI: 10.3389/fdata.2023.1099182] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 03/21/2023] [Indexed: 04/09/2023] Open
Abstract
Since the World Health Organization (WHO) characterized COVID-19 as a pandemic in March 2020, there have been over 600 million confirmed cases of COVID-19 and more than six million deaths as of October 2022. The relationship between the COVID-19 pandemic and human behavior is complicated. On one hand, human behavior is found to shape the spread of the disease. On the other hand, the pandemic has impacted and even changed human behavior in almost every aspect. To provide a holistic understanding of the complex interplay between human behavior and the COVID-19 pandemic, researchers have been employing big data techniques such as natural language processing, computer vision, audio signal processing, frequent pattern mining, and machine learning. In this study, we present an overview of the existing studies on using big data techniques to study human behavior in the time of the COVID-19 pandemic. In particular, we categorize these studies into three groups-using big data to measure, model, and leverage human behavior, respectively. The related tasks, data, and methods are summarized accordingly. To provide more insights into how to fight the COVID-19 pandemic and future global catastrophes, we further discuss challenges and potential opportunities.
Collapse
Affiliation(s)
| | | | | | - Jiebo Luo
- Department of Computer Science, University of Rochester, Rochester, NY, United States
| |
Collapse
|
24
|
Xiang W, Chen L, Yan X, Wang B, Liu X. The impact of traffic control measures on the spread of COVID-19 within urban agglomerations based on a modified epidemic model. CITIES (LONDON, ENGLAND) 2023; 135:104238. [PMID: 36817574 PMCID: PMC9922589 DOI: 10.1016/j.cities.2023.104238] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 12/30/2022] [Accepted: 02/08/2023] [Indexed: 05/03/2023]
Abstract
With the spatial structure of urban agglomerations, well-developed transportation networks and close economic ties can increase the risk of intercity transmission of infectious diseases. To reveal the epidemic transmission mechanism in urban agglomerations and to explore the effectiveness of traffic control measures, this study proposes an Urban-Agglomeration-based Epidemic and Mobility Model (UAEMM) based on the reality of urban transportation networks and population mobility factors. Since the model considers the urban population inflow, along with the active intracity population, it can be used to estimate the composition of urban cases. The model was applied to the Chang-Zhu-Tan urban agglomeration, and the results show that the model can better simulate the transmission process of the urban agglomeration for a certain scale of epidemic. The number of cases within the urban agglomeration is higher than the number of cases imported into the urban agglomeration from external cities. The composition of cases in the core cities of the urban agglomeration changes with the adjustment of prevention and control measures. In contrast, the number of cases imported into the secondary cities is consistently greater than the number of cases transmitted within the cities. A traffic control measures discount factor is introduced to simulate the development of the epidemic in the urban agglomeration under the traffic control measures of the first-level response to major public health emergency, traffic blockades in infected areas, and public transportation shutdowns. If none of those traffic control measures had been taken after the outbreak of COVID-19, the number of cases in the urban agglomeration would theoretically have increased to 3879, which is 11.61 times the actual number of cases that occurred. If only one traffic control measure had been used alone, each of the three measures would have reduced the number of cases in the urban agglomeration to 30.19 %-57.44 % of the theoretical values of infection cases, with the best blocking effect coming from the first-level response to major public health emergency. Traffic control measures have a significant effect in interrupting the spread of COVID-19 in urban agglomerations. The methodology and main findings presented in this paper are of general interest and can also be used in studies in other countries for similar purposes to help understand the spread of COVID-19 in urban agglomerations.
Collapse
Affiliation(s)
- Wang Xiang
- Hunan Key Laboratory of Smart Roadway and Cooperative Vehicle-Infrastructure Systems, Changsha University of Science & Technology, Changsha 410114, China
| | - Li Chen
- Hunan Key Laboratory of Smart Roadway and Cooperative Vehicle-Infrastructure Systems, Changsha University of Science & Technology, Changsha 410114, China
| | - Xuedong Yan
- Key Laboratory of Transport Industry of Big Data Application Technologies for Comprehensive Transport, Beijing Jiaotong University, Beijing 100044, China
| | - Bin Wang
- Alibaba Cloud Computing Co. Ltd., Changsha 410007, China
| | - Xiaobing Liu
- Key Laboratory of Transport Industry of Big Data Application Technologies for Comprehensive Transport, Beijing Jiaotong University, Beijing 100044, China
| |
Collapse
|
25
|
Ashwin M, Alqahtani AS, Mubarakali A. Smart Artificial Intelligence techniques using embedded band for diagnosis and combating COVID-19. MICROPROCESSORS AND MICROSYSTEMS 2023; 98:104819. [PMID: 37016684 PMCID: PMC10008045 DOI: 10.1016/j.micpro.2023.104819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Recently, COVID-19 virus spread to create a major impact in human body worldwide. The Corona virus, initiated by the SARS-CoV-2 virus, was known in China, December 2019 and affirmed a worldwide epidemic by the World Health Organization on 11 March 2020. The core aim of this research is to detect the spreading of COVID-19 virus and solve the problems in human lungs infection quickly. An Artificial Intelligence (AI) technique is a possibly controlling device in the battle against the corona virus epidemic. Recently, AI with computational techniques are utilized for COVID-19 virus with the building blocks of Deep Learning method using Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) is used to classify and identify the lung images affected region. These two algorithms used to diagnose COVID-19 infections rapidly. The AI applications against COVID-19 are Medical Imaging for Diagnosis, Lung delineation, Lesion measurement, Non-Invasive Measurements for Disease Tracking, Patient Outcome Prediction, Molecular Scale: from Proteins to Drug Development and Societal Scale: Epidemiology and Infodemiology.
Collapse
Affiliation(s)
- M Ashwin
- Department of Artificial Intelligence and Data Science, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Andhra Pradesh, India
| | - Abdulrahman Saad Alqahtani
- Vice President of University of Bisha for Graduate Studies and Scientific Research, University of Bisha, KSA
| | - Azath Mubarakali
- College of Computer Science, King Khalid University, Abha, Kingdom of Saudi Arabia
| |
Collapse
|
26
|
Gifani P, Vafaeezadeh M, Ghorbani M, Mehri-Kakavand G, Pursamimi M, Shalbaf A, Davanloo AA. Automatic Diagnosis of Stage of COVID-19 Patients using an Ensemble of Transfer Learning with Convolutional Neural Networks Based on Computed Tomography Images. JOURNAL OF MEDICAL SIGNALS & SENSORS 2023; 13:101-109. [PMID: 37448543 PMCID: PMC10336907 DOI: 10.4103/jmss.jmss_158_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 01/13/2022] [Accepted: 04/19/2022] [Indexed: 07/15/2023]
Abstract
Background Diagnosis of the stage of COVID-19 patients using the chest computed tomography (CT) can help the physician in making decisions on the length of time required for hospitalization and adequate selection of patient care. This diagnosis requires very expert radiologists who are not available everywhere and is also tedious and subjective. The aim of this study is to propose an advanced machine learning system to diagnose the stages of COVID-19 patients including normal, early, progressive, peak, and absorption stages based on lung CT images, using an automatic deep transfer learning ensemble. Methods Different strategies of deep transfer learning were used which were based on pretrained convolutional neural networks (CNNs). Pretrained CNNs were fine-tuned on the chest CT images, and then, the extracted features were classified by a softmax layer. Finally, we built an ensemble method based on majority voting of the best deep transfer learning outputs to further improve the recognition performance. Results The experimental results from 689 cases indicate that the ensemble of three deep transfer learning outputs based on EfficientNetB4, InceptionResV3, and NasNetlarge has the highest results in diagnosing the stage of COVID-19 with an accuracy of 91.66%. Conclusion The proposed method can be used for the classification of the stage of COVID-19 disease with good accuracy to help the physician in making decisions on patient care.
Collapse
Affiliation(s)
- Parisa Gifani
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Majid Vafaeezadeh
- Department of Biomedical Engineering, Iran University of Science and Technology, Tehran, Iran
| | - Mahdi Ghorbani
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ghazal Mehri-Kakavand
- Department of Medical Physics, School of Medicine, Semnan University of Medical Sciences, Semnan, Iran
| | - Mohamad Pursamimi
- Department of Medical Physics, School of Medicine, Semnan University of Medical Sciences, Semnan, Iran
| | - Ahmad Shalbaf
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | | |
Collapse
|
27
|
Gürsoy E, Kaya Y. An overview of deep learning techniques for COVID-19 detection: methods, challenges, and future works. MULTIMEDIA SYSTEMS 2023; 29:1603-1627. [PMID: 37261262 PMCID: PMC10039775 DOI: 10.1007/s00530-023-01083-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Accepted: 03/20/2023] [Indexed: 06/02/2023]
Abstract
The World Health Organization (WHO) declared a pandemic in response to the coronavirus COVID-19 in 2020, which resulted in numerous deaths worldwide. Although the disease appears to have lost its impact, millions of people have been affected by this virus, and new infections still occur. Identifying COVID-19 requires a reverse transcription-polymerase chain reaction test (RT-PCR) or analysis of medical data. Due to the high cost and time required to scan and analyze medical data, researchers are focusing on using automated computer-aided methods. This review examines the applications of deep learning (DL) and machine learning (ML) in detecting COVID-19 using medical data such as CT scans, X-rays, cough sounds, MRIs, ultrasound, and clinical markers. First, the data preprocessing, the features used, and the current COVID-19 detection methods are divided into two subsections, and the studies are discussed. Second, the reported publicly available datasets, their characteristics, and the potential comparison materials mentioned in the literature are presented. Third, a comprehensive comparison is made by contrasting the similar and different aspects of the studies. Finally, the results, gaps, and limitations are summarized to stimulate the improvement of COVID-19 detection methods, and the study concludes by listing some future research directions for COVID-19 classification.
Collapse
Affiliation(s)
- Ercan Gürsoy
- Department of Computer Engineering, Adana Alparslan Turkes Science and Technology University, 01250 Adana, Turkey
| | - Yasin Kaya
- Department of Computer Engineering, Adana Alparslan Turkes Science and Technology University, 01250 Adana, Turkey
| |
Collapse
|
28
|
Sharma M, Patel RK, Garg A, SanTan R, Acharya UR. Automated detection of schizophrenia using deep learning: a review for the last decade. Physiol Meas 2023; 44. [PMID: 36630717 DOI: 10.1088/1361-6579/acb24d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 01/11/2023] [Indexed: 01/12/2023]
Abstract
Schizophrenia (SZ) is a devastating mental disorder that disrupts higher brain functions like thought, perception, etc., with a profound impact on the individual's life. Deep learning (DL) can detect SZ automatically by learning signal data characteristics hierarchically without the need for feature engineering associated with traditional machine learning. We performed a systematic review of DL models for SZ detection. Various deep models like long short-term memory, convolution neural networks, AlexNet, etc., and composite methods have been published based on electroencephalographic signals, and structural and/or functional magnetic resonance imaging acquired from SZ patients and healthy patients control subjects in diverse public and private datasets. The studies, the study datasets, and model methodologies are reported in detail. In addition, the challenges of DL models for SZ diagnosis and future works are discussed.
Collapse
Affiliation(s)
- Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Ruchit Kumar Patel
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Akshat Garg
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Ru SanTan
- Department of Cardiology, National Heart Centre Singapore, Singapore 169609, Singapore
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 639798, Singapore.,Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan.,Department of Biomedical Engineering, School of Science and Technology, Singapore 639798, Singapore
| |
Collapse
|
29
|
Hansun S, Charles V, Gherman T. The role of the mass vaccination programme in combating the COVID-19 pandemic: An LSTM-based analysis of COVID-19 confirmed cases. Heliyon 2023; 9:e14397. [PMID: 36911879 PMCID: PMC9993739 DOI: 10.1016/j.heliyon.2023.e14397] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2022] [Revised: 02/28/2023] [Accepted: 03/02/2023] [Indexed: 03/12/2023] Open
Abstract
The COVID-19 virus has impacted all facets of our lives. As a global response to this threat, vaccination programmes have been initiated and administered in numerous nations. The question remains, however, as to whether mass vaccination programmes result in a decrease in the number of confirmed COVID-19 cases. In this study, we aim to predict the future number of COVID-19 confirmed cases for the top ten countries with the highest number of vaccinations in the world. A well-known Deep Learning method for time series analysis, namely, the Long Short-Term Memory (LSTM) networks, is applied as the prediction method. Using three evaluation metrics, i.e., Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Mean Absolute Percentage Error (MAPE), we found that the model built by using LSTM networks could give a good prediction of the future number and trend of COVID-19 confirmed cases in the considered countries. Two different scenarios are employed, namely: 'All Time', which includes all historical data; and 'Before Vaccination', which excludes data collected after the mass vaccination programme began. The average MAPE scores for the 'All Time' and 'Before Vaccination' scenarios are 5.977% and 10.388%, respectively. Overall, the results show that the mass vaccination programme has a positive impact on decreasing and controlling the spread of the COVID-19 disease in those countries, as evidenced by decreasing future trends after the programme was implemented.
Collapse
Affiliation(s)
- Seng Hansun
- Informatics Department, Universitas Multimedia Nusantara, Tangerang, Indonesia
| | - Vincent Charles
- CENTRUM Católica Graduate Business School, Lima, Peru.,Pontifical Catholic University of Peru, Lima, Peru
| | - Tatiana Gherman
- Faculty of Business and Law, University of Northampton, Northampton, NN1 5PH, UK
| |
Collapse
|
30
|
Ning X, Jia L, Wei Y, Li XA, Chen F. Epi-DNNs: Epidemiological priors informed deep neural networks for modeling COVID-19 dynamics. Comput Biol Med 2023; 158:106693. [PMID: 36996662 PMCID: PMC9970927 DOI: 10.1016/j.compbiomed.2023.106693] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 02/05/2023] [Accepted: 02/14/2023] [Indexed: 03/04/2023]
Abstract
Differential equations-based epidemic compartmental models and deep neural networks-based artificial intelligence (AI) models are powerful tools for analyzing and fighting the transmission of COVID-19. However, the capability of compartmental models is limited by the challenges of parameter estimation, while AI models fail to discover the evolutionary pattern of COVID-19 and lack explainability. This paper aims to provide a novel method (called Epi-DNNs) by integrating compartmental models and deep neural networks (DNNs) to model the complex dynamics of COVID-19. In the proposed Epi-DNNs method, the neural network is designed to express the unknown parameters in the compartmental model and the Runge–Kutta method is implemented to solve the ordinary differential equations (ODEs) so as to give the values of the ODEs at a given time. Specifically, the discrepancy between predictions and observations is incorporated into the loss function, then the defined loss is minimized and applied to identify the best-fitted parameters governing the compartmental model. Furthermore, we verify the performance of Epi-DNNs on the real-world reported COVID-19 data on the Omicron epidemic in Shanghai covering February 25 to May 27, 2022. The experimental findings on the synthesized data have revealed its effectiveness in COVID-19 transmission modeling. Moreover, the inferred parameters from the proposed Epi-DNNs method yield a predictive compartmental model, which can serve to forecast future dynamics.
Collapse
Affiliation(s)
- Xiao Ning
- State Key Laboratory of Bioelectronics, School of Biological Science and Medical Engineering, Southeast University, 2 Sipailou, Nanjing, 210096, PR China
| | - Linlin Jia
- The COBRA Lab, INSA Rouen Normandie, 1 Rue Tesniere, Mont-Saint-Aignan, 76821, France
| | - Yongyue Wei
- Center for Global Health, Departments of Epidemiology and Biostatistics, School of Public Health, Nanjing Medical University, Address Two, Nanjing, 21166, PR China,Public Health and Epidemic Preparedness and Response Center, Peking University, Xueyuan Road, Haidian District, Beijing, 100191, PR China
| | - Xi-An Li
- Ceyear Technologies Co., Ltd, 98 Xiangjiang Road, Qingdao, 266000, PR China,Corresponding author
| | - Feng Chen
- State Key Laboratory of Bioelectronics, School of Biological Science and Medical Engineering, Southeast University, 2 Sipailou, Nanjing, 210096, PR China,Center for Global Health, Departments of Epidemiology and Biostatistics, School of Public Health, Nanjing Medical University, Address Two, Nanjing, 21166, PR China,Corresponding author at: State Key Laboratory of Bioelectronics, School of Biological Science and Medical Engineering, Southeast University, 2 Sipailou, Nanjing, 210096, PR China
| |
Collapse
|
31
|
Lee K, Takahashi F, Kawasaki Y, Yoshinaga N, Sakai H. Prediction models for the impact of the COVID-19 pandemic on research activities of Japanese nursing researchers using deep learning. Jpn J Nurs Sci 2023:e12529. [PMID: 36758540 DOI: 10.1111/jjns.12529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Revised: 12/18/2022] [Accepted: 01/15/2023] [Indexed: 02/11/2023]
Abstract
AIM This study aimed to construct and evaluate prediction models using deep learning to explore the impact of attributes and lifestyle factors on research activities of nursing researchers during the COVID-19 pandemic. METHODS A secondary data analysis was conducted from a cross-sectional online survey by the Japanese Society of Nursing Science at the inception of the COVID-19 pandemic. A total of 1089 respondents from nursing faculties were divided into a training dataset and a test dataset. We constructed two prediction models with the training dataset using artificial intelligence (AI) predictive analysis tools; motivation and time were used as predictor items for negative impact on research activities. Predictive factors were attributes, lifestyle, and predictor items for each other. The models' accuracy and internal validity were evaluated using an ordinal logistic regression analysis to assess goodness-of-fit; the test dataset was used to assess external validity. Predicted contributions by each factor were also calculated. RESULTS The models' accuracy and goodness-of-fit were good. The prediction contribution analysis showed that no increase in research motivation and lack of increase in research time strongly influenced each other. Other factors that negatively influenced research motivation and research time were residing outside the special alert area and lecturer position and living with partner/spouse and associate professor position, respectively. CONCLUSIONS Deep learning is a research method enabling early prediction of unexpected events, suggesting new applicability in nursing science. To continue research activities during the COVID-19 pandemic and future contingencies, the research environment needs to be improved, workload corrected by position, and considered in terms of work-life balance.
Collapse
Affiliation(s)
- Kumsun Lee
- Faculty of Nursing, Kansai Medical University, Hirakata, Japan
| | | | - Yuki Kawasaki
- Faculty of Nursing, Kansai Medical University, Hirakata, Japan
| | - Naoki Yoshinaga
- COVID-19 Nursing Research Countermeasures Committee, Japan Academy of Nursing Science, Tokyo, Japan.,School of Nursing, Faculty of Medicine, University of Miyazaki, Miyazaki, Japan
| | - Hiroko Sakai
- Faculty of Nursing, Kansai Medical University, Hirakata, Japan
| |
Collapse
|
32
|
Eyiokur FI, Kantarcı A, Erakın ME, Damer N, Ofli F, Imran M, Križaj J, Salah AA, Waibel A, Štruc V, Ekenel HK. A survey on computer vision based human analysis in the COVID-19 era. IMAGE AND VISION COMPUTING 2023; 130:104610. [PMID: 36540857 PMCID: PMC9755265 DOI: 10.1016/j.imavis.2022.104610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 12/11/2022] [Indexed: 06/17/2023]
Abstract
The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals. Various prevention measures were introduced around the world to limit the transmission of the disease, including face masks, mandates for social distancing and regular disinfection in public spaces, and the use of screening applications. These developments also triggered the need for novel and improved computer vision techniques capable of ( i ) providing support to the prevention measures through an automated analysis of visual data, on the one hand, and ( ii ) facilitating normal operation of existing vision-based services, such as biometric authentication schemes, on the other. Especially important here, are computer vision techniques that focus on the analysis of people and faces in visual data and have been affected the most by the partial occlusions introduced by the mandates for facial masks. Such computer vision based human analysis techniques include face and face-mask detection approaches, face recognition techniques, crowd counting solutions, age and expression estimation procedures, models for detecting face-hand interactions and many others, and have seen considerable attention over recent years. The goal of this survey is to provide an introduction to the problems induced by COVID-19 into such research and to present a comprehensive review of the work done in the computer vision based human analysis field. Particular attention is paid to the impact of facial masks on the performance of various methods and recent solutions to mitigate this problem. Additionally, a detailed review of existing datasets useful for the development and evaluation of methods for COVID-19 related applications is also provided. Finally, to help advance the field further, a discussion on the main open challenges and future research direction is given at the end of the survey. This work is intended to have a broad appeal and be useful not only for computer vision researchers but also the general public.
Collapse
Affiliation(s)
- Fevziye Irem Eyiokur
- Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Alperen Kantarcı
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
| | - Mustafa Ekrem Erakın
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
| | - Naser Damer
- Fraunhofer Institute for Computer Graphics Research IGD, Darmstadt, Germany
- Department of Computer Science, TU Darmstadt, Darmstadt, Germany
| | - Ferda Ofli
- Qatar Computing Research Institute, HBKU, Doha, Qatar
| | | | - Janez Križaj
- Faculty of Electrical Engineering, University of Ljubljana, Tržaška cesta 25, 1000 Ljubljana, Slovenia
| | - Albert Ali Salah
- Department of Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands
- Department of Computer Engineering, Bogˇaziçi University, Istanbul, Turkey
| | - Alexander Waibel
- Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Karlsruhe, Germany
- Carnegie Mellon University, Pittsburgh, United States
| | - Vitomir Štruc
- Faculty of Electrical Engineering, University of Ljubljana, Tržaška cesta 25, 1000 Ljubljana, Slovenia
| | - Hazım Kemal Ekenel
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
| |
Collapse
|
33
|
Zhou J, Li G, Wang R, Chen R, Luo S. A Novel Contrastive Self-Supervised Learning Framework for Solving Data Imbalance in Solder Joint Defect Detection. ENTROPY (BASEL, SWITZERLAND) 2023; 25:268. [PMID: 36832635 PMCID: PMC9954869 DOI: 10.3390/e25020268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 01/16/2023] [Accepted: 01/23/2023] [Indexed: 06/18/2023]
Abstract
Poor chip solder joints can severely affect the quality of the finished printed circuit boards (PCBs). Due to the diversity of solder joint defects and the scarcity of anomaly data, it is a challenging task to automatically and accurately detect all types of solder joint defects in the production process in real time. To address this issue, we propose a flexible framework based on contrastive self-supervised learning (CSSL). In this framework, we first design several special data augmentation approaches to generate abundant synthetic, not good (sNG) data from the normal solder joint data. Then, we develop a data filter network to distill the highest quality data from sNG data. Based on the proposed CSSL framework, a high-accuracy classifier can be obtained even when the available training data are very limited. Ablation experiments verify that the proposed method can effectively improve the ability of the classifier to learn normal solder joint (OK) features. Through comparative experiments, the classifier trained with the help of the proposed method can achieve an accuracy of 99.14% on the test set, which is better than other competitive methods. In addition, its reasoning time is less than 6 ms per chip image, which is in favor of the real-time defect detection of chip solder joints.
Collapse
|
34
|
Abiola O, Abayomi-Alli A, Tale OA, Misra S, Abayomi-Alli O. Sentiment analysis of COVID-19 tweets from selected hashtags in Nigeria using VADER and Text Blob analyser. JOURNAL OF ELECTRICAL SYSTEMS AND INFORMATION TECHNOLOGY 2023; 10:5. [PMCID: PMC9841936 DOI: 10.1186/s43067-023-00070-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 01/03/2023] [Indexed: 06/28/2023]
Abstract
Abstract
Background
Information is essential for growth; without it, little can be accomplished. Data gathering has seen significant changes throughout the previous few centuries because of the certain transitory medium. The look and style of information transference are affected by the employment of new and emerging technologies, some of which are efficient, others are reliable, and many more are quick and effective, but a few were disappointing for various reasons.
Aims
This study aims at using TextBlob and VADER analyser with historical tweets, to analyse emotional responses to the coronavirus pandemic (COVID-19). It shows us how much of a sociological, environmental, and economic impact it has in Nigeria, among other things. This study would be a tremendous step forward for students, researchers, and scholars who want to advance in fields like data science, machine learning, and deep learning.
Methodology
The hashtag ‘COVID-19' was used to collect 1,048,575 tweets from Twitter. The tweets were pre-processed with a Twitter tokenizer, while TextBlob and Valence Aware Dictionary for Sentiment Reasoning (VADER) were used for text mining and sentiment analysis, respectively. Topic modelling was done with Latent Dirichlet Allocation and visualized with Multidimensional scaling.
Results
The result of the VADER sentiment returned 39.8%, 31.3%, and 28.9%, positive, neutral, and negative sentiment, respectively, while the result of the TextBlob sentiment returned 46.0%, 36.7%, and 17.3%, neutral, positive, and negative sentiment, respectively.
Conclusion
With all of this, information from social media may be used to help organizations, governments, and nations around the world make smart and effective decisions about how to restrict and limit the negative effects of COVID-19. Also, know the opinion and challenges of people, then deal with the problem of misinformation. It is concluded that with popular belief a significant number of the populace regards COVID-19 as a virus that has come to stay, some believe it will eventually be conquered.
Collapse
|
35
|
Khan A, Akram MU, Nazir S. Automated grading of chest x-ray images for viral pneumonia with convolutional neural networks ensemble and region of interest localization. PLoS One 2023; 18:e0280352. [PMID: 36649367 PMCID: PMC9844910 DOI: 10.1371/journal.pone.0280352] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 12/27/2022] [Indexed: 01/18/2023] Open
Abstract
Following its initial identification on December 31, 2019, COVID-19 quickly spread around the world as a pandemic claiming more than six million lives. An early diagnosis with appropriate intervention can help prevent deaths and serious illness as the distinguishing symptoms that set COVID-19 apart from pneumonia and influenza frequently don't show up until after the patient has already suffered significant damage. A chest X-ray (CXR), one of many imaging modalities that are useful for detection and one of the most used, offers a non-invasive method of detection. The CXR image analysis can also reveal additional disorders, such as pneumonia, which show up as anomalies in the lungs. Thus these CXRs can be used for automated grading aiding the doctors in making a better diagnosis. In order to classify a CXR image into the Negative for Pneumonia, Typical, Indeterminate, and Atypical, we used the publicly available CXR image competition dataset SIIM-FISABIO-RSNA COVID-19 from Kaggle. The suggested architecture employed an ensemble of EfficientNetv2-L for classification, which was trained via transfer learning from the initialised weights of ImageNet21K on various subsets of data (Code for the proposed methodology is available at: https://github.com/asadkhan1221/siim-covid19.git). To identify and localise opacities, an ensemble of YOLO was combined using Weighted Boxes Fusion (WBF). Significant generalisability gains were made possible by the suggested technique's addition of classification auxiliary heads to the CNN backbone. The suggested method improved further by utilising test time augmentation for both classifiers and localizers. The results for Mean Average Precision score show that the proposed deep learning model achieves 0.617 and 0.609 on public and private sets respectively and these are comparable to other techniques for the Kaggle dataset.
Collapse
Affiliation(s)
- Asad Khan
- Computer and Software Engineering Department, National University of Sciences and Technology, Islamabad, Pakistan
| | - Muhammad Usman Akram
- Computer and Software Engineering Department, National University of Sciences and Technology, Islamabad, Pakistan
| | - Sajid Nazir
- Department of Computing, Glasgow Caledonian University, Glasgow, United Kingdom
- * E-mail:
| |
Collapse
|
36
|
Prediction of the COVID-19 infectivity and the sustainable impact on public health under deep learning algorithm. Soft comput 2023; 27:2695-2704. [PMID: 34456617 PMCID: PMC8380005 DOI: 10.1007/s00500-021-06142-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/10/2021] [Indexed: 10/24/2022]
Abstract
The aim is to explore the development trend of COVID-19 (Corona Virus Disease 2019) and predict the infectivity of 2019-nCoV (2019 Novel Coronavirus), as well as its impact on public health. First, the existing data are analyzed through data pre-processing to extract useful feature factors. Then, the LSTM (Long-Short Term Memory) prediction model in the deep learning algorithm is used to predict the epidemic situation in Hubei Province, outside Hubei nationwide, and the whole country, respectively. Meanwhile, the impact of intervention time changes on the epidemic situation is compared. The results show that the prediction results are almost consistent with the actual values. Specifically, Hubei Province abolishes quarantine restrictions after the Spring Festival holiday, and the first COVID-19 peak is reached in late February, while the second COVID-19 peak has been reached in early March. Finally, the cumulative number of diagnoses reaches 85,000 cases, with an increase of 15,000 cases compared with the nationwide cases outside Hubei under the continuous implementation of prevention and control measures. Under the prediction of the proposed LSTM model, if the nationwide implementation of prevention and control interventions is postponed by 5 days, the epidemic will peak in early March, and the cumulative number of diagnoses will be about 200,000; and if the intervention measures are implemented five days earlier, the epidemic will peak in mid-February, with a cumulative number of diagnoses of approximately 40,000. Meanwhile, the proposed LSTM model predicts the RMSE values of the epidemic situation in Hubei Province, outside Hubei nationwide, and the whole country as 34.63, 75.42, and 50.27, respectively. Under model comparison analysis, the prediction error of the proposed LSTM model is small and has better applicability over similar algorithms. The results show that the LSTM model is effective and has high performance in infectious disease prediction, and the research results can provide scientific and effective references for subsequent related research.
Collapse
|
37
|
Saleem K, Saleem M, Ahmad RZ, Javed AR, Alazab M, Gadekallu TR, Suleman A. Situation-Aware BDI Reasoning to Detect Early Symptoms of Covid 19 Using Smartwatch. IEEE SENSORS JOURNAL 2023; 23:898-905. [PMID: 36913222 PMCID: PMC9983688 DOI: 10.1109/jsen.2022.3156819] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 02/28/2022] [Indexed: 05/09/2023]
Abstract
Ambient intelligence plays a crucial role in healthcare situations. It provides a certain way to deal with emergencies to provide the essential resources such as nearest hospitals and emergency stations promptly to avoid deaths. Since the outbreak of Covid-19, several artificial intelligence techniques have been used. However, situation awareness is a key aspect to handling any pandemic situation. The situation-awareness approach gives patients a routine life where they are continuously monitored by caregivers through wearable sensors and alert the practitioners in case of any patient emergency. Therefore, in this paper, we propose a situation-aware mechanism to detect Covid-19 systems early and alert the user to be self-aware regarding the situation to take precautions if the situation seems unlikely to be normal. We provide Belief-Desire-Intention intelligent reasoning mechanism for the system to analyze the situation after acquiring the data from the wearable sensors and alert the user according to their environment. We use the case study for further demonstration of our proposed framework. We model the proposed system by temporal logic and map the system illustration into a simulation tool called NetLogo to determine the results of the proposed system.
Collapse
Affiliation(s)
- Kiran Saleem
- School of SoftwareDalian University of Technology Dalian 116024 China
| | - Misbah Saleem
- Institute of Diet and Nutritional Science, University of Lahore Lahore 54590 Pakistan
| | | | | | - Mamoun Alazab
- College of EngineeringIT and Environment, Charles Darwin University Darwin NT 0815 Australia
| | | | - Ahmad Suleman
- Center of Excellence in Solid State PhysicsUniversity of Punjab Lahore 05422 Pakistan
| |
Collapse
|
38
|
Sharma P, Gangadharappa M. Detection of multiple anomalous instances in video surveillance systems. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-221925] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Anomalous event recognition has a complicated definition in the complex background due to the sparse occurrence of anomalies. In this paper, we form a framework for classifying multiple anomalies present in video frames that happen in a context such as the sudden moment of people in various directions and anomalous vehicles in the pedestrian park. An attention U-net model on video frames is utilized to create a binary segmented anomalous image that classifies each anomalous object in the video. White pixels indicate the anomaly, and black pixels serve as the background image. For better segmentation, we have assigned a border to every anomalous object in a binary image. Further to distinguish each anomaly a watershed algorithm is utilized that develops multi-level gray image masks for every anomalous class. This forms a multi-class problem, where each anomalous instance is represented by a different gray color level. We use pixel values, Optical Intensity, entropy values, and Gaussian filter with sigma 5, and 7 to form a feature extraction module for training video images along with their multi-instance gray-level masks. Pixel-level localization and identification of unusual items are done using the feature vectors acquired from the feature extraction module and multi-class stack classifier model. The proposed methodology is evaluated on UCSD Ped1, Ped2 and UMN datasets that obtain pixel-level average accuracy results of 81.15%,87.26% and 82.67% respectively.
Collapse
|
39
|
Al-Garadi MA, Yang YC, Sarker A. The Role of Natural Language Processing during the COVID-19 Pandemic: Health Applications, Opportunities, and Challenges. Healthcare (Basel) 2022; 10:2270. [PMID: 36421593 PMCID: PMC9690240 DOI: 10.3390/healthcare10112270] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/03/2022] [Accepted: 11/06/2022] [Indexed: 07/30/2023] Open
Abstract
The COVID-19 pandemic is the most devastating public health crisis in at least a century and has affected the lives of billions of people worldwide in unprecedented ways. Compared to pandemics of this scale in the past, societies are now equipped with advanced technologies that can mitigate the impacts of pandemics if utilized appropriately. However, opportunities are currently not fully utilized, particularly at the intersection of data science and health. Health-related big data and technological advances have the potential to significantly aid the fight against such pandemics, including the current pandemic's ongoing and long-term impacts. Specifically, the field of natural language processing (NLP) has enormous potential at a time when vast amounts of text-based data are continuously generated from a multitude of sources, such as health/hospital systems, published medical literature, and social media. Effectively mitigating the impacts of the pandemic requires tackling challenges associated with the application and deployment of NLP systems. In this paper, we review the applications of NLP to address diverse aspects of the COVID-19 pandemic. We outline key NLP-related advances on a chosen set of topics reported in the literature and discuss the opportunities and challenges associated with applying NLP during the current pandemic and future ones. These opportunities and challenges can guide future research aimed at improving the current health and social response systems and pandemic preparedness.
Collapse
Affiliation(s)
- Mohammed Ali Al-Garadi
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37240, USA
| | - Yuan-Chi Yang
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA
| | - Abeed Sarker
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA
| |
Collapse
|
40
|
Ahila T, Subhajini AC. E-GCS: Detection of COVID-19 through classification by attention bottleneck residual network. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 2022; 116:105398. [PMID: 36158870 PMCID: PMC9485443 DOI: 10.1016/j.engappai.2022.105398] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 06/30/2022] [Accepted: 08/26/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND Recently, the coronavirus disease 2019 (COVID-19) has caused mortality of many people globally. Thus, there existed a need to detect this disease to prevent its further spread. Hence, the study aims to predict COVID-19 infected patients based on deep learning (DL) and image processing. OBJECTIVES The study intends to classify the normal and abnormal cases of COVID-19 by considering three different medical imaging modalities namely ultrasound imaging, X-ray images and CT scan images through introduced attention bottleneck residual network (AB-ResNet). It also aims to segment the abnormal infected area from normal images for localizing localising the disease infected area through the proposed edge based graph cut segmentation (E-GCS). METHODOLOGY AB-ResNet is used for classifying images whereas E-GCS segment the abnormal images. The study possess various advantages as it rely on DL and possess capability for accelerating the training speed of deep networks. It also enhance the network depth leading to minimum parameters, minimising the impact of vanishing gradient issue and attaining effective network performance with respect to better accuracy. RESULTS/CONCLUSION Performance and comparative analysis is undertaken to evaluate the efficiency of the introduced system and results explores the efficiency of the proposed system in COVID-19 detection with high accuracy (99%).
Collapse
Affiliation(s)
- T Ahila
- Department of Computer Applications, Noorul Islam Centre For Higher Education, Kumaracoil, 629180, India
| | - A C Subhajini
- Department of Computer Applications, Noorul Islam Centre For Higher Education, Kumaracoil, 629180, India
| |
Collapse
|
41
|
Chen Y, Zhang Z. An easy numeric data augmentation method for early-stage COVID-19 tweets exploration of participatory dynamics of public attention and news coverage. Inf Process Manag 2022; 59:103073. [PMID: 36061343 PMCID: PMC9420706 DOI: 10.1016/j.ipm.2022.103073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2022] [Revised: 08/21/2022] [Accepted: 08/25/2022] [Indexed: 11/05/2022]
Abstract
With the onset of COVID-19, the pandemic has aroused huge discussions on social media like Twitter, followed by many social media analyses concerning it. Despite such an abundance of studies, however, little work has been done on reactions from the public and officials on social networks and their associations, especially during the early outbreak stage. In this paper, a total of 9,259,861 COVID-19-related English tweets published from 31 December 2019 to 11 March 2020 are accumulated for exploring the participatory dynamics of public attention and news coverage during the early stage of the pandemic. An easy numeric data augmentation (ENDA) technique is proposed for generating new samples while preserving label validity. It attains superior performance on text classification tasks with deep models (BERT) than an easier data augmentation method. To demonstrate the efficacy of ENDA further, experiments and ablation studies have also been implemented on other benchmark datasets. The classification results of COVID-19 tweets show tweets peaks trigged by momentous events and a strong positive correlation between the daily number of personal narratives and news reports. We argue that there were three periods divided by the turning points on January 20 and February 23 and the low level of news coverage suggests the missed windows for government response in early January and February. Our study not only contributes to a deeper understanding of the dynamic patterns and relationships of public attention and news coverage on social media during the pandemic but also sheds light on early emergency management and government response on social media during global health crises.
Collapse
|
42
|
Deep learning for Covid-19 forecasting: State-of-the-art review. Neurocomputing 2022; 511:142-154. [PMID: 36097509 PMCID: PMC9454152 DOI: 10.1016/j.neucom.2022.09.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Revised: 07/03/2022] [Accepted: 09/04/2022] [Indexed: 11/21/2022]
Abstract
The Covid-19 pandemic has galvanized scientists to apply machine learning methods to help combat the crisis. Despite the significant amount of research there exists no comprehensive survey devoted specifically to examining deep learning methods for Covid-19 forecasting. In this paper, we fill the gap in the literature by reviewing and analyzing the current studies that use deep learning for Covid-19 forecasting. In our review, all published papers and preprints, discoverable through Google Scholar, for the period from Apr 1, 2020 to Feb 20, 2022 which describe deep learning approaches to forecasting Covid-19 were considered. Our search identified 152 studies, of which 53 passed the initial quality screening and were included in our survey. We propose a model-based taxonomy to categorize the literature. We describe each model and highlight its performance. Finally, the deficiencies of the existing approaches are identified and the necessary improvements for future research are elucidated. The study provides a gateway for researchers who are interested in forecasting Covid-19 using deep learning.
Collapse
|
43
|
Omics Data and Data Representations for Deep Learning-Based Predictive Modeling. Int J Mol Sci 2022; 23:ijms232012272. [PMID: 36293133 PMCID: PMC9603455 DOI: 10.3390/ijms232012272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 10/03/2022] [Accepted: 10/12/2022] [Indexed: 11/25/2022] Open
Abstract
Medical discoveries mainly depend on the capability to process and analyze biological datasets, which inundate the scientific community and are still expanding as the cost of next-generation sequencing technologies is decreasing. Deep learning (DL) is a viable method to exploit this massive data stream since it has advanced quickly with there being successive innovations. However, an obstacle to scientific progress emerges: the difficulty of applying DL to biology, and this because both fields are evolving at a breakneck pace, thus making it hard for an individual to occupy the front lines of both of them. This paper aims to bridge the gap and help computer scientists bring their valuable expertise into the life sciences. This work provides an overview of the most common types of biological data and data representations that are used to train DL models, with additional information on the models themselves and the various tasks that are being tackled. This is the essential information a DL expert with no background in biology needs in order to participate in DL-based research projects in biomedicine, biotechnology, and drug discovery. Alternatively, this study could be also useful to researchers in biology to understand and utilize the power of DL to gain better insights into and extract important information from the omics data.
Collapse
|
44
|
Gomes R, Kamrowski C, Mohan PD, Senor C, Langlois J, Wildenberg J. Application of Deep Learning to IVC Filter Detection from CT Scans. Diagnostics (Basel) 2022; 12:diagnostics12102475. [PMID: 36292164 PMCID: PMC9600884 DOI: 10.3390/diagnostics12102475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Revised: 10/05/2022] [Accepted: 10/10/2022] [Indexed: 11/16/2022] Open
Abstract
IVC filters (IVCF) perform an important function in select patients that have venous blood clots. However, they are usually intended to be temporary, and significant delay in removal can have negative health consequences for the patient. Currently, all Interventional Radiology (IR) practices are tasked with tracking patients in whom IVCF are placed. Due to their small size and location deep within the abdomen it is common for patients to forget that they have an IVCF. Therefore, there is a significant delay for a new healthcare provider to become aware of the presence of a filter. Patients may have an abdominopelvic CT scan for many reasons and, fortunately, IVCF are clearly visible on these scans. In this research a deep learning model capable of segmenting IVCF from CT scan slices along the axial plane is developed. The model achieved a Dice score of 0.82 for training over 372 CT scan slices. The segmentation model is then integrated with a prediction algorithm capable of flagging an entire CT scan as having IVCF. The prediction algorithm utilizing the segmentation model achieved a 92.22% accuracy at detecting IVCF in the scans.
Collapse
Affiliation(s)
- Rahul Gomes
- Department of Computer Science, University of Wisconsin-Eau Claire, Eau Claire, WI 54701, USA
- Correspondence: (R.G.); (J.W.)
| | - Connor Kamrowski
- Department of Computer Science, University of Wisconsin-Eau Claire, Eau Claire, WI 54701, USA
| | - Pavithra Devy Mohan
- Department of Computer Science, University of Wisconsin-Eau Claire, Eau Claire, WI 54701, USA
| | - Cameron Senor
- Department of Computer Science, University of Wisconsin-Eau Claire, Eau Claire, WI 54701, USA
| | - Jordan Langlois
- Department of Computer Science, University of Wisconsin-Eau Claire, Eau Claire, WI 54701, USA
| | - Joseph Wildenberg
- Interventional Radiology, Mayo Clinic Health System, Eau Claire, WI 54703, USA
- Correspondence: (R.G.); (J.W.)
| |
Collapse
|
45
|
Agenda-Setting for COVID-19: A Study of Large-Scale Economic News Coverage Using Natural Language Processing. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS 2022; 15:291-312. [PMID: 36217352 PMCID: PMC9535225 DOI: 10.1007/s41060-022-00364-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 09/14/2022] [Indexed: 11/15/2022]
Abstract
Over the past two years, organizations and businesses have been forced to constantly adapt and develop effective responses to the challenges of the COVID-19 pandemic. The acuteness, global scale and intense dynamism of the situation make online news and information even more important for making informed management and policy decisions. This paper focuses on the economic impact of the COVID-19 pandemic, using natural language processing (NLP) techniques to examine the news media as the main source of information and agenda-setters of public discourse over an eight-month period. The aim of this study is to understand which economic topics news media focused on alongside the dominant health coverage, which topics did not surface, and how these topics influenced each other and evolved over time and space. To this end, we used an extensive open-source dataset of over 350,000 media articles on non-medical aspects of COVID-19 retrieved from over 60 top-tier business blogs and news sites. We referred to the World Economic Forum’s Strategic Intelligence taxonomy to categorize the articles into a variety of topics. In doing so, we found that in the early days of COVID-19, the news media focused predominantly on reporting new cases, which tended to overshadow other topics, such as the economic impact of the virus. Different independent news sources reported on the same topics, showing a herd behavior of the news media during this global health crisis. However, a temporal analysis of news distribution in relation to its geographic focus showed that the rise in COVID-19 cases was associated with an increase in media coverage of relevant socio-economic topics. This research helps prepare for the prevention of social and economic crises when decision-makers closely monitor news coverage of viruses and related topics in other parts of the world. Thus, monitoring the news landscape on a global scale can support decision-making in social and economic crises. Our analyses point to ways in which this monitoring and issues management can be improved to remain alert to social dynamics and market changes.
Collapse
|
46
|
Pham P, Pedrycz W, Vo B. Dual attention-based sequential auto-encoder for Covid-19 outbreak forecasting: A case study in Vietnam. EXPERT SYSTEMS WITH APPLICATIONS 2022; 203:117514. [PMID: 35607612 PMCID: PMC9117090 DOI: 10.1016/j.eswa.2022.117514] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Revised: 05/02/2022] [Accepted: 05/03/2022] [Indexed: 06/15/2023]
Abstract
For preventing the outbreaks of Covid-19 infection in different countries, many organizations and governments have extensively studied and applied different kinds of quarantine isolation policies, medical treatments as well as organized massive/fast vaccination strategy for over-18 citizens. There are several valuable lessons have been achieved in different countries this Covid-19 battle. These studies have presented the usefulness of prompt actions in testing, isolating confirmed infectious cases from community as well as social resource planning/optimization through data-driven anticipation. In recent times, many studies have demonstrated the effectiveness of short/long-term forecasting in number of new Covid-19 cases in forms of time-series data. These predictions have directly supported to effectively optimize the available healthcare resources as well as imposing suitable policies for slowing down the Covid-19 spreads, especially in high-populated cities/regions/nations. There are several progresses of deep neural architectures, such as recurrent neural network (RNN) have demonstrated significant improvements in analyzing and learning the time-series datasets for conducting better predictions. However, most of recent RNN-based techniques are considered as unable to handle chaotic/non-smooth sequential datasets. The consecutive disturbances and lagged observations from chaotic time-series dataset like as routine Covid-19 confirmed cases have led to the low performance in temporal feature learning process through recent RNN-based models. To meet this challenge, in this paper, we proposed a novel dual attention-based sequential auto-encoding architecture, called as: DAttAE. Our proposed model supports to effectively learn and predict the new Covid-19 cases in forms of chaotic and non-smooth time series dataset. Specifically, the integration between dual self-attention mechanism in a given Bi-LSTM based auto-encoder in our proposed model supports to directly focus the model on a specific time-range sequence in order to achieve better prediction. We evaluated the performance of our proposed DAttAE model by comparing with multiple traditional and state-of-the-art deep learning-based techniques for time-series prediction task upon different real-world datasets. Experimental outputs demonstrated the effectiveness of our proposed attention-based deep neural approach in comparing with state-of-the-art RNN-based architectures for time series based Covid-19 outbreak prediction task.
Collapse
Affiliation(s)
- Phu Pham
- Faculty of Information Technology, HUTECH University, Ho Chi Minh City, Viet Nam
| | - Witold Pedrycz
- Department of Electrical & Computer Engineering, University of Alberta, Edmonton T6R 2V4, Canada
- Warsaw School of Information Technology, Newelska 6, Warsaw, Poland
| | - Bay Vo
- Faculty of Information Technology, HUTECH University, Ho Chi Minh City, Viet Nam
| |
Collapse
|
47
|
Li Y, Ma K. A Hybrid Model Based on Improved Transformer and Graph Convolutional Network for COVID-19 Forecasting. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:12528. [PMID: 36231828 PMCID: PMC9564883 DOI: 10.3390/ijerph191912528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 09/25/2022] [Accepted: 09/28/2022] [Indexed: 06/16/2023]
Abstract
The coronavirus disease 2019 (COVID-19) has spread rapidly around the world since 2020, with a significant fatality rate. Until recently, numerous countries were unable to adequately control the pandemic. As a result, COVID-19 trend prediction has become a hot topic in academic circles. Both traditional models and existing deep learning (DL) models have the problem of low prediction accuracy. In this paper, we propose a hybrid model based on an improved Transformer and graph convolution network (GCN) for COVID-19 forecasting. The salient feature of the model in this paper is that rich temporal sequence information is extracted by the multi-head attention mechanism, and then the correlation of temporal sequence information is further aggregated by GCN. In addition, to solve the problem of the high time complexity of the existing Transformer, we use the cosine function to replace the softmax calculation, so that the calculation of query, key and value can be split, and the time complexity is reduced from the original O(N2) to O(N). We only concentrated on three states in the United States, one of which was the most affected, one of which was the least affected, and one intermediate state, in order to make our predictions more meaningful. We use mean absolute percentage error and mean absolute error as evaluation indexes. The experimental results show that the proposed time series model has a better predictive performance than the current DL models and traditional models. Additionally, our model's convergence outperforms that of the current DL models, offering a more precise benchmark for the control of epidemics.
Collapse
Affiliation(s)
- Yulan Li
- Faculty of Civil Engineering and Mechanics, Kunming University of Science and Technology, Kunming 650500, China
- Faculty of Science, Kunming University of Science and Technology, Kunming 650500, China
| | - Kun Ma
- Faculty of Civil Engineering and Mechanics, Kunming University of Science and Technology, Kunming 650500, China
| |
Collapse
|
48
|
Peng L, Wang C, Tian G, Liu G, Li G, Lu Y, Yang J, Chen M, Li Z. Analysis of CT scan images for COVID-19 pneumonia based on a deep ensemble framework with DenseNet, Swin transformer, and RegNet. Front Microbiol 2022; 13:995323. [PMID: 36212877 PMCID: PMC9539545 DOI: 10.3389/fmicb.2022.995323] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 08/22/2022] [Indexed: 12/15/2022] Open
Abstract
COVID-19 has caused enormous challenges to global economy and public health. The identification of patients with the COVID-19 infection by CT scan images helps prevent its pandemic. Manual screening COVID-19-related CT images spends a lot of time and resources. Artificial intelligence techniques including deep learning can effectively aid doctors and medical workers to screen the COVID-19 patients. In this study, we developed an ensemble deep learning framework, DeepDSR, by combining DenseNet, Swin transformer, and RegNet for COVID-19 image identification. First, we integrate three available COVID-19-related CT image datasets to one larger dataset. Second, we pretrain weights of DenseNet, Swin Transformer, and RegNet on the ImageNet dataset based on transformer learning. Third, we continue to train DenseNet, Swin Transformer, and RegNet on the integrated larger image dataset. Finally, the classification results are obtained by integrating results from the above three models and the soft voting approach. The proposed DeepDSR model is compared to three state-of-the-art deep learning models (EfficientNetV2, ResNet, and Vision transformer) and three individual models (DenseNet, Swin transformer, and RegNet) for binary classification and three-classification problems. The results show that DeepDSR computes the best precision of 0.9833, recall of 0.9895, accuracy of 0.9894, F1-score of 0.9864, AUC of 0.9991 and AUPR of 0.9986 under binary classification problem, and significantly outperforms other methods. Furthermore, DeepDSR obtains the best precision of 0.9740, recall of 0.9653, accuracy of 0.9737, and F1-score of 0.9695 under three-classification problem, further suggesting its powerful image identification ability. We anticipate that the proposed DeepDSR framework contributes to the diagnosis of COVID-19.
Collapse
Affiliation(s)
- Lihong Peng
- School of Computer Science, Hunan University of Technology, Zhuzhou, China
- College of Life Sciences and Chemistry, Hunan University of Technology, Zhuzhou, China
| | - Chang Wang
- School of Computer Science, Hunan University of Technology, Zhuzhou, China
| | - Geng Tian
- Geneis (Beijing) Co., Ltd., Beijing, China
| | - Guangyi Liu
- School of Computer Science, Hunan University of Technology, Zhuzhou, China
| | - Gan Li
- School of Computer Science, Hunan University of Technology, Zhuzhou, China
| | - Yuankang Lu
- School of Computer Science, Hunan University of Technology, Zhuzhou, China
| | | | - Min Chen
- School of Computer Science, Hunan Institute of Technology, Hengyang, China
- *Correspondence: Min Chen, ; Zejun Li,
| | - Zejun Li
- School of Computer Science, Hunan Institute of Technology, Hengyang, China
- *Correspondence: Min Chen, ; Zejun Li,
| |
Collapse
|
49
|
Mining Public Opinions on COVID-19 Vaccination: A Temporal Analysis to Support Combating Misinformation. Trop Med Infect Dis 2022; 7:tropicalmed7100256. [DOI: 10.3390/tropicalmed7100256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Revised: 09/17/2022] [Accepted: 09/19/2022] [Indexed: 11/16/2022] Open
Abstract
This article presents a study that applied opinion analysis about COVID-19 immunization in Brazil. An initial set of 143,615 tweets was collected containing 49,477 pro- and 44,643 anti-vaccination and 49,495 neutral posts. Supervised classifiers (multinomial naïve Bayes, logistic regression, linear support vector machines, random forests, adaptative boosting, and multilayer perceptron) were tested, and multinomial naïve Bayes, which had the best trade-off between overfitting and correctness, was selected to classify a second set containing 221,884 unclassified tweets. A timeline with the classified tweets was constructed, helping to identify dates with peaks in each polarity and search for events that may have caused the peaks, providing methodological assistance in combating sources of misinformation linked to the spread of anti-vaccination opinion.
Collapse
|
50
|
Application and Communication Optimization Technology of Unmanned Distribution Car under Deep Learning in Logistics Express of COVID-19. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5386737. [PMID: 36164428 PMCID: PMC9509245 DOI: 10.1155/2022/5386737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 08/23/2022] [Accepted: 08/30/2022] [Indexed: 11/21/2022]
Abstract
This work aims to solve the problem that the daily necessities of urban residents cannot be delivered during coronavirus disease 2019 (COVID-19), thereby reducing the possibility of the delivery personnel contracting COVID-19 due to the need to transport medicines to the hospital during the epidemic. Firstly, this work studies the application and communication optimization technology of unmanned delivery cars based on deep learning (DL) under COVID-19. Secondly, a route planning method for unmanned delivery cars based on the DL method is proposed under the influence of factors such as maximum flight time, load, and road conditions. This work analyzes and introduces unmanned delivery cars from four aspects combined with the actual operation of unmanned delivery cars and related literature: the characteristics, delivery mode, economy, and limitations of unmanned delivery cars. The unmanned delivery car is in the promotion stage. A basic AVRPTW model is established that minimizes the total delivery cost without considering the charging behavior under the restriction of some routes, delivery time, load, and other factors. The path optimization problem of unmanned delivery cars in various situations is considered. A multiobjective optimization model of the unmanned delivery car in the charging/swap mode is established with the goal of minimizing the total delivery cost and maximizing customer satisfaction under the premise of meeting the car driving requirements. An improved genetic algorithm is designed to solve the established model. Finally, the model is tested, and its results are analyzed. The effectiveness of this route planning method is proved through case analysis. Customer satisfaction, delivery time, cost input, and other aspects have been greatly improved through the improvement and optimization of the unmanned delivery car line, which has been well applied in practice. In addition, unmanned delivery cars are affected by many factors such as load, and the service time required for delivery is longer. Therefore, this work chooses an unmanned distribution car with strong endurance to improve distribution efficiency. The new hospital contactless distribution mode discussed here will play an important role in promoting future development.
Collapse
|