51
|
Mohammed EA, Keyhani M, Sanati-Nezhad A, Hejazi SH, Far BH. An ensemble learning approach to digital corona virus preliminary screening from cough sounds. Sci Rep 2021; 11:15404. [PMID: 34321592 PMCID: PMC8319422 DOI: 10.1038/s41598-021-95042-2] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2021] [Accepted: 07/09/2021] [Indexed: 02/05/2023] Open
Abstract
This work develops a robust classifier for a COVID-19 pre-screening model from crowdsourced cough sound data. The crowdsourced cough recordings contain a variable number of coughs, with some input sound files more informative than the others. Accurate detection of COVID-19 from the sound datasets requires overcoming two main challenges (i) the variable number of coughs in each recording and (ii) the low number of COVID-positive cases compared to healthy coughs in the data. We use two open datasets of crowdsourced cough recordings and segment each cough recording into non-overlapping coughs. The segmentation enriches the original data without oversampling by splitting the original cough sound files into non-overlapping segments. Splitting the sound files enables us to increase the samples of the minority class (COVID-19) without changing the feature distribution of the COVID-19 samples resulted from applying oversampling techniques. Each cough sound segment is transformed into six image representations for further analyses. We conduct extensive experiments with shallow machine learning, Convolutional Neural Network (CNN), and pre-trained CNN models. The results of our models were compared to other recently published papers that apply machine learning to cough sound data for COVID-19 detection. Our method demonstrated a high performance using an ensemble model on the testing dataset with area under receiver operating characteristics curve = 0.77, precision = 0.80, recall = 0.71, F1 measure = 0.75, and Kappa = 0.53. The results show an improvement in the prediction accuracy of our COVID-19 pre-screening model compared to the other models.
Collapse
Affiliation(s)
- Emad A Mohammed
- Department of Electrical and Software Engineering, University of Calgary, Calgary, T2N 1N4, Canada
| | - Mohammad Keyhani
- Haskayne School of Business, University of Calgary, Calgary, T2N 1N4, Canada
| | - Amir Sanati-Nezhad
- Department of Mechanical and Manufacturing Engineering, University of Calgary, Calgary, T2N 1N4, Canada
| | - S Hossein Hejazi
- Department of Chemical and Petroleum Engineering, University of Calgary, Calgary, T2N 1N4, Canada.
| | - Behrouz H Far
- Department of Electrical and Software Engineering, University of Calgary, Calgary, T2N 1N4, Canada.
| |
Collapse
|
52
|
Singh B, Datta B, Ashish A, Dutta G. A comprehensive review on current COVID-19 detection methods: From lab care to point of care diagnosis. SENSORS INTERNATIONAL 2021; 2:100119. [PMID: 34766062 PMCID: PMC8302821 DOI: 10.1016/j.sintl.2021.100119] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/16/2021] [Revised: 07/13/2021] [Accepted: 07/14/2021] [Indexed: 12/19/2022] Open
Abstract
Without a doubt, the current global pandemic affects all walks of our life. It affected almost every age group all over the world with a disease named COVID-19, declared as a global pandemic by WHO in early 2020. Due to the high transmission and moderate mortality rate of this virus, it is also regarded as the panic-zone virus. This potentially deadly virus has pointed up the significance of COVID-19 research. Due to the rapid transmission of COVID-19, early detection is very crucial. Presently, there are different conventional techniques are available for coronavirus detection like CT-scan, PCR, Sequencing, CRISPR, ELISA, LFA, LAMP. The urgent need for rapid, accurate, and cost-effective detection and the requirement to cut off shortcomings of traditional detection methods, make scientists realize to advance new technologies. Biosensors are one of the reliable platforms for accurate, early diagnosis. In this article, we have pointed recent diagnosis approaches for COVID-19. The review includes basic virology of SARS-CoV-2 mainly clinical and pathological features. We have also briefly discussed different types of biosensors, their working principles, and current advancement for COVID-19 detection and prevention.
Collapse
Affiliation(s)
- Bishal Singh
- School of Medical Science and Technology (SMST), Indian Institute of Technology Kharagpur, Kharagpur, West Bengal, 721302, India
| | - Brateen Datta
- School of Medical Science and Technology (SMST), Indian Institute of Technology Kharagpur, Kharagpur, West Bengal, 721302, India
| | - Amlan Ashish
- School of Medical Science and Technology (SMST), Indian Institute of Technology Kharagpur, Kharagpur, West Bengal, 721302, India
| | - Gorachand Dutta
- School of Medical Science and Technology (SMST), Indian Institute of Technology Kharagpur, Kharagpur, West Bengal, 721302, India
| |
Collapse
|
53
|
Surianarayanan C, Chelliah PR. Leveraging Artificial Intelligence (AI) Capabilities for COVID-19 Containment. NEW GENERATION COMPUTING 2021; 39:717-741. [PMID: 34131359 PMCID: PMC8191724 DOI: 10.1007/s00354-021-00128-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 06/05/2021] [Indexed: 05/15/2023]
Abstract
The Coronavirus disease (COVID-19) is an infectious disease caused by the newly discovered Severe Acute Respiratory Syndrome Coronavirus two (SARS-CoV-2). Most of the people do not have the acquired immunity to fight this virus. There is no specific treatment or medicine to cure the disease. The effects of this disease appear to vary from individual to individual, right from mild cough, fever to respiratory disease. It also leads to mortality in many people. As the virus has a very rapid transmission rate, the entire world is in distress. The control and prevention of this disease has evolved as an urgent and critical issue to be addressed through technological solutions. The Healthcare industry therefore needs support from the domain of artificial intelligence (AI). AI has the inherent capability of imitating the human brain and assisting in decision-making support by automatically learning from input data. It can process huge amounts of data quickly without getting tiresome and making errors. AI technologies and tools significantly relieve the burden of healthcare professionals. In this paper, we review the critical role of AI in responding to different research challenges around the COVID-19 crisis. A sample implementation of a powerful probabilistic machine learning (ML) algorithm for assessment of risk levels of individuals is incorporated in this paper. Other pertinent application areas such as surveillance of people and hotspots, mortality prediction, diagnosis, prognostic assistance, drug repurposing and discovery of protein structure, and vaccine are presented. The paper also describes various challenges that are associated with the implementation of AI-based tools and solutions for practical use.
Collapse
Affiliation(s)
- Chellammal Surianarayanan
- Government Arts and Science College (Formerly Bharathidasan University Constituent Arts and Science College), Affiliated to Bharathidasan University, Tiruchirappalli, Tamilnadu India
| | - Pethuru Raj Chelliah
- Site Reliability Engineering Division, Reliance Jio Platforms Ltd, Bangalore, India
| |
Collapse
|
54
|
Sait U, K V GL, Shivakumar S, Kumar T, Bhaumik R, Prajapati S, Bhalla K, Chakrapani A. A deep-learning based multimodal system for Covid-19 diagnosis using breathing sounds and chest X-ray images. Appl Soft Comput 2021; 109:107522. [PMID: 34054379 PMCID: PMC8149173 DOI: 10.1016/j.asoc.2021.107522] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2021] [Revised: 04/20/2021] [Accepted: 05/21/2021] [Indexed: 12/23/2022]
Abstract
Covid-19 has become a deadly pandemic claiming more than three million lives worldwide. SARS-CoV-2 causes distinct pathomorphological alterations in the respiratory system, thereby acting as a biomarker to aid its diagnosis. A multimodal framework (Ai-CovScan) for Covid-19 detection using breathing sounds, chest X-ray (CXR) images, and rapid antigen test (RAnT) is proposed. Transfer Learning approach using existing deep-learning Convolutional Neural Network (CNN) based on Inception-v3 is combined with Multi-Layered Perceptron (MLP) to develop the CovScanNet model for reducing false-negatives. This model reports a preliminary accuracy of 80% for the breathing sound analysis, and 99.66% Covid-19 detection accuracy for the curated CXR image dataset. Based on Ai-CovScan, a smartphone app is conceptualised as a mass-deployable screening tool, which could alter the course of this pandemic. This app’s deployment could minimise the number of people accessing the limited and expensive confirmatory tests, thereby reducing the burden on the severely stressed healthcare infrastructure.
Collapse
Affiliation(s)
- Unais Sait
- Faculty of Architecture and Design, PES University, Bengaluru, India
| | - Gokul Lal K V
- East Point College of Engineering and Technology, Bengaluru, India
| | - Sanjana Shivakumar
- Department of Design and Computation Arts, Concordia University, Qc, Canada
| | - Tarun Kumar
- Centre for Product Design and Manufacturing, Indian Institute of Science, Bengaluru, India
| | - Rahul Bhaumik
- Faculty of Architecture and Design, PES University, Bengaluru, India
| | - Sunny Prajapati
- Faculty of Architecture and Design, PES University, Bengaluru, India
| | - Kriti Bhalla
- School of Architecture, Ramaiah Institute of Technology, Bengaluru, Karnataka, India
| | | |
Collapse
|
55
|
Ibrahim MR, Youssef SM, Fathalla KM. Abnormality detection and intelligent severity assessment of human chest computed tomography scans using deep learning: a case study on SARS-COV-2 assessment. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2021; 14:5665-5688. [PMID: 34055098 PMCID: PMC8147594 DOI: 10.1007/s12652-021-03282-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 04/19/2021] [Indexed: 05/07/2023]
Abstract
Different respiratory infections cause abnormal symptoms in lung parenchyma that show in chest computed tomography. Since December 2019, the SARS-COV-2 virus, which is the causative agent of COVID-19, has invaded the world causing high numbers of infections and deaths. The infection with SARS-COV-2 virus shows an abnormality in lung parenchyma that can be effectively detected using Computed Tomography (CT) imaging. In this paper, a novel computer aided framework (COV-CAF) is proposed for classifying the severity degree of the infection from 3D Chest Volumes. COV-CAF fuses traditional and deep learning approaches. The proposed COV-CAF consists of two phases: the preparatory phase and the feature analysis and classification phase. The preparatory phase handles 3D-CT volumes and presents an effective cut choice strategy for choosing informative CT slices. The feature analysis and classification phase incorporate fuzzy clustering for automatic Region of Interest (RoI) segmentation and feature fusion. In feature fusion, automatic features are extracted from a newly introduced Convolution Neural Network (Norm-VGG16) and are fused with spatial hand-crafted features extracted from segmented RoI. Experiments are conducted on MosMedData: Chest CT Scans with COVID-19 Related Findings with COVID-19 severity classes and SARS-COV-2 CT-Scan benchmark datasets. The proposed COV-CAF achieved remarkable results on both datasets. On MosMedData dataset, it achieved an overall accuracy of 97.76% and average sensitivity of 96.73%, while on SARS-COV-2 CT-Scan dataset it achieves an overall accuracy and sensitivity 97.59% and 98.41% respectively.
Collapse
Affiliation(s)
- Mohamed Ramzy Ibrahim
- Computer Engineering Department, Arab Academy for Science, Technology and Maritime Transport (AASTMT), Alexandria, 1029 Egypt
| | - Sherin M. Youssef
- Computer Engineering Department, Arab Academy for Science, Technology and Maritime Transport (AASTMT), Alexandria, 1029 Egypt
| | - Karma M. Fathalla
- Computer Engineering Department, Arab Academy for Science, Technology and Maritime Transport (AASTMT), Alexandria, 1029 Egypt
| |
Collapse
|
56
|
Lella KK, Pja A. Automatic COVID-19 disease diagnosis using 1D convolutional neural network and augmentation with human respiratory sound based on parameters: cough, breath, and voice. AIMS Public Health 2021; 8:240-264. [PMID: 34017889 PMCID: PMC8116184 DOI: 10.3934/publichealth.2021019] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Accepted: 03/07/2021] [Indexed: 12/21/2022] Open
Abstract
The issue in respiratory sound classification has attained good attention from the clinical scientists and medical researcher's group in the last year to diagnosing COVID-19 disease. To date, various models of Artificial Intelligence (AI) entered into the real-world to detect the COVID-19 disease from human-generated sounds such as voice/speech, cough, and breath. The Convolutional Neural Network (CNN) model is implemented for solving a lot of real-world problems on machines based on Artificial Intelligence (AI). In this context, one dimension (1D) CNN is suggested and implemented to diagnose respiratory diseases of COVID-19 from human respiratory sounds such as a voice, cough, and breath. An augmentation-based mechanism is applied to improve the preprocessing performance of the COVID-19 sounds dataset and to automate COVID-19 disease diagnosis using the 1D convolutional network. Furthermore, a DDAE (Data De-noising Auto Encoder) technique is used to generate deep sound features such as the input function to the 1D CNN instead of adopting the standard input of MFCC (Mel-frequency cepstral coefficient), and it is performed better accuracy and performance than previous models. RESULTS As a result, around 4% accuracy is achieved than traditional MFCC. We have classified COVID-19 sounds, asthma sounds, and regular healthy sounds using a 1D CNN classifier and shown around 90% accuracy to detect the COVID-19 disease from respiratory sounds. CONCLUSION A Data De-noising Auto Encoder (DDAE) was adopted to extract the acoustic sound signals in-depth features instead of traditional MFCC. The proposed model improves efficiently to classify COVID-19 sounds for detecting COVID-19 positive symptoms.
Collapse
Affiliation(s)
| | - Alphonse Pja
- Department of Computer Applications, NIT Tiruchirappalli, Tamil Nadu, India
| |
Collapse
|
57
|
Lella KK, Pja A. Automatic COVID-19 disease diagnosis using 1D convolutional neural network and augmentation with human respiratory sound based on parameters: cough, breath, and voice. AIMS Public Health 2021. [PMID: 34017889 DOI: 10.3934/publichealth2021019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/11/2023] Open
Abstract
UNLABELLED The issue in respiratory sound classification has attained good attention from the clinical scientists and medical researcher's group in the last year to diagnosing COVID-19 disease. To date, various models of Artificial Intelligence (AI) entered into the real-world to detect the COVID-19 disease from human-generated sounds such as voice/speech, cough, and breath. The Convolutional Neural Network (CNN) model is implemented for solving a lot of real-world problems on machines based on Artificial Intelligence (AI). In this context, one dimension (1D) CNN is suggested and implemented to diagnose respiratory diseases of COVID-19 from human respiratory sounds such as a voice, cough, and breath. An augmentation-based mechanism is applied to improve the preprocessing performance of the COVID-19 sounds dataset and to automate COVID-19 disease diagnosis using the 1D convolutional network. Furthermore, a DDAE (Data De-noising Auto Encoder) technique is used to generate deep sound features such as the input function to the 1D CNN instead of adopting the standard input of MFCC (Mel-frequency cepstral coefficient), and it is performed better accuracy and performance than previous models. RESULTS As a result, around 4% accuracy is achieved than traditional MFCC. We have classified COVID-19 sounds, asthma sounds, and regular healthy sounds using a 1D CNN classifier and shown around 90% accuracy to detect the COVID-19 disease from respiratory sounds. CONCLUSION A Data De-noising Auto Encoder (DDAE) was adopted to extract the acoustic sound signals in-depth features instead of traditional MFCC. The proposed model improves efficiently to classify COVID-19 sounds for detecting COVID-19 positive symptoms.
Collapse
Affiliation(s)
| | - Alphonse Pja
- Department of Computer Applications, NIT Tiruchirappalli, Tamil Nadu, India
| |
Collapse
|