1
|
Sabry AH, I. Dallal Bashi O, Nik Ali N, Mahmood Al Kubaisi Y. Lung disease recognition methods using audio-based analysis with machine learning. Heliyon 2024; 10:e26218. [PMID: 38420389 PMCID: PMC10900411 DOI: 10.1016/j.heliyon.2024.e26218] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 12/11/2023] [Accepted: 02/08/2024] [Indexed: 03/02/2024] Open
Abstract
The use of computer-based automated approaches and improvements in lung sound recording techniques have made lung sound-based diagnostics even better and devoid of subjectivity errors. Using a computer to evaluate lung sound features more thoroughly with the use of analyzing changes in lung sound behavior, recording measurements, suppressing the presence of noise contaminations, and graphical representations are all made possible by computer-based lung sound analysis. This paper starts with a discussion of the need for this research area, providing an overview of the field and the motivations behind it. Following that, it details the survey methodology used in this work. It presents a discussion on the elements of sound-based lung disease classification using machine learning algorithms. This includes commonly prior considered datasets, feature extraction techniques, pre-processing methods, artifact removal methods, lung-heart sound separation, deep learning algorithms, and wavelet transform of lung audio signals. The study introduces studies that review lung screening including a summary table of these references and discusses the literature gaps in the existing studies. It is concluded that the use of sound-based machine learning in the classification of respiratory diseases has promising results. While we believe this material will prove valuable to physicians and researchers exploring sound-signal-based machine learning, large-scale investigations remain essential to solidify the findings and foster wider adoption within the medical community.
Collapse
Affiliation(s)
- Ahmad H. Sabry
- Department of Medical Instrumentation Engineering Techniques, Shatt Al-Arab University College, Basra, Iraq
| | - Omar I. Dallal Bashi
- Medical Technical Institute, Northern Technical University, 95G2+P34, Mosul, 41002, Iraq
| | - N.H. Nik Ali
- School of Electrical Engineering, College of Engineering, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
| | - Yasir Mahmood Al Kubaisi
- Department of Sustainability Management, Dubai Academic Health Corporation, Dubai, 4545, United Arab Emirates
| |
Collapse
|
2
|
Kraman SS, Pasterkamp H, Wodicka GR. Smart Devices Are Poised to Revolutionize the Usefulness of Respiratory Sounds. Chest 2023; 163:1519-1528. [PMID: 36706908 PMCID: PMC10925548 DOI: 10.1016/j.chest.2023.01.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 01/10/2023] [Accepted: 01/17/2023] [Indexed: 01/26/2023] Open
Abstract
The association between breathing sounds and respiratory health or disease has been exceptionally useful in the practice of medicine since the advent of the stethoscope. Remote patient monitoring technology and artificial intelligence offer the potential to develop practical means of assessing respiratory function or dysfunction through continuous assessment of breathing sounds when patients are at home, at work, or even asleep. Automated reports such as cough counts or the percentage of the breathing cycles containing wheezes can be delivered to a practitioner via secure electronic means or returned to the clinical office at the first opportunity. This has not previously been possible. The four respiratory sounds that most lend themselves to this technology are wheezes, to detect breakthrough asthma at night and even occupational asthma when a patient is at work; snoring as an indicator of OSA or adequacy of CPAP settings; cough in which long-term recording can objectively assess treatment adequacy; and crackles, which, although subtle and often overlooked, can contain important clinical information when appearing in a home recording. In recent years, a flurry of publications in the engineering literature described construction, usage, and testing outcomes of such devices. Little of this has appeared in the medical literature. The potential value of this technology for pulmonary medicine is compelling. We expect that these tiny, smart devices soon will allow us to address clinical questions that occur away from the clinic.
Collapse
Affiliation(s)
- Steve S Kraman
- Department of Internal Medicine, Division of Pulmonary, Critical Care and Sleep Medicine, University of Kentucky, Lexington, KY.
| | - Hans Pasterkamp
- University of Manitoba, Department of Pediatrics and Child Health, Max Rady College of Medicine, University of Manitoba, Winnipeg, MB, Canada
| | - George R Wodicka
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN
| |
Collapse
|
3
|
Serrurier A, Neuschaefer-Rube C, Röhrig R. Past and Trends in Cough Sound Acquisition, Automatic Detection and Automatic Classification: A Comparative Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:2896. [PMID: 35458885 PMCID: PMC9027375 DOI: 10.3390/s22082896] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 04/07/2022] [Accepted: 04/08/2022] [Indexed: 11/16/2022]
Abstract
Cough is a very common symptom and the most frequent reason for seeking medical advice. Optimized care goes inevitably through an adapted recording of this symptom and automatic processing. This study provides an updated exhaustive quantitative review of the field of cough sound acquisition, automatic detection in longer audio sequences and automatic classification of the nature or disease. Related studies were analyzed and metrics extracted and processed to create a quantitative characterization of the state-of-the-art and trends. A list of objective criteria was established to select a subset of the most complete detection studies in the perspective of deployment in clinical practice. One hundred and forty-four studies were short-listed, and a picture of the state-of-the-art technology is drawn. The trend shows an increasing number of classification studies, an increase of the dataset size, in part from crowdsourcing, a rapid increase of COVID-19 studies, the prevalence of smartphones and wearable sensors for the acquisition, and a rapid expansion of deep learning. Finally, a subset of 12 detection studies is identified as the most complete ones. An unequaled quantitative overview is presented. The field shows a remarkable dynamic, boosted by the research on COVID-19 diagnosis, and a perfect adaptation to mobile health.
Collapse
Affiliation(s)
- Antoine Serrurier
- Institute of Medical Informatics, University Hospital of the RWTH Aachen, 52057 Aachen, Germany;
- Clinic for Phoniatrics, Pedaudiology & Communication Disorders, University Hospital of the RWTH Aachen, 52057 Aachen, Germany;
| | - Christiane Neuschaefer-Rube
- Clinic for Phoniatrics, Pedaudiology & Communication Disorders, University Hospital of the RWTH Aachen, 52057 Aachen, Germany;
| | - Rainer Röhrig
- Institute of Medical Informatics, University Hospital of the RWTH Aachen, 52057 Aachen, Germany;
| |
Collapse
|
4
|
Ferreira-Cardoso H, Jácome C, Silva S, Amorim A, Redondo MT, Fontoura-Matias J, Vicente-Ferreira M, Vieira-Marques P, Valente J, Almeida R, Fonseca JA, Azevedo I. Lung Auscultation Using the Smartphone-Feasibility Study in Real-World Clinical Practice. SENSORS (BASEL, SWITZERLAND) 2021; 21:4931. [PMID: 34300670 PMCID: PMC8309818 DOI: 10.3390/s21144931] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Revised: 07/03/2021] [Accepted: 07/16/2021] [Indexed: 11/17/2022]
Abstract
Conventional lung auscultation is essential in the management of respiratory diseases. However, detecting adventitious sounds outside medical facilities remains challenging. We assessed the feasibility of lung auscultation using the smartphone built-in microphone in real-world clinical practice. We recruited 134 patients (median[interquartile range] 16[11-22.25]y; 54% male; 31% cystic fibrosis, 29% other respiratory diseases, 28% asthma; 12% no respiratory diseases) at the Pediatrics and Pulmonology departments of a tertiary hospital. First, clinicians performed conventional auscultation with analog stethoscopes at 4 locations (trachea, right anterior chest, right and left lung bases), and documented any adventitious sounds. Then, smartphone auscultation was recorded twice in the same four locations. The recordings (n = 1060) were classified by two annotators. Seventy-three percent of recordings had quality (obtained in 92% of the participants), with the quality proportion being higher at the trachea (82%) and in the children's group (75%). Adventitious sounds were present in only 35% of the participants and 14% of the recordings, which may have contributed to the fair agreement between conventional and smartphone auscultation (85%; k = 0.35(95% CI 0.26-0.44)). Our results show that smartphone auscultation was feasible, but further investigation is required to improve its agreement with conventional auscultation.
Collapse
Affiliation(s)
| | - Cristina Jácome
- MEDCIDS—Department of Community Medicine, Health Information and Decision, Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal; (R.A.); (J.A.F.)
- CINTESIS—Center for Health Technology and Services Research, Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal;
| | - Sónia Silva
- Department of Pediatrics, Centro Hospitalar Universitário de São João, 4200-319 Porto, Portugal; (S.S.); (J.F.-M.); (M.V.-F.); (I.A.)
| | - Adelina Amorim
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal; (H.F.-C.); (A.A.)
- Department of Pulmonology, Centro Hospitalar Universitário de São João, 4200-319 Porto, Portugal;
| | - Margarida T. Redondo
- Department of Pulmonology, Centro Hospitalar Universitário de São João, 4200-319 Porto, Portugal;
| | - José Fontoura-Matias
- Department of Pediatrics, Centro Hospitalar Universitário de São João, 4200-319 Porto, Portugal; (S.S.); (J.F.-M.); (M.V.-F.); (I.A.)
| | - Margarida Vicente-Ferreira
- Department of Pediatrics, Centro Hospitalar Universitário de São João, 4200-319 Porto, Portugal; (S.S.); (J.F.-M.); (M.V.-F.); (I.A.)
| | - Pedro Vieira-Marques
- CINTESIS—Center for Health Technology and Services Research, Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal;
| | - José Valente
- MEDIDA—Serviços em Medicina, Educação, Investigação, Desenvolvimento e Avaliação, LDA, 4200-386 Porto, Portugal;
| | - Rute Almeida
- MEDCIDS—Department of Community Medicine, Health Information and Decision, Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal; (R.A.); (J.A.F.)
- CINTESIS—Center for Health Technology and Services Research, Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal;
| | - João Almeida Fonseca
- MEDCIDS—Department of Community Medicine, Health Information and Decision, Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal; (R.A.); (J.A.F.)
- CINTESIS—Center for Health Technology and Services Research, Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal;
- MEDIDA—Serviços em Medicina, Educação, Investigação, Desenvolvimento e Avaliação, LDA, 4200-386 Porto, Portugal;
| | - Inês Azevedo
- Department of Pediatrics, Centro Hospitalar Universitário de São João, 4200-319 Porto, Portugal; (S.S.); (J.F.-M.); (M.V.-F.); (I.A.)
- Department of Obstetrics, Gynecology and Pediatrics, Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
- EpiUnit, Institute of Public Health, University of Porto, 4050-091 Porto, Portugal
| |
Collapse
|
5
|
Stasak B, Huang Z, Razavi S, Joachim D, Epps J. Automatic Detection of COVID-19 Based on Short-Duration Acoustic Smartphone Speech Analysis. JOURNAL OF HEALTHCARE INFORMATICS RESEARCH 2021; 5:201-217. [PMID: 33723525 PMCID: PMC7948650 DOI: 10.1007/s41666-020-00090-4] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Revised: 11/11/2020] [Accepted: 12/03/2020] [Indexed: 12/16/2022]
Abstract
Currently, there is an increasing global need for COVID-19 screening to help reduce the rate of infection and at-risk patient workload at hospitals. Smartphone-based screening for COVID-19 along with other respiratory illnesses offers excellent potential due to its rapid-rollout remote platform, user convenience, symptom tracking, comparatively low cost, and prompt result processing timeframe. In particular, speech-based analysis embedded in smartphone app technology can measure physiological effects relevant to COVID-19 screening that are not yet digitally available at scale in the healthcare field. Using a selection of the Sonde Health COVID-19 2020 dataset, this study examines the speech of COVID-19-negative participants exhibiting mild and moderate COVID-19-like symptoms as well as that of COVID-19-positive participants with mild to moderate symptoms. Our study investigates the classification potential of acoustic features (e.g., glottal, prosodic, spectral) from short-duration speech segments (e.g., held vowel, pataka phrase, nasal phrase) for automatic COVID-19 classification using machine learning. Experimental results indicate that certain feature-task combinations can produce COVID-19 classification accuracy of up to 80% as compared with using the all-acoustic feature baseline (68%). Further, with brute-forced n-best feature selection and speech task fusion, automatic COVID-19 classification accuracy of upwards of 82-86% was achieved, depending on whether the COVID-19-negative participant had mild or moderate COVID-19-like symptom severity.
Collapse
Affiliation(s)
- Brian Stasak
- School of Electrical Engineering & Telecommunications, University of New South Wales, Sydney, NSW Australia
| | - Zhaocheng Huang
- School of Electrical Engineering & Telecommunications, University of New South Wales, Sydney, NSW Australia
| | | | | | - Julien Epps
- School of Electrical Engineering & Telecommunications, University of New South Wales, Sydney, NSW Australia
| |
Collapse
|