1
|
Du Z, Xu Y, Yu X, Wang S, Xu L. Estimation of Speech Features Using a Wearable Inertial Sensor. J Voice 2024:S0892-1997(24)00303-5. [PMID: 39393952 DOI: 10.1016/j.jvoice.2024.09.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 09/07/2024] [Accepted: 09/09/2024] [Indexed: 10/13/2024]
Abstract
Speech features have been investigated as novel digital biomarkers for many psychiatric and neurocognitive diseases. Microphones are the most used devices for speech recording but inevitably suffering from several disadvantages such as privacy leakage and environmental noises, limiting their clinical applications particularly for long-term ambulatory monitoring. The aim of the present study is therefore to explore the feasibility of extracting speech features from the acceleration recorded on the sternum. Ten healthy subjects volunteered in our study. Two speech tasks, that is, repeating one sentence 20 times and reading 20 different sentences, were performed by each subject, with each task repeated eight times under different speech rate and loudness. Voice signals and speech-caused chest vibrations were simultaneously recorded by a microphone and an accelerometer placed on the sternum. Forty-two acoustic features and six time-related prosodic features were extracted from both signals using a standard toolbox, and then compared by a linear fit and correlation analysis. Good agreement between the acceleration features and microphone features is observed in all six time-related prosodic features for both tasks, but only in 19 and 17 acoustic features for task 1 and 2, respectively, with most of them loudness- or pitch-related. Our results suggest the sternum acceleration to track time-related speech prosody, loudness, and pitch very well, demonstrating the feasibility of deriving digital biomarkers from the acceleration signal for diseases strongly related to time-related prosodic and loudness features.
Collapse
Affiliation(s)
- Zuyu Du
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Yaodan Xu
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China; Shanghai Advanced Research Institute, Chinese Academy of Science, Shanghai, China
| | - Xinsheng Yu
- Shanghai Ruiwei Digital Technology, Shanghai, China
| | - Sen Wang
- Shanghai Ruiwei Digital Technology, Shanghai, China
| | - Lin Xu
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China; Shanghai Frontiers Science Center of Human-centered Artificial Intelligence, Shanghai, China; MoE Key Lab of Intelligent Perception and Human-Machine Collaboration (ShanghaiTech University), Shanghai, China.
| |
Collapse
|
2
|
Robotti C, Costantini G, Saggio G, Cesarini V, Calastri A, Maiorano E, Piloni D, Perrone T, Sabatini U, Ferretti VV, Cassaniti I, Baldanti F, Gravina A, Sakib A, Alessi E, Pietrantonio F, Pascucci M, Casali D, Zarezadeh Z, Zoppo VD, Pisani A, Benazzo M. Machine Learning-based Voice Assessment for the Detection of Positive and Recovered COVID-19 Patients. J Voice 2024; 38:796.e1-796.e13. [PMID: 34965907 PMCID: PMC8616736 DOI: 10.1016/j.jvoice.2021.11.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 11/17/2021] [Accepted: 11/18/2021] [Indexed: 12/12/2022]
Abstract
Many virological tests have been implemented during the Coronavirus Disease 2019 (COVID-19) pandemic for diagnostic purposes, but they appear unsuitable for screening purposes. Furthermore, current screening strategies are not accurate enough to effectively curb the spread of the disease. Therefore, the present study was conducted within a controlled clinical environment to determine eventual detectable variations in the voice of COVID-19 patients, recovered and healthy subjects, and also to determine whether machine learning-based voice assessment (MLVA) can accurately discriminate between them, thus potentially serving as a more effective mass-screening tool. Three different subpopulations were consecutively recruited: positive COVID-19 patients, recovered COVID-19 patients and healthy individuals as controls. Positive patients were recruited within 10 days from nasal swab positivity. Recovery from COVID-19 was established clinically, virologically and radiologically. Healthy individuals reported no COVID-19 symptoms and yielded negative results at serological testing. All study participants provided three trials for multiple vocal tasks (sustained vowel phonation, speech, cough). All recordings were initially divided into three different binary classifications with a feature selection, ranking and cross-validated RBF-SVM pipeline. This brough a mean accuracy of 90.24%, a mean sensitivity of 91.15%, a mean specificity of 89.13% and a mean AUC of 0.94 across all tasks and all comparisons, and outlined the sustained vowel as the most effective vocal task for COVID discrimination. Moreover, a three-way classification was carried out on an external test set comprised of 30 subjects, 10 per class, with a mean accuracy of 80% and an accuracy of 100% for the detection of positive subjects. Within this assessment, recovered individuals proved to be the most difficult class to identify, and all the misclassified subjects were declared positive; this might be related to mid and short-term vocal traces of COVID-19, even after the clinical resolution of the infection. In conclusion, MLVA may accurately discriminate between positive COVID-19 patients, recovered COVID-19 patients and healthy individuals. Further studies should test MLVA among larger populations and asymptomatic positive COVID-19 patients to validate this novel screening technology and test its potential application as a potentially more effective surveillance strategy for COVID-19.
Collapse
Affiliation(s)
- Carlo Robotti
- Department of Otolaryngology - Head and Neck Surgery, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy; Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy.
| | - Giovanni Costantini
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy.
| | - Giovanni Saggio
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy.
| | - Valerio Cesarini
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy
| | - Anna Calastri
- Department of Otolaryngology - Head and Neck Surgery, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy
| | - Eugenia Maiorano
- Department of Otolaryngology - Head and Neck Surgery, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy
| | - Davide Piloni
- Pneumology Unit, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy
| | - Tiziano Perrone
- Department of Internal Medicine, Fondazione IRCCS Policlinico San Matteo, University of Pavia, Pavia, Italy
| | - Umberto Sabatini
- Department of Internal Medicine, Fondazione IRCCS Policlinico San Matteo, University of Pavia, Pavia, Italy
| | - Virginia Valeria Ferretti
- Clinical Epidemiology and Biometry Unit, Fondazione IRCCS Policlinico San Matteo Foundation, Pavia, Italy
| | - Irene Cassaniti
- Molecular Virology Unit, Microbiology and Virology Department, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy
| | - Fausto Baldanti
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy; Molecular Virology Unit, Microbiology and Virology Department, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy
| | - Andrea Gravina
- Otorhinolaryngology Department, University of Rome Tor Vergata, Rome, Italy
| | - Ahmed Sakib
- Otorhinolaryngology Department, University of Rome Tor Vergata, Rome, Italy
| | - Elena Alessi
- Internal Medicine Unit, Ospedale dei Castelli ASL Roma 6, Ariccia, Italy
| | | | - Matteo Pascucci
- Internal Medicine Unit, Ospedale dei Castelli ASL Roma 6, Ariccia, Italy
| | - Daniele Casali
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy
| | - Zakarya Zarezadeh
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy
| | - Vincenzo Del Zoppo
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy
| | - Antonio Pisani
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy; IRCCS Mondino Foundation, Pavia, Italy
| | - Marco Benazzo
- Department of Otolaryngology - Head and Neck Surgery, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy; Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy
| |
Collapse
|
3
|
Varma N, Han JK, Passman R, Rosman LA, Ghanbari H, Noseworthy P, Avari Silva JN, Deshmukh A, Sanders P, Hindricks G, Lip G, Sridhar AR. Promises and Perils of Consumer Mobile Technologies in Cardiovascular Care: JACC Scientific Statement. J Am Coll Cardiol 2024; 83:611-631. [PMID: 38296406 DOI: 10.1016/j.jacc.2023.11.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 11/16/2023] [Indexed: 02/08/2024]
Abstract
Direct-to-consumer (D2C) wearables are becoming increasingly popular in cardiovascular health management because of their affordability and capability to capture diverse health data. Wearables may enable continuous health care provider-patient partnerships and reduce the volume of episodic clinic-based care (thereby reducing health care costs). However, challenges arise from the unregulated use of these devices, including questionable data reliability, potential misinterpretation of information, unintended psychological impacts, and an influx of clinically nonactionable data that may overburden the health care system. Further, these technologies could exacerbate, rather than mitigate, health disparities. Experience with wearables in atrial fibrillation underscores these challenges. The prevalent use of D2C wearables necessitates a collaborative approach among stakeholders to ensure effective integration into cardiovascular care. Wearables are heralding innovative disease screening, diagnosis, and management paradigms, expanding therapeutic avenues, and anchoring personalized medicine.
Collapse
Affiliation(s)
- Niraj Varma
- Heart and Vascular Institute, Cleveland Clinic, Cleveland, Ohio, USA.
| | - Janet K Han
- Department of Cardiology, VA Greater Los Angeles Healthcare System, Los Angeles, California, USA; Department of Cardiology, David Geffen School of Medicine at the University of California-Los Angeles, Los Angeles, California, USA
| | - Rod Passman
- Department of Cardiology, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Lindsey Anne Rosman
- Division of Cardiology, University of North Carolina School of Medicine, Chapel Hill, North Carolina, USA
| | - Hamid Ghanbari
- Department of Cardiology, University of Michigan, Ann Arbor, Michigan, USA
| | - Peter Noseworthy
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | | | - Abhishek Deshmukh
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Prashanthan Sanders
- Department of Cardiology, University of Adelaide, South Australia, Australia
| | | | - Gregory Lip
- Liverpool Centre for Cardiovascular Science at University of Liverpool, Liverpool John Moores University, and Liverpool Heart & Chest Hospital, Liverpool, United Kingdom; Department of Clinical Medicine, Danish Center for Clinical Health Services Research, Aalborg University, Aalborg, Denmark
| | - Arun R Sridhar
- Department of Cardiology, Pulse Heart Institute, Seattle, Washington, USA; Department of Clinical Medicine, Danish Center for Clinical Health Services Research, Aalborg University, Aalborg, Denmark
| |
Collapse
|
4
|
Sara JDS, Orbelo D, Maor E, Lerman LO, Lerman A. Guess What We Can Hear-Novel Voice Biomarkers for the Remote Detection of Disease. Mayo Clin Proc 2023; 98:1353-1375. [PMID: 37661144 PMCID: PMC10043966 DOI: 10.1016/j.mayocp.2023.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 02/08/2023] [Accepted: 03/16/2023] [Indexed: 03/30/2023]
Abstract
The advancement of digital biomarkers and the provision of remote health care greatly progressed during the coronavirus disease 2019 global pandemic. Combining voice/speech data with artificial intelligence and machine-based learning offers a novel solution to the growing demand for telemedicine. Voice biomarkers, obtained from the extraction of characteristic acoustic and linguistic features, are associated with a variety of diseases and even coronavirus disease 2019. In the current review, we (1) describe the basis on which digital voice biomarkers could facilitate "telemedicine," (2) discuss potential mechanisms that may explain the association between voice biomarkers and disease, (3) offer a novel classification system to conceptualize voice biomarkers depending on different methods for recording and analyzing voice/speech samples, (4) outline evidence revealing an association between voice biomarkers and a number of disease states, and (5) describe the process of developing a voice biomarker from recording, storing voice samples, and extracting acoustic and linguistic features relevant to training and testing deep and machine-based learning algorithms to detect disease. We further explore several important future considerations in this area of research, including the necessity for clinical trials and the importance of safeguarding data and individual privacy. To this end, we searched PubMed and Google Scholar to identify studies evaluating the relationship between voice/speech features and biomarkers and various diseases. Search terms included digital biomarker, telemedicine, voice features, voice biomarker, speech features, speech biomarkers, acoustics, linguistics, cardiovascular disease, neurologic disease, psychiatric disease, and infectious disease. The search was limited to studies published in English in peer-reviewed journals between 1980 and the present. To identify potential studies not captured by our database search strategy, we also searched studies listed in the bibliography of relevant publications and reviews.
Collapse
Affiliation(s)
| | - Diana Orbelo
- Division of Otolaryngology, Mayo Clinic College of Medicine and Science, Rochester, MN; Chaim Sheba Medical Center, Tel HaShomer, Israel
| | - Elad Maor
- Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Lilach O Lerman
- Division of Nephrology and Hypertension, Mayo Clinic Rochester, MN
| | - Amir Lerman
- Department of Cardiovascular Medicine, Mayo Clinic College of Medicine and Science, Rochester, MN.
| |
Collapse
|
5
|
Ciccarelli M, Giallauria F, Carrizzo A, Visco V, Silverio A, Cesaro A, Calabrò P, De Luca N, Mancusi C, Masarone D, Pacileo G, Tourkmani N, Vigorito C, Vecchione C. Artificial intelligence in cardiovascular prevention: new ways will open new doors. J Cardiovasc Med (Hagerstown) 2023; 24:e106-e115. [PMID: 37186561 DOI: 10.2459/jcm.0000000000001431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
Prevention and effective treatment of cardiovascular disease are progressive issues that grow in tandem with the average age of the world population. Over recent decades, the potential role of artificial intelligence in cardiovascular medicine has been increasingly recognized because of the incredible amount of real-world data (RWD) regarding patient health status and healthcare delivery that can be collated from a variety of sources wherein patient information is routinely collected, including patient registries, clinical case reports, reimbursement claims and billing reports, medical devices, and electronic health records. Like any other (health) data, RWD can be analysed in accordance with high-quality research methods, and its analysis can deliver valuable patient-centric insights complementing the information obtained from conventional clinical trials. Artificial intelligence application on RWD has the potential to detect a patient's health trajectory leading to personalized medicine and tailored treatment. This article reviews the benefits of artificial intelligence in cardiovascular prevention and management, focusing on diagnostic and therapeutic improvements without neglecting the limitations of this new scientific approach.
Collapse
Affiliation(s)
- Michele Ciccarelli
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
| | - Francesco Giallauria
- Department of Translational Medical Sciences, Federico II University, Naples, Italy
| | - Albino Carrizzo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
- Vascular Physiopathology Unit, IRCCS Neuromed, Pozzilli
| | - Valeria Visco
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
| | - Angelo Silverio
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
| | - Arturo Cesaro
- Department of Translational Medical Sciences, University of Campania 'Luigi Vanvitelli', Naples, Italy
| | - Paolo Calabrò
- Department of Translational Medical Sciences, University of Campania 'Luigi Vanvitelli', Naples, Italy
| | - Nicola De Luca
- Department of Advanced Biomedical Sciences, Federico II University, Naples, Italy
| | - Costantino Mancusi
- Department of Advanced Biomedical Sciences, Federico II University, Naples, Italy
| | - Daniele Masarone
- Heart Failure Unit, Department of Cardiology, AORN dei Colli-Monaldi Hospital Naples, Naples, Italy
| | - Giuseppe Pacileo
- Heart Failure Unit, Department of Cardiology, AORN dei Colli-Monaldi Hospital Naples, Naples, Italy
| | - Nidal Tourkmani
- Cardiology and Cardiac Rehabilitation Unit, 'Mons. Giosuè Calaciura Clinic', Catania, Italy
- ABL, Guangzhou, China
| | - Carlo Vigorito
- Department of Translational Medical Sciences, Federico II University, Naples, Italy
| | - Carmine Vecchione
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
- Vascular Physiopathology Unit, IRCCS Neuromed, Pozzilli
| |
Collapse
|
6
|
Murton OM, Dec GW, Hillman RE, Majmudar MD, Steiner J, Guttag JV, Mehta DD. Acoustic Voice and Speech Biomarkers of Treatment Status during Hospitalization for Acute Decompensated Heart Failure. APPLIED SCIENCES (BASEL, SWITZERLAND) 2023; 13:1827. [PMID: 37064434 PMCID: PMC10104453 DOI: 10.3390/app13031827] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/18/2023]
Abstract
This study investigates acoustic voice and speech features as biomarkers for acute decompensated heart failure (ADHF), a serious escalation of heart failure symptoms including breathlessness and fatigue. ADHF-related systemic fluid accumulation in the lungs and laryngeal tissues is hypothesized to affect phonation and respiration for speech. A set of daily spoken recordings from 52 patients undergoing inpatient ADHF treatment was analyzed to identify voice and speech biomarkers for ADHF and to examine the trajectory of biomarkers during treatment. Results indicated that speakers produce more stable phonation, a more creaky voice, faster speech rates, and longer phrases after ADHF treatment compared to their pre-treatment voices. This project builds on work to develop a method of monitoring ADHF using speech biomarkers and presents a more detailed understanding of relevant voice and speech features.
Collapse
Affiliation(s)
- Olivia M. Murton
- Center for Laryngeal Surgery and Voice Rehabilitation, Massachusetts General Hospital, Boston, MA 02114, USA
- Speech and Hearing Bioscience and Technology, Division of Medical Sciences, Harvard Medical School, Boston, MA 02115, USA
- MGH Institute of Health Professions, Boston, MA 02129, USA
| | - G. William Dec
- Institute for Heart, Vascular, and Stroke Care, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Robert E. Hillman
- Center for Laryngeal Surgery and Voice Rehabilitation, Massachusetts General Hospital, Boston, MA 02114, USA
- Speech and Hearing Bioscience and Technology, Division of Medical Sciences, Harvard Medical School, Boston, MA 02115, USA
- MGH Institute of Health Professions, Boston, MA 02129, USA
- Department of Surgery, Harvard Medical School, Boston, MA 02115, USA
| | | | - Johannes Steiner
- Division of Cardiovascular Medicine, Oregon Health & Science University, Portland, OR 97239, USA
| | - John V. Guttag
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Daryush D. Mehta
- Center for Laryngeal Surgery and Voice Rehabilitation, Massachusetts General Hospital, Boston, MA 02114, USA
- Speech and Hearing Bioscience and Technology, Division of Medical Sciences, Harvard Medical School, Boston, MA 02115, USA
- MGH Institute of Health Professions, Boston, MA 02129, USA
- Department of Surgery, Harvard Medical School, Boston, MA 02115, USA
- Correspondence:
| |
Collapse
|
7
|
Martínez-Nicolás I, Llorente TE, Martínez-Sánchez F, Meilán JJG. Speech biomarkers of risk factors for vascular dementia in people with mild cognitive impairment. Front Hum Neurosci 2022; 16:1057578. [PMID: 36590068 PMCID: PMC9798230 DOI: 10.3389/fnhum.2022.1057578] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 11/18/2022] [Indexed: 12/23/2022] Open
Abstract
Introduction In this study we intend to use speech analysis to analyze the cognitive impairments caused by pathologies of vascular origin such as diabetes, hypertension, hypercholesterolemia and heart disease, predictors of the development of vascular dementia. Methods In this study, 40 participants with mild cognitive impairment were asked to read while being recorded and they were inquired about their history of the aforementioned conditions. Their speech was then analyzed. Results We found that some speech parameters of frequencies and syllabic rhythm vary due to these pathologies. In addition, we conducted a discriminant analysis in which we found that diabetes and hypertension can be predicted with an accuracy over 95% with few speech parameters, and hypercholesterolemia and heart disease with an accuracy over 80%. Discussion The predictor parameters found are heterogeneous, including voice quality, amplitude, frequency, and rhythm parameters. This result may lead to investigate why such important qualitative changes occur in the voice of older adults with these pathologies. Rather than trying to find a diagnostic procedure already existing in classical medicine, we expect this finding to contribute to explore the causes and concomitant pathologies of these diseases. We discuss the implications of behavioral traits, such as speech, as digital biomarkers.
Collapse
Affiliation(s)
- Israel Martínez-Nicolás
- Facultad de Psicología, Universidad de Salamanca, Salamanca, Spain,*Correspondence: Israel Martínez-Nicolás,
| | - Thide E. Llorente
- Facultad de Psicología, Universidad de Salamanca, Salamanca, Spain,Instituto de Neurociencias de Castilla y León, Salamanca, Spain
| | | | - Juan J. G. Meilán
- Facultad de Psicología, Universidad de Salamanca, Salamanca, Spain,Instituto de Neurociencias de Castilla y León, Salamanca, Spain
| |
Collapse
|
8
|
Higa E, Elbéji A, Zhang L, Fischer A, Aguayo GA, Nazarov PV, Fagherazzi G. Discovery and Analytical Validation of a Vocal Biomarker to Monitor Anosmia and Ageusia in Patients With COVID-19: Cross-sectional Study. JMIR Med Inform 2022; 10:e35622. [DOI: 10.2196/35622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Revised: 08/11/2022] [Accepted: 09/07/2022] [Indexed: 11/09/2022] Open
Abstract
Background
The COVID-19 disease has multiple symptoms, with anosmia and ageusia being the most prevalent, varying from 75% to 95% and from 50% to 80% of infected patients, respectively. An automatic assessment tool for these symptoms will help monitor the disease in a fast and noninvasive manner.
Objective
We hypothesized that people with COVID-19 experiencing anosmia and ageusia had different voice features than those without such symptoms. Our objective was to develop an artificial intelligence pipeline to identify and internally validate a vocal biomarker of these symptoms for remotely monitoring them.
Methods
This study used population-based data. Participants were assessed daily through a web-based questionnaire and asked to register 2 different types of voice recordings. They were adults (aged >18 years) who were confirmed by a polymerase chain reaction test to be positive for COVID-19 in Luxembourg and met the inclusion criteria. Statistical methods such as recursive feature elimination for dimensionality reduction, multiple statistical learning methods, and hypothesis tests were used throughout this study. The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) Prediction Model Development checklist was used to structure the research.
Results
This study included 259 participants. Younger (aged <35 years) and female participants showed higher rates of ageusia and anosmia. Participants were aged 41 (SD 13) years on average, and the data set was balanced for sex (female: 134/259, 51.7%; male: 125/259, 48.3%). The analyzed symptom was present in 94 (36.3%) out of 259 participants and in 450 (27.5%) out of 1636 audio recordings. In all, 2 machine learning models were built, one for Android and one for iOS devices, and both had high accuracy—88% for Android and 85% for iOS. The final biomarker was then calculated using these models and internally validated.
Conclusions
This study demonstrates that people with COVID-19 who have anosmia and ageusia have different voice features from those without these symptoms. Upon further validation, these vocal biomarkers could be nested in digital devices to improve symptom assessment in clinical practice and enhance the telemonitoring of COVID-19–related symptoms.
Trial Registration
Clinicaltrials.gov NCT04380987; https://clinicaltrials.gov/ct2/show/NCT04380987
Collapse
|
9
|
Schöbi D, Zhang Y, Kehl J, Aissani M, Pfister O, Strahm M, van Haelst P, Zhou Q. Evaluation of Speech and Pause Alterations in Patients With Acute and Chronic Heart Failure. J Am Heart Assoc 2022; 11:e027023. [PMID: 36314494 PMCID: PMC9673640 DOI: 10.1161/jaha.122.027023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Background
Acute heart failure is the most frequent cause of unplanned hospital admission in elderly patients. Various biomarkers have been evaluated to better assess the status of these patients and prevent decompensation. Recently, voice has been suggested as a cost‐effective and noninvasive way to monitor disease progression. This study evaluates speech and pause alterations in patients with acute decompensated and stable heart failure. Specifically, we aim to identify a vocal biomarker that could be used to monitor patients with heart failure and to prevent decompensation.
Methods and Results
Speech and pause patterns were evaluated in 68 patients with acute and 36 patients with stable heart failure. Voice recordings were performed using a web‐browser based application that consisted of 5 tasks. Speech and pause patterns were automatically extracted and compared between acute and stable patients and with clinical markers. Compared with stable patients, pause ratio was up to 14.9% increased in patients with acute heart failure. This increase was largely independent of sex, age, and ejection fraction and persisted in patients with lower degrees of edema or dyspnea. Furthermore, pause ratio was positively correlated with NT‐proBNP (N‐terminal pro‐B‐type natriuretic peptide) after controlling for acute versus stable heart failure. Collectively, our findings indicate that the pause ratio could be useful in identifying acute heart failure, particularly in patients who do not display traditional indicators of decompensation.
Conclusions
Speech and pause patterns are altered in patients with acute heart failure. Particularly, we identified pause ratio as an easily interpretable vocal biomarker to support the monitoring of heart failure decompensation.
Collapse
Affiliation(s)
- Dario Schöbi
- Pharma Research and Early Development Informatics Roche Innovation Center Basel Switzerland
| | - Yan‐Ping Zhang
- Pharma Research and Early Development Informatics Roche Innovation Center Basel Switzerland
| | - Joelle Kehl
- Division of Cardiology, Department of Medicine University Hospital Basel Basel Switzerland
| | - Meriam Aissani
- Division of Cardiology, Department of Medicine University Hospital Basel Basel Switzerland
| | - Otmar Pfister
- Division of Cardiology, Department of Medicine University Hospital Basel Basel Switzerland
| | - Martin Strahm
- Pharma Research and Early Development Informatics Roche Innovation Center Basel Switzerland
| | - Paul van Haelst
- Division of Cardiology, Department of Medicine University Hospital Basel Basel Switzerland
- Roche Diabetes Care Basel Switzerland
| | - Qian Zhou
- Division of Cardiology, Department of Medicine University Hospital Basel Basel Switzerland
- Department of Cardiology and Angiology I, Heart Center, Faculty of Medicine University of Freiburg Freiburg Germany
| |
Collapse
|
10
|
Ngo QC, Motin MA, Pah ND, Drotár P, Kempster P, Kumar D. Computerized analysis of speech and voice for Parkinson's disease: A systematic review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 226:107133. [PMID: 36183641 DOI: 10.1016/j.cmpb.2022.107133] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Revised: 09/13/2022] [Accepted: 09/13/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND AND OBJECTIVE Speech impairment is an early symptom of Parkinson's disease (PD). This study has summarized the literature related to speech and voice in detecting PD and assessing its severity. METHODS A systematic review of the literature from 2010 to 2021 to investigate analysis methods and signal features. The keywords "Automatic analysis" in conjunction with "PD speech" or "PD voice" were used, and the PubMed and ScienceDirect databases were searched. A total of 838 papers were found on the first run, of which 189 were selected. One hundred and forty-seven were found to be suitable for the review. The different datasets, recording protocols, signal analysis methods and features that were reported are listed. Values of the features that separate PD patients from healthy controls were tabulated. Finally, the barriers that limit the wide use of computerized speech analysis are discussed. RESULTS Speech and voice may be valuable markers for PD. However, large differences between the datasets make it difficult to compare different studies. In addition, speech analytic methods that are not informed by physiological understanding may alienate clinicians. CONCLUSIONS The potential usefulness of speech and voice for the detection and assessment of PD is confirmed by evidence from the classification and correlation results.
Collapse
Affiliation(s)
| | - Mohammod Abdul Motin
- Biosignals Lab, RMIT University, Melbourne, Australia; Department of Electrical & Electronic Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Nemuel Daniel Pah
- Biosignals Lab, RMIT University, Melbourne, Australia; Universitas Surabaya, Indonesia
| | - Peter Drotár
- Intelligent Information Systems Lab, Technical University of Kosice, Letna 9, 42001, Kosice, Slovakia
| | - Peter Kempster
- Neurosciences Department, Monash Health, Clayton, VIC, Australia; Department of Medicine, School of Clinical Sciences, Monash University, Clayton, VIC, Australia
| | - Dinesh Kumar
- Biosignals Lab, RMIT University, Melbourne, Australia.
| |
Collapse
|
11
|
Park HY, Park D, Kang HS, Kim H, Lee S, Im S. Post-stroke respiratory complications using machine learning with voice features from mobile devices. Sci Rep 2022; 12:16682. [PMID: 36202829 PMCID: PMC9537337 DOI: 10.1038/s41598-022-20348-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 09/12/2022] [Indexed: 11/11/2022] Open
Abstract
Abnormal voice may identify those at risk of post-stroke aspiration. This study was aimed to determine whether machine learning algorithms with voice recorded via a mobile device can accurately classify those with dysphagia at risk of tube feeding and post-stroke aspiration pneumonia and be used as digital biomarkers. Voice samples from patients referred for swallowing disturbance in a university-affiliated hospital were collected prospectively using a mobile device. Subjects that required tube feeding were further classified to high risk of respiratory complication, based on the voluntary cough strength and abnormal chest x-ray images. A total of 449 samples were obtained, with 234 requiring tube feeding and 113 showing high risk of respiratory complications. The eXtreme gradient boosting multimodal models that included abnormal acoustic features and clinical variables showed high sensitivity levels of 88.7% (95% CI 82.6–94.7) and 84.5% (95% CI 76.9–92.1) in the classification of those at risk of tube feeding and at high risk of respiratory complications; respectively. In both cases, voice features proved to be the strongest contributing factors in these models. Voice features may be considered as viable digital biomarkers in those at risk of respiratory complications related to post-stroke dysphagia.
Collapse
Affiliation(s)
- Hae-Yeon Park
- Department of Rehabilitation Medicine, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - DoGyeom Park
- Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
| | - Hye Seon Kang
- Department of Pulmonary, Allergy and Critical Care Medicine, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea.,Department of Internal Medicine, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - HyunBum Kim
- Department of Otolaryngology-Head and Neck Surgery, Yeouido St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Seungchul Lee
- Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea. .,Department of Mechanical Engineering, Pohang University of Science and Technology (POSTECH), 223, 5th Engineering Building, 77 Cheongam-Ro, Nam-Gu, Pohang, 37673, Gyeongbuk, Republic of Korea.
| | - Sun Im
- Department of Rehabilitation Medicine, Bucheon St. Mary's Hospital, College of Medicine, Catholic University of Korea, 327 Sosa-ro, Seoul, Bucheon-si, 14647, Gyeonggi-do, Republic of Korea.
| |
Collapse
|
12
|
Kranthi Kumar L, Alphonse PJA. COVID-19: respiratory disease diagnosis with regularized deep convolutional neural network using human respiratory sounds. THE EUROPEAN PHYSICAL JOURNAL. SPECIAL TOPICS 2022; 231:3673-3696. [PMID: 35966369 PMCID: PMC9363874 DOI: 10.1140/epjs/s11734-022-00649-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 07/26/2022] [Indexed: 06/15/2023]
Abstract
Human respiratory sound auscultation (HRSA) parameters have been the real choice for detecting human respiratory diseases in the last few years. It is a challenging task to extract the respiratory sound features from the breath, voice, and cough sounds. The existing methods failed to extract the sound features to diagnose respiratory diseases. We proposed and evaluated a new regularized deep convolutional neural network (RDCNN) architecture to accept COVID-19 sound data and essential sound features. The proposed architecture is trained with the COVID-19 sound data sets and gives a better learning curve than any other state-of-the-art model. We examine the performance of RDCNN with Max-Pooling (Model-1) and without Max-Pooling (Model-2) functions. In this work, we observed that RDCNN model performance with three sound feature extraction methods [Soft-Mel frequency channel, Log-Mel frequency spectrum, and Modified Mel-frequency Cepstral Coefficient (MMFCC) spectrum] for COVID-19 sound data sets (KDD-data, ComParE2021-CCS-CSS-Data, and NeurlPs2021-data). To amplify the models' performance, we applied the augmentation technique along with regularization. We have also carried out this work to estimate the mutation of SARS-CoV-2 in the five waves using prognostic models (fractal-based). The proposed model achieves state-of-the-art performance on the COVID-19 sound data set to identify COVID-19 disease symptoms. The model's learnable parameter gradients have vanished in the intermediate layers while optimizing the prediction error which is addressed with our proposed RDCNN model. Our experiments suggested that 3 × 3 kernel size for regularized deep CNN (without max-pooling) shows 2-3% better classification accuracy compared to RDCNN with max-pooling. The experimental results suggest that this new approach may achieve the finest results on respiratory diseases.
Collapse
Affiliation(s)
- Lella Kranthi Kumar
- Department of Computer Applications, NIT Tiruchirappalli, Tiruchirappalli, Tamil Nadu 620015 India
| | - P. J. A. Alphonse
- Department of Computer Applications, NIT Tiruchirappalli, Tiruchirappalli, Tamil Nadu 620015 India
| |
Collapse
|
13
|
Golovchiner G, Glikson M, Swissa M, Sela Y, Abelow A, Morelli O, Beker A. Automated detection of atrial fibrillation based on vocal features analysis. J Cardiovasc Electrophysiol 2022; 33:1647-1654. [PMID: 35695799 DOI: 10.1111/jce.15595] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2021] [Revised: 05/28/2022] [Accepted: 06/05/2022] [Indexed: 11/30/2022]
Abstract
INTRODUCTION Early detection of atrial fibrillation (AF) is desirable but challenging due to the often-asymptomatic nature of AF. Known screening methods are limited and most of them depend of electrocardiography or other techniques with direct contact with the skin. Analysis of voice signals from natural speech has been reported for several applications in medicine. The study goal was to evaluate the usefulness of vocal features analysis for the detection of AF. METHODS This prospective study was performed in two medical centers. Patients with persistent AF admitted for cardioversion were enrolled. The patients pronounced the vowels "Ahh" and "Ohh" were recorded synchronously with an ECG tracing. An algorithm was developed to provide an "AF indicator" for detection of AF from the speech signal. RESULTS A total of 158 patients were recruited. The final analysis of "Ahh" and "Ohh" syllables was performed on 143 and 142 patients, respectively. The mean age was 71.4 ± 9.3 and 43% of patients were females. The developed AF indicator was reliable. Its numerical value decreased significantly in sinus rhythm (SR) after the cardioversion ("Ahh": from 13.98 ± 3.10 to 7.49 ± 1.58; "Ohh": from 11.39 ± 2.99 to 2.99 ± 1.61). The values at SR were significantly more homogenous compared to AF as indicated by a lower standard deviation. The area under the receiver operating characteristic curve was >0.98 and >0.89 ("Ahh" and "Ohh," respectively, p < .001). The AF indicator sensitivity is 95% with 82% specificity. CONCLUSION This study is the first report to demonstrate feasibility and reliability of the identification of AF episodes using voice analysis with acceptable accuracy, within the identified limitations of our study methods. The developed AF indicator has higher accuracy using the "Ahh" syllable versus "Ohh."
Collapse
Affiliation(s)
| | - Michael Glikson
- The Heart Institute, Shaare Zedek Medical Center, Jerusalem, Israel
| | - Moshe Swissa
- Department of Cardiology, Kaplan Medical Center, Rehovot, Israel
| | - Yaron Sela
- Sammy Ofer Scholl of Communication Interdisciplinary Center, Herzlia, Israel
| | - Aryeh Abelow
- Department of Cardiology, Rabin Medical Center, Petah Tikva, Israel
| | - Olga Morelli
- Department of Cardiology, Rabin Medical Center, Petah Tikva, Israel
| | | |
Collapse
|
14
|
Sara JDS, Maor E, Orbelo D, Gulati R, Lerman LO, Lerman A. Noninvasive Voice Biomarker Is Associated With Incident Coronary Artery Disease Events at Follow-up. Mayo Clin Proc 2022; 97:835-846. [PMID: 35341593 DOI: 10.1016/j.mayocp.2021.10.024] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Revised: 09/24/2021] [Accepted: 10/15/2021] [Indexed: 12/13/2022]
Abstract
OBJECTIVE To evaluate the association between a preidentified voice biomarker and incident coronary artery disease (CAD) events. METHODS Patients referred for clinically indicated coronary angiography underwent a total of three 30-second voice recordings using the Vocalis Health smartphone application between January 1, 2015, and February 28, 2017. A pre-established voice biomarker was derived from each individual recording, and the mean biomarker value was calculated for each patient. Individuals were clinically observed through December 31, 2019. The prespecified primary outcome was a composite of presenting to the emergency department with chest pain, being admitted to the hospital with chest pain, or having an acute coronary syndrome; the prespecified secondary outcome was a composite of a positive stress test result at follow-up or the presence of CAD at follow-up coronary angiography. RESULTS In the final analysis, 108 patients were included (mean age, 59.47±11.44 years; male, 59 [54.6%]). The median follow-up time was 24 months (range, 1 to 60 months). In multivariable Cox proportional hazards models adjusting for CAD grade on baseline angiography, a high baseline mean voice biomarker was significantly associated with both the primary (hazard ratio, 2.61; 95% CI, 1.42 to 4.80; P=.002) and secondary (hazard ratio, 3.13; 95% CI, 1.13 to 8.68; P=.03) composite outcomes. CONCLUSION This study found a significant association between a noninvasive voice biomarker and incident CAD events at follow-up. These results may have important clinical implications for the remote and noninvasive screening of patients to identify those at risk of coronary disease and its complications.
Collapse
Affiliation(s)
| | - Elad Maor
- Chaim Sheba Medical Center, Tel Hashomer, Israel; Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Diana Orbelo
- Division of Laryngology, Mayo Clinic, Rochester, MN
| | | | - Lliach O Lerman
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN
| | | |
Collapse
|
15
|
Hartley A, Khamis R. Voice Biomarkers: The Most Modern and Least Invasive Tool for Coronary Assessment? Mayo Clin Proc 2022; 97:816-818. [PMID: 35512879 PMCID: PMC9058927 DOI: 10.1016/j.mayocp.2022.03.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Accepted: 03/24/2022] [Indexed: 10/25/2022]
Affiliation(s)
- Adam Hartley
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Ramzi Khamis
- National Heart and Lung Institute, Imperial College London, London, UK.
| |
Collapse
|
16
|
Rahman T, Ibtehaz N, Khandakar A, Hossain MSA, Mekki YMS, Ezeddin M, Bhuiyan EH, Ayari MA, Tahir A, Qiblawey Y, Mahmud S, Zughaier SM, Abbas T, Al-Maadeed S, Chowdhury MEH. QUCoughScope: An Intelligent Application to Detect COVID-19 Patients Using Cough and Breath Sounds. Diagnostics (Basel) 2022; 12:920. [PMID: 35453968 PMCID: PMC9028864 DOI: 10.3390/diagnostics12040920] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Revised: 02/17/2022] [Accepted: 02/28/2022] [Indexed: 11/17/2022] Open
Abstract
Problem-Since the outbreak of the COVID-19 pandemic, mass testing has become essential to reduce the spread of the virus. Several recent studies suggest that a significant number of COVID-19 patients display no physical symptoms whatsoever. Therefore, it is unlikely that these patients will undergo COVID-19 testing, which increases their chances of unintentionally spreading the virus. Currently, the primary diagnostic tool to detect COVID-19 is a reverse-transcription polymerase chain reaction (RT-PCR) test from the respiratory specimens of the suspected patient, which is invasive and a resource-dependent technique. It is evident from recent researches that asymptomatic COVID-19 patients cough and breathe in a different way than healthy people. Aim-This paper aims to use a novel machine learning approach to detect COVID-19 (symptomatic and asymptomatic) patients from the convenience of their homes so that they do not overburden the healthcare system and also do not spread the virus unknowingly by continuously monitoring themselves. Method-A Cambridge University research group shared such a dataset of cough and breath sound samples from 582 healthy and 141 COVID-19 patients. Among the COVID-19 patients, 87 were asymptomatic while 54 were symptomatic (had a dry or wet cough). In addition to the available dataset, the proposed work deployed a real-time deep learning-based backend server with a web application to crowdsource cough and breath datasets and also screen for COVID-19 infection from the comfort of the user's home. The collected dataset includes data from 245 healthy individuals and 78 asymptomatic and 18 symptomatic COVID-19 patients. Users can simply use the application from any web browser without installation and enter their symptoms, record audio clips of their cough and breath sounds, and upload the data anonymously. Two different pipelines for screening were developed based on the symptoms reported by the users: asymptomatic and symptomatic. An innovative and novel stacking CNN model was developed using three base learners from of eight state-of-the-art deep learning CNN algorithms. The stacking CNN model is based on a logistic regression classifier meta-learner that uses the spectrograms generated from the breath and cough sounds of symptomatic and asymptomatic patients as input using the combined (Cambridge and collected) dataset. Results-The stacking model outperformed the other eight CNN networks with the best classification performance for binary classification using cough sound spectrogram images. The accuracy, sensitivity, and specificity for symptomatic and asymptomatic patients were 96.5%, 96.42%, and 95.47% and 98.85%, 97.01%, and 99.6%, respectively. For breath sound spectrogram images, the metrics for binary classification of symptomatic and asymptomatic patients were 91.03%, 88.9%, and 91.5% and 80.01%, 72.04%, and 82.67%, respectively. Conclusion-The web-application QUCoughScope records coughing and breathing sounds, converts them to a spectrogram, and applies the best-performing machine learning model to classify the COVID-19 patients and healthy subjects. The result is then reported back to the test user in the application interface. Therefore, this novel system can be used by patients in their premises as a pre-screening method to aid COVID-19 diagnosis by prioritizing the patients for RT-PCR testing and thereby reducing the risk of spreading of the disease.
Collapse
Affiliation(s)
- Tawsifur Rahman
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | - Nabil Ibtehaz
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | - Amith Khandakar
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | - Md Sakib Abrar Hossain
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | | | - Maymouna Ezeddin
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | - Enamul Haque Bhuiyan
- BioMedical Engineering and Imaging Institute (BMEII), Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA;
| | - Mohamed Arselene Ayari
- Department of Civil Engineering, College of Engineering, Qatar University, Doha 2713, Qatar;
| | - Anas Tahir
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | - Yazan Qiblawey
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | - Sakib Mahmud
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| | - Susu M. Zughaier
- College of Medicine, Qatar University, Doha 2713, Qatar; (Y.M.S.M.); (S.M.Z.)
| | - Tariq Abbas
- Urology Division, Surgery Department, Sidra Medicine, Doha 26999, Qatar;
| | - Somaya Al-Maadeed
- Department of Computer Science and Engineering, College of Engineering, Qatar University, Doha 2713, Qatar;
| | - Muhammad E. H. Chowdhury
- Electrical Engineering Department, College of Engineering, Qatar University, Doha 2713, Qatar; (T.R.); (N.I.); (A.K.); (M.S.A.H.); (M.E.); (A.T.); (Y.Q.); (S.M.)
| |
Collapse
|
17
|
Nahar JK, Lopez-Jimenez F. Utilizing Conversational Artificial Intelligence, Voice, and Phonocardiography Analytics in Heart Failure Care. Heart Fail Clin 2022; 18:311-323. [DOI: 10.1016/j.hfc.2021.11.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
|
18
|
Maor E, Tsur N, Barkai G, Meister I, Makmel S, Friedman E, Aronovich D, Mevorach D, Lerman A, Zimlichman E, Bachar G. Noninvasive Vocal Biomarker is Associated With Severe Acute Respiratory Syndrome Coronavirus 2 Infection. Mayo Clin Proc Innov Qual Outcomes 2021; 5:654-662. [PMID: 34007956 PMCID: PMC8120447 DOI: 10.1016/j.mayocpiqo.2021.05.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
Objective To investigate the association of voice analysis with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection. Patients and Methods A vocal biomarker, a unitless scalar with a value between 0 and 1, was developed based on 434 voice samples. The biomarker training was followed by a prospective, multicenter, observational study. All subjects were tested for SARS-CoV-2, had their voice recorded to a smartphone application, and gave their informed consent to participate in the study. The association of SARS-CoV-2 infection with the vocal biomarker was evaluated. Results The final study population included 80 subjects with a median age of 29 [range, 23 to 36] years, of whom 68% were men. Forty patients were positive for SARS-CoV-2. Infected patients were 12 times more likely to report at least one symptom (odds ratio, 11.8; P<.001). The vocal biomarker was significantly higher among infected patients (OR, 0.11; 95% CI, 0.06 to 0.17 vs OR, 0.19; 95% CI, 0.12 to 0.3; P=.001). The area under the receiver operating characteristic curve evaluating the association of the vocal biomarker with SARS-CoV-2 status was 72%. With a biomarker threshold of 0.115, the results translated to a sensitivity and specificity of 85% (95% CI, 70% to 94%) and 53% (95% CI, 36% to 69%), respectively. When added to a self-reported symptom classifier, the area under the curve significantly improved from 0.775 to 0.85. Conclusion Voice analysis is associated with SARS-CoV-2 status and holds the potential to improve the accuracy of self-reported symptom-based screening tools. This pilot study suggests a possible role for vocal biomarkers in screening for SARS-CoV-2-infected subjects.
Collapse
Affiliation(s)
- Elad Maor
- Leviev Heart Center, Sheba Medical Center, Tel Hashomer, Israel
- Sackler School of Medicine, Tel Aviv University, Tel Aviv-Yafo, Israel
- Correspondence: Address to Elad Maor, MD, PhD, Leviev Heart Center, Sheba Medical Center, Tel Hashomer, Derech Sheba 2, Ramat Gan, Israel. @maor_elad
| | - Nir Tsur
- Department of Otolaryngology, Head and Neck Surgery, Rabin and Schneider Medical Center, Petah Tikva, Israel
- Sackler School of Medicine, Tel Aviv University, Tel Aviv-Yafo, Israel
| | - Galia Barkai
- Department of Otolaryngology, Head and Neck Surgery, Rabin and Schneider Medical Center, Petah Tikva, Israel
- Pediatric Infectious Disease Unit, Sheba Medical Center, Tel Hashomer, Israel
- Sackler School of Medicine, Tel Aviv University, Tel Aviv-Yafo, Israel
| | - Ido Meister
- Directorate of Defense Research and Development, Ministry of Defense, Be’er Sheva, Israel
| | - Shmuel Makmel
- Directorate of Defense Research and Development, Ministry of Defense, Be’er Sheva, Israel
| | - Eli Friedman
- Directorate of Defense Research and Development, Ministry of Defense, Be’er Sheva, Israel
| | | | | | - Amir Lerman
- Department of Cardiovascular Diseases, Mayo College of Medicine, Rochester, MN
| | - Eyal Zimlichman
- Leviev Heart Center, Sheba Medical Center, Tel Hashomer, Israel
- Sackler School of Medicine, Tel Aviv University, Tel Aviv-Yafo, Israel
| | - Gideon Bachar
- Sackler School of Medicine, Tel Aviv University, Tel Aviv-Yafo, Israel
| |
Collapse
|
19
|
Amir O, Anker SD, Gork I, Abraham WT, Pinney SP, Burkhoff D, Shallom ID, Haviv R, Edelman ER, Lotan C. Feasibility of remote speech analysis in evaluation of dynamic fluid overload in heart failure patients undergoing haemodialysis treatment. ESC Heart Fail 2021; 8:2467-2472. [PMID: 33955187 PMCID: PMC8318440 DOI: 10.1002/ehf2.13367] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Revised: 03/02/2021] [Accepted: 04/01/2021] [Indexed: 12/02/2022] Open
Abstract
Aims This study aimed to assess the ability of a voice analysis application to discriminate between wet and dry states in chronic heart failure (CHF) patients undergoing regular scheduled haemodialysis treatment due to volume overload as a result of their chronic renal failure. Methods and results In this single‐centre, observational study, five patients with CHF, peripheral oedema of ≥2, and pulmonary congestion‐related dyspnoea, undergoing haemodialysis three times per week, recorded five sentences into a standard smartphone/tablet before and after haemodialysis. Recordings were provided that same noon/early evening and the next morning and evening. Patient weight was measured at the hospital before and after each haemodialysis session. Recordings were analysed by a smartphone application (app) algorithm, to compare speech measures (SMs) of utterances collected over time. On average, patients provided recordings throughout 25.8 ± 3.9 dialysis treatment cycles, resulting in a total of 472 recordings. Weight changes of 1.95 ± 0.64 kg were documented during cycles. Median baseline SM prior to dialysis was 0.87 ± 0.17, and rose to 1.07 ± 0.15 following the end of the dialysis session, at noon (P = 0.0355), and remained at a similar level until the following morning (P = 0.007). By the evening of the day following dialysis, SMs returned to baseline levels (0.88 ± 0.19). Changes in patient weight immediately after dialysis positively correlated with SM changes, with the strongest correlation measured the evening of the dialysis day [slope: −0.40 ± 0.15 (95% confidence interval: −0.71 to −0.10), P = 0.0096]. Conclusions The fluid‐controlled haemodialysis model demonstrated the ability of the app algorithm to identify cyclic changes in SMs, which reflected bodily fluid levels. The voice analysis platform bears considerable potential as a harbinger of impending fluid overload in a range of clinical scenarios, which will enhance monitoring and triage efforts, ultimately optimizing remote CHF management.
Collapse
Affiliation(s)
- Offer Amir
- Department of Cardiology, Hadassah Medical Center, Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel.,Azrieli Faculty of Medicine, Bar-Ilan University, Safed, Israel
| | - Stefan D Anker
- Department of Cardiology (CVK) and Berlin Institute of Health Center for Regenerative Therapies (BCRT), German Centre for Cardiovascular Research (DZHK) partner site Berlin, Charité-Universitätsmedizin Berlin, Augustenburger Platz, Berlin, D-13353, Germany
| | - Ittamar Gork
- Department of Cardiology, Hadassah Medical Center, Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| | - William T Abraham
- Division of Cardiovascular Medicine, The Ohio State University, Columbus, OH, USA
| | | | | | | | | | - Elazer R Edelman
- Institute for Medical Engineering and Science, MIT, Cambridge, MA, USA
| | - Chaim Lotan
- Department of Cardiology, Hadassah Medical Center, Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| |
Collapse
|
20
|
Fagherazzi G, Fischer A, Ismael M, Despotovic V. Voice for Health: The Use of Vocal Biomarkers from Research to Clinical Practice. Digit Biomark 2021; 5:78-88. [PMID: 34056518 PMCID: PMC8138221 DOI: 10.1159/000515346] [Citation(s) in RCA: 50] [Impact Index Per Article: 16.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 02/18/2021] [Indexed: 12/17/2022] Open
Abstract
Diseases can affect organs such as the heart, lungs, brain, muscles, or vocal folds, which can then alter an individual's voice. Therefore, voice analysis using artificial intelligence opens new opportunities for healthcare. From using vocal biomarkers for diagnosis, risk prediction, and remote monitoring of various clinical outcomes and symptoms, we offer in this review an overview of the various applications of voice for health-related purposes. We discuss the potential of this rapidly evolving environment from a research, patient, and clinical perspective. We also discuss the key challenges to overcome in the near future for a substantial and efficient use of voice in healthcare.
Collapse
Affiliation(s)
- Guy Fagherazzi
- Deep Digital Phenotyping Research Unit, Department of Population Health, Luxembourg Institute of Health, Strassen, Luxembourg
| | - Aurélie Fischer
- Deep Digital Phenotyping Research Unit, Department of Population Health, Luxembourg Institute of Health, Strassen, Luxembourg
| | - Muhannad Ismael
- IT for Innovation in Services Department (ITIS), Luxembourg Institute of Science and Technology (LIST), Esch-sur-Alzette, Luxembourg
| | - Vladimir Despotovic
- Department of Computer Science, Faculty of Science, Technology and Medicine, University of Luxembourg, Esch-sur-Alzette, Luxembourg
| |
Collapse
|
21
|
Falter M, Scherrenberg M, Dendale P. Digital Health in Cardiac Rehabilitation and Secondary Prevention: A Search for the Ideal Tool. SENSORS (BASEL, SWITZERLAND) 2020; 21:E12. [PMID: 33374985 PMCID: PMC7792579 DOI: 10.3390/s21010012] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 12/08/2020] [Accepted: 12/19/2020] [Indexed: 12/19/2022]
Abstract
Digital health is becoming more integrated in daily medical practice. In cardiology, patient care is already moving from the hospital to the patients' homes, with large trials showing positive results in the field of telemonitoring via cardiac implantable electronic devices (CIEDs), monitoring of pulmonary artery pressure via implantable devices, telemonitoring via home-based non-invasive sensors, and screening for atrial fibrillation via smartphone and smartwatch technology. Cardiac rehabilitation and secondary prevention are modalities that could greatly benefit from digital health integration, as current compliance and cardiac rehabilitation participation rates are low and optimisation is urgently required. This viewpoint offers a perspective on current use of digital health technologies in cardiac rehabilitation, heart failure and secondary prevention. Important barriers which need to be addressed for implementation in medical practice are discussed. To conclude, a future ideal digital tool and integrated healthcare system are envisioned. To overcome personal, technological, and legal barriers, technological development should happen in dialog with patients and caregivers. Aided by digital technology, a future could be realised in which we are able to offer high-quality, affordable, personalised healthcare in a patient-centred way.
Collapse
Affiliation(s)
- Maarten Falter
- Heart Centre Hasselt, Jessa Hospital, 3500 Hasselt, Belgium; (M.S.); (P.D.)
- Mobile Health Unit, Faculty of Medicine and Life Sciences, Hasselt University, 3500 Hasselt, Belgium
- KU Leuven, Faculty of Medicine, 3000 Leuven, Belgium
| | - Martijn Scherrenberg
- Heart Centre Hasselt, Jessa Hospital, 3500 Hasselt, Belgium; (M.S.); (P.D.)
- Mobile Health Unit, Faculty of Medicine and Life Sciences, Hasselt University, 3500 Hasselt, Belgium
| | - Paul Dendale
- Heart Centre Hasselt, Jessa Hospital, 3500 Hasselt, Belgium; (M.S.); (P.D.)
- Mobile Health Unit, Faculty of Medicine and Life Sciences, Hasselt University, 3500 Hasselt, Belgium
| |
Collapse
|
22
|
|
23
|
Davergne T, Rakotozafiarison A, Servy H, Gossec L. Wearable Activity Trackers in the Management of Rheumatic Diseases: Where Are We in 2020? SENSORS (BASEL, SWITZERLAND) 2020; 20:E4797. [PMID: 32854412 PMCID: PMC7506912 DOI: 10.3390/s20174797] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 08/14/2020] [Accepted: 08/24/2020] [Indexed: 12/26/2022]
Abstract
In healthcare, physical activity can be monitored in two ways: self-monitoring by the patient himself or external monitoring by health professionals. Regarding self-monitoring, wearable activity trackers allow automated passive data collection that educate and motivate patients. Wearing an activity tracker can improve walking time by around 1500 steps per day. However, there are concerns about measurement accuracy (e.g., lack of a common validation protocol or measurement discrepancies between different devices). For external monitoring, many innovative electronic tools are currently used in rheumatology to help support physician time management, to reduce the burden on clinic time, and to prioritize patients who may need further attention. In inflammatory arthritis, such as rheumatoid arthritis, regular monitoring of patients to detect disease flares improves outcomes. In a pilot study applying machine learning to activity tracker steps, we showed that physical activity was strongly linked to disease flares and that patterns of physical activity could be used to predict flares with great accuracy, with a sensitivity and specificity above 95%. Thus, automatic monitoring of steps may lead to improved disease control through potential early identification of disease flares. However, activity trackers have some limitations when applied to rheumatic patients, such as tracker adherence, lack of clarity on long-term effectiveness, or the potential multiplicity of trackers.
Collapse
Affiliation(s)
- Thomas Davergne
- Sorbonne Université, INSERM, Institut Pierre Louis d’Epidémiologie et de Santé Publique (UMRS 1136), 75013 Paris, France;
| | | | - Hervé Servy
- E-Health Services Sanoïa, 13420 Gémenos, France;
| | - Laure Gossec
- Sorbonne Université, INSERM, Institut Pierre Louis d’Epidémiologie et de Santé Publique (UMRS 1136), 75013 Paris, France;
- APHP, Rheumatology Department, Pitié Salpêtrière Hospital, 75013 Paris, France;
| |
Collapse
|
24
|
Brown SA, Rhee JW, Guha A, Rao VU. Innovation in Precision Cardio-Oncology During the Coronavirus Pandemic and Into a Post-pandemic World. Front Cardiovasc Med 2020; 7:145. [PMID: 32923460 PMCID: PMC7456950 DOI: 10.3389/fcvm.2020.00145] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 07/08/2020] [Indexed: 12/12/2022] Open
Affiliation(s)
- Sherry-Ann Brown
- Cardio-Oncology Program, Division of Cardiovascular Medicine, Medical College of Wisconsin, Milwaukee, WI, United States
| | - June-Wha Rhee
- Stanford Cardiovascular Institute, Stanford University, Stanford, CA, United States
| | - Avirup Guha
- Harrington Heart and Vascular Institute, Case Western Reserve University, Cleveland, OH, United States
| | - Vijay U. Rao
- Franciscan Health, Indianapolis, Indiana Heart Physicians, Indianapolis, IN, United States
| |
Collapse
|
25
|
Ledwoch J, Duncker D. [eHealth-smart devices revolutionizing cardiology]. Herzschrittmacherther Elektrophysiol 2020; 31:368-374. [PMID: 32661563 PMCID: PMC7355522 DOI: 10.1007/s00399-020-00700-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2020] [Accepted: 06/21/2020] [Indexed: 12/25/2022]
Abstract
Hintergrund Der Nutzen von Smart Devices wie Handys und Smartwatches in der Kardiologie nimmt deutlich zu. Der gehäufte Einsatz wird vor allem auch von Patienten und der Industrie vorangetrieben. Fragestellung Welche Möglichkeiten bieten Smart Devices in der Kardiologie? Material und Methode Es wurde eine selektive Literaturrecherche durchgeführt. Naturwissenschaftliche und klinische Studien über die verschiedenen Einsatzmöglichkeiten der technischen Mittel wurden interpretiert. Ergebnisse Der Besitz und Gebrauch von Smartphones in Deutschland ist im weltweiten Vergleich sehr hoch. Dies ermöglicht einen sehr breiten Einsatz dieser Technologie auch im medizinischen Bereich. Die Anwendungsmöglichkeiten sind vielfältig und reichen von der Nutzung als Nachschlagewerk über einen „clinical decision support“ bis hin zur Erfassung von Biosignalen. Gerade die Kombination aus Biosignalmessung und Weiterverarbeitung der Information durch künstliche Intelligenz (KI) ermöglicht eine deutliche Verbesserung der bisherigen Diagnosemethoden und erlaubt extrem genaue Vorhersagen verschiedener kardiovaskulärer Krankheitsverläufe. Schlussfolgerung Smart Devices werden in der Kardiologie zunehmend im klinischen Alltag genutzt. Aufgrund der technischen Möglichkeiten wird der Einsatz sehr wahrscheinlich weiter steigen und einige Bereiche der Kardiologie deutlich verändern.
Collapse
Affiliation(s)
- Jakob Ledwoch
- Klinik für Kardiologie, Pneumologie und Internistische Intensivmedizin, München Klinik Neuperlach, Oskar-Maria-Graf-Ring 51, 81737, München, Deutschland.
| | - David Duncker
- Rhythmologie und Elektrophysiologie, Klinik für Kardiologie und Angiologie, Medizinische Hochschule Hannover, Hannover, Deutschland
| |
Collapse
|
26
|
Lopez-Jimenez F, Attia Z, Arruda-Olson AM, Carter R, Chareonthaitawee P, Jouni H, Kapa S, Lerman A, Luong C, Medina-Inojosa JR, Noseworthy PA, Pellikka PA, Redfield MM, Roger VL, Sandhu GS, Senecal C, Friedman PA. Artificial Intelligence in Cardiology: Present and Future. Mayo Clin Proc 2020; 95:1015-1039. [PMID: 32370835 DOI: 10.1016/j.mayocp.2020.01.038] [Citation(s) in RCA: 88] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2019] [Revised: 01/30/2020] [Accepted: 01/31/2020] [Indexed: 02/06/2023]
Abstract
Artificial intelligence (AI) is a nontechnical, popular term that refers to machine learning of various types but most often to deep neural networks. Cardiology is at the forefront of AI in medicine. For this review, we searched PubMed and MEDLINE databases with no date restriction using search terms related to AI and cardiology. Articles were selected for inclusion on the basis of relevance. We highlight the major achievements in recent years in nearly all areas of cardiology and underscore the mounting evidence suggesting how AI will take center stage in the field. Artificial intelligence requires a close collaboration among computer scientists, clinical investigators, clinicians, and other users in order to identify the most relevant problems to be solved. Best practices in the generation and implementation of AI include the selection of ideal data sources, taking into account common challenges during the interpretation, validation, and generalizability of findings, and addressing safety and ethical concerns before final implementation. The future of AI in cardiology and in medicine in general is bright as the collaboration between investigators and clinicians continues to excel.
Collapse
Affiliation(s)
| | - Zachi Attia
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN
| | | | - Rickey Carter
- Department of Health Sciences Research, Mayo Clinic, Jacksonville, FL
| | | | - Hayan Jouni
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN
| | - Suraj Kapa
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN
| | - Amir Lerman
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN
| | - Christina Luong
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN
| | | | - Peter A Noseworthy
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN; Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, MN
| | | | | | - Veronique L Roger
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN; Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, MN
| | | | - Conor Senecal
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN
| | - Paul A Friedman
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN
| |
Collapse
|
27
|
Sara JDS, Maor E, Borlaug B, Lewis BR, Orbelo D, Lerman LO, Lerman A. Non-invasive vocal biomarker is associated with pulmonary hypertension. PLoS One 2020; 15:e0231441. [PMID: 32298301 PMCID: PMC7162478 DOI: 10.1371/journal.pone.0231441] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2019] [Accepted: 03/08/2020] [Indexed: 12/19/2022] Open
Abstract
Emerging data suggest that noninvasive voice biomarker analysis is associated with coronary artery disease. We recently showed that a vocal biomarker was associated with hospitalization and heart failure in patients with heart failure. We evaluate the association between a vocal biomarker and invasively measured indices of pulmonary hypertension (PH). Patients were referred for an invasive cardiac hemodynamic study between January 2017 and December 2018, and had their voices recorded on three separate occasions to their smartphone prior to each study. A pre-established vocal biomarker was determined based on each individual recording. The intra-class correlation co-efficient between the separate voice recording biomarker values for each individual participant was 0.829 (95% CI 0.740-0.889) implying very good agreement between values. Thus, the mean biomarker was calculated for each patient. Patients were divided into two groups: high pulmonary arterial pressure (PAP) defined as ≥ 35 mmHg (moderate or greater PH), versus lower PAP. Eighty three patients, mean age 61.6 ± 15.1 years, 37 (44.6%) male, were included. Patients with a high mean PAP (≥ 35 mmHg) had on average significantly higher values of the mean voice biomarker compared to those with a lower mean PAP (0.74 ± 0.85 vs. 0.40 ± 0.88 p = 0.046). Multivariate logistic regression showed that an increase in the mean voice biomarker by 1 unit was associated with a high PAP, odds ratio 2.31, 95% CI 1.05-5.07, p = 0.038. This study shows a relationship between a noninvasive vocal biomarker and an invasively derived hemodynamic index related to PH obtained during clinically indicated cardiac catheterization. These results may have important practical clinical implications for telemedicine and remote monitoring of patients with heart failure and PH.
Collapse
Affiliation(s)
- Jaskanwal Deep Singh Sara
- Department of Cardiovascular Diseases, Mayo College of Medicine, Rochester, MN, United States of America
| | - Elad Maor
- Chaim Sheba Medical Center, Tel Hashomer, Israel
- Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Barry Borlaug
- Department of Cardiovascular Diseases, Mayo College of Medicine, Rochester, MN, United States of America
| | - Bradley R. Lewis
- Division of Biomedical Statistics and Informatics, Mayo College of Medicine, Rochester, MN, United States of America
| | - Diana Orbelo
- Divison of Laryngology, Mayo College of Medicine, Rochester, MN, United States of America
| | - Lliach O. Lerman
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, United States of America
| | - Amir Lerman
- Department of Cardiovascular Diseases, Mayo College of Medicine, Rochester, MN, United States of America
| |
Collapse
|
28
|
Krusche M, Mucke J, Burmester GR. What will be the job of the rheumatologist in 2030? Joint Bone Spine 2020; 87:525-527. [PMID: 32278812 DOI: 10.1016/j.jbspin.2020.03.016] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Accepted: 03/31/2020] [Indexed: 12/18/2022]
Affiliation(s)
- Martin Krusche
- Department of Rheumatology and Clinical Immunology, Charité- Universitätsmedizin, 1, Charitéplatz, D-10117 Berlin, Germany.
| | - Johanna Mucke
- Department of Rheumatology and Hiller Research Unit Rheumatology, Heinrich-Heine-University Düsseldorf, Düsseldorf, Germany
| | - Gerd-Rüdiger Burmester
- Department of Rheumatology and Clinical Immunology, Charité- Universitätsmedizin, 1, Charitéplatz, D-10117 Berlin, Germany
| |
Collapse
|
29
|
Maor E, Perry D, Mevorach D, Taiblum N, Luz Y, Mazin I, Lerman A, Koren G, Shalev V. Vocal Biomarker Is Associated With Hospitalization and Mortality Among Heart Failure Patients. J Am Heart Assoc 2020; 9:e013359. [PMID: 32233754 PMCID: PMC7428646 DOI: 10.1161/jaha.119.013359] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Background The purpose of this article is to evaluate the association of voice signal analysis with adverse outcome among patients with congestive heart failure (CHF). Methods and Results The study cohort included 10 583 patients who were registered to a call center of patients who had chronic conditions including CHF in Israel between 2013 and 2018. A total of 223 acoustic features were extracted from 20 s of speech for each patient. A biomarker was developed based on a training cohort of non-CHF patients (N=8316). The biomarker was tested on a mutually exclusive CHF study cohort (N=2267) and was evaluated as a continuous and ordinal (4 quartiles) variable. Median age of the CHF study population was 77 (interquartile range 68-83) and 63% were men. During a median follow-up of 20 months (interquartile range 9-34), 824 (36%) patients died. Kaplan-Meier survival analysis showed higher cumulative probability of death with increasing quartiles (23%, 29%, 38%, and 54%; P<0.001). Survival analysis with adjustment to known predictors of poor survival demonstrated that each SD increase in the biomarker was associated with a significant 32% increased risk of death during follow-up (95% CI, 1.24-1.41, P<0.001) and that compared with the lowest quartile, patients in the highest quartile were 96% more likely to die (95% CI, 1.59-2.42, P<0.001). The model consistently demonstrated an independent association of the biomarker with hospitalizations during follow-up (P<0.001). Conclusions Noninvasive vocal biomarker is associated with adverse outcome among CHF patients, suggesting a possible role for voice analysis in telemedicine and CHF patient care.
Collapse
Affiliation(s)
- Elad Maor
- Chaim Sheba Medical Center Tel Hashomer Israel.,Sackler School of Medicine Tel Aviv University Tel Aviv Israel
| | | | | | | | | | - Israel Mazin
- Chaim Sheba Medical Center Tel Hashomer Israel.,Sackler School of Medicine Tel Aviv University Tel Aviv Israel
| | - Amir Lerman
- Department of Cardiovascular Disease Mayo Clinic Rochester MN
| | - Gideon Koren
- Kahn-Maccabi Institute of Research and Innovation Tel Aviv Israel.,Sackler School of Medicine Tel Aviv University Tel Aviv Israel
| | - Varda Shalev
- Kahn-Maccabi Institute of Research and Innovation Tel Aviv Israel.,Sackler School of Medicine Tel Aviv University Tel Aviv Israel
| |
Collapse
|
30
|
Dias R, Torkamani A. Artificial intelligence in clinical and genomic diagnostics. Genome Med 2019; 11:70. [PMID: 31744524 PMCID: PMC6865045 DOI: 10.1186/s13073-019-0689-8] [Citation(s) in RCA: 149] [Impact Index Per Article: 29.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Accepted: 11/08/2019] [Indexed: 12/13/2022] Open
Abstract
Artificial intelligence (AI) is the development of computer systems that are able to perform tasks that normally require human intelligence. Advances in AI software and hardware, especially deep learning algorithms and the graphics processing units (GPUs) that power their training, have led to a recent and rapidly increasing interest in medical AI applications. In clinical diagnostics, AI-based computer vision approaches are poised to revolutionize image-based diagnostics, while other AI subtypes have begun to show similar promise in various diagnostic modalities. In some areas, such as clinical genomics, a specific type of AI algorithm known as deep learning is used to process large and complex genomic datasets. In this review, we first summarize the main classes of problems that AI systems are well suited to solve and describe the clinical diagnostic tasks that benefit from these solutions. Next, we focus on emerging methods for specific tasks in clinical genomics, including variant calling, genome annotation and variant classification, and phenotype-to-genotype correspondence. Finally, we end with a discussion on the future potential of AI in individualized medicine applications, especially for risk prediction in common complex diseases, and the challenges, limitations, and biases that must be carefully addressed for the successful deployment of AI in medical applications, particularly those utilizing human genetics and genomics data.
Collapse
Affiliation(s)
- Raquel Dias
- The Scripps Translational Science Institute, The Scripps Research Institute, 3344 North Torrey Pines Court Suite 300, La Jolla, CA, 92037, USA
- Department of Integrative Structural and Computational Biology, The Scripps Research Institute, 3344 North Torrey Pines Court Suite 300, La Jolla, CA, 92037, USA
| | - Ali Torkamani
- The Scripps Translational Science Institute, The Scripps Research Institute, 3344 North Torrey Pines Court Suite 300, La Jolla, CA, 92037, USA.
- Department of Integrative Structural and Computational Biology, The Scripps Research Institute, 3344 North Torrey Pines Court Suite 300, La Jolla, CA, 92037, USA.
| |
Collapse
|
31
|
Sugrue A, Mahowald J, Asirvatham SJ. Hey Goglexiri, Do I Have Coronary Artery Disease? Mayo Clin Proc 2018; 93:818-820. [PMID: 29976371 DOI: 10.1016/j.mayocp.2018.05.021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/25/2018] [Accepted: 05/29/2018] [Indexed: 11/16/2022]
Affiliation(s)
- Alan Sugrue
- Department of Cardiovascular Diseases, Division of Heart Rhythm Services, Mayo Clinic, Rochester, MN
| | - Jillian Mahowald
- Department of Cardiovascular Diseases, Division of Heart Rhythm Services, Mayo Clinic, Rochester, MN
| | - Samuel J Asirvatham
- Department of Cardiovascular Diseases, Division of Heart Rhythm Services, Department of Pediatric and Adolescent Medicine, Division of Pediatric Cardiology, Mayo Clinic, Rochester, MN.
| |
Collapse
|
32
|
Torkamani A, Andersen KG, Steinhubl SR, Topol EJ. High-Definition Medicine. Cell 2017; 170:828-843. [PMID: 28841416 DOI: 10.1016/j.cell.2017.08.007] [Citation(s) in RCA: 115] [Impact Index Per Article: 16.4] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2017] [Revised: 07/10/2017] [Accepted: 08/04/2017] [Indexed: 12/13/2022]
Abstract
The foundation for a new era of data-driven medicine has been set by recent technological advances that enable the assessment and management of human health at an unprecedented level of resolution-what we refer to as high-definition medicine. Our ability to assess human health in high definition is enabled, in part, by advances in DNA sequencing, physiological and environmental monitoring, advanced imaging, and behavioral tracking. Our ability to understand and act upon these observations at equally high precision is driven by advances in genome editing, cellular reprogramming, tissue engineering, and information technologies, especially artificial intelligence. In this review, we will examine the core disciplines that enable high-definition medicine and project how these technologies will alter the future of medicine.
Collapse
Affiliation(s)
- Ali Torkamani
- The Scripps Translational Science Institute, La Jolla, CA 92037, USA; Department of Integrative Structural and Computational Biology, The Scripps Research Institute, La Jolla, CA 92037, USA.
| | - Kristian G Andersen
- The Scripps Translational Science Institute, La Jolla, CA 92037, USA; Department of Immunology and Microbial Science, The Scripps Research Institute, La Jolla, CA 92037, USA
| | - Steven R Steinhubl
- The Scripps Translational Science Institute, La Jolla, CA 92037, USA; Department of Molecular Medicine, The Scripps Research Institute, La Jolla, CA 92037, USA
| | - Eric J Topol
- The Scripps Translational Science Institute, La Jolla, CA 92037, USA; Department of Molecular Medicine, The Scripps Research Institute, La Jolla, CA 92037, USA
| |
Collapse
|