1
|
Evangelista EG, Bélisle-Pipon JC, Naunheim MR, Powell M, Gallois H, Bensoussan Y. Voice as a Biomarker in Health-Tech: Mapping the Evolving Landscape of Voice Biomarkers in the Start-Up World. Otolaryngol Head Neck Surg 2024; 171:340-352. [PMID: 38822764 DOI: 10.1002/ohn.830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 02/10/2024] [Accepted: 02/24/2024] [Indexed: 06/03/2024]
Abstract
OBJECTIVE The vocal biomarkers market was worth $1.9B in 2021 and is projected to exceed $5.1B by 2028, for a compound annual growth rate of 15.15%. The investment growth demonstrates a blossoming interest in voice and artificial intelligence (AI) as it relates to human health. The objective of this study was to map the current landscape of start-ups utilizing voice as a biomarker in health-tech. DATA SOURCES A comprehensive search for start-ups was conducted using Google, LinkedIn, Twitter, and Facebook. A review of the research was performed using company website, PubMed, and Google Scholar. REVIEW METHODS A 3-pronged approach was taken to thoroughly map the landscape. First, an internet search was conducted to identify current start-ups focusing on products relating to voice as a biomarker of health. Second, Crunchbase was utilized to collect financial and organizational information. Third, a review of the literature was conducted to analyze publications associated with the identified start-ups. RESULTS A total of 27 start-up start-ups with a focus in the utilization of AI for developing biomarkers of health from the human voice were identified. Twenty-four of these start-ups garnered $178,808,039 in investments. The 27 start-ups published 194 publications combined, 128 (66%) of which were peer reviewed. CONCLUSION There is growing enthusiasm surrounding voice as a biomarker in health-tech. Academic drive may complement commercialization to best achieve progress in this arena. More research is needed to accurately capture the entirety of the field, including larger industry players, academic institutions, and non-English content.
Collapse
Affiliation(s)
- Emily G Evangelista
- University of South Florida Morsani College of Medicine, Tampa, Florida, USA
| | | | - Matthew R Naunheim
- Division of Laryngology, Otolaryngology-Head and Neck Surgery, Massachusetts Eye and Ear, Harvard Medical School, Boston, Massachusetts, USA
| | - Maria Powell
- Department of Otolaryngology-Head and Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Hortense Gallois
- Department of Bio-ethics, Faculty of Health Sciences, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Yael Bensoussan
- Division of Laryngology, Department of Otolaryngology-Head and Neck Surgery, University of South Florida Morsani College of Medicine, Tampa, Florida, USA
| |
Collapse
|
2
|
Janssen Daalen JM, van den Bergh R, Prins EM, Moghadam MSC, van den Heuvel R, Veen J, Mathur S, Meijerink H, Mirelman A, Darweesh SKL, Evers LJW, Bloem BR. Digital biomarkers for non-motor symptoms in Parkinson's disease: the state of the art. NPJ Digit Med 2024; 7:186. [PMID: 38992186 PMCID: PMC11239921 DOI: 10.1038/s41746-024-01144-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 05/22/2024] [Indexed: 07/13/2024] Open
Abstract
Digital biomarkers that remotely monitor symptoms have the potential to revolutionize outcome assessments in future disease-modifying trials in Parkinson's disease (PD), by allowing objective and recurrent measurement of symptoms and signs collected in the participant's own living environment. This biomarker field is developing rapidly for assessing the motor features of PD, but the non-motor domain lags behind. Here, we systematically review and assess digital biomarkers under development for measuring non-motor symptoms of PD. We also consider relevant developments outside the PD field. We focus on technological readiness level and evaluate whether the identified digital non-motor biomarkers have potential for measuring disease progression, covering the spectrum from prodromal to advanced disease stages. Furthermore, we provide perspectives for future deployment of these biomarkers in trials. We found that various wearables show high promise for measuring autonomic function, constipation and sleep characteristics, including REM sleep behavior disorder. Biomarkers for neuropsychiatric symptoms are less well-developed, but show increasing accuracy in non-PD populations. Most biomarkers have not been validated for specific use in PD, and their sensitivity to capture disease progression remains untested for prodromal PD where the need for digital progression biomarkers is greatest. External validation in real-world environments and large longitudinal cohorts remains necessary for integrating non-motor biomarkers into research, and ultimately also into daily clinical practice.
Collapse
Affiliation(s)
- Jules M Janssen Daalen
- Radboud university medical center, Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Center of Expertise for Parkinson & Movement Disorders, Nijmegen, The Netherlands.
| | - Robin van den Bergh
- Radboud university medical center, Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Center of Expertise for Parkinson & Movement Disorders, Nijmegen, The Netherlands
| | - Eva M Prins
- Radboud university medical center, Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Center of Expertise for Parkinson & Movement Disorders, Nijmegen, The Netherlands
| | - Mahshid Sadat Chenarani Moghadam
- Radboud university medical center, Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Center of Expertise for Parkinson & Movement Disorders, Nijmegen, The Netherlands
| | - Rudie van den Heuvel
- HAN University of Applied Sciences, School of Engineering and Automotive, Health Concept Lab, Arnhem, The Netherlands
| | - Jeroen Veen
- HAN University of Applied Sciences, School of Engineering and Automotive, Health Concept Lab, Arnhem, The Netherlands
| | | | - Hannie Meijerink
- ParkinsonNL, Parkinson Patient Association, Bunnik, The Netherlands
| | - Anat Mirelman
- Tel Aviv University, Sagol School of Neuroscience, Department of Neurology, Faculty of Medicine, Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition, and Mobility (CMCM), Tel Aviv, Israel
| | - Sirwan K L Darweesh
- Radboud university medical center, Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Center of Expertise for Parkinson & Movement Disorders, Nijmegen, The Netherlands
| | - Luc J W Evers
- Radboud university medical center, Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Center of Expertise for Parkinson & Movement Disorders, Nijmegen, The Netherlands
- Radboud University, Institute for Computing and Information Sciences, Nijmegen, The Netherlands
| | - Bastiaan R Bloem
- Radboud university medical center, Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Center of Expertise for Parkinson & Movement Disorders, Nijmegen, The Netherlands.
| |
Collapse
|
3
|
Kim HB, Song J, Park S, Lee YO. Classification of laryngeal diseases including laryngeal cancer, benign mucosal disease, and vocal cord paralysis by artificial intelligence using voice analysis. Sci Rep 2024; 14:9297. [PMID: 38654036 DOI: 10.1038/s41598-024-58817-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 04/03/2024] [Indexed: 04/25/2024] Open
Abstract
Voice change is often the first sign of laryngeal cancer, leading to diagnosis through hospital laryngoscopy. Screening for laryngeal cancer solely based on voice could enhance early detection. However, identifying voice indicators specific to laryngeal cancer is challenging, especially when differentiating it from other laryngeal ailments. This study presents an artificial intelligence model designed to distinguish between healthy voices, laryngeal cancer voices, and those of the other laryngeal conditions. We gathered voice samples of individuals with laryngeal cancer, vocal cord paralysis, benign mucosal diseases, and healthy participants. Comprehensive testing was conducted to determine the best mel-frequency cepstral coefficient conversion and machine learning techniques, with results analyzed in-depth. In our tests, laryngeal diseases distinguishing from healthy voices achieved an accuracy of 0.85-0.97. However, when multiclass classification, accuracy ranged from 0.75 to 0.83. These findings highlight the challenges of artificial intelligence-driven voice-based diagnosis due to overlaps with benign conditions but also underscore its potential.
Collapse
Affiliation(s)
- Hyun-Bum Kim
- Department of Otolaryngology-Head and Neck Surgery, The Catholic University of Korea, Seoul, South Korea
| | - Jaemin Song
- Department of Industrial and Data Engineering, Hongik University, Seoul, South Korea
| | - Seho Park
- Department of Industrial and Data Engineering, Hongik University, Seoul, South Korea
| | - Yong Oh Lee
- Department of Industrial and Data Engineering, Hongik University, Seoul, South Korea.
| |
Collapse
|
4
|
Abumalloh RA, Nilashi M, Samad S, Ahmadi H, Alghamdi A, Alrizq M, Alyami S. Parkinson's disease diagnosis using deep learning: A bibliometric analysis and literature review. Ageing Res Rev 2024; 96:102285. [PMID: 38554785 DOI: 10.1016/j.arr.2024.102285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 03/20/2024] [Accepted: 03/24/2024] [Indexed: 04/02/2024]
Abstract
Parkinson's Disease (PD) is a progressive neurodegenerative illness triggered by decreased dopamine secretion. Deep Learning (DL) has gained substantial attention in PD diagnosis research, with an increase in the number of published papers in this discipline. PD detection using DL has presented more promising outcomes as compared with common machine learning approaches. This article aims to conduct a bibliometric analysis and a literature review focusing on the prominent developments taking place in this area. To achieve the target of the study, we retrieved and analyzed the available research papers in the Scopus database. Following that, we conducted a bibliometric analysis to inspect the structure of keywords, authors, and countries in the surveyed studies by providing visual representations of the bibliometric data using VOSviewer software. The study also provides an in-depth review of the literature focusing on different indicators of PD, deployed approaches, and performance metrics. The outcomes indicate the firm development of PD diagnosis using DL approaches over time and a large diversity of studies worldwide. Additionally, the literature review presented a research gap in DL approaches related to incremental learning, particularly in relation to big data analysis.
Collapse
Affiliation(s)
- Rabab Ali Abumalloh
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar
| | - Mehrbakhsh Nilashi
- Institute of Research and Development, Duy Tan University, Da Nang, Vietnam; School of Computer Science, Duy Tan University, Da Nang, Vietnam; UCSI Graduate Business School, UCSI University, No. 1 Jalan Menara Gading, UCSI Heights, Cheras, Kuala Lumpur 56000, Malaysia; Centre for Global Sustainability Studies (CGSS), Universiti Sains Malaysia, Penang 11800, Malaysia.
| | - Sarminah Samad
- Faculty of Business, UNITAR International University, Tierra Crest, Jalan SS6/3, Petaling Jaya, Selangor 47301, Malaysia
| | - Hossein Ahmadi
- Centre for Health Technology, Faculty of Health, University of Plymouth, Plymouth PL4 8AA, UK
| | - Abdullah Alghamdi
- Information Systems Dept., College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia; AI Lab, Scientific and Engineering Research Center (SERC), Najran University, Najran, Saudi Arabia
| | - Mesfer Alrizq
- Information Systems Dept., College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia; AI Lab, Scientific and Engineering Research Center (SERC), Najran University, Najran, Saudi Arabia
| | - Sultan Alyami
- AI Lab, Scientific and Engineering Research Center (SERC), Najran University, Najran, Saudi Arabia; Computer Science Dept., College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
| |
Collapse
|
5
|
Evangelista E, Kale R, McCutcheon D, Rameau A, Gelbard A, Powell M, Johns M, Law A, Song P, Naunheim M, Watts S, Bryson PC, Crowson MG, Pinto J, Bensoussan Y. Current Practices in Voice Data Collection and Limitations to Voice AI Research: A National Survey. Laryngoscope 2024; 134:1333-1339. [PMID: 38087983 DOI: 10.1002/lary.31052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Revised: 08/08/2023] [Accepted: 08/29/2023] [Indexed: 02/17/2024]
Abstract
INTRODUCTION Accuracy and validity of voice AI algorithms rely on substantial quality voice data. Although commensurable amounts of voice data are captured daily in voice centers across North America, there is no standardized protocol for acoustic data management, which limits the usability of these datasets for voice artificial intelligence (AI) research. OBJECTIVE The aim was to capture current practices of voice data collection, storage, analysis, and perceived limitations to collaborative voice research. METHODS A 30-question online survey was developed with expert guidance from the voicecollab.ai members, an international collaborative of voice AI researchers. The survey was disseminated via REDCap to an estimated 200 practitioners at North American voice centers. Survey questions assessed respondents' current practices in terms of acoustic data collection, storage, and retrieval as well as limitations to collaborative voice research. RESULTS Seventy-two respondents completed the survey of which 81.7% were laryngologists and 18.3% were speech language pathologists (SLPs). Eighteen percent of respondents reported seeing 40%-60% and 55% reported seeing >60 patients with voice disorders weekly (conservative estimate of over 4000 patients/week). Only 28% of respondents reported utilizing standardized protocols for collection and storage of acoustic data. Although, 87% of respondents conduct voice research, only 38% of respondents report doing so on a multi-institutional level. Perceived limitations to conducting collaborative voice research include lack of standardized methodology for collection (30%) and lack of human resources to prepare and label voice data adequately (55%). CONCLUSION To conduct large-scale multi-institutional voice research with AI, there is a pertinent need for standardization of acoustic data management, as well as an infrastructure for secure and efficient data sharing. LEVEL OF EVIDENCE 5 Laryngoscope, 134:1333-1339, 2024.
Collapse
Affiliation(s)
- Emily Evangelista
- University of South Florida Morsani College of Medicine, Tampa, Florida, U.S.A
| | - Rohan Kale
- Department of Biology, University of South Florida, Tampa, Florida, U.S.A
| | | | - Anais Rameau
- Department of Otolaryngology, Head and Neck Surgery Weill Cornell Medical College, Ithaca, New York, U.S.A
| | - Alexander Gelbard
- Department of Otolaryngology, Head and Neck Surgery Vanderbilt University Medical Center, Nashville, Tennessee, U.S.A
| | - Maria Powell
- Department of Otolaryngology, Head and Neck Surgery Vanderbilt University Medical Center, Nashville, Tennessee, U.S.A
| | - Michael Johns
- Department of Otolaryngology-Head and Neck Surgery Keck College of Medicine, University of Southern California, Los Angeles, California, U.S.A
| | - Anthony Law
- Department of Otolaryngology, Emory University School of Medicine, Atlanta, Georgia, U.S.A
| | - Phillip Song
- Massachusetts Eye and Ear, Division of Laryngology, Otolaryngology-Head and Neck Surgery Harvard Medical School, Boston, Massachusetts, U.S.A
| | - Matthew Naunheim
- Massachusetts Eye and Ear, Division of Laryngology, Otolaryngology-Head and Neck Surgery Harvard Medical School, Boston, Massachusetts, U.S.A
| | - Stephanie Watts
- Department of Otolaryngology, Head and Neck Surgery at University of South Florida Morsani College of Medicine, Tampa, Florida, U.S.A
| | - Paul C Bryson
- Department of Otolaryngology, Head and Neck Surgery at Cleveland Clinic, Cleveland, Ohio, U.S.A
| | - Matthew G Crowson
- Massachusetts Eye and Ear, Otolaryngology-Head and Neck Surgery Harvard Medical School, Boston, Massachusetts, U.S.A
| | - Jeremy Pinto
- Mila Quebec Artificial Intelligence Institute, Montreal, Quebec, Canada
| | - Yael Bensoussan
- Division of Laryngology Department of Otolaryngology, Head and Neck Surgery at University of South Florida Morsani College of Medicine, Tampa, Florida, U.S.A
| |
Collapse
|
6
|
Kim HB, Park YS, Lee JE, Han KD, Park YH. Study on relationship between self-recognition of voice disorder and mental health status: Korea National Health and Nutrition Examination Survey. J Affect Disord 2023; 338:482-486. [PMID: 37247786 DOI: 10.1016/j.jad.2023.05.082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 05/21/2023] [Accepted: 05/22/2023] [Indexed: 05/31/2023]
Abstract
BACKGROUND The voice has been thought to be associated with emotions, but conducting large-scale research on this relationship has some limitations. To overcome these limitations, questionnaires have been utilized as a research tool. METHODS A population-based cross-sectional study was done. A total of 15,977 participants completed questionnaires regarding self-recognition of voice disorder (SRVD), and mental health status. RESULTS 1053(6.6 %) participants answered that they had SRVD. In the multivariate Cox proportional hazard model, psychological stress (Hazard ratio (HR) = 1.371, 95 % confidence interval (CI) = 1.154-1.629), depressive symptoms (HR = 1.626, 95 % CI = 1.323-1.997), suicidal ideation (HR = 1.739, 95 % CI = 1.418-2.133), and suicide attempt (HR =2.206, 95 % CI = 1.067-4.56) were all associated with SRVD. In SRVD lasting over three weeks, psychological stress (HR = 1.604, 95 % CI = 1.278-2.014), depressive symptoms (HR = 1.807, 95 % CI = 1.384-2.36), and suicidal ideation (HR = 2.073, 95 % CI = 1.587-2.709) were also significant factors. As the number of mental health problems increased, the odds ratio of both SRVD (OR = 2.49, 95 % CI = 1.839-3.37) and SRVD lasting over three weeks (OR = 3.254, 95 % CI = 2.242-4.725) increased, respectively. LIMITATIONS SRVD and mental health status were judged only by simple questionnaires. Cross-sectional design and retrospective data could not draw causal relationships. CONCLUSIONS SRVD and SRVD lasting over three weeks had a significant relationship with mental health status, including psychological stress, depressive symptoms, and suicidal ideation. There is a need to consider psychiatric treatment for individuals who visit hospitals with voice disorders.
Collapse
Affiliation(s)
- Hyun-Bum Kim
- Department of Otorhinolaryngology-Head and Neck Surgery, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Youn-Sun Park
- Department of Otorhinolaryngology-Head and Neck Surgery, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Ju-Eun Lee
- Department of Otorhinolaryngology-Head and Neck Surgery, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Kyung-Do Han
- Department of Statistics and Actuarial Science, Soongsil University, Seoul, Republic of Korea
| | - Young-Hak Park
- Department of Otorhinolaryngology-Head and Neck Surgery, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea.
| |
Collapse
|
7
|
Idrisoglu A, Dallora AL, Anderberg P, Berglund JS. Applied Machine Learning Techniques to Diagnose Voice-Affecting Conditions and Disorders: Systematic Literature Review. J Med Internet Res 2023; 25:e46105. [PMID: 37467031 PMCID: PMC10398366 DOI: 10.2196/46105] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 04/26/2023] [Accepted: 05/23/2023] [Indexed: 07/20/2023] Open
Abstract
BACKGROUND Normal voice production depends on the synchronized cooperation of multiple physiological systems, which makes the voice sensitive to changes. Any systematic, neurological, and aerodigestive distortion is prone to affect voice production through reduced cognitive, pulmonary, and muscular functionality. This sensitivity inspired using voice as a biomarker to examine disorders that affect the voice. Technological improvements and emerging machine learning (ML) technologies have enabled possibilities of extracting digital vocal features from the voice for automated diagnosis and monitoring systems. OBJECTIVE This study aims to summarize a comprehensive view of research on voice-affecting disorders that uses ML techniques for diagnosis and monitoring through voice samples where systematic conditions, nonlaryngeal aerodigestive disorders, and neurological disorders are specifically of interest. METHODS This systematic literature review (SLR) investigated the state of the art of voice-based diagnostic and monitoring systems with ML technologies, targeting voice-affecting disorders without direct relation to the voice box from the point of view of applied health technology. Through a comprehensive search string, studies published from 2012 to 2022 from the databases Scopus, PubMed, and Web of Science were scanned and collected for assessment. To minimize bias, retrieval of the relevant references in other studies in the field was ensured, and 2 authors assessed the collected studies. Low-quality studies were removed through a quality assessment and relevant data were extracted through summary tables for analysis. The articles were checked for similarities between author groups to prevent cumulative redundancy bias during the screening process, where only 1 article was included from the same author group. RESULTS In the analysis of the 145 included studies, support vector machines were the most utilized ML technique (51/145, 35.2%), with the most studied disease being Parkinson disease (PD; reported in 87/145, 60%, studies). After 2017, 16 additional voice-affecting disorders were examined, in contrast to the 3 investigated previously. Furthermore, an upsurge in the use of artificial neural network-based architectures was observed after 2017. Almost half of the included studies were published in last 2 years (2021 and 2022). A broad interest from many countries was observed. Notably, nearly one-half (n=75) of the studies relied on 10 distinct data sets, and 11/145 (7.6%) used demographic data as an input for ML models. CONCLUSIONS This SLR revealed considerable interest across multiple countries in using ML techniques for diagnosing and monitoring voice-affecting disorders, with PD being the most studied disorder. However, the review identified several gaps, including limited and unbalanced data set usage in studies, and a focus on diagnostic test rather than disorder-specific monitoring. Despite the limitations of being constrained by only peer-reviewed publications written in English, the SLR provides valuable insights into the current state of research on ML-based voice-affecting disorder diagnosis and monitoring and highlighting areas to address in future research.
Collapse
Affiliation(s)
- Alper Idrisoglu
- Department of Health, Blekinge Institute of Technology, Karslkrona, Sweden
| | - Ana Luiza Dallora
- Department of Health, Blekinge Institute of Technology, Karslkrona, Sweden
| | - Peter Anderberg
- Department of Health, Blekinge Institute of Technology, Karslkrona, Sweden
- School of Health Sciences, University of Skövde, Skövde, Sweden
| | | |
Collapse
|
8
|
Alemu Y, Chen H, Duan C, Caulley D, Arriaga RI, Sezgin E. Detecting Clinically Relevant Emotional Distress and Functional Impairment in Children and Adolescents: Protocol for an Automated Speech Analysis Algorithm Development Study. JMIR Res Protoc 2023; 12:e46970. [PMID: 37351936 DOI: 10.2196/46970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 05/24/2023] [Accepted: 05/25/2023] [Indexed: 06/24/2023] Open
Abstract
BACKGROUND Even before the onset of the COVID-19 pandemic, children and adolescents were experiencing a mental health crisis, partly due to a lack of quality mental health services. The rate of suicide for Black youth has increased by 80%. By 2025, the health care system will be short of 225,000 therapists, further exacerbating the current crisis. Therefore, it is of utmost importance for providers, schools, youth mental health, and pediatric medical providers to integrate innovation in digital mental health to identify problems proactively and rapidly for effective collaboration with other health care providers. Such approaches can help identify robust, reproducible, and generalizable predictors and digital biomarkers of treatment response in psychiatry. Among the multitude of digital innovations to identify a biomarker for psychiatric diseases currently, as part of the macrolevel digital health transformation, speech stands out as an attractive candidate with features such as affordability, noninvasive, and nonintrusive. OBJECTIVE The protocol aims to develop speech-emotion recognition algorithms leveraging artificial intelligence/machine learning, which can establish a link between trauma, stress, and voice types, including disrupting speech-based characteristics, and detect clinically relevant emotional distress and functional impairments in children and adolescents. METHODS Informed by theoretical foundations (the Theory of Psychological Trauma Biomarkers and Archetypal Voice Categories), we developed our methodology to focus on 5 emotions: anger, happiness, fear, neutral, and sadness. Participants will be recruited from 2 local mental health centers that serve urban youths. Speech samples, along with responses to the Symptom and Functioning Severity Scale, Patient Health Questionnaire 9, and Adverse Childhood Experiences scales, will be collected using an Android mobile app. Our model development pipeline is informed by Gaussian mixture model (GMM), recurrent neural network, and long short-term memory. RESULTS We tested our model with a public data set. The GMM with 128 clusters showed an evenly distributed accuracy across all 5 emotions. Using utterance-level features, GMM achieved an accuracy of 79.15% overall, while frame selection increased accuracy to 85.35%. This demonstrates that GMM is a robust model for emotion classification of all 5 emotions and that emotion frame selection enhances accuracy, which is significant for scientific evaluation. Recruitment and data collection for the study were initiated in August 2021 and are currently underway. The study results are likely to be available and published in 2024. CONCLUSIONS This study contributes to the literature as it addresses the need for speech-focused digital health tools to detect clinically relevant emotional distress and functional impairments in children and adolescents. The preliminary results show that our algorithm has the potential to improve outcomes. The findings will contribute to the broader digital health transformation. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/46970.
Collapse
Affiliation(s)
- Yared Alemu
- TQIntelligence, Inc, Tucker, GA, United States
- Department of Psychiatry and Behavioral Sciences, Morehouse School of Medicine, Atlanta, GA, United States
| | - Hua Chen
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Chenghao Duan
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Desmond Caulley
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Rosa I Arriaga
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Emre Sezgin
- The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, OH, United States
| |
Collapse
|
9
|
Brigo F, Lorusso L, Walusinski O, Drouin E. Voices from the past: The pioneering use of the phonograph in neurology. Rev Neurol (Paris) 2023; 179:137-140. [PMID: 36150939 DOI: 10.1016/j.neurol.2022.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 06/09/2022] [Accepted: 06/10/2022] [Indexed: 10/14/2022]
Abstract
Since its discovery by the American inventor and industrialist Thomas Alva Edison (1847-1931) in 1877, the phonograph attracted much interest in the field of medicine. This article describes the earliest pioneering examples of the use of the phonograph in neurology. In France, the use of the phonograph for obtaining audio recordings of delusions and speech or language disturbances was first proposed by Victor Maurice Dupont (1857-1910) in 1889 and in Italy by the physician Gaetano Rummo (1853-1917), who had studied at La Salpêtrière under Jean-Martin Charcot (1825-1893). The applicability of the phonograph to the record of speech disturbances was illustrated in England by John Hughlings Jackson (1835-1911) and William Halse Rivers (1864-1922), and by William Hale White (1857-1949) and Cuthbert Hilton Golding-Bird (1848-1939) in 1891. Since then, audio recordings have been used rarely in neurology, a branch of medicine where the visual aspects dominate, to the extent that inspection can be enough to reach a definite clinical diagnosis. In the mid-20th century, the advent of audio and video recordings supplanted audio recordings alone, relegating them to a very marginal role.
Collapse
Affiliation(s)
- F Brigo
- Department of Neurology, Hospital of Merano (SABES-ASDAA), Merano, Italy.
| | - L Lorusso
- UOC Neurology and Stroke Unit, ASST Lecco, Merate, Italy
| | | | - E Drouin
- Service de neurologie, groupe hospitalier de l'institut catholique de Lille, GHICL, Lille, France
| | | |
Collapse
|
10
|
Exploration of Despair Eccentricities Based on Scale Metrics with Feature Sampling Using a Deep Learning Algorithm. Diagnostics (Basel) 2022; 12:diagnostics12112844. [PMID: 36428903 PMCID: PMC9689169 DOI: 10.3390/diagnostics12112844] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/11/2022] [Accepted: 11/15/2022] [Indexed: 11/19/2022] Open
Abstract
The majority of people in the modern biosphere struggle with depression as a result of the coronavirus pandemic's impact, which has adversely impacted mental health without warning. Even though the majority of individuals are still protected, it is crucial to check for post-corona virus symptoms if someone is feeling a little lethargic. In order to identify the post-coronavirus symptoms and attacks that are present in the human body, the recommended approach is included. When a harmful virus spreads inside a human body, the post-diagnosis symptoms are considerably more dangerous, and if they are not recognised at an early stage, the risks will be increased. Additionally, if the post-symptoms are severe and go untreated, it might harm one's mental health. In order to prevent someone from succumbing to depression, the technology of audio prediction is employed to recognise all the symptoms and potentially dangerous signs. Different choral characters are used to combine machine-learning algorithms to determine each person's mental state. Design considerations are made for a separate device that detects audio attribute outputs in order to evaluate the effectiveness of the suggested technique; compared to the previous method, the performance metric is substantially better by roughly 67%.
Collapse
|
11
|
Abstract
BACKGROUND In this modern era, depression is one of the most prevalent mental disorders from which millions of individuals are affected today. The symptoms of depression are heterogeneous and often coincide with other disorders such as bipolar disorder, Parkinson's, schizophrenia, etc. It is a serious mental illness that may lead to other health problems if left untreated. Currently, identifying individuals with depression is totally based on the expertise of the clinician's experience. In order to assist clinicians in identifying the characteristics and classifying depressed people, different types of data modalities and machine learning techniques have been incorporated by researchers in this field. This study aims to find the answers to some important questions related to the trend of publications, data modality, machine learning models, dataset usage, pre-processing techniques and feature extraction and selection techniques that are prevalent and guide the direction of future research on depression diagnosis. METHODS This systematic review was conducted using a broad range of articles from two major databases: IEEE Xplore and PubMed. Studies ranging from the years 2011 to April 2021 were retrieved from the databases resulting in a total of 590 articles (53 articles from the IEEE Xplore database and 537 articles from the PubMed database). Out of those, the articles which satisfied the defined inclusion criteria were investigated for further analysis. RESULTS A total of 135 articles were identified and analysed for this review. High growth in the number of publications has been observed in recent years. Furthermore, significant diversity in the use of data modalities and machine learning classifiers has also been noted in this study. fMRI data with an SVM classifier was found to be the most popular choice among researchers. In most of the studies, data scarcity and small sample size, particularly for neuroimaging data are major concerns. The use of identical data pre-processing tools for similar data modalities can be seen. This study also provides statistical analysis of the current framework with respect to the modality, machine learning classifier, sample size and accuracy by applying one-way ANOVA and the Tukey - Kramer test. CONCLUSION The results indicate that an effective fusion of machine learning techniques with a potential data modality has a promising future for assisting clinicians in automatic depression diagnosis.
Collapse
Affiliation(s)
- Sweta Bhadra
- Department of CS & IT, Cotton University, Guwahati, India
| | | |
Collapse
|
12
|
Things to Consider When Automatically Detecting Parkinson’s Disease Using the Phonation of Sustained Vowels: Analysis of Methodological Issues. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12030991] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Diagnosing Parkinson’s Disease (PD) necessitates monitoring symptom progression. Unfortunately, diagnostic confirmation often occurs years after disease onset. A more sensitive and objective approach is paramount to the expedient diagnosis and treatment of persons with PD (PwPDs). Recent studies have shown that we can train accurate models to detect signs of PD from audio recordings of confirmed PwPDs. However, disparities exist between studies and may be caused, in part, by differences in employed corpora or methodologies. Our hypothesis is that unaccounted covariates in methodology, experimental design, and data preparation resulted in overly optimistic results in studies of PD automatic detection employing sustained vowels. These issues include record-wise fold creation rather than subject-wise; an imbalance of age between the PwPD and control classes; using too small of a corpus compared to the sizes of feature vectors; performing cross-validation without including development data; and the absence of cross-corpora testing to confirm results. In this paper, we evaluate the influence of these methodological issues in the automatic detection of PD employing sustained vowels. We perform several experiments isolating each issue to measure its influence employing three different corpora. Moreover, we analyze if the perceived dysphonia of the speakers could be causing differences in results between the corpora. Results suggest that each independent methodological issue analyzed has an effect on classification accuracy. Consequently, we recommend a list of methodological steps to be considered in future experiments to avoid overoptimistic or misleading results.
Collapse
|
13
|
Jeong H, Jeong YW, Park Y, Kim K, Park J, Kang DR. Applications of deep learning methods in digital biomarker research using noninvasive sensing data. Digit Health 2022; 8:20552076221136642. [PMID: 36353696 PMCID: PMC9638529 DOI: 10.1177/20552076221136642] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Accepted: 10/04/2022] [Indexed: 07/02/2024] Open
Abstract
Introduction: Noninvasive digital biomarkers are critical elements in digital healthcare in terms of not only the ease of measurement but also their use of raw data. In recent years, deep learning methods have been put to use to analyze these diverse heterogeneous data; these methods include representation learning for feature extraction and supervised learning for the prediction of these biomarkers. Methods: We introduce clinical cases of digital biomarkers and various deep-learning methods applied according to each data type. In addition, deep learning methods for the integrated analysis of multidimensional heterogeneous data are introduced, and the utility of these data as an integrated digital biomarker is presented. The current status of digital biomarker research is examined by surveying research cases applied to various types of data as well as modeling methods. Results: We present a future research direction for using data from heterogeneous sources together by introducing deep learning methods for dimensionality reduction and mode integration from multimodal digital biomarker studies covering related domains. The integration of multimodality has led to advances in research through the improvement of performance and complementarity between modes. Discussion: The integrative digital biomarker will be more useful for research on diseases that require data from multiple sources to be treated together. Since delicate signals from patients are not missed and the interaction effects between signals are also considered, it will be helpful for immediate detection and more accurate prediction of symptoms.
Collapse
Affiliation(s)
- Hoyeon Jeong
- Department of Biostatistics, Yonsei University Wonju College of
Medicine, Wonju, Republic of Korea
| | - Yong W Jeong
- Department of Biostatistics, Yonsei University Wonju College of
Medicine, Wonju, Republic of Korea
| | - Yeonjae Park
- Department of Biostatistics, Yonsei University Wonju College of
Medicine, Wonju, Republic of Korea
| | - Kise Kim
- School of Health and Environmental Science, Korea University, Seoul, Republic of Korea
| | | | - Dae R Kang
- Department of Biostatistics, Yonsei University Wonju College of
Medicine, Wonju, Republic of Korea
- Department of Precision Medicine, Yonsei University Wonju College of
Medicine, Wonju, Republic of Korea
| |
Collapse
|
14
|
Xue C, Karjadi C, Paschalidis IC, Au R, Kolachalama VB. Detection of dementia on voice recordings using deep learning: a Framingham Heart Study. Alzheimers Res Ther 2021; 13:146. [PMID: 34465384 PMCID: PMC8409004 DOI: 10.1186/s13195-021-00888-3] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 08/12/2021] [Indexed: 11/10/2022]
Abstract
BACKGROUND Identification of reliable, affordable, and easy-to-use strategies for detection of dementia is sorely needed. Digital technologies, such as individual voice recordings, offer an attractive modality to assess cognition but methods that could automatically analyze such data are not readily available. METHODS AND FINDINGS We used 1264 voice recordings of neuropsychological examinations administered to participants from the Framingham Heart Study (FHS), a community-based longitudinal observational study. The recordings were 73 min in duration, on average, and contained at least two speakers (participant and examiner). Of the total voice recordings, 483 were of participants with normal cognition (NC), 451 recordings were of participants with mild cognitive impairment (MCI), and 330 were of participants with dementia (DE). We developed two deep learning models (a two-level long short-term memory (LSTM) network and a convolutional neural network (CNN)), which used the audio recordings to classify if the recording included a participant with only NC or only DE and to differentiate between recordings corresponding to those that had DE from those who did not have DE (i.e., NDE (NC+MCI)). Based on 5-fold cross-validation, the LSTM model achieved a mean (±std) area under the receiver operating characteristic curve (AUC) of 0.740 ± 0.017, mean balanced accuracy of 0.647 ± 0.027, and mean weighted F1 score of 0.596 ± 0.047 in classifying cases with DE from those with NC. The CNN model achieved a mean AUC of 0.805 ± 0.027, mean balanced accuracy of 0.743 ± 0.015, and mean weighted F1 score of 0.742 ± 0.033 in classifying cases with DE from those with NC. For the task related to the classification of participants with DE from NDE, the LSTM model achieved a mean AUC of 0.734 ± 0.014, mean balanced accuracy of 0.675 ± 0.013, and mean weighted F1 score of 0.671 ± 0.015. The CNN model achieved a mean AUC of 0.746 ± 0.021, mean balanced accuracy of 0.652 ± 0.020, and mean weighted F1 score of 0.635 ± 0.031 in classifying cases with DE from those who were NDE. CONCLUSION This proof-of-concept study demonstrates that automated deep learning-driven processing of audio recordings of neuropsychological testing performed on individuals recruited within a community cohort setting can facilitate dementia screening.
Collapse
Affiliation(s)
- Chonghua Xue
- Section of Computational Biomedicine, Department of Medicine, Boston University School of Medicine, 72 E. Concord Street, Evans 636, Boston, MA, 02118, USA
| | - Cody Karjadi
- The Framingham Heart Study, Boston University, Boston, MA, 02118, USA
- Departments of Anatomy & Neurobiology and Neurology, Boston University School of Medicine, Boston, MA, 02118, USA
| | - Ioannis Ch Paschalidis
- Departments to Electrical & Computer Engineering, Systems Engineering and Biomedical Engineering; Faculty of Computing & Data Sciences, Boston University, Boston, MA, 02118, USA
| | - Rhoda Au
- The Framingham Heart Study, Boston University, Boston, MA, 02118, USA
- Departments of Anatomy & Neurobiology and Neurology, Boston University School of Medicine, Boston, MA, 02118, USA
- Boston University Alzheimer's Disease Center, Boston, MA, 02118, USA
- Department of Epidemiology, Boston University School of Public Health, Boston, MA, 02118, USA
| | - Vijaya B Kolachalama
- Section of Computational Biomedicine, Department of Medicine, Boston University School of Medicine, 72 E. Concord Street, Evans 636, Boston, MA, 02118, USA.
- Boston University Alzheimer's Disease Center, Boston, MA, 02118, USA.
- Department of Computer Science and Faculty of Computing & Data Sciences, Boston University, Boston, MA, 02115, USA.
| |
Collapse
|
15
|
Xue C, Karjadi C, Paschalidis IC, Au R, Kolachalama VB. Detection of dementia on voice recordings using deep learning: a Framingham Heart Study. Alzheimers Res Ther 2021. [PMID: 34465384 DOI: 10.1186/s13195-021-00888-3.pdf] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
BACKGROUND Identification of reliable, affordable, and easy-to-use strategies for detection of dementia is sorely needed. Digital technologies, such as individual voice recordings, offer an attractive modality to assess cognition but methods that could automatically analyze such data are not readily available. METHODS AND FINDINGS We used 1264 voice recordings of neuropsychological examinations administered to participants from the Framingham Heart Study (FHS), a community-based longitudinal observational study. The recordings were 73 min in duration, on average, and contained at least two speakers (participant and examiner). Of the total voice recordings, 483 were of participants with normal cognition (NC), 451 recordings were of participants with mild cognitive impairment (MCI), and 330 were of participants with dementia (DE). We developed two deep learning models (a two-level long short-term memory (LSTM) network and a convolutional neural network (CNN)), which used the audio recordings to classify if the recording included a participant with only NC or only DE and to differentiate between recordings corresponding to those that had DE from those who did not have DE (i.e., NDE (NC+MCI)). Based on 5-fold cross-validation, the LSTM model achieved a mean (±std) area under the receiver operating characteristic curve (AUC) of 0.740 ± 0.017, mean balanced accuracy of 0.647 ± 0.027, and mean weighted F1 score of 0.596 ± 0.047 in classifying cases with DE from those with NC. The CNN model achieved a mean AUC of 0.805 ± 0.027, mean balanced accuracy of 0.743 ± 0.015, and mean weighted F1 score of 0.742 ± 0.033 in classifying cases with DE from those with NC. For the task related to the classification of participants with DE from NDE, the LSTM model achieved a mean AUC of 0.734 ± 0.014, mean balanced accuracy of 0.675 ± 0.013, and mean weighted F1 score of 0.671 ± 0.015. The CNN model achieved a mean AUC of 0.746 ± 0.021, mean balanced accuracy of 0.652 ± 0.020, and mean weighted F1 score of 0.635 ± 0.031 in classifying cases with DE from those who were NDE. CONCLUSION This proof-of-concept study demonstrates that automated deep learning-driven processing of audio recordings of neuropsychological testing performed on individuals recruited within a community cohort setting can facilitate dementia screening.
Collapse
Affiliation(s)
- Chonghua Xue
- Section of Computational Biomedicine, Department of Medicine, Boston University School of Medicine, 72 E. Concord Street, Evans 636, Boston, MA, 02118, USA
| | - Cody Karjadi
- The Framingham Heart Study, Boston University, Boston, MA, 02118, USA.,Departments of Anatomy & Neurobiology and Neurology, Boston University School of Medicine, Boston, MA, 02118, USA
| | - Ioannis Ch Paschalidis
- Departments to Electrical & Computer Engineering, Systems Engineering and Biomedical Engineering; Faculty of Computing & Data Sciences, Boston University, Boston, MA, 02118, USA
| | - Rhoda Au
- The Framingham Heart Study, Boston University, Boston, MA, 02118, USA.,Departments of Anatomy & Neurobiology and Neurology, Boston University School of Medicine, Boston, MA, 02118, USA.,Boston University Alzheimer's Disease Center, Boston, MA, 02118, USA.,Department of Epidemiology, Boston University School of Public Health, Boston, MA, 02118, USA
| | - Vijaya B Kolachalama
- Section of Computational Biomedicine, Department of Medicine, Boston University School of Medicine, 72 E. Concord Street, Evans 636, Boston, MA, 02118, USA. .,Boston University Alzheimer's Disease Center, Boston, MA, 02118, USA. .,Department of Computer Science and Faculty of Computing & Data Sciences, Boston University, Boston, MA, 02115, USA.
| |
Collapse
|
16
|
Weissler EH, Naumann T, Andersson T, Ranganath R, Elemento O, Luo Y, Freitag DF, Benoit J, Hughes MC, Khan F, Slater P, Shameer K, Roe M, Hutchison E, Kollins SH, Broedl U, Meng Z, Wong JL, Curtis L, Huang E, Ghassemi M. The role of machine learning in clinical research: transforming the future of evidence generation. Trials 2021; 22:537. [PMID: 34399832 PMCID: PMC8365941 DOI: 10.1186/s13063-021-05489-x] [Citation(s) in RCA: 53] [Impact Index Per Article: 17.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Accepted: 07/26/2021] [Indexed: 12/13/2022] Open
Abstract
Background Interest in the application of machine learning (ML) to the design, conduct, and analysis of clinical trials has grown, but the evidence base for such applications has not been surveyed. This manuscript reviews the proceedings of a multi-stakeholder conference to discuss the current and future state of ML for clinical research. Key areas of clinical trial methodology in which ML holds particular promise and priority areas for further investigation are presented alongside a narrative review of evidence supporting the use of ML across the clinical trial spectrum. Results Conference attendees included stakeholders, such as biomedical and ML researchers, representatives from the US Food and Drug Administration (FDA), artificial intelligence technology and data analytics companies, non-profit organizations, patient advocacy groups, and pharmaceutical companies. ML contributions to clinical research were highlighted in the pre-trial phase, cohort selection and participant management, and data collection and analysis. A particular focus was paid to the operational and philosophical barriers to ML in clinical research. Peer-reviewed evidence was noted to be lacking in several areas. Conclusions ML holds great promise for improving the efficiency and quality of clinical research, but substantial barriers remain, the surmounting of which will require addressing significant gaps in evidence.
Collapse
Affiliation(s)
- E Hope Weissler
- Duke Clinical Research Institute, Duke University School of Medicine, Box 2834, Durham, NC, 27701, USA.
| | | | | | - Rajesh Ranganath
- Courant Institute of Mathematical Science, New York University, New York, NY, USA
| | - Olivier Elemento
- Englander Institute for Precision Medicine, Weill Cornell Medical College, New York, NY, USA
| | - Yuan Luo
- Northwestern University Clinical and Translational Sciences Institute, Northwestern University, Chicago, IL, USA
| | - Daniel F Freitag
- Division Pharmaceuticals, Open Innovation and Digital Technologies, Bayer AG, Wuppertal, Germany
| | - James Benoit
- University of Alberta, Edmonton, Alberta, Canada
| | - Michael C Hughes
- Department of Computer Science, Tufts University, Medford, MA, USA
| | | | | | | | | | | | - Scott H Kollins
- Duke Clinical Research Institute, Duke University School of Medicine, Box 2834, Durham, NC, 27701, USA
| | - Uli Broedl
- Boehringer-Ingelheim, Burlington, Canada
| | | | | | - Lesley Curtis
- Duke Clinical Research Institute, Duke University School of Medicine, Box 2834, Durham, NC, 27701, USA
| | - Erich Huang
- Duke Clinical Research Institute, Duke University School of Medicine, Box 2834, Durham, NC, 27701, USA.,Duke Forge, Durham, NC, USA
| | - Marzyeh Ghassemi
- Vector Institute, University of Toronto, Toronto, Ontario, Canada.,Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, 02139, USA.,Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, 02139, USA.,CIFAR AI Chair, Vector Institute, Toronto, Ontario, Canada
| |
Collapse
|
17
|
Chen X, Pan Z. A Convenient and Low-Cost Model of Depression Screening and Early Warning Based on Voice Data Using for Public Mental Health. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:6441. [PMID: 34198659 PMCID: PMC8296267 DOI: 10.3390/ijerph18126441] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 06/10/2021] [Accepted: 06/10/2021] [Indexed: 12/12/2022]
Abstract
Depression is a common mental health disease, which has great harm to public health. At present, the diagnosis of depression mainly depends on the interviews between doctors and patients, which is subjective, slow and expensive. Voice data are a kind of data that are easy to obtain and have the advantage of low cost. It has been proved that it can be used in the diagnosis of depression. The voice data used for modeling in this study adopted the authoritative public data set, which had passed the ethical review. The features of voice data were extracted by Python programming, and the voice features were stored in the format of CSV files. Through data processing, a big database, containing 1479 voice feature samples, was generated for modeling. Then, the decision tree screening model of depression was established by 10-fold cross validation and algorithm selection. The experiment achieved 83.4% prediction accuracy on voice data set. According to the prediction results of the model, the patients can be given early warning and intervention in time, so as to realize the health management of personal depression.
Collapse
Affiliation(s)
- Xin Chen
- School of Medicine, Hangzhou Normal University, Hangzhou 311121, China;
- Engineering Research Center of Mobile Health Management System, Ministry of Education, Hangzhou Normal University, Hangzhou 311121, China
- Institute of VR and Intelligent System, Hangzhou Normal University, Hangzhou 311121, China
| | - Zhigeng Pan
- School of Medicine, Hangzhou Normal University, Hangzhou 311121, China;
- Engineering Research Center of Mobile Health Management System, Ministry of Education, Hangzhou Normal University, Hangzhou 311121, China
- Institute of VR and Intelligent System, Hangzhou Normal University, Hangzhou 311121, China
| |
Collapse
|
18
|
Cohen AB, Nahed BV. The Digital Neurologic Examination. Digit Biomark 2021; 5:114-126. [PMID: 34056521 DOI: 10.1159/000515577] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 03/01/2021] [Indexed: 11/19/2022] Open
Abstract
Digital health has been rapidly thrust into the forefront of care delivery. Poised to extend the clinician's reach, a new set of examination tools will redefine neurologic and neurosurgical care, serving as the basis for the digital neurologic examination. We describe its components and review specific technologies, which move beyond traditional video-based telemedicine encounters and include separate digital tools. A future suite of these clinical assessment technologies will blur the lines between history taking, examination, and remote monitoring. Prior to full-scale implementation, however, much more investigation is needed. Because of the nascent state of the technologies, researchers, clinicians, and developers should establish digital neurologic examination requirements in order to maximize its impact.
Collapse
Affiliation(s)
- Adam B Cohen
- Department of Neurology, The Johns Hopkins Hospital, Baltimore, Maryland, USA.,Health Technologies, Army Medical Response, National Health Mission Area, The Johns Hopkins University Applied Physics Lab, Laurel, Maryland, USA
| | - Brain V Nahed
- Department of Neurosurgery, The Massachusetts General Hospital, Boston, Massachusetts, USA
| |
Collapse
|
19
|
Maharjan SM, Poudyal A, van Heerden A, Byanjankar P, Thapa A, Islam C, Kohrt BA, Hagaman A. Passive sensing on mobile devices to improve mental health services with adolescent and young mothers in low-resource settings: the role of families in feasibility and acceptability. BMC Med Inform Decis Mak 2021; 21:117. [PMID: 33827552 PMCID: PMC8025381 DOI: 10.1186/s12911-021-01473-2] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Accepted: 03/21/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Passive sensor data from mobile devices can shed light on daily activities, social behavior, and maternal-child interactions to improve maternal and child health services including mental healthcare. We assessed feasibility and acceptability of the Sensing Technologies for Maternal Depression Treatment in Low Resource Settings (StandStrong) platform. The StandStrong passive data collection platform was piloted with adolescent and young mothers, including mothers experiencing postpartum depression, in Nepal. METHODS Mothers (15-25 years old) with infants (< 12 months old) were recruited in person from vaccination clinics in rural Nepal. They were provided with an Android smartphone and a Bluetooth beacon to collect data in four domains: the mother's location using the Global Positioning System (GPS), physical activity using the phone's accelerometer, auditory environment using episodic audio recording on the phone, and mother-infant proximity measured with the Bluetooth beacon attached to the infant's clothing. Feasibility and acceptability were evaluated based on the amount of passive sensing data collected compared to the total amount that could be collected in a 2-week period. Endline qualitative interviews were conducted to understand mothers' experiences and perceptions of passive data collection. RESULTS Of the 782 women approached, 320 met eligibility criteria and 38 mothers (11 depressed, 27 non-depressed) were enrolled. 38 mothers (11 depressed, 27 non-depressed) were enrolled. Across all participants, 5,579 of the hour-long data collection windows had at least one audio recording [mean (M) = 57.4% of the total possible hour-long recording windows per participant; median (Mdn) = 62.6%], 5,001 activity readings (M = 50.6%; Mdn = 63.2%), 4,168 proximity readings (M = 41.1%; Mdn = 47.6%), and 3,482 GPS readings (M = 35.4%; Mdn = 39.2%). Feasibility challenges were phone battery charging, data usage exceeding prepaid limits, and burden of carrying mobile phones. Acceptability challenges were privacy concerns and lack of family involvement. Overall, families' understanding of passive sensing and families' awareness of potential benefits to mothers and infants were the major modifiable factors increasing acceptability and reducing gaps in data collection. CONCLUSION Per sensor type, approximately half of the hour-long collection windows had at least one reading. Feasibility challenges for passive sensing on mobile devices can be addressed by providing alternative phone charging options, reverse billing for the app, and replacing mobile phones with smartwatches. Enhancing acceptability will require greater family involvement and improved communication regarding benefits of passive sensing for psychological interventions and other health services. Registration International Registered Report Identifier (IRRID): DERR1-10.2196/14734.
Collapse
Affiliation(s)
- Sujen Man Maharjan
- Transcultural Psychosocial Organization (TPO) Nepal, Kathmandu, 44600, Nepal
| | - Anubhuti Poudyal
- Division of Global Mental Health, Department of Psychiatry and Behavioral Sciences, George Washington School of Medicine and Health Sciences, 2120 L St NW Suite 600, Washington, DC, 20037, USA
| | - Alastair van Heerden
- Center for Community Based Research, Human Sciences Research Council, Pietermaritzburg, South Africa
- Medical Research Council/Wits Developmental Pathways for Health Research Unit, Department of Pediatrics, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa
| | - Prabin Byanjankar
- Transcultural Psychosocial Organization (TPO) Nepal, Kathmandu, 44600, Nepal
| | - Ada Thapa
- Division of Global Mental Health, Department of Psychiatry and Behavioral Sciences, George Washington School of Medicine and Health Sciences, 2120 L St NW Suite 600, Washington, DC, 20037, USA
| | - Celia Islam
- George Washington School of Medicine and Health Sciences, Washington, DC, 20037, USA
| | - Brandon A Kohrt
- Division of Global Mental Health, Department of Psychiatry and Behavioral Sciences, George Washington School of Medicine and Health Sciences, 2120 L St NW Suite 600, Washington, DC, 20037, USA.
| | - Ashley Hagaman
- Department of Social and Behavioral Sciences, Yale School of Public Health, Yale University, New Haven, CT, 06510, USA
- Center for Methods in Implementation and Prevention Science, Yale School of Public Health, Yale University, New Haven, CT, 06510, USA
| |
Collapse
|
20
|
Xicoy H, Vila M, Laguna A. Systems Medicine in Parkinson׳s Disease: Joining Efforts to Change History. SYSTEMS MEDICINE 2021. [DOI: 10.1016/b978-0-12-801238-3.11612-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022] Open
|
21
|
Estimation of Parkinson's disease severity using speech features and extreme gradient boosting. Med Biol Eng Comput 2020; 58:2757-2773. [PMID: 32910301 DOI: 10.1007/s11517-020-02250-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Accepted: 08/20/2020] [Indexed: 10/23/2022]
Abstract
In recent years, there is an increasing interest in building e-health systems. The systems built to deliver the health services with the use of internet and communication technologies aim to reduce the costs arising from outpatient visits of patients. Some of the related recent studies propose machine learning-based telediagnosis and telemonitoring systems for Parkinson's disease (PD). Motivated from the studies showing the potential of speech disorders in PD telemonitoring systems, in this study, we aim to estimate the severity of PD from voice recordings of the patients using motor Unified Parkinson's Disease Rating Scale (UPDRS) as the evaluation metric. For this purpose, we apply various speech processing algorithms to the voice signals of the patients and then use these features as input to a two-stage estimation model. The first step is to apply a wrapper-based feature selection algorithm, called Boruta, and select the most informative speech features. The second step is to feed the selected set of features to a decision tree-based boosting algorithm, extreme gradient boosting, which has been recently applied successfully in many machine learning tasks due to its generalization ability and speed. The feature selection analysis showed that the vibration pattern of the vocal fold is an important indicator of PD severity. Besides, we also investigate the effectiveness of using age and years passed since diagnosis as covariates together with speech features. The lowest mean absolute error with 3.87 was obtained by combining these covariates and speech features with prediction level fusion. Graphical Abstract Framework for the proposed UPDRS estimation model.
Collapse
|