1
|
Cruz-Gonzalez P, He AWJ, Lam EP, Ng IMC, Li MW, Hou R, Chan JNM, Sahni Y, Vinas Guasch N, Miller T, Lau BWM, Sánchez Vidaña DI. Artificial intelligence in mental health care: a systematic review of diagnosis, monitoring, and intervention applications. Psychol Med 2025; 55:e18. [PMID: 39911020 DOI: 10.1017/s0033291724003295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2025]
Abstract
Artificial intelligence (AI) has been recently applied to different mental health illnesses and healthcare domains. This systematic review presents the application of AI in mental health in the domains of diagnosis, monitoring, and intervention. A database search (CCTR, CINAHL, PsycINFO, PubMed, and Scopus) was conducted from inception to February 2024, and a total of 85 relevant studies were included according to preestablished inclusion criteria. The AI methods most frequently used were support vector machine and random forest for diagnosis, machine learning for monitoring, and AI chatbot for intervention. AI tools appeared to be accurate in detecting, classifying, and predicting the risk of mental health conditions as well as predicting treatment response and monitoring the ongoing prognosis of mental health disorders. Future directions should focus on developing more diverse and robust datasets and on enhancing the transparency and interpretability of AI models to improve clinical practice.
Collapse
Affiliation(s)
- Pablo Cruz-Gonzalez
- Rehabilitation Research Institute of Singapore, Nanyang Technological University, Singapore, Singapore
| | - Aaron Wan-Jia He
- School of Public Health, LKS Faculty of Medicine, The University of Hong Kong, Hong Kong, Hong Kong
| | - Elly PoPo Lam
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Ingrid Man Ching Ng
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Mandy Wingman Li
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Rangchun Hou
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Jackie Ngai-Man Chan
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Yuvraj Sahni
- Department of Building Environment and Energy Engineering, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Nestor Vinas Guasch
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Tiev Miller
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Benson Wui-Man Lau
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
- Mental Health Research Center, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| | - Dalinda Isabel Sánchez Vidaña
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
- Mental Health Research Center, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
| |
Collapse
|
2
|
Liu H, Wang XP. Alternative Therapies for Non-Motor Symptoms in Parkinson's Disease: A Mini Review. Neuropsychiatr Dis Treat 2024; 20:2585-2591. [PMID: 39723118 PMCID: PMC11669284 DOI: 10.2147/ndt.s495092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2024] [Accepted: 12/16/2024] [Indexed: 12/28/2024] Open
Abstract
Parkinson's disease (PD) is primarily recognized for its motor symptoms, yet non-motor symptoms (NMS) such as neuropsychiatric disturbances, sleep disorders, autonomic dysfunction, and sensory abnormalities significantly contribute to the disease's overall burden. While traditional pharmacological and surgical treatments have primarily targeted motor symptoms, alternative therapies such as acupuncture, cognitive therapy, and Traditional Chinese Medicine (TCM) are gaining attention for managing NMS. This review provides a comprehensive analysis of alternative therapies for NMS in PD, drawing on evidence from international guidelines and TCM. The review highlights the current gaps in research, emphasizing the need for high-quality randomized controlled trials (RCTs) and standardized protocols, particularly in the evaluation of TCM therapies. Additionally, it underscores the potential of integrated treatment approaches that combine traditional and modern medicine, offering a personalized strategy for managing NMS in PD. By addressing these challenges, this review aims to enhance the understanding and application of alternative therapies, ultimately improving the quality of life for PD patients. These therapies, particularly those emphasizing holistic and individualized approaches, such as cognitive therapy and TCM, offer potential solutions to the unmet needs in PD management without causing side effects associated with medications or fluctuations in drug plasma levels.
Collapse
Affiliation(s)
- Hui Liu
- Department of Neurology, Putuo Hospital, Shanghai University of Traditional Chinese Medicine, Shanghai, 200062, People’s Republic of China
| | - Xiao-Ping Wang
- Department of Neurology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, People’s Republic of China
| |
Collapse
|
3
|
Luo X, Zhang A, Li Y, Zhang Z, Ying F, Lin R, Yang Q, Wang J, Huang G. Emergence of Artificial Intelligence Art Therapies (AIATs) in Mental Health Care: A Systematic Review. Int J Ment Health Nurs 2024; 33:1743-1760. [PMID: 39020473 DOI: 10.1111/inm.13384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 05/26/2024] [Accepted: 06/11/2024] [Indexed: 07/19/2024]
Abstract
The application of artificial intelligence art therapies (AIATs) in mental health care represents an innovative merger between digital technology and the therapeutic potential of creative arts. This systematic review aimed to assess the effectiveness and ethical considerations of AIATs, incorporating robots, AI painting and AI Chatbots to augment traditional art therapies. Aligning with the Preferred Reporting Items for systematic reviews (PRISMA) guidelines, we meticulously searched PubMed, Cochrane Library, Web of Science and CNKI, resulting in 15 selected articles for detailed analysis. To ensure methodological quality, we applied the Joanna Briggs Institute (JBI) criteria for quality assessment and extracted data using the PICO(S) format, specifically targeting randomised controlled trials (RCTs). Our findings suggest that AIATs can profoundly enhance the therapeutic experience by providing new creative outlets and reinforcing existing methods, despite possible drawbacks and ethical challenges. This examination underscores AIATs' potential to enrich mental health therapies, emphasising the critical importance of ethical considerations and the responsible application of AI as the field evolves. With a focus on expanding treatment efficacy and patient expressiveness, the promise of AIATs in mental health care necessitates a careful balance between innovation and ethical responsibility. Trial Registration: PROSPERO: CRD42024504472.
Collapse
Affiliation(s)
- Xuexing Luo
- Faculty of Humanities and Arts, Macau University of Science and Technology, Taipa, Macau
| | - Aijia Zhang
- Faculty of Humanities and Arts, Macau University of Science and Technology, Taipa, Macau
| | - Yu Li
- State Key Laboratory of Quality Research in Chinese Medicines, Macau University of Science and Technology, Taipa, Macau
- Faculty of Chinese Medicine, Macau University of Science and Technology, Taipa, Macau
| | - Zheyu Zhang
- Faculty of Humanities and Arts, Macau University of Science and Technology, Taipa, Macau
| | - Fangtian Ying
- Faculty of Humanities and Arts, Macau University of Science and Technology, Taipa, Macau
- Zhejiang University, Hangzhou, China
| | - Runqing Lin
- Faculty of Humanities and Arts, Macau University of Science and Technology, Taipa, Macau
| | - Qianxu Yang
- Department of Social and Preventive Medicine, Faculty of Medicine, Centre for Epidemiology and Evidence-Based Practice, University of Malaya, Kuala Lumpur, Malaysia
| | - Jue Wang
- State Key Laboratory of Quality Research in Chinese Medicines, Macau University of Science and Technology, Taipa, Macau
- Faculty of Chinese Medicine, Macau University of Science and Technology, Taipa, Macau
- Guangdong-Hong Kong-Macao Joint Laboratory for Contaminants Exposure and Health, Guangzhou, China
| | - Guanghui Huang
- Faculty of Humanities and Arts, Macau University of Science and Technology, Taipa, Macau
- Zhuhai M.U.S.T. Science and Technology Research Institute, Macau University of Science and Technology, Taipa, Macau
| |
Collapse
|
4
|
Takeshige-Amano H, Oyama G, Ogawa M, Fusegi K, Kambe T, Shiina K, Ueno SI, Okuzumi A, Hatano T, Motoi Y, Kawakami I, Ando M, Nakayama S, Ishida Y, Maei S, Lu X, Kobayashi T, Wooden R, Ota S, Morito K, Ito Y, Nakajima Y, Yoritaka A, Kato T, Hattori N. Digital detection of Alzheimer's disease using smiles and conversations with a chatbot. Sci Rep 2024; 14:26309. [PMID: 39487204 PMCID: PMC11530557 DOI: 10.1038/s41598-024-77220-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Accepted: 10/21/2024] [Indexed: 11/04/2024] Open
Abstract
In super-aged societies, dementia has become a critical issue, underscoring the urgent need for tools to assess cognitive status effectively in various sectors, including financial and business settings. Facial and speech features have been tried as cost-effective biomarkers of dementia including Alzheimer's disease (AD). We aimed to establish an easy, automatic, and extensive screening tool for AD using a chatbot and artificial intelligence. Smile images and visual and auditory data of natural conversations with a chatbot from 99 healthy controls (HCs) and 93 individuals with AD or mild cognitive impairment due to AD (PwA) were analyzed using machine learning. A subset of 8 facial and 21 sound features successfully distinguished PwA from HCs, with a high area under the receiver operating characteristic curve of 0.94 ± 0.05. Another subset of 8 facial and 20 sound features predicted the cognitive test scores, with a mean absolute error as low as 5.78 ± 0.08. These results were superior to those obtained from face or auditory data alone or from conventional image depiction tasks. Thus, by combining spontaneous sound and facial data obtained through conversations with a chatbot, the proposed model can be put to practical use in real-life scenarios.
Collapse
Affiliation(s)
- Haruka Takeshige-Amano
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Genko Oyama
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan.
| | - Mayuko Ogawa
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Keiko Fusegi
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | - Taiki Kambe
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Kenta Shiina
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Shin-Ichi Ueno
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Ayami Okuzumi
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Taku Hatano
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Yumiko Motoi
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Ito Kawakami
- Department of Psychiatry, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Maya Ando
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | - Sachiko Nakayama
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | | | - Shun Maei
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | - Xiangxun Lu
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | | | - Rina Wooden
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | - Susumu Ota
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | | | | | | | - Asako Yoritaka
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | - Tadafumi Kato
- Department of Psychiatry, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Nobutaka Hattori
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan.
- Neurodegenerative Disorders Collaborative Laboratory, RIKEN Center for Brain Science, Saitama, Japan.
| |
Collapse
|
5
|
Laymouna M, Ma Y, Lessard D, Schuster T, Engler K, Lebouché B. Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review. J Med Internet Res 2024; 26:e56930. [PMID: 39042446 PMCID: PMC11303905 DOI: 10.2196/56930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Revised: 04/07/2024] [Accepted: 04/12/2024] [Indexed: 07/24/2024] Open
Abstract
BACKGROUND Chatbots, or conversational agents, have emerged as significant tools in health care, driven by advancements in artificial intelligence and digital technology. These programs are designed to simulate human conversations, addressing various health care needs. However, no comprehensive synthesis of health care chatbots' roles, users, benefits, and limitations is available to inform future research and application in the field. OBJECTIVE This review aims to describe health care chatbots' characteristics, focusing on their diverse roles in the health care pathway, user groups, benefits, and limitations. METHODS A rapid review of published literature from 2017 to 2023 was performed with a search strategy developed in collaboration with a health sciences librarian and implemented in the MEDLINE and Embase databases. Primary research studies reporting on chatbot roles or benefits in health care were included. Two reviewers dual-screened the search results. Extracted data on chatbot roles, users, benefits, and limitations were subjected to content analysis. RESULTS The review categorized chatbot roles into 2 themes: delivery of remote health services, including patient support, care management, education, skills building, and health behavior promotion, and provision of administrative assistance to health care providers. User groups spanned across patients with chronic conditions as well as patients with cancer; individuals focused on lifestyle improvements; and various demographic groups such as women, families, and older adults. Professionals and students in health care also emerged as significant users, alongside groups seeking mental health support, behavioral change, and educational enhancement. The benefits of health care chatbots were also classified into 2 themes: improvement of health care quality and efficiency and cost-effectiveness in health care delivery. The identified limitations encompassed ethical challenges, medicolegal and safety concerns, technical difficulties, user experience issues, and societal and economic impacts. CONCLUSIONS Health care chatbots offer a wide spectrum of applications, potentially impacting various aspects of health care. While they are promising tools for improving health care efficiency and quality, their integration into the health care system must be approached with consideration of their limitations to ensure optimal, safe, and equitable use.
Collapse
Affiliation(s)
- Moustafa Laymouna
- Department of Family Medicine, Faculty of Medicine and Health Sciences, McGill University, Montreal, QC, Canada
- Centre for Outcomes Research and Evaluation, Research Institute of the McGill University Health Centre, Montreal, QC, Canada
- Infectious Diseases and Immunity in Global Health Program, Research Institute of McGill University Health Centre, Montreal, QC, Canada
| | - Yuanchao Ma
- Centre for Outcomes Research and Evaluation, Research Institute of the McGill University Health Centre, Montreal, QC, Canada
- Infectious Diseases and Immunity in Global Health Program, Research Institute of McGill University Health Centre, Montreal, QC, Canada
- Chronic and Viral Illness Service, Division of Infectious Disease, Department of Medicine, McGill University Health Centre, Montreal, QC, Canada
- Department of Biomedical Engineering, Polytechnique Montréal, Montreal, QC, Canada
| | - David Lessard
- Centre for Outcomes Research and Evaluation, Research Institute of the McGill University Health Centre, Montreal, QC, Canada
- Infectious Diseases and Immunity in Global Health Program, Research Institute of McGill University Health Centre, Montreal, QC, Canada
- Chronic and Viral Illness Service, Division of Infectious Disease, Department of Medicine, McGill University Health Centre, Montreal, QC, Canada
| | - Tibor Schuster
- Department of Family Medicine, Faculty of Medicine and Health Sciences, McGill University, Montreal, QC, Canada
| | - Kim Engler
- Centre for Outcomes Research and Evaluation, Research Institute of the McGill University Health Centre, Montreal, QC, Canada
- Infectious Diseases and Immunity in Global Health Program, Research Institute of McGill University Health Centre, Montreal, QC, Canada
- Chronic and Viral Illness Service, Division of Infectious Disease, Department of Medicine, McGill University Health Centre, Montreal, QC, Canada
| | - Bertrand Lebouché
- Department of Family Medicine, Faculty of Medicine and Health Sciences, McGill University, Montreal, QC, Canada
- Centre for Outcomes Research and Evaluation, Research Institute of the McGill University Health Centre, Montreal, QC, Canada
- Infectious Diseases and Immunity in Global Health Program, Research Institute of McGill University Health Centre, Montreal, QC, Canada
- Chronic and Viral Illness Service, Division of Infectious Disease, Department of Medicine, McGill University Health Centre, Montreal, QC, Canada
| |
Collapse
|
6
|
Oyama G, Tsamis K, Konitsiotis S, Metman LV. Editorial: Remote monitoring technologies in neurodegenerative movement disorders. Front Neurol 2024; 15:1421454. [PMID: 39055318 PMCID: PMC11269253 DOI: 10.3389/fneur.2024.1421454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Accepted: 06/24/2024] [Indexed: 07/27/2024] Open
Affiliation(s)
- Genko Oyama
- Department of Neurology and Stroke Unit, Saitama Medical University, Saitama, Japan
| | - Konstantinos Tsamis
- Laboratory of Physiology, Faculty of Medicine, School of Health Sciences, University of Ioannina, Ioannina, Greece
| | - Spyridon Konitsiotis
- Department of Neurology, University Hospital of Ioannina and Faculty of Medicine, School of Health Sciences, University of Ioannina, Ioannina, Greece
| | - Leonard Verhagen Metman
- Division of Parkinson's Disease and Movement Disorders Center, DBS and Advanced Therapeutics Program, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| |
Collapse
|
7
|
Martindale APL, Llewellyn CD, de Visser RO, Ng B, Ngai V, Kale AU, di Ruffano LF, Golub RM, Collins GS, Moher D, McCradden MD, Oakden-Rayner L, Rivera SC, Calvert M, Kelly CJ, Lee CS, Yau C, Chan AW, Keane PA, Beam AL, Denniston AK, Liu X. Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines. Nat Commun 2024; 15:1619. [PMID: 38388497 PMCID: PMC10883966 DOI: 10.1038/s41467-024-45355-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 01/22/2024] [Indexed: 02/24/2024] Open
Abstract
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77-94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
Collapse
Affiliation(s)
| | - Carrie D Llewellyn
- Department of Primary Care and Public Health, Brighton and Sussex Medical School, Brighton, UK
| | - Richard O de Visser
- Department of Primary Care and Public Health, Brighton and Sussex Medical School, Brighton, UK
| | - Benjamin Ng
- Birmingham and Midland Eye Centre, Sandwell and West Birmingham NHS Trust, Birmingham, UK
- Christ Church, University of Oxford, Oxford, UK
| | - Victoria Ngai
- University College London Medical School, London, UK
| | - Aditya U Kale
- Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
- National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, University of Birmingham, Birmingham, UK
| | | | - Robert M Golub
- Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Gary S Collins
- Centre for Statistics in Medicine//UK EQUATOR Centre, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottowa, Canada
| | - Melissa D McCradden
- Department of Bioethics, The Hospital for Sick Children, Toronto, Canada
- Genetics & Genome Biology Research Program, Peter Gilgan Centre for Research & Learning, Toronto, Canada
- Division of Clinical and Public Health, Dalla Lana School of Public Health, Toronto, Canada
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia
| | - Samantha Cruz Rivera
- Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK
- Centre for Patient Reported Outcomes Research (CPROR), Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Melanie Calvert
- National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, University of Birmingham, Birmingham, UK
- Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK
- Centre for Patient Reported Outcomes Research (CPROR), Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
- NIHR Applied Research Collaboration (ARC) West Midlands, University of Birmingham, Birmingham, UK
- NIHR Blood and Transplant Research Unit (BTRU) in Precision Transplant and Cellular Therapeutics, University of Birmingham, Birmingham, UK
| | | | | | - Christopher Yau
- Nuffield Department of Women's and Reproductive Health, University of Oxford, Oxford, UK
- Health Data Research UK, London, UK
| | - An-Wen Chan
- Department of Medicine, Women's College Hospital. University of Toronto, Toronto, Canada
| | - Pearse A Keane
- NIHR Biomedical Research Centre at Moorfields, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK
| | - Andrew L Beam
- Department of Epidemiology, Harvard. T.H. Chan School of Public Health, Boston, MA, USA
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Alastair K Denniston
- Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
- National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, University of Birmingham, Birmingham, UK
- Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK
- NIHR Biomedical Research Centre at Moorfields, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK
| | - Xiaoxuan Liu
- Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK.
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK.
- Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK.
| |
Collapse
|
8
|
Ding H, Simmich J, Vaezipour A, Andrews N, Russell T. Evaluation framework for conversational agents with artificial intelligence in health interventions: a systematic scoping review. J Am Med Inform Assoc 2024; 31:746-761. [PMID: 38070173 PMCID: PMC10873847 DOI: 10.1093/jamia/ocad222] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Revised: 11/04/2023] [Accepted: 11/24/2023] [Indexed: 02/18/2024] Open
Abstract
OBJECTIVES Conversational agents (CAs) with emerging artificial intelligence present new opportunities to assist in health interventions but are difficult to evaluate, deterring their applications in the real world. We aimed to synthesize existing evidence and knowledge and outline an evaluation framework for CA interventions. MATERIALS AND METHODS We conducted a systematic scoping review to investigate designs and outcome measures used in the studies that evaluated CAs for health interventions. We then nested the results into an overarching digital health framework proposed by the World Health Organization (WHO). RESULTS The review included 81 studies evaluating CAs in experimental (n = 59), observational (n = 15) trials, and other research designs (n = 7). Most studies (n = 72, 89%) were published in the past 5 years. The proposed CA-evaluation framework includes 4 evaluation stages: (1) feasibility/usability, (2) efficacy, (3) effectiveness, and (4) implementation, aligning with WHO's stepwise evaluation strategy. Across these stages, this article presents the essential evidence of different study designs (n = 8), sample sizes, and main evaluation categories (n = 7) with subcategories (n = 40). The main evaluation categories included (1) functionality, (2) safety and information quality, (3) user experience, (4) clinical and health outcomes, (5) costs and cost benefits, (6) usage, adherence, and uptake, and (7) user characteristics for implementation research. Furthermore, the framework highlighted the essential evaluation areas (potential primary outcomes) and gaps across the evaluation stages. DISCUSSION AND CONCLUSION This review presents a new framework with practical design details to support the evaluation of CA interventions in healthcare research. PROTOCOL REGISTRATION The Open Science Framework (https://osf.io/9hq2v) on March 22, 2021.
Collapse
Affiliation(s)
- Hang Ding
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| | - Joshua Simmich
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| | - Atiyeh Vaezipour
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| | - Nicole Andrews
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
- The Tess Cramond Pain and Research Centre, Metro North Hospital and Health Service, Brisbane, QLD, Australia
- The Occupational Therapy Department, The Royal Brisbane and Women’s Hospital, Metro North Hospital and Health Service, Brisbane, QLD, Australia
| | - Trevor Russell
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| |
Collapse
|
9
|
Li H, Zhang R, Lee YC, Kraut RE, Mohr DC. Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being. NPJ Digit Med 2023; 6:236. [PMID: 38114588 PMCID: PMC10730549 DOI: 10.1038/s41746-023-00979-5] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Accepted: 11/29/2023] [Indexed: 12/21/2023] Open
Abstract
Conversational artificial intelligence (AI), particularly AI-based conversational agents (CAs), is gaining traction in mental health care. Despite their growing usage, there is a scarcity of comprehensive evaluations of their impact on mental health and well-being. This systematic review and meta-analysis aims to fill this gap by synthesizing evidence on the effectiveness of AI-based CAs in improving mental health and factors influencing their effectiveness and user experience. Twelve databases were searched for experimental studies of AI-based CAs' effects on mental illnesses and psychological well-being published before May 26, 2023. Out of 7834 records, 35 eligible studies were identified for systematic review, out of which 15 randomized controlled trials were included for meta-analysis. The meta-analysis revealed that AI-based CAs significantly reduce symptoms of depression (Hedge's g 0.64 [95% CI 0.17-1.12]) and distress (Hedge's g 0.7 [95% CI 0.18-1.22]). These effects were more pronounced in CAs that are multimodal, generative AI-based, integrated with mobile/instant messaging apps, and targeting clinical/subclinical and elderly populations. However, CA-based interventions showed no significant improvement in overall psychological well-being (Hedge's g 0.32 [95% CI -0.13 to 0.78]). User experience with AI-based CAs was largely shaped by the quality of human-AI therapeutic relationships, content engagement, and effective communication. These findings underscore the potential of AI-based CAs in addressing mental health issues. Future research should investigate the underlying mechanisms of their effectiveness, assess long-term effects across various mental health outcomes, and evaluate the safe integration of large language models (LLMs) in mental health care.
Collapse
Affiliation(s)
- Han Li
- Department of Communications and New Media, National University of Singapore, Singapore, 117416, Singapore
| | - Renwen Zhang
- Department of Communications and New Media, National University of Singapore, Singapore, 117416, Singapore.
| | - Yi-Chieh Lee
- Department of Computer Science, National University of Singapore, Singapore, 117416, Singapore
| | - Robert E Kraut
- Human-Computer Interaction Institute Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - David C Mohr
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Chicago, IL, 60611, USA
| |
Collapse
|
10
|
Smith CM, Weathers AL, Lewis SL. An overview of clinical machine learning applications in neurology. J Neurol Sci 2023; 455:122799. [PMID: 37979413 DOI: 10.1016/j.jns.2023.122799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 10/26/2023] [Accepted: 11/12/2023] [Indexed: 11/20/2023]
Abstract
Machine learning techniques for clinical applications are evolving, and the potential impact this will have on clinical neurology is important to recognize. By providing a broad overview on this growing paradigm of clinical tools, this article aims to help healthcare professionals in neurology prepare to navigate both the opportunities and challenges brought on through continued advancements in machine learning. This narrative review first elaborates on how machine learning models are organized and implemented. Machine learning tools are then classified by clinical application, with examples of uses within neurology described in more detail. Finally, this article addresses limitations and considerations regarding clinical machine learning applications in neurology.
Collapse
Affiliation(s)
- Colin M Smith
- Lehigh Valley Fleming Neuroscience Institute, 1250 S Cedar Crest Blvd., Allentown, PA 18103, USA
| | - Allison L Weathers
- Cleveland Clinic Information Technology Division, 9500 Euclid Ave. Cleveland, OH 44195, USA
| | - Steven L Lewis
- Lehigh Valley Fleming Neuroscience Institute, 1250 S Cedar Crest Blvd., Allentown, PA 18103, USA.
| |
Collapse
|
11
|
Gupta R, Kumari S, Senapati A, Ambasta RK, Kumar P. New era of artificial intelligence and machine learning-based detection, diagnosis, and therapeutics in Parkinson's disease. Ageing Res Rev 2023; 90:102013. [PMID: 37429545 DOI: 10.1016/j.arr.2023.102013] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 06/26/2023] [Accepted: 07/06/2023] [Indexed: 07/12/2023]
Abstract
Parkinson's disease (PD) is characterized by the loss of neuronal cells, which leads to synaptic dysfunction and cognitive defects. Despite the advancements in treatment strategies, the management of PD is still a challenging event. Early prediction and diagnosis of PD are of utmost importance for effective management of PD. In addition, the classification of patients with PD as compared to normal healthy individuals also imposes drawbacks in the early diagnosis of PD. To address these challenges, artificial intelligence (AI) and machine learning (ML) models have been implicated in the diagnosis, prediction, and treatment of PD. Recent times have also demonstrated the implication of AI and ML models in the classification of PD based on neuroimaging methods, speech recording, gait abnormalities, and others. Herein, we have briefly discussed the role of AI and ML in the diagnosis, treatment, and identification of novel biomarkers in the progression of PD. We have also highlighted the role of AI and ML in PD management through altered lipidomics and gut-brain axis. We briefly explain the role of early PD detection through AI and ML algorithms based on speech recordings, handwriting patterns, gait abnormalities, and neuroimaging techniques. Further, the review discuss the potential role of the metaverse, the Internet of Things, and electronic health records in the effective management of PD to improve the quality of life. Lastly, we also focused on the implementation of AI and ML-algorithms in neurosurgical process and drug discovery.
Collapse
Affiliation(s)
- Rohan Gupta
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA.
| | - Smita Kumari
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA
| | | | - Rashmi K Ambasta
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA
| | - Pravir Kumar
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA.
| |
Collapse
|
12
|
Yamada Y, Shinkawa K, Nemoto M, Nemoto K, Arai T. A mobile application using automatic speech analysis for classifying Alzheimer's disease and mild cognitive impairment. COMPUT SPEECH LANG 2023. [DOI: 10.1016/j.csl.2023.101514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/16/2023]
|
13
|
OYAMA GENKO, OGAWA MAYUKO, SEKIMOTO SATOKO, HATANO TAKU, HATTORI NOBUTAKA. A Narrative Review of Current Status and Future Perspective of Telemedicine for Parkinson's Disease, Dementia, and Intractable Neurological Diseases in Japan. JUNTENDO IJI ZASSHI = JUNTENDO MEDICAL JOURNAL 2023; 69:14-20. [PMID: 38854844 PMCID: PMC11153070 DOI: 10.14789/jmj.jmj22-0031-r] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Accepted: 10/20/2022] [Indexed: 06/11/2024]
Abstract
The coronavirus disease 2019 pandemic has uncovered several inherent problems in society. While the demand for telemedicine surged worldwide and some countries responded flexibly, in Japan, most telemedicine services were limited to telephone consultations, and full-fledged telemedicine did not become widespread. In addition, the digitalization process in both medicine and wider society lags behind some other nations. It is necessary to accelerate digital transformation in healthcare to build a sustainable society that is resilient to crises, such as new pandemics. In particular, as Japan is facing an issue of super-aged society, a sustainable care model for people with Parkinson's disease, dementia, and intractable neurological diseases should be established. Many neurodegenerative and intractable neurological diseases are progressive; as the disease progresses, patients could become difficult to visit specialists. Although online medical care has many advantages, it does not provide the same quality of information as face-to-face consultations. However, new technology can overcome the limitations of online medical care. As an evolutionary direction for telemedicine, three-dimensional telemedicine technologies are being developed, which enable online medical treatment to be delivered as if the patient was sharing the same space. Telemonitoring can enable the objective and continuous evaluation of patient information at home through the use of motion capture, wearable devices, and other devices. The advancement of digital transformation in medical care should be a game-changer in accumulating big data and analyzing it using artificial intelligence.
Collapse
Affiliation(s)
- GENKO OYAMA
- Corresponding author: Genko Oyama, Department of Neurology, Juntendo University School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan, TEL: +81-3-3813-3111 FAX: +81-3-5800-0547 E-mail:
| | | | | | | | | |
Collapse
|