Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being

Utilizing natural language processing and large language models in the diagnosis and prediction of infectious diseases: A systematic review

BACKGROUND

Natural Language Processing (NLP) and Large Language Models (LLMs) hold largely untapped potential in infectious disease management. This review explores their current use and uncovers areas needing more attention.

METHODS

This analysis followed systematic review procedures, registered with the Prospective Register of Systematic Reviews. We conducted a search across major databases including PubMed, Embase, Web of Science, and Scopus, up to December 2023, using keywords related to NLP, LLM, and infectious diseases. We also employed the Quality Assessment of Diagnostic Accuracy Studies-2 tool for evaluating the quality and robustness of the included studies.

RESULTS

Our review identified 15 studies with diverse applications of NLP in infectious disease management. Notable examples include GPT-4's application in detecting urinary tract infections and BERTweet's use in Lyme Disease surveillance through social media analysis. These models demonstrated effective disease monitoring and public health tracking capabilities. However, the effectiveness varied across studies. For instance, while some NLP tools showed high accuracy in pneumonia detection and high sensitivity in identifying invasive mold diseases from medical reports, others fell short in areas like bloodstream infection management.

CONCLUSIONS

This review highlights the yet-to-be-fully-realized promise of NLP and LLMs in infectious disease management. It calls for more exploration to fully harness AI's capabilities, particularly in the areas of diagnosis, surveillance, predicting disease courses, and tracking epidemiological trends.

Applications of large language models in psychiatry: a systematic review

Background

With their unmatched ability to interpret and engage with human language and context, large language models (LLMs) hint at the potential to bridge AI and human cognitive processes. This review explores the current application of LLMs, such as ChatGPT, in the field of psychiatry.

Methods

We followed PRISMA guidelines and searched through PubMed, Embase, Web of Science, and Scopus, up until March 2024.

Results

From 771 retrieved articles, we included 16 that directly examine LLMs' use in psychiatry. LLMs, particularly ChatGPT and GPT-4, showed diverse applications in clinical reasoning, social media, and education within psychiatry. They can assist in diagnosing mental health issues, managing depression, evaluating suicide risk, and supporting education in the field. However, our review also points out their limitations, such as difficulties with complex cases and potential underestimation of suicide risks.

Conclusion

Early research in psychiatry reveals LLMs' versatile applications, from diagnostic support to educational roles. Given the rapid pace of advancement, future investigations are poised to explore the extent to which these models might redefine traditional roles in mental health care.

Effects of a Chatbot-Based Intervention on Stress and Health-Related Parameters in a Stressed Sample: Randomized Controlled Trial

BACKGROUND

Stress levels and the prevalence of mental disorders in the general population have been rising in recent years. Chatbot-based interventions represent novel and promising digital approaches to improve health-related parameters. However, there is a lack of research on chatbot-based interventions in the area of mental health.

OBJECTIVE

The aim of this study was to investigate the effects of a 3-week chatbot-based intervention guided by the chatbot ELME, specifically with respect to the ability to reduce stress and improve various health-related parameters in a stressed sample.

METHODS

In this multicenter two-armed randomized controlled trial, 118 individuals with medium to high stress levels were randomized to the intervention group (n=59) or the treatment-as-usual control group (n=59). The ELME chatbot guided participants of the intervention group through 3 weeks of training based on the topics stress, mindfulness, and interoception, with practical and psychoeducative elements delivered in two daily interactive intervention sessions via a smartphone (approximately 10-20 minutes each). The primary outcome (perceived stress) and secondary outcomes (mindfulness; interoception or interoceptive sensibility; subjective well-being; and emotion regulation, including the subfacets reappraisal and suppression) were assessed preintervention (T1), post intervention (T2; after 3 weeks), and at follow-up (T3; after 6 weeks). During both conditions, participants also underwent ecological momentary assessments of stress and interoceptive sensibility.

RESULTS

There were no significant changes in perceived stress (β03=-.018, SE=.329; P=.96) and momentary stress. Mindfulness and the subfacet reappraisal significantly increased in the intervention group over time, whereas there was no change in the subfacet suppression. Well-being and momentary interoceptive sensibility increased in both groups over time.

CONCLUSIONS

To gain insight into how the intervention can be improved to achieve its full potential for stress reduction, besides a longer intervention duration, specific sample subgroups should be considered. The chatbot-based intervention seems to have the potential to improve mindfulness and emotion regulation in a stressed sample. Future chatbot-based studies and interventions in health care should be designed based on the latest findings on the efficacy of rule-based and artificial intelligence-based chatbots.

TRIAL REGISTRATION

German Clinical Trials Register DRKS00027560; https://drks.de/search/en/trial/DRKS00027560.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-doi.org/10.3389/fdgth.2023.1046202.

Exploring the Role of Artificial Intelligence in Mental Healthcare: Current Trends and Future Directions - A Narrative Review for a Comprehensive Insight

Mental health is an essential component of the health and well-being of a person and community, and it is critical for the individual, society, and socio-economic development of any country. Mental healthcare is currently in the health sector transformation era, with emerging technologies such as artificial intelligence (AI) reshaping the screening, diagnosis, and treatment modalities of psychiatric illnesses. The present narrative review is aimed at discussing the current landscape and the role of AI in mental healthcare, including screening, diagnosis, and treatment. Furthermore, this review attempted to highlight the key challenges, limitations, and prospects of AI in providing mental healthcare based on existing works of literature. The literature search for this narrative review was obtained from PubMed, Saudi Digital Library (SDL), Google Scholar, Web of Science, and IEEE Xplore, and we included only English-language articles published in the last five years. Keywords used in combination with Boolean operators ("AND" and "OR") were the following: "Artificial intelligence", "Machine learning", Deep learning", "Early diagnosis", "Treatment", "interventions", "ethical consideration", and "mental Healthcare". Our literature review revealed that, equipped with predictive analytics capabilities, AI can improve treatment planning by predicting an individual's response to various interventions. Predictive analytics, which uses historical data to formulate preventative interventions, aligns with the move toward individualized and preventive mental healthcare. In the screening and diagnostic domains, a subset of AI, such as machine learning and deep learning, has been proven to analyze various mental health data sets and predict the patterns associated with various mental health problems. However, limited studies have evaluated the collaboration between healthcare professionals and AI in delivering mental healthcare, as these sensitive problems require empathy, human connections, and holistic, personalized, and multidisciplinary approaches. Ethical issues, cybersecurity, a lack of data analytics diversity, cultural sensitivity, and language barriers remain concerns for implementing this futuristic approach in mental healthcare. Considering these sensitive problems require empathy, human connections, and holistic, personalized, and multidisciplinary approaches, it is imperative to explore these aspects. Therefore, future comparative trials with larger sample sizes and data sets are warranted to evaluate different AI models used in mental healthcare across regions to fill the existing knowledge gaps.

Assessing the Accuracy of Generative Conversational Artificial Intelligence in Debunking Sleep Health Myths: Mixed Methods Comparative Study With Expert Analysis

BACKGROUND

Adequate sleep is essential for maintaining individual and public health, positively affecting cognition and well-being, and reducing chronic disease risks. It plays a significant role in driving the economy, public safety, and managing health care costs. Digital tools, including websites, sleep trackers, and apps, are key in promoting sleep health education. Conversational artificial intelligence (AI) such as ChatGPT (OpenAI, Microsoft Corp) offers accessible, personalized advice on sleep health but raises concerns about potential misinformation. This underscores the importance of ensuring that AI-driven sleep health information is accurate, given its significant impact on individual and public health, and the spread of sleep-related myths.

OBJECTIVE

This study aims to examine ChatGPT's capability to debunk sleep-related disbeliefs.

METHODS

A mixed methods design was leveraged. ChatGPT categorized 20 sleep-related myths identified by 10 sleep experts and rated them in terms of falseness and public health significance, on a 5-point Likert scale. Sensitivity, positive predictive value, and interrater agreement were also calculated. A qualitative comparative analysis was also conducted.

RESULTS

ChatGPT labeled a significant portion (n=17, 85%) of the statements as "false" (n=9, 45%) or "generally false" (n=8, 40%), with varying accuracy across different domains. For instance, it correctly identified most myths about "sleep timing," "sleep duration," and "behaviors during sleep," while it had varying degrees of success with other categories such as "pre-sleep behaviors" and "brain function and sleep." ChatGPT's assessment of the degree of falseness and public health significance, on the 5-point Likert scale, revealed an average score of 3.45 (SD 0.87) and 3.15 (SD 0.99), respectively, indicating a good level of accuracy in identifying the falseness of statements and a good understanding of their impact on public health. The AI-based tool showed a sensitivity of 85% and a positive predictive value of 100%. Overall, this indicates that when ChatGPT labels a statement as false, it is highly reliable, but it may miss identifying some false statements. When comparing with expert ratings, high intraclass correlation coefficients (ICCs) between ChatGPT's appraisals and expert opinions could be found, suggesting that the AI's ratings were generally aligned with expert views on falseness (ICC=.83, P<.001) and public health significance (ICC=.79, P=.001) of sleep-related myths. Qualitatively, both ChatGPT and sleep experts refuted sleep-related misconceptions. However, ChatGPT adopted a more accessible style and provided a more generalized view, focusing on broad concepts, while experts sometimes used technical jargon, providing evidence-based explanations.

CONCLUSIONS

ChatGPT-4 can accurately address sleep-related queries and debunk sleep-related myths, with a performance comparable to sleep experts, even if, given its limitations, the AI cannot completely replace expert opinions, especially in nuanced and complex fields such as sleep health, but can be a valuable complement in the dissemination of updated information and promotion of healthy behaviors.

Practice and proficiency of Isha Yoga for better mental health outcomes: insights from a COVID-19 survey

Introduction

The COVID-19 pandemic has brought about unparalleled suffering on a global scale, affecting both physical and mental well-being. In such challenging times, it becomes crucial to identify interventions that can alleviate negative mental health outcomes, such as stress, while promoting positive mental health outcomes, like well-being. We report the effectiveness of a mind-body practise, Isha Yoga, in promoting well-being.

Methods

We conducted an online survey, during the COVID-19 pandemic, with Yoga practitioners (n = 1,352) from the Isha Yoga tradition in Karnataka, India. We evaluated stress and well-being attributes using conventional psychometric questionnaires. Subsequently, we requested the Isha Yoga practitioners to share another survey with their friends and family members, assessing similar outcomes. From the respondents of this shared survey (n = 221), we identified individuals who currently did not engage in any form of Yoga or meditation, constituting the non-Yoga control group (n = 110). To enhance the reliability and validity of our study and minimize the limitations commonly associated with online surveys, we adhered to the CHERRIES guidelines for reporting survey studies.

Results

Isha Yoga practitioners had significantly lower levels of stress (p < 0.001, gHedges = 0.94) and mental distress (p < 0.001, gHedges = 0.75) while reporting significantly higher levels of well-being (p < 0.001, gHedges = 0.78) and affective balance (p < 0.001, gHedges = 0.80) compared to the control group. Furthermore, expertise-related improvements were observed in these outcomes, and a dose-response relationship was found between regularity of Isha Yoga practice and outcome changes. A minimum 3-4 days of weekly practice showed significant differences with the control group. In addition, we investigated the effect of Isha Yoga on stress and well-being among the healthcare workers (HCWs) in our sample and observed better mental health outcomes.

Discussion

These findings collectively underscore the benefits of Mind and Body practices like Isha Yoga on various aspects of mental health and well-being, emphasizing its potential as an effective and holistic approach for promoting a healthy lifestyle among diverse populations, including healthcare workers, even in difficult circumstances such as the COVID-19 pandemic.

Factors influencing patient engagement in mental health chatbots: A thematic analysis of findings from a systematic review of reviews

Introduction

Mental health disorders affect millions of people worldwide. Chatbots are a new technology that can help users with mental health issues by providing innovative features. This article aimed to conduct a systematic review of reviews on chatbots in mental health services and synthesized the evidence on the factors influencing patient engagement with chatbots.

Methods

This study reviewed the literature from 2000 to 2024 using qualitative analysis. The authors conducted a systematic search of several databases, such as PubMed, Scopus, ProQuest, and Cochrane database of systematic reviews, to identify relevant studies on the topic. The quality of the selected studies was assessed using the Critical Appraisal Skills Programme appraisal checklist and the data obtained from the systematic review were subjected to a thematic analysis utilizing the Boyatzis's code development approach.

Results

The database search resulted in 1494 papers, of which 10 were included in the study after the screening process. The quality assessment of the included studies scored the papers within a moderate level. The thematic analysis revealed four main themes: chatbot design, chatbot outcomes, user perceptions, and user characteristics.

Conclusion

The research proposed some ways to use color and music in chatbot design. It also provided a systematic and multidimensional analysis of the factors, offered some insights for chatbot developers and researchers, and highlighted the potential of chatbots to improve patient-centered and person-centered care in mental health services.