Emotion recognition in doctor-patient interactions from real-world clinical video database: Initial development of artificial empathy

Evaluating the Potential and Pitfalls of AI-Powered Conversational Agents as Humanlike Virtual Health Carers in the Remote Management of Noncommunicable Diseases: Scoping Review

BACKGROUND

The rising prevalence of noncommunicable diseases (NCDs) worldwide and the high recent mortality rates (74.4%) associated with them, especially in low- and middle-income countries, is causing a substantial global burden of disease, necessitating innovative and sustainable long-term care solutions.

OBJECTIVE

This scoping review aims to investigate the impact of artificial intelligence (AI)-based conversational agents (CAs)-including chatbots, voicebots, and anthropomorphic digital avatars-as human-like health caregivers in the remote management of NCDs as well as identify critical areas for future research and provide insights into how these technologies might be used effectively in health care to personalize NCD management strategies.

METHODS

A broad literature search was conducted in July 2023 in 6 electronic databases-Ovid MEDLINE, Embase, PsycINFO, PubMed, CINAHL, and Web of Science-using the search terms "conversational agents," "artificial intelligence," and "noncommunicable diseases," including their associated synonyms. We also manually searched gray literature using sources such as ProQuest Central, ResearchGate, ACM Digital Library, and Google Scholar. We included empirical studies published in English from January 2010 to July 2023 focusing solely on health care-oriented applications of CAs used for remote management of NCDs. The narrative synthesis approach was used to collate and summarize the relevant information extracted from the included studies.

RESULTS

The literature search yielded a total of 43 studies that matched the inclusion criteria. Our review unveiled four significant findings: (1) higher user acceptance and compliance with anthropomorphic and avatar-based CAs for remote care; (2) an existing gap in the development of personalized, empathetic, and contextually aware CAs for effective emotional and social interaction with users, along with limited consideration of ethical concerns such as data privacy and patient safety; (3) inadequate evidence of the efficacy of CAs in NCD self-management despite a moderate to high level of optimism among health care professionals regarding CAs' potential in remote health care; and (4) CAs primarily being used for supporting nonpharmacological interventions such as behavioral or lifestyle modifications and patient education for the self-management of NCDs.

CONCLUSIONS

This review makes a unique contribution to the field by not only providing a quantifiable impact analysis but also identifying the areas requiring imminent scholarly attention for the ethical, empathetic, and efficacious implementation of AI in NCD care. This serves as an academic cornerstone for future research in AI-assisted health care for NCD management.

TRIAL REGISTRATION

Open Science Framework; https://doi.org/10.17605/OSF.IO/GU5PX.

Beyond words: analyzing non-verbal communication techniques in a medical communication skills course via synchronous online platform

Background

Effective doctor-patient relationships hinge on robust communication skills, with non-verbal communication techniques (NVC) often overlooked, particularly in online synchronous interactions. This study delves into the exploration of NVC types during online feedback sessions for communication skill activities in a medical education module.

Methods

A cohort of 100 first-year medical students and 10 lecturers at the Faculty of Medicine, Universiti Kebangsaan Malaysia (UKM), engaged in communication skills activities via Microsoft Teams. Sessions were recorded, and lecturer NVC, encompassing body position, facial expressions, voice intonation, body movements, eye contact, and paralinguistics, were meticulously observed. Following these sessions, students provided reflective writings highlighting their perceptions of the feedback, specifically focusing on observed NVC.

Results

The study identified consistent non-verbal communication patterns during feedback sessions. Lecturers predominantly leaned forward and toward the camera, maintained direct eye contact, and exhibited dynamic voice intonation. They frequently engaged in tactile gestures and paused to formulate thoughts, often accompanied by filler sounds like "um" and "okay." This consistency suggests proficient use of NVC in providing synchronous online feedback. Less observed NVC included body touching and certain paralinguistic cues like long sighs. Initial student apprehension, rooted in feelings of poor performance during activities, transformed positively upon observing the lecturer's facial expressions and cheerful intonation. This transformation fostered an open reception of feedback, motivating students to address communication skill deficiencies. Additionally, students expressed a preference for comfortable learning environments to alleviate uncertainties during feedback reception. Potential contrivances in non-verbal communication (NVC) due to lecturer awareness of being recorded, a small sample size of 10 lecturers limiting generalizability, a focus solely on preclinical lecturers, and the need for future research to address these constraints and explore diverse educational contexts.

Conclusion

Medical schools globally should prioritize integrating NVC training into their curricula to equip students with essential communication skills for diverse healthcare settings. The study's findings serve as a valuable reference for lecturers, emphasizing the importance of employing effective NVC during online feedback sessions. This is crucial as NVC, though occurring online synchronously, remains pivotal in conveying nuanced information. Additionally, educators require ongoing professional development to enhance proficiency in utilizing NVC techniques in virtual learning environments. Potential research directions stemming from the study's findings include longitudinal investigations into the evolution of NVC patterns, comparative analyses across disciplines, cross-cultural examinations, interventions to improve NVC skills, exploration of technology's role in NVC enhancement, qualitative studies on student perceptions, and interdisciplinary collaborations to deepen understanding of NVC in virtual learning environments.

Text-Mining and Video Analytics of COVID-19 Narratives Shared by Patients on YouTube

This study explores how individuals who have experienced COVID-19 share their stories on YouTube, focusing on the nature of information disclosure, public engagement, and emotional impact pertaining to consumer health. Using a dataset of 186 YouTube videos, we used text mining and video analytics techniques to analyze textual transcripts and visual frames to identify themes, emotions, and their relationship with viewer engagement metrics. Findings reveal eight key themes: infection origins, symptoms, treatment, mental well-being, isolation, prevention, government directives, and vaccination. While viewers engaged most with videos about infection origins, treatment, and vaccination, fear and sadness in the text consistently drove views, likes, and comments. Visuals primarily conveyed happiness and sadness, but their influence on engagement varied. This research highlights the crucial role YouTube plays in disseminating COVID-19 patient narratives and suggests its potential for improving health communication strategies. By understanding how emotions and content influence viewer engagement, healthcare professionals and public health officials can tailor their messaging to better connect with the public and address pandemic-related anxieties.

Artificial intelligence and obesity management: An Obesity Medicine Association (OMA) Clinical Practice Statement (CPS) 2023

Background

This Obesity Medicine Association (OMA) Clinical Practice Statement (CPS) provides clinicians an overview of Artificial Intelligence, focused on the management of patients with obesity.

Methods

The perspectives of the authors were augmented by scientific support from published citations and integrated with information derived from search engines (i.e., Chrome by Google, Inc) and chatbots (i.e., Chat Generative Pretrained Transformer or Chat GPT).

Results

Artificial Intelligence (AI) is the technologic acquisition of knowledge and skill by a nonhuman device, that after being initially programmed, has varying degrees of operations autonomous from direct human control, and that performs adaptive output tasks based upon data input learnings. AI has applications regarding medical research, medical practice, and applications relevant to the management of patients with obesity. Chatbots may be useful to obesity medicine clinicians as a source of clinical/scientific information, helpful in writings and publications, as well as beneficial in drafting office or institutional Policies and Procedures and Standard Operating Procedures. AI may facilitate interactive programming related to analyses of body composition imaging, behavior coaching, personal nutritional intervention & physical activity recommendations, predictive modeling to identify patients at risk for obesity-related complications, and aid clinicians in precision medicine. AI can enhance educational programming, such as personalized learning, virtual reality, and intelligent tutoring systems. AI may help augment in-person office operations and telemedicine (e.g., scheduling and remote monitoring of patients). Finally, AI may help identify patterns in datasets related to a medical practice or institution that may be used to assess population health and value-based care delivery (i.e., analytics related to electronic health records).

Conclusions

AI is contributing to both an evolution and revolution in medical care, including the management of patients with obesity. Challenges of Artificial Intelligence include ethical and legal concerns (e.g., privacy and security), accuracy and reliability, and the potential perpetuation of pervasive systemic biases.