Insights Into the Use of a Digital Healthy Aging Coach (AGATHA) for Older Adults From Malaysia: App Engagement, Usability, and Impact Study

BACKGROUND

Digital inclusion is considered a pivotal social determinant of health, particularly for older adults who may face significant barriers to digital access due to physical, sensory, and social limitations. Avatar for Global Access to Technology for Healthy Aging (AGATHA) is a virtual healthy aging coach developed by the World Health Organization to address these challenges. Designed as a comprehensive virtual coach, AGATHA comprises a gamified platform that covers multiple health-related topics and modules aimed at fostering user engagement and promoting healthy aging.

OBJECTIVE

The aim of this study was to explore the perception and user experience of Malaysian older adults in their interactions with the AGATHA app and its avatar. The focus of this study was to examine the engagement, usability, and educational impact of the app on health literacy and digital skills.

METHODS

We performed a qualitative study among adults 60 years and older from suburban and rural communities across six states in Malaysia. Participants were purposefully recruited to ensure representation across various socioeconomic and cultural backgrounds. Each participant attended a 1-hour training session to familiarize themselves with the interface and functionalities of AGATHA. Subsequently, all participants were required to engage with the AGATHA app two to three times per week for up to 2 weeks. Upon completion of this trial phase, an in-depth interview session was conducted to gather detailed feedback on their experiences.

RESULTS

Overall, the participants found AGATHA to be highly accessible and engaging. The content was reported to have a comprehensive structure and was delivered in an easily understandable and informative manner. Moreover, the participants found the app to be beneficial in enhancing their understanding pertaining to health-related issues in aging. Some key feedback gathered highlighted the need for increased interactive features that would allow for interaction with peers, better personalization of content tailored to the individual's health condition, and improvement in the user-experience design to accommodate older users' specific needs. Furthermore, enhancements in decision-support features within the app were suggested to better assist users in making health decisions.

CONCLUSIONS

The prototype digital health coaching program AGATHA was well received as a user-friendly tool suitable for beginners, and was also perceived to be useful to enhance older adults' digital literacy and confidence. The findings of this study offer important insights for designing other digital health tools and interventions targeting older adults, highlighting the importance of a user-centered design and personalization to improve the adoption of digital health solutions among older adults. This study also serves as a useful starting point for further development and refinement of digital health programs aimed at fostering an inclusive, supportive digital environment for older adults.

A Mindfulness-Based App Intervention for Pregnant Women: Protocol for a Pilot Feasibility Study

BACKGROUND

Pregnancy is a complex time characterized by major transformations in a woman, which impact her physical, mental, and social well-being. How a woman adapts to these changes can affect her quality of life and psychological well-being. The literature indicates that pregnant women commonly experience psychological symptoms, with anxiety, stress, and depression being among the most frequent. Hence, promoting a healthy lifestyle focused on women's psychological well-being is crucial. Recently developed digital solutions have assumed a crucial role in supporting psychological well-being in physiologically pregnant women. Therefore, the need becomes evident for the development and implementation of digital solutions, such as a virtual coach implemented in a smartphone, as a support for the psychological well-being of pregnant women who do not present psychological and psychiatric disorders.

OBJECTIVE

This study aims to assess the feasibility, acceptability, and utility of a mindfulness-based mobile app. The primary objective is to explore the feasibility of using a virtual coach, Maia, developed within the TreC Mamma app to promote women's psychological well-being during pregnancy through a psychoeducational module based on mindfulness. Finally, through the delivery of this module, the level of psychological well-being will be explored as a secondary objective.

METHODS

This is a proof-of-concept study in which a small sample (N=50) is sufficient to achieve the intended purposes. Recruitment will occur within the group of pregnant women belonging to the pregnancy care services of the Trento Azienda Provinciale per i Servizi Sanitari di Trento. The convenience sampling method will be used. Maia will interact with the participating women for 8 weeks, starting from weeks 24 and 26 of pregnancy. Specifically, there will be 2 sessions per week, which the woman can choose, to allow more flexibility toward her needs.

RESULTS

The psychoeducational pathway is expected to lead to significant results in terms of usability and engagement in women's interactions with Maia. Furthermore, it is anticipated that there will be improvements in psychological well-being and overall quality of life. The analysis of the data collected in this study will be mainly descriptive, orientated toward assessing the achievement of the study objectives.

CONCLUSIONS

Literature has shown that women preferred web-based support during the perinatal period, suggesting that implementing digital interventions can overcome barriers to social stigma and asking for help. Maia can be a valuable resource for regular psychoeducational support for women during pregnancy.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR1-10.2196/53890.

Towards Automating Personal Exercise Assessment and Guidance with Affordable Mobile Technology

Physical activity (PA) offers many benefits for human health. However, beginners often feel discouraged when introduced to basic exercise routines. Due to lack of experience and personal guidance, they might abandon efforts or experience musculoskeletal injuries. Additionally, due to phenomena such as pandemics and limited access to supervised exercise spaces, especially for the elderly, the need to develop personalized systems has become apparent. In this work, we develop a monitored physical exercise system that offers real-time guidance and recommendations during exercise, designed to assist users in their home environment. For this purpose, we used posture estimation interfaces that recognize body movement using a computer or smartphone camera. The chosen pose estimation model was BlazePose. Machine learning and signal processing techniques were used to identify the exercise currently being performed. The performances of three machine learning classifiers were evaluated for the exercise recognition task, achieving test-set accuracy between 94.76% and 100%. The research methodology included kinematic analysis (KA) of five selected exercises and statistical studies on performance and range of motion (ROM), which enabled the identification of deviations from the expected exercise execution to support guidance. To this end, data was collected from 57 volunteers, contributing to a comprehensive understanding of exercise performance. By leveraging the capabilities of the BlazePose model, an interactive tool for patients is proposed that could support rehabilitation programs remotely.

e-VITA study protocol: EU-Japan virtual coach for smart aging

Aim

The aim of this study is to report a trial protocol for assessing the improvement of older adults' well-being, promoting active and healthy aging, and reducing the risks of social exclusion, using a virtual coach.

Background

Increased longevity brings with it reduced autonomy and independence, and it is therefore necessary to act with preventive measures that can promote active and healthy aging. With the development of technology, new tools have appeared, including virtual coaches, which can enable people to lead a healthy lifestyle by identifying individual needs and goals and providing personalized recommendations and advice. However, it is important that these coaches take into consideration the inter-individual and cross-cultural differences of each person.

Design

A randomized controlled trial is proposed.

Methods

This study will recruit 240 healthy subjects aged 65 years and older. Participants will be assigned to an experimental group that will receive the e-VITA system or to the control group that will receive an information booklet only. The primary outcome measure is the person's quality of life (QoL). Data will be collected at baseline, 3 months after the trial, and at the end of the trial, after 6 months.

Discussion

This study will evaluate the effectiveness of the e-VITA system, consisting of a virtual coach, several sensors for monitoring, a smartphone for use at home, and a booklet, in improving the older person's quality of life. The increased perceived well-being will also be linked to improvements in other areas of the person's life, psychological and cognitive status, the area of sociality, nutrition, and eHealth literacy.

Empowering Smart Aging: Insights into the Technical Architecture of the e-VITA Virtual Coaching System for Older Adults

With a substantial rise in life expectancy throughout the last century, society faces the imperative of seeking inventive approaches to foster active aging and provide adequate aging care. The e-VITA initiative, jointly funded by the European Union and Japan, centers on an advanced virtual coaching methodology designed to target essential aspects of promoting active and healthy aging. This paper describes the technical framework underlying the e-VITA virtual coaching system platform and presents preliminary feedback on its use. At its core is the e-VITA Manager, a pivotal component responsible for harmonizing the seamless integration of various specialized devices and modules. These modules include the Dialogue Manager, Data Fusion, and Emotional Detection, each making distinct contributions to enhance the platform's functionalities. The platform's design incorporates a multitude of devices and software components from Europe and Japan, each built upon diverse technologies and standards. This versatile platform facilitates communication and seamless integration among smart devices such as sensors and robots while efficiently managing data to provide comprehensive coaching functionalities.

User Perceptions and Needs Analysis of a Virtual Coach for Active and Healthy Ageing-An International Qualitative Study

Virtual coaching systems show great potential for meeting the challenges of demographic change. However, the proportion of older users in the field of digital technologies is far behind that of younger people. As part of the e-VITA project, semi-structured interviews were conducted in Japan, France, Italy and Germany with 58 people aged 65 and over, and the content was analyzed with the aim of obtaining information about how older adults organize their everyday lives, also with regard to the COVID-19 pandemic, how they deal with their health, what role digital technologies play in the lives of the interviewees and why they oppose progressive digitization. Second, the survey asked why the older adults oppose a virtual coach, which is to be developed in the e-VITA project to support older adults in healthy and active aging, and what barriers they see in a possible implementation. It was found that older respondents lead active, varied lives and that the COVID-19 pandemic contributed to the increased use of digital solutions. In addition, respondents were consciously addressing their own health. With regard to a virtual coach, barriers were seen primarily in the area of data security and sharing. It can be concluded from this that heterogeneity among older user groups should be taken into account when developing virtual coaches. In addition, aspects of data security and data protection should be presented in a clearly understandable and transparent manner.

Early Development of a Virtual Coach for Healthy Coping Interventions in Type 2 Diabetes Mellitus: Validation Study

Background

Mobile health solutions aimed at monitoring tasks among people with diabetes mellitus (DM) have been broadly applied. However, virtual coaches (VCs), embedded or not in mobile health, are considered valuable means of improving patients’ health-related quality of life and ensuring adherence to self-care recommendations in diabetes management. Despite the growing need for effective, healthy coping digital interventions to support patients’ self-care and self-management, the design of psychological digital interventions that are acceptable, usable, and engaging for the target users still represents the main challenge, especially from a psychosocial perspective.

Objective

This study primarily aims to test VC interventions based on psychoeducational and counseling approaches to support and promote healthy coping behaviors in adults with DM. As a preliminary study, university students have participated in it and have played the standardized patients’ (SPs) role with the aim of improving the quality of the intervention protocol in terms of user acceptability, experience, and engagement. The accuracy of users’ role-playing is further analyzed.

Methods

This preliminary study is based on the Obesity-Related Behavioral Intervention Trial model, with a specific focus on its early phases. The healthy coping intervention protocol was initially designed together with a team of psychologists following the main guidelines and recommendations for psychoeducational interventions for healthy coping in the context of DM. The protocol was refined with the support of 3 experts in the design of behavioral intervention technologies for mental health and well-being, who role-played 3 SPs’ profiles receiving the virtual coaching intervention in a Wizard of Oz setting via WhatsApp. A refined version of the healthy coping protocol was then iteratively tested with a sample of 18 university students (mean age 23.61, SD 1.975 years) in a slightly different Wizard of Oz evaluation setting. Participants provided quantitative and qualitative postintervention feedback by reporting their experiences with the VC. Clustering techniques on the logged interactions and dialogs between the VC and users were collected and analyzed to identify additional refinements for future VC development.

Results

Both quantitative and qualitative analyses showed that the digital healthy coping intervention was perceived as supportive, motivating, and able to trigger self-reflection on coping strategies. Analyses of the logged dialogs showed that most of the participants accurately played the SPs’ profile assigned, confirming the validity and usefulness of this testing approach in preliminary assessments of behavioral digital interventions and protocols.

Conclusions

This study outlined an original approach to the early development and iterative testing of digital healthy coping interventions for type 2 DM. Indeed, the intervention was well-accepted and proved its effectiveness in the definition and refinement of the initial protocol and of the user experience with a VC before directly involving real patients in its subsequent use and testing.

Feasibility, Usability, and Effectiveness of a Machine Learning-Based Physical Activity Chatbot: Quasi-Experimental Study

BACKGROUND

Behavioral eHealth and mobile health interventions have been moderately successful in increasing physical activity, although opportunities for further improvement remain to be discussed. Chatbots equipped with natural language processing can interact and engage with users and help continuously monitor physical activity by using data from wearable sensors and smartphones. However, a limited number of studies have evaluated the effectiveness of chatbot interventions on physical activity.

OBJECTIVE

This study aims to investigate the feasibility, usability, and effectiveness of a machine learning-based physical activity chatbot.

METHODS

A quasi-experimental design without a control group was conducted with outcomes evaluated at baseline and 6 weeks. Participants wore a Fitbit Flex 1 (Fitbit LLC) and connected to the chatbot via the Messenger app. The chatbot provided daily updates on the physical activity level for self-monitoring, sent out daily motivational messages in relation to goal achievement, and automatically adjusted the daily goals based on physical activity levels in the last 7 days. When requested by the participants, the chatbot also provided sources of information on the benefits of physical activity, sent general motivational messages, and checked participants' activity history (ie, the step counts/min that were achieved on any day). Information about usability and acceptability was self-reported. The main outcomes were daily step counts recorded by the Fitbit and self-reported physical activity.

RESULTS

Among 116 participants, 95 (81.9%) were female, 85 (73.3%) were in a relationship, 101 (87.1%) were White, and 82 (70.7%) were full-time workers. Their average age was 49.1 (SD 9.3) years with an average BMI of 32.5 (SD 8.0) kg/m2. Most experienced technical issues were due to an unexpected change in Facebook policy (93/113, 82.3%). Most of the participants scored the usability of the chatbot (101/113, 89.4%) and the Fitbit (99/113, 87.6%) as at least "OK." About one-third (40/113, 35.4%) would continue to use the chatbot in the future, and 53.1% (60/113) agreed that the chatbot helped them become more active. On average, 6.7 (SD 7.0) messages/week were sent to the chatbot and 5.1 (SD 7.4) min/day were spent using the chatbot. At follow-up, participants recorded more steps (increase of 627, 95% CI 219-1035 steps/day) and total physical activity (increase of 154.2 min/week; 3.58 times higher at follow-up; 95% CI 2.28-5.63). Participants were also more likely to meet the physical activity guidelines (odds ratio 6.37, 95% CI 3.31-12.27) at follow-up.

CONCLUSIONS

The machine learning-based physical activity chatbot was able to significantly increase participants' physical activity and was moderately accepted by the participants. However, the Facebook policy change undermined the chatbot functionality and indicated the need to use independent platforms for chatbot deployment to ensure successful delivery of this type of intervention.

"Hi This Is NESTORE, Your Personal Assistant": Design of an Integrated IoT System for a Personalized Coach for Healthy Aging

In the context of the fourth revolution in healthcare technologies, leveraging monitoring and personalization across different domains becomes a key factor for providing useful services to maintain and promote well-being. This is even more crucial for older people, with aging being a complex multi-dimensional and multi-factorial process which can lead to frailty. The NESTORE project was recently funded by the EU Commission with the aim of supporting healthy older people to sustain their well-being and capacity to live independently. It is based on a multi-dimensional model of the healthy aging process that covers physical activity, nutrition, cognition, and social activity. NESTORE is based on the paradigm of the human-in-the-loop cyber-physical system that, exploiting the availability of Internet of Things technologies combined with analytics in the cloud, provides a virtual coaching system to support healthy aging. This work describes the design of the NESTORE methodology and its IoT architecture. We first model the end-user under several domains, then we present the NESTORE system that, analyzing relevant key-markers, provides coaching activities and personalized feedback to the user. Finally, we describe the validation strategy to assess the effectiveness of NESTORE as a coaching platform for healthy aging.

Evaluating the Performance of Balance Physiotherapy Exercises Using a Sensory Platform: The Basis for a Persuasive Balance Rehabilitation Virtual Coaching System

Rehabilitation programs play an important role in improving the quality of life of patients with balance disorders. Such programs are usually executed in a home environment, due to lack of resources. This procedure usually results in poorly performed exercises or even complete drop outs from the programs, as the patients lack guidance and motivation. This paper introduces a novel system for managing balance disorders in a home environment using a virtual coach for guidance, instruction, and inducement. The proposed system comprises sensing devices, augmented reality technology, and intelligent inference agents, which capture, recognize, and evaluate a patient's performance during the execution of exercises. More specifically, this work presents a home-based motion capture and assessment module, which utilizes a sensory platform to recognize an exercise performed by a patient and assess it. The sensory platform comprises IMU sensors (Mbientlab MMR^© 9axis), pressure insoles (Moticon^©), and a depth RGB camera (Intel D415^©). This module is designed to deliver messages both during the performance of the exercise, delivering personalized notifications and alerts to the patient, and after the end of the exercise, scoring the overall performance of the patient. A set of proof of concept validation studies has been deployed, aiming to assess the accuracy of the different components for the sub-modules of the motion capture and assessment module. More specifically, Euler angle calculation algorithm in 2D (R² = 0.99) and in 3D (R² = 0.82 in yaw plane and R² = 0.91 for the pitch plane), as well as head turns speed (R² = 0.96), showed good correlation between the calculated and ground truth values provided by experts' annotations. The posture assessment algorithm resulted to accuracy = 0.83, while the gait metrics were validated against two well-established gait analysis systems (R² = 0.78 for double support, R² = 0.71 for single support, R² = 0.80 for step time, R² = 0.75 for stride time (WinTrack^©), R² = 0.82 for cadence, and R² = 0.79 for stride time (RehaGait^©). Validation results provided evidence that the proposed system can accurately capture and assess a physiotherapy exercise within the balance disorders context, thus providing a robust basis for the virtual coaching ecosystem and thereby improve a patient's commitment to rehabilitation programs while enhancing the quality of the performed exercises. In summary, virtual coaching can improve the quality of the home-based rehabilitation programs as long as it is combined with accurate motion capture and assessment modules, which provides to the virtual coach the capacity to tailor the interaction with the patient and deliver personalized experience.

User Requirements Analysis of an Embodied Conversational Agent for Coaching Older Adults to Choose Active and Healthy Ageing Behaviors during the Transition to Retirement: A Cross-National User Centered Design Study

Background: Retirement is recognized as a factor influencing the ageing process. Today, virtual health coaching systems can play a pivotal role in supporting older adults’ active and healthy ageing. This study wants to answer two research questions: (1) What are the user requirements of a virtual coach (VC) based on an Embodied Conversational Agent (ECA) for motivating older adults in transition to retirement to adopt a healthy lifestyle? (2) How could a VC address the active and healthy ageing dimensions, even during COVID-19 times? Methods: Two-wave focus-groups with 60 end-users aged 55 and over and 27 follow-up telephone interviews were carried out in Austria, Italy and the Netherlands in 2019–2020. Qualitative data were analysed by way of framework analysis. Results: End-users suggest the VC should motivate older workers and retirees to practice physical activity, maintain social contacts and emotional well-being. The ECA should be reactive, customizable, expressive, sympathetic, not directive nor patronizing, with a pleasant and motivating language. The COVID-19 outbreak increased the users’ need for functions boosting community relationships and promoting emotional well-being. Conclusions: the VC can address the active and healthy ageing paradigm by increasing the chances of doing low-cost healthy activities at any time and in any place.

Digital Therapeutics in Parkinson's Disease: Practical Applications and Future Potential

Digital therapeutics, treatments delivered remotely and enabled by modern technology, facilitate the provision of personalized, evidence-based, interdisciplinary interventions to manage the complexities associated with Parkinson’s disease. In the context of the COVID-19 pandemic, the need for digital therapeutics has arguably never been greater. However, despite new advances in technology and a heightened interest due to the pandemic, digital therapeutics remain underdeveloped and underutilized. In this paper, we briefly review practical applications and emerging advances in digital therapeutic platforms that target motor and non-motor signs and healthy lifestyle behaviors such as regular exercise, a healthful diet and optimal sleep hygiene habits. Future applications which could transform personalized self-management and patient care are presented. Opportunities, drawbacks and barriers to access are discussed.

The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review

Background

The high demand for health care services and the growing capability of artificial intelligence have led to the development of conversational agents designed to support a variety of health-related activities, including behavior change, treatment support, health monitoring, training, triage, and screening support. Automation of these tasks could free clinicians to focus on more complex work and increase the accessibility to health care services for the public. An overarching assessment of the acceptability, usability, and effectiveness of these agents in health care is needed to collate the evidence so that future development can target areas for improvement and potential for sustainable adoption.

Objective

This systematic review aims to assess the effectiveness and usability of conversational agents in health care and identify the elements that users like and dislike to inform future research and development of these agents.

Methods

PubMed, Medline (Ovid), EMBASE (Excerpta Medica dataBASE), CINAHL (Cumulative Index to Nursing and Allied Health Literature), Web of Science, and the Association for Computing Machinery Digital Library were systematically searched for articles published since 2008 that evaluated unconstrained natural language processing conversational agents used in health care. EndNote (version X9, Clarivate Analytics) reference management software was used for initial screening, and full-text screening was conducted by 1 reviewer. Data were extracted, and the risk of bias was assessed by one reviewer and validated by another.

Results

A total of 31 studies were selected and included a variety of conversational agents, including 14 chatbots (2 of which were voice chatbots), 6 embodied conversational agents (3 of which were interactive voice response calls, virtual patients, and speech recognition screening systems), 1 contextual question-answering agent, and 1 voice recognition triage system. Overall, the evidence reported was mostly positive or mixed. Usability and satisfaction performed well (27/30 and 26/31), and positive or mixed effectiveness was found in three-quarters of the studies (23/30). However, there were several limitations of the agents highlighted in specific qualitative feedback.

Conclusions

The studies generally reported positive or mixed evidence for the effectiveness, usability, and satisfactoriness of the conversational agents investigated, but qualitative user perceptions were more mixed. The quality of many of the studies was limited, and improved study design and reporting are necessary to more accurately evaluate the usefulness of the agents in health care and identify key areas for improvement. Further research should also analyze the cost-effectiveness, privacy, and security of the agents.

International Registered Report Identifier (IRRID)

RR2-10.2196/16934

Digital Health Coaching Programs Among Older Employees in Transition to Retirement: Systematic Literature Review

Background

The rapid increase of the aging population is pushing many national governments to reshape retirement legislation in order to extend older adults’ working life. Once retired, older adults can be invaluable resources for the community as family carers, as volunteers, or by returning to work. Healthy aging is one of the main conditions for being able to work longer and being active after retirement. The latter, indeed, represents a very sensitive life transition, which can entail psychological and social difficulties. Interventions for promoting older workers’ health and well-being and supporting the transition to retirement are on the top of the policy agenda of most European countries. Recently, computer-based and digital health interventions have been seen as promising means to reach this purpose.

Objective

This systematic literature review aimed to explore studies on digital health coaching programs for older workers that followed a user-centered design approach and evaluated their effectiveness in providing older adults with guidance for adopting a healthy lifestyle and being active in the community.

Methods

The search identified 1931 papers, and 2 relevant articles were selected by applying specific eligibility criteria.

Results

To our knowledge, only few digital health coaching programs have targeted the population of older workers to date; there is an insufficient number of studies on the efficacy of such programs. The results show the difficulties of assessing the efficacy of digital coaching itself and with respect to older employees. The 2 studies suggest that digital health programs for workplaces can improve various aspects of older employees’ well-being; however, they considered health mainly from a physical perspective and neglected contextual, social, psychological, and cultural factors that can influence older workers’ health and general well-being. Future digital health coaching programs should adopt the healthy aging paradigm as a multidimensional lens for interpreting the impact of eHealth technology on aging and retirement. The literature around this issue remains at an embryonic state, and this gap needs to be filled by further investigations that apply a user-centered approach for designing the technology, test innovative research methodologies, and adopt new technical solutions for high-quality interaction design.

Conclusions

Further digital health coaching programs aimed at supporting healthy and active living for older workers and retirees are necessary. The user-centered design approach is recommended in order to fully address the users’ health needs and the technological requirements throughout development. Moreover, the healthy aging perspective allows inclusion of physical, social, and psychological factors influencing the transition from work to retirement, as well as the experiences and interactions of individuals with the technology.

VIVID: Independent Living of Aging Adults Suffered a Stroke

Based on the recent statistics published by the Stroke Association (UK), first-time incidence of stroke occurs almost 17 million times a year worldwide (one every two seconds), making Stroke as the second cause of death in the world. By the age of 75, 1 in 5 women and 1 in 6 men will have a stroke, which is one of the largest causes of disability, as half of all stroke survivors have a disability, making those persons dependent on others (1 in 5 are cared for by family and/or friends). People living longer is a cause for celebration, but older people are more vulnerable to mental health, cognition and physical problems, especially if they have already experienced a stroke (minor or mild). Depression is a main condition after a stroke and may be experienced in the form of sadness, unexplained pains, loss of interest in socializing, weight loss etc. The abovementioned conditions reduce the person's ability to remain active and independent, affecting their well-being and quality of living. Independent living of aging adults that have suffered a stroke is the key motivation for the VIVID project.

Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation

BACKGROUND

Automated virtual reality exposure therapies (VRETs) are self-help treatments conducted by oneself and supported by a virtual therapist embodied visually and/or with audio feedback. This simulates many of the nonspecific relational elements and common factors present in face-to-face therapy and may be a means of improving adherence to and efficacy of self-guided treatments. However, little is known about alliance toward the virtual therapist, despite alliance being an important predictor of treatment outcome.

OBJECTIVE

In this study, we aimed to evaluate the first alliance instrument developed for use with embodied virtual therapists in an automated treatment format-the Virtual Therapist Alliance Scale (VTAS)-by (1) assessing its psychometric properties, (2) verifying the dimensionality of the scale, and (3) determining the predictive ability of the scale with treatment outcome.

METHODS

A psychometric evaluation and exploratory factor analysis of the VTAS was conducted using data from two samples of spider-fearful patients treated with VRET and the help of an embodied, voice-based virtual therapist (n=70). Multiple regression models and bivariate correlations were used to assess the VTAS relationship with treatment outcome, according to self-reported fear and convergence with presence and user-friendliness process measures.

RESULTS

The VTAS showed a sound two-factor solution composed of a primary factor covering task, goal, and copresence; adequate internal consistency; and good convergent validity, including moderate correlation (r=.310, P=.01) with outcomes over follow-up.

CONCLUSIONS

These preliminary results suggest that alliance toward a virtual therapist is a significant predictor of treatment outcome, favors the importance of a task-goal over bond-factor, and should be explored in studies with larger sample sizes and in additional forms of embodiment.

Effectiveness of Conversational Agents (Virtual Assistants) in Health Care: Protocol for a Systematic Review

Background

Conversational agents (also known as chatbots) have evolved in recent decades to become multimodal, multifunctional platforms with potential to automate a diverse range of health-related activities supporting the general public, patients, and physicians. Multiple studies have reported the development of these agents, and recent systematic reviews have described the scope of use of conversational agents in health care. However, there is scarce research on the effectiveness of these systems; thus, their viability and applicability are unclear.

Objective

The objective of this systematic review is to assess the effectiveness of conversational agents in health care and to identify limitations, adverse events, and areas for future investigation of these agents.

Methods

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols will be used to structure this protocol. The focus of the systematic review is guided by a population, intervention, comparator, and outcome framework. A systematic search of the PubMed (Medline), EMBASE, CINAHL, and Web of Science databases will be conducted. Two authors will independently screen the titles and abstracts of the identified references and select studies according to the eligibility criteria. Any discrepancies will then be discussed and resolved. Two reviewers will independently extract and validate data from the included studies into a standardized form and conduct quality appraisal.

Results

As of January 2020, we have begun a preliminary literature search and piloting of the study selection process.

Conclusions

This systematic review aims to clarify the effectiveness, limitations, and future applications of conversational agents in health care. Our findings may be useful to inform the future development of conversational agents and promote the personalization of patient care.

International Registered Report Identifier (IRRID)

PRR1-10.2196/16934