Development and Usability Evaluation of a Healthy Lifestyle Coaching Chatbot Using a Habit Formation Model

Artificial Intelligence and Public Health: An Exploratory Study

Artificial intelligence (AI) has the potential to revolutionize research by automating data analysis, generating new insights, and supporting the discovery of new knowledge. The top 10 contribution areas of AI towards public health were gathered in this exploratory study. We utilized the "text-davinci-003" model of GPT-3, using OpenAI playground default parameters. The model was trained with the largest training dataset any AI had, limited to a cut-off date in 2021. This study aimed to test the ability of GPT-3 to advance public health and to explore the feasibility of using AI as a scientific co-author. We asked the AI asked for structured input, including scientific quotations, and reviewed responses for plausibility. We found that GPT-3 was able to assemble, summarize, and generate plausible text blocks relevant for public health concerns, elucidating valuable areas of application for itself. However, most quotations were purely invented by GPT-3 and thus invalid. Our research showed that AI can contribute to public health research as a team member. According to authorship guidelines, the AI was ultimately not listed as a co-author, as it would be done with a human researcher. We conclude that good scientific practice also needs to be followed for AI contributions, and a broad scientific discourse on AI contributions is needed.

Usability Testing of a Social Media Chatbot for Increasing Physical Activity Behavior

Digital interventions for increasing physical activity behavior have shown great potential, especially those with social media. Chatbots, also known as conversational agents, have emerged in healthcare in relation to digital interventions and have proven effective in promoting physical activity among adults. The study’s objective is to explore users’ experiences with a social media chatbot. The concept and the prototype development of the social media chatbot MYA were realized in three steps: requirement analysis, concept development, and implementation. MYA’s design includes behavior change techniques effective in increasing physical activity through digital interventions. Participants in a usability study answered a survey with the Chatbot Usability Questionnaire (CUQ), which is comparable to the Systems Usability Scale. The mean CUQ score was below 68, the benchmark for average usability. The highest mean CUQ score was 64.5 for participants who thought MYA could help increase their physical activity behavior. The lowest mean CUQ score was 40.6 for participants aged between 50 and 69 years. Generally, MYA was considered to be welcoming, very easy to use, realistic, engaging, and informative. However, some technical issues were identified. A good and diversified user experience promotes prolonged chatbot use. Addressing identified issues will enhance users’ interaction with MYA.

Quality Assessment Methods for Textual Conversational Interfaces: A Multivocal Literature Review

The evaluation and assessment of conversational interfaces is a complex task since such software products are challenging to validate through traditional testing approaches. We conducted a systematic Multivocal Literature Review (MLR), on five different literature sources, to provide a view on quality attributes, evaluation frameworks, and evaluation datasets proposed to provide aid to the researchers and practitioners of the field. We came up with a final pool of 118 contributions, including grey (35) and white literature (83). We categorized 123 different quality attributes and metrics under ten different categories and four macro-categories: Relational, Conversational, User-Centered and Quantitative attributes. While Relational and Conversational attributes are most commonly explored by the scientific literature, we testified a predominance of User-Centered Attributes in industrial literature. We also identified five different academic frameworks/tools to automatically compute sets of metrics, and 28 datasets (subdivided into seven different categories based on the type of data contained) that can produce conversations for the evaluation of conversational interfaces. Our analysis of literature highlights that a high number of qualitative and quantitative attributes are available in the literature to evaluate the performance of conversational interfaces. Our categorization can serve as a valid entry point for researchers and practitioners to select the proper functional and non-functional aspects to be evaluated for their products.

Effectiveness of Mobile Health-Based Exercise Interventions for Patients with Peripheral Artery Disease: Systematic Review and Meta-Analysis

Background

Peripheral artery disease (PAD) affects over 236 million people worldwide, and exercise interventions are commonly used to alleviate symptoms of this condition. However, no previous systematic review has evaluated the effects of mobile health (mHealth)–based exercise interventions for patients with PAD.

Objective

This study aimed to assess the effect of mHealth-based exercise interventions on walking performance, functional status, and quality of life in patients with PAD.

Methods

A systematic review and meta-analysis were conducted. We searched in seven databases to identify randomized controlled trials of patients with PAD published in English up to December 4, 2020. Studies were included if patients participated in mHealth-based exercise interventions and were assessed for walking performance. We analyzed pooled effect size on walking performance, functional status, and quality of life based on the standardized mean differences between groups.

Results

A total of seven studies were selected for the systematic review, and six studies were included in the meta-analysis. The duration of interventions in the included studies was 12 to 48 weeks. In the pooled analysis, when compared with the control groups, the mHealth-based exercise intervention groups were associated with significant improvements in pain-free walking (95% CI 0.13-0.88), maximal walking (95% CI 0.03-0.87), 6-minute walk test (6MWT) distance (95% CI 0.59-1.24), and walking distance (95% CI 0.02-0.49). However, benefits of the interventions on walking speed, stair-climbing ability, and quality of life were not observed.

Conclusions

mHealth-based exercise interventions for patients with PAD were beneficial for improving pain-free walking, maximal walking, and 6MWT distance. We found that exercise interventions using mHealth are an important strategy for improving the exercise effectiveness and adherence rate of patients with PAD. Future studies should consider the use of various and suitable functions of mHealth that can increase the adherence rates and improve the effectiveness of exercise.