Usability and Engagement Evaluation of an Unguided Online Program for Promoting a Healthy Lifestyle and Reducing the Risk for Eating Disorders and Obesity in the School Setting

Interactive Malaysian Childhood Healthy Lifestyle (i-MaCHeL) programme: a single-arm pilot study

BACKGROUND

The growing obesity epidemic in Malaysia presents a public health challenge that requires innovative intervention strategies. In an effort to address this problem, an Interactive Malaysian Childhood Healthy Lifestyle (i-MaCHeL) programme, which is a web-based initiative designed for preschool child-parent dyads offers a novel approach. Nevertheless, the success of such a web-based intervention depends on several interrelated factors. This research aims to examine the feasibility of i-MaCHeL in the Malaysian context, its usability for preschool child-parent dyads, and the acceptability of the programme among these user groups.

METHODS

This was a single-arm pilot study involving 46 child-parent dyads recruited from six government preschools in Terengganu, Malaysia. The preschools were selected using a cluster random sampling technique at the preschool level. The intervention feasibility was determined based on the retention rate of participants in the pilot study. The System Usability Scale (SUS) and intervention process evaluation were used to assess the usability and acceptability of the web-based i-MaCHeL programme.

RESULTS

The retention data demonstrated that 42 out of 46 participants completed the 13-week intervention programme, which showed that the overall retention rate was 91.3%. A mean (SD) SUS score of 84.70 (13.82) was obtained from parents, indicating that the web-based i-MaCHeL had an acceptable usability level. The mean scores of the process evaluation items ranged from 4.52 (0.63) to 4.83 (0.38), demonstrating that the web-based i-MaCHeL was highly accepted by the parents. The acceptability data also indicated that at least 92.9% (39/42) of the parents agreed/strongly agreed that the web content, programme duration, intervention dose, WhatsApp group, and delivery mode were appropriate.

CONCLUSIONS

According to these findings, the i-MaCHeL intervention using a web-based approach was feasible, usable, and acceptable as part of a weight-related behaviour change intervention for preschool child-parent dyads. This pilot study demonstrated that the web-based i-MaCHeL was feasible and promising for delivering weight-related behavioural intervention to child-parent dyads.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04711525 . Registered on January 15, 2021.

An mHealth Application in German Health Care System: Importance of User Participation in the Development Process

This paper addresses the challenges and solutions in developing a holistic prevention mobile health application (mHealth app) for Germany's healthcare sector. Despite Germany's lag in healthcare digitalization, the app aims to enhance primary prevention in physical activity, nutrition, and stress management. A significant focus is on user participation and usability to counter the prevalent issue of user attrition in mHealth applications, as described by Eysenbach's 'law of attrition'. The development process, conducted in a scientific and university context, faces constraints like limited budgets and external service providers. The study firstly presents the structure and functionality of the app for people with statutory health insurance in Germany and secondly the implementation of user participation through a usability study. User participation is executed via usability tests, particularly the think-aloud method, where users verbalize their thoughts while using the app. This approach has proven effective in identifying and resolving usability issues, although some user feedback could not be implemented due to cost-benefit considerations. The implementation of this study into the development process was able to show that user participation, facilitated by methods like think-aloud, is vital for developing mHealth apps. Especially in health prevention, where long-term engagement is a challenge. The findings highlight the importance of allocating time and resources for user participation in the development of mHealth applications.

Promoting Physical and Mental Health among Children and Adolescents via Gamification-A Conceptual Systematic Review

The rapid growth in digital technology usage among children and adolescents has highlighted the need for novel approaches to promote their physical and mental health. This paper investigates the viability of gamification-the application of game mechanics to non-gaming contexts-as a potent instrument for health promotion and mental health support. This conceptual systematic review seeks to examine the various published articles promoting children and adolescents' physical and mental health through gamified techniques. These interventions can provide an interactive and engaging platform for encouraging physical activity, promoting healthy nutrition, enhancing emotional regulation, and promoting mental health. The significance of this topic stems from the pervasive use of electronic games, beginning at a young age, which makes them popular educational tools. For the review to be systematic and reproducible, the PsycINFO, Scopus, PubMed, and Elsevier databases were searched and the PRISMA method was utilized for the analysis. After analyzing the research data, empirical studies assessing the use of gamification in promoting adolescents' physical and mental health are discussed. In conclusion, gamification has demonstrated promise for promoting children's and adolescents' physical and mental health. It improves motivation, commitment, and adherence to healthy behaviors. However, additional research is required to evaluate gamification interventions' long-term effectiveness and sustainability in promoting health behaviors among this population.

The Relationship between Gamified Physical Exercise and Mental Health in Adolescence: An Example of Open Innovation in Gamified Learning

Interest in gamified physical activity has been driven by its potential to benefit student mental health. Integrating gamified practices for mental health improvement represents a significant innovation within multidisciplinary approaches to enhancing mental well-being. This review follows the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines and was conducted using the Scopus and Web of Science (WOS) databases, primary sources for education-related studies. Thirteen papers were analyzed, yielding important insights into the relationship between gamified physical activity and mental health. The findings indicate that gamified physical activity positively influences adolescents' mental health and well-being. Additionally, there is a need for improved application and game design to enhance learning within school contexts. Tailoring exergames to fit specific disciplines and school-related characteristics can promote healthier mobile application usage and offer significant benefits for the mental health of young individuals. The difference between this study and previous ones is that it focuses on mobile applications for encouraging active living to improve quality of life and mental health.

Design Features Associated With Engagement in Mobile Health Physical Activity Interventions Among Youth: Systematic Review of Qualitative and Quantitative Studies

BACKGROUND

Globally, 81% of youth do not meet the physical activity (PA) guidelines. Youth of families with a low socioeconomic position are less likely to meet the recommended PA guidelines. Mobile health (mHealth) interventions are preferred by youth over traditional in-person approaches and are in line with their media preferences. Despite the promise of mHealth interventions in promoting PA, a common challenge is to engage users in the long term or effectively. Earlier reviews highlighted the association of different design features (eg, notifications and rewards) with engagement among adults. However, little is known about which design features are important for increasing engagement among youth.

OBJECTIVE

To inform the design process of future mHealth tools, it is important to investigate the design features that can yield effective user engagement. This systematic review aimed to identify which design features are associated with engagement in mHealth PA interventions among youth who were aged between 4 and 18 years.

METHODS

A systematic search was conducted in EBSCOhost (MEDLINE, APA PsycINFO, and Psychology & Behavioral Sciences Collection) and Scopus. Qualitative and quantitative studies were included if they documented design features associated with engagement. Design features and related behavior change techniques and engagement measures were extracted. Study quality was assessed according to the Mixed Method Assessment Tool, and one-third of all screening and data extraction were double coded by a second reviewer.

RESULTS

Studies (n=21) showed that various features were associated with engagement, such as a clear interface, rewards, multiplayer game mode, social interaction, variety of challenges with personalized difficulty level, self-monitoring, and variety of customization options among others, including self-set goals, personalized feedback, progress, and a narrative. In contrast, various features need to be carefully considered while designing mHealth PA interventions, such as sounds, competition, instructions, notifications, virtual maps, or self-monitoring, facilitated by manual input. In addition, technical functionality can be considered as a prerequisite for engagement. Research addressing youth from low socioeconomic position families is very limited with regard to engagement in mHealth apps.

CONCLUSIONS

Mismatches between different design features in terms of target group, study design, and content translation from behavior change techniques to design features are highlighted and set up in a design guideline and future research agenda.

TRIAL REGISTRATION

PROSPERO CRD42021254989; https://tinyurl.com/5n6ppz24.

The positive impact of gamification in imparting nutritional knowledge and combating childhood obesity: A systematic review on the recent solutions

Objective

This paper reviews the recent gamified interventions that focus on the dietary factor to explore the effectiveness of using gaming elements in combating the prevalence of childhood obesity.

Methods

Two electronic databases were searched (PubMed and ProQuest); to identify the relevant papers published between 2018 and 2021. The keywords that use to search the entire selected databases were gamification and obesity. There were no restrictions regarding the language. Two independent reviewers screened the titles, abstracts, and keywords for relevance.

Results

407 papers were identified initially, while only 18 articles met the inclusion criteria. Most of the included articles indicated the positive impact of gamification on changing children eating behaviors. This systematic review summarizes the theories followed in developing such interventions and suggests some other theories to use and follow. Moreover, we synthesized the main findings into six recommendations that would assist in combating the global concern regarding childhood obesity if IS/IT researchers and other implement them during the development of any IT intervention.

Conclusions

Using gamification and gaming elements in imparting nutritional knowledge to children and improving their eating habits and behaviors is considered effective generally. It provides them with the needed knowledge and promotes the acquisition of better habits within enjoyable environment.

Internet-based cognitive behavior therapy for eating disorders - Development and feasibility evaluation

BACKGROUND

Eating disorders (ED) are severe psychiatric conditions, characterized by decreased quality of life and high mortality. However, only a minority of patients with ED seek care and very few receive treatment. Internet-delivered cognitive behavioral therapy (ICBT) has the potential to increase access to evidence-based treatments.

AIMS

The aims of the present study were to (1) develop and evaluate the usability of an Internet-delivered guided self-help treatment based on Enhanced Cognitive Behavioral Therapy (ICBT-E) for patients with full or subthreshold bulimia nervosa (BN) or binge eating disorder (BED) with a user centered design process, and (2) to evaluate its feasibility and preliminary outcome in a clinical environment.

METHOD

The study was undertaken in two stages. In Stage I, a user-centered design approach was applied with iterative phases of prototype development and evaluation. Participants were eight clinicians and 30 individuals with current or previous history of ED. In Stage II, 41 patients with full or subthreshold BN or BED were recruited to a single-group open trial to evaluate the feasibility and preliminary outcome of ICBT-E. Primary outcome variables were diagnostic status and self-rated ED symptoms.

RESULTS

The user-centered design process was instrumental in the development of the ICBT-E, by contributing to improvements of the program and to the content being adapted to the needs and preferences of end-users. The overall usability of the program was found to be good. ICBT-E targets key maintaining factors in ED by introducing healthy eating patterns and addressing over-evaluation of weight and shape. The results indicate that ICBT-E, delivered in a clinical setting, is a feasible and promising treatment for full or subthreshold BN or BED, with a high level of acceptability observed and treatment completion of 73.2 %. Participation in ICBT-E was associated with significant symptom reductions in core ED symptomology, functional impairment as well as depressive symptoms, and the results were maintained at the 3-month follow-up.

CONCLUSIONS

ICBT-E was developed with end-users' preferences in mind, in accordance with the identified recommendations, and the program was perceived as usable by end-users. The study demonstrated the potential of ICBT-E, which marks a step forward in the effort to make powerful, empirically supported psychological interventions targeting ED more widely available and accessible.

Virtual prevention of eating disorders in children, adolescents, and emerging adults: a scoping review

BACKGROUND

During the COVID-19 pandemic, there was a necessity for eating disorder (ED) outpatient treatment to be delivered virtually. Given this transition, and the surge in new ED cases, there was an urgent need to investigate virtually delivered ED prevention programs. This review aimed to identify the available evidence on virtual ED prevention programs for children, adolescents, and emerging adults.

METHOD

Using scoping review methodology, seven databases were searched for studies published from January 2000 to April 2021 reporting on virtually delivered ED prevention interventions for children and adolescents (< 18 years) and emerging adults (18-25 years). Studies were excluded if they contained adults (> 25 years) and individuals with clinical ED diagnoses. Abstracts and full-text papers were reviewed independently by two reviewers. Data was extracted on study type, methodology, age, sample size, virtual intervention, outcomes, and results. In April 2022, we used a forward citation chaining process to identify any relevant articles from April 2021 to April 2022.

RESULTS

Of 5129 unique studies identified, 67 met eligibility criteria, which included asynchronous (n = 35) and synchronous (n = 18) internet-based programs, other e-technology including mobile apps (n = 3) and text messaging interventions (n = 1), computer-based programs (n = 6), and online caregiver interventions focused on child outcomes (n = 4). Few studies mainly included children and adolescents (n = 18), whereas the vast majority included emerging adults (n = 49). For children and adolescents, the most widely researched programs were Student Bodies and its adapted versions (n = 4), eBody Project (n = 2), and Parents Act Now (n = 2). For emerging adults, the most widely researched programs were Student Bodies and its adapted versions (n = 16), eBody Project (n = 6) and Expand Your Horizon (n = 4). These interventions were effective at reducing various symptoms and ED risk. Some studies demonstrated that virtual prevention intervention efficacy resembled in-person delivery.

CONCLUSION

Virtual prevention interventions for EDs can be effective, however more research is needed studying their impact on children and adolescents and on improving access for vulnerable groups. Additional efficacy studies are required, such as for text messaging and mobile app ED prevention interventions. Evidence-based recommendations for virtual ED prevention for children, adolescents, and emerging adults at-risk for EDs should be prioritized.

Digital Health Promotion and Prevention in Settings: Scoping Review

BACKGROUND

Digital technologies are increasingly integrating into people's daily living environments such as schools, sport clubs, and health care facilities. These settings play a crucial role for health promotion and prevention because they affect the health of their members, as the World Health Organization has declared. Implementing digital health promotion and prevention in settings offers the opportunity to reach specific target groups, lower the costs of implementation, and improve the health of the population. Currently, there is a lack of scientific evidence that reviews the research on digital health promotion and prevention in settings.

OBJECTIVE

This scoping review aims to provide an overview of research targeting digital health promotion and primary prevention in settings. It assesses the range of scientific literature regarding outcomes such as applied technology, targeted setting, and area of health promotion or prevention, as well as identifies research gaps.

METHODS

The scoping review was conducted following the Levac, Colquhoun, and O'Brien framework. We searched scientific databases and gray literature for articles on digital setting-based health promotion and prevention published from 2010 to January 2020. We included empirical and nonempirical publications in English or German and excluded secondary or tertiary prevention and health promotion at the workplace.

RESULTS

From 8888 records, the search resulted in 200 (2.25%) included publications. We identified a huge diversity of literature regarding digital setting-based health promotion and prevention. The variety of technology types extends from computer- and web-based programs to mobile devices (eg, smartphone apps) and telemonitoring devices (sensors). We found analog, digital, and blended settings in which digital health promotion and prevention takes place. The most frequent analog settings were schools (39/200, 19.5%) and neighborhoods or communities (24/200, 12%). Social media apps were also included because in some studies they were defined as a (digital) setting. They accounted for 31.5% (63/200) of the identified settings. The most commonly focused areas of health promotion and prevention were physical activity (81/200, 40.5%), nutrition (45/200, 22.5%), and sexual health (34/200, 17%). Most of the interventions combined several health promotion or prevention methods, including environmental change; providing information, social support, training, or incentives; and monitoring. Finally, we found that the articles mostly reported on behavioral rather than structural health promotion and prevention.

CONCLUSIONS

The research field of digital health promotion and prevention in settings is heterogeneous. At the same time, we identified research gaps regarding the absence of valid definitions of relevant terms (eg, digital settings) and the lack of literature on structural health promotion and prevention in settings. Therefore, it remains unclear how digital technologies can contribute to structural (or organizational) changes in settings. More research is needed to successfully implement digital technologies to achieve health promotion and prevention in settings.

Establishing a Working Definition of User Experience for eHealth Interventions of Self-reported User Experience Measures With eHealth Researchers and Adolescents: Scoping Review

BACKGROUND

Across eHealth intervention studies involving children, adolescents, and their parents, researchers have measured user experience to assist with intervention development, refinement, and evaluation. To date, no widely accepted definitions or measures of user experience exist to support a standardized approach for evaluation and comparison within or across interventions.

OBJECTIVE

We conduct a scoping review with subsequent Delphi consultation to identify how user experience is defined and measured in eHealth research studies, characterize the measurement tools used, and establish working definitions for domains of user experience that could be used in future eHealth evaluations.

METHODS

We systematically searched electronic databases for published and gray literature available from January 1, 2005, to April 11, 2019. We included studies assessing an eHealth intervention that targeted any health condition and was designed for use by children, adolescents, and their parents. eHealth interventions needed to be web-, computer-, or mobile-based, mediated by the internet with some degree of interactivity. We required studies to report the measurement of user experience as first-person experiences, involving cognitive and behavioral factors reported by intervention users. We appraised the quality of user experience measures in included studies using published criteria: well-established, approaching well-established, promising, or not yet established. We conducted a descriptive analysis of how user experience was defined and measured in each study. Review findings subsequently informed the survey questions used in the Delphi consultations with eHealth researchers and adolescent users for how user experience should be defined and measured.

RESULTS

Of the 8634 articles screened for eligibility, 129 articles and 1 erratum were included in the review. A total of 30 eHealth researchers and 27 adolescents participated in the Delphi consultations. On the basis of the literature and consultations, we proposed working definitions for 6 main user experience domains: acceptability, satisfaction, credibility, usability, user-reported adherence, and perceived impact. Although most studies incorporated a study-specific measure, we identified 10 well-established measures to quantify 5 of the 6 domains of user experience (all except for self-reported adherence). Our adolescent and researcher participants ranked perceived impact as one of the most important domains of user experience and usability as one of the least important domains. Rankings between adolescents and researchers diverged for other domains.

CONCLUSIONS

Findings highlight the various ways in which user experience has been defined and measured across studies and what aspects are most valued by researchers and adolescent users. We propose incorporating the working definitions and available measures of user experience to support consistent evaluation and reporting of outcomes across studies. Future studies can refine the definitions and measurement of user experience, explore how user experience relates to other eHealth outcomes, and inform the design and use of human-centered eHealth interventions.

Psychopathological Symptoms and Well-Being in Overweight and Underweight Adolescents: A Network Analysis

Overweight and underweight adolescents have an increased risk of psychological problems and reduced quality of life. We used a network analysis approach on a variety of psychopathology and well-being variables to identify central factors in these populations. The network analysis was conducted on data of 344 overweight adolescents (>90th BMI-percentile) and 423 underweight adolescents (<10th BMI-percentile) drawn from a large community sample (10-19 years) including behavioral and emotional problems (Youth Self-Report), eating disorder risk (SCOFF) and well-being variables (KIDSCREEN). Additionally, psychopathology and well-being scores of overweight and underweight individuals were compared with 1.560 normal weight adolescents. Compared to their normal weight peers, overweight adolescents showed elevated psychopathology and eating disorder risk as well as reduced well-being. Underweight adolescents reported increased levels of internalizing problems but no increased eating disorder risk or reduced well-being. The network analysis revealed that anxious/depressed mood and attention problems were the most central and interconnected nodes for both overweight and underweight subsamples. Among underweight individuals, social problems and socially withdrawn behavior additionally functioned as a bridge between other nodes in the network. The results support psychological interventions focusing on improving mood, coping with negative emotions and tackling inner tension.

Patient use of a self-monitoring app during eating disorder treatment: Naturalistic longitudinal cohort study

OBJECTIVE

To explore patients' use of the self-monitoring app Recovery Record during 26 weeks of naturalistic eating disorder treatment.

METHODS

Selected patient characteristics at baseline were explored as predictors of app use using linear regression. Patients were grouped according to diagnosis (anorexia versus bulimia), and mixed-effects analyses were used to explore differences in app use between diagnoses across four time periods (weeks 1-4; weeks 5-8; weeks 9-12; weeks 13-26).

RESULTS

Eighty-four patients were included of which 41 had anorexia and 43 had bulimia. The total number of logs varied greatly (mean (SD): 592 (628.50)), and patient app activity almost ceased at week 13. Increasing age and no previous eating disorder treatment predicted increased app activity (p = .007; p = .039, respectively). Patients with anorexia logged over four times more often than patients with bulimia in the last time period (median (CI): 4.27 (1.28;14.31); p = .018). Time predicted declining app use (all p ≤ .007).

CONCLUSION

Future research on long-term app engagement should investigate associations between patients' app use and changes in their eating disorder symptom severity over time.

A German version of the Caregiver Skills scale for caregivers of patients with anorexia nervosa

OBJECTIVE

To investigate acceptance, reliability, convergent validity, factor structure and sensitivity to change of a German translation of the Caregiver Skills (CASK) scale measuring skills related to caring for patients with eating disorders.

METHODS

Two hundred and thirty-three parents (76% female) of adolescent patients (mean age 15.1) with anorexia nervosa (AN) completed the 27 items of the CASK. We calculated item/scale characteristics, internal consistencies and bivariate correlations with other measures of caregiving burden. We evaluated goodness-of-fit of the 6-factor model using confirmatory factors analysis and explored the sensitivity to change following two skills-based trainings.

RESULTS

The fit of the 6-factor model was acceptable (Root Mean Square Error of Approximation: 0.077, Standard Root Mean Square Residual: 0.080). Cronbach's alpha was excellent for the total (.94) and acceptable for all subscales (0.73-0.85). The total CASK score was 68.04 (max. 100) showing relatively high self-rated caregiver skills. Non-completion rates of most items were low (<3%) indicating high acceptance. Convergent validity was found with measures of psychological distress, depression, anxiety and expressed emotion. The total score significantly increased following an 8-week workshop/online skills training (d = 0.70) and a 2-day multi-family intervention (d = 0.47).

DISCUSSION

The German CASK version is a useful instrument to assess caregiver skills in parents of patients with AN and to evaluate outcomes of skills-based trainings.

Engagement with a Web-Based Health Promotion Intervention among Vocational School Students: A Secondary User and Usage Analysis

Engagement with web-based interventions is both generally low and typically declining. Visits and revisits remain a challenge. Based on log data of a web-based cluster randomized controlled trial conducted in vocational schools, the present secondary analysis aimed to identify influencing factors on initially logging in to a health promotion platform among young adults and to examine the engagement over the course of an eight-week intervention. Data of 336 students (62.2% female, age span 18–25) from two intervention arms (web-based intervention and web-based intervention with an additional initial face-to-face contact) was included. Binary logistic regression and log-data visualization were performed. An additional initial face-to-face contact (odds ratio (OR) = 2.971, p = 0.005), female sex (OR = 2.237, p = 0.046) and the health-related skill “dealing with health information” (OR = 2.179, p = 0.030) significantly increased the likelihood of initially logging in. Other variables showed no influence. 16.6% of all potential users logged in at least once, of which 57.4% revisited the platform. Most logins were tracked at the beginning of the intervention and repeated engagement was low. To increase the engagement with web-based interventions, health-related skills should be fostered. In addition, a strategy could be to interlink comparable interventions in vocational schools more regularly with everyday teaching through multi-component interventions.

Usability Testing of an Interactive Dashboard for Surgical Quality Improvement in a Large Congenital Heart Center

BACKGROUND

Interactive data visualization and dashboards can be an effective way to explore meaningful patterns in large clinical data sets and to inform quality improvement initiatives. However, these interactive dashboards may have usability issues that undermine their effectiveness. These usability issues can be attributed to mismatched mental models between the designers and the users. Unfortunately, very few evaluation studies in visual analytics have specifically examined such mismatches between these two groups.

OBJECTIVES

We aimed to evaluate the usability of an interactive surgical dashboard and to seek opportunities for improvement. We also aimed to provide empirical evidence to demonstrate the mismatched mental models between the designers and the users of the dashboard.

METHODS

An interactive dashboard was developed in a large congenital heart center. This dashboard provides real-time, interactive access to clinical outcomes data for the surgical program. A mixed-method, two-phase study was conducted to collect user feedback. A group of designers (N = 3) and a purposeful sample of users (N = 12) were recruited. The qualitative data were analyzed thematically. The dashboards were compared using the System Usability Scale (SUS) and qualitative data.

RESULTS

The participating users gave an average SUS score of 82.9 on the new dashboard and 63.5 on the existing dashboard (p = 0.006). The participants achieved high task accuracy when using the new dashboard. The qualitative analysis revealed three opportunities for improvement. The data analysis and triangulation provided empirical evidence to the mismatched mental models.

CONCLUSION

We conducted a mixed-method usability study on an interactive surgical dashboard and identified areas of improvements. Our study design can be an effective and efficient way to evaluate visual analytics systems in health care. We encourage researchers and practitioners to conduct user-centered evaluation and implement education plans to mitigate potential usability challenges and increase user satisfaction and adoption.

Eating Disorders and Obesity: The Challenge for Our Times

Public health concerns largely have disregarded the important overlap between eating disorders and obesity. This Special Issue addresses this neglect and points to how progress can be made in preventing and treating both. Thirteen primary research papers, three reviews, and two commentaries comprise this Special Issue. Two commentaries set the scene, noting the need for an integrated approach to prevention and treatment. The empirical papers and reviews fall into four broad areas of research: first, an understanding of the neuroscience of eating behaviours and body weight; second, relationships between disordered eating and obesity risk; third, new and integrated approaches in treatment; and fourth, assessment. Collectively, the papers highlight progress in science, translational research, and future research directions.