Optimizing Child Nutrition Education With the Foodbot Factory Mobile Health App: Formative Evaluation and Analysis

"When you're hurt and you need serious help you call 999." Educating children about emergency services and appropriate use of 999: An evaluation study of the Blue Light Hub app

OBJECTIVES

In the face of unprecedented demand, the Welsh Ambulance Services University NHS Trust developed 'Blue Light Hub': a new app to educate primary school-aged children about emergency services. Our overarching aim was to examine the effectiveness of the app.

DESIGN

Primary school-aged children from three schools in South Wales, UK, played with the app for 2 hours over 2 weeks in class time. Children completed quizzes to assess their knowledge and awareness of, and confidence in engaging with, emergency services before and after using the app.

PARTICIPANTS

Our evaluation focused on N=393 children who completed both the pre-test and post-test quizzes. On average, children were 8-9 years old (median school year, Year 4); 47.8% were male and 50.9% were female.

RESULTS

After using the app, there was a significant increase in the proportion of children who knew of appropriate actions to take in non-emergency scenarios, χ2(1) = 26.01, and could provide a question a call handler would ask them if they called 999, χ2(1) = 13.79. There was also an increase in the proportion of children who could identify an National Health Service (NHS) service that could help them if they were unwell, χ2(1) = 33.31, name different roles in the NHS, χ2(1) = 12.80 and knew how dialling 111 could help them χ2(1) = 90.05 (all p values<0.001).

CONCLUSION

To our knowledge, Blue Light Hub is the first app of its kind designed to educate primary school-aged children about emergency services. Our findings provide preliminary evidence that the app supports children's knowledge and awareness of emergency services.

[Exploring Needs, Motivations, and Limitations Towards Healthy Eating and Digital Resources: A Qualitative Study in a Mexican Primary Education Setting]

OBJECTIVE

To explore the needs, motivations, and limitations related to healthy eating and digital materials, as well as to identify patterns for their design as a strategy aimed at Mexican families.

DESIGN

A qualitative observational study of the phenomenon through focus group sessions.

LOCATION

A public primary education center in the city of Querétaro, Mexico.

PARTICIPANTS

Children aged 9 to 11 years and parents, mothers, or caregivers with children in primary education.

METHOD

Twelve sessions were conducted with three groups of students and two sessions with parents, mothers, or caregivers using an interview guide. Various digital materials, developed based on social cognitive theory, were presented during the sessions. The sessions were recorded with the participants' or their guardians' prior consent and transcribed for analysis. Coding was performed for key points of analysis, and information saturation was confirmed.

RESULTS

Students expressed motivation towards digital material that promotes play and experimentation, especially within the family context. The main perceived barrier was the caregivers' resistance to change. Parents expressed motivation and a need for explanatory material on diseases, with economic and time-related barriers.

CONCLUSIONS

Digital material based on social cognitive theory, designed to improve nutrition, can be an effective strategy in nutritional education if it considers the circumstances of the target population. It is advisable to include affective and behavioral elements to achieve meaningful learning within households.

Updating the Foodbot Factory serious game with new interactive engaging features and enhanced educational content

Serious games (i.e., digital games designed for educational purposes) can foster positive learning attitudes and are increasingly used as educational tools. Foodbot Factory is a serious game application (app) that helps children learn about healthy eating based on Canada's Food Guide principles and has demonstrated to increase nutrition knowledge among this group. This paper describes the process followed to expand Foodbot Factory's educational content and integrate immersive technologies and innovative features into the app. The revision process, which was guided by the Obesity-Related Behavioral Intervention Trials model, included the following phases: first, an interdisciplinary team of nutrition scientists, education experts, and computer scientists analyzed data from the original pilot study, recently published literature, and feedback from stakeholders to define areas to improve Foodbot Factory. The five original Foodbot Factory modules were evaluated by the team during weekly meetings, where the educational content, interactive features, and other elements that required updates (e.g., aesthetics and accessibility) were identified. Second, prototypes were created and refined until a final version of Foodbot Factory was approved. Nineteen children tested the updated Foodbot Factory and found it "easy to use" (89%) and "fun" (95%). The new version of Foodbot Factory contains 19 learning objectives, including 13 original and six new objectives. Interactive engagement features in the updated Foodbot Factory included augmented reality incorporated into two learning modules; new mini-games were created, including a memory game; an overhaul of the aesthetics; (e.g., new food images); and accessibility features were included to support users with cognitive and vision disabilities.

Using Games to Promote Healthy Behavior in Children: A Narrative Review

BACKGROUND: Games are a fairly effective method to overcome public health problems, especially in children. AIM: This study aims to review the use of games to promote healthy behavior in children. METHODS: The method used is to search for literature published in PubMed in 2017–2021. Search using the keywords: Games, intervention, children, health, and behavior. Based on the search, 452 articles were found. Then, the articles are selected based on inclusion criteria, which are open-access articles, original research, and addressing behavioral problems related to public health. RESULTS: Based on the inclusion criteria, 18 articles were selected to be analyzed. The 18 articles discussed the use of games to overcome health behavior problems in children. In detail, there are three articles on mental health, eight articles on nutritional behavior, four articles on physical and sedentary activity, one article on dental health, and two articles on hand washing practices. CONCLUSION: The game method is mostly used to shape nutritional behavior. There are still few articles that discuss clean living behaviors, such as waste management. So that research is needed that looks at the effectiveness of the game method to shape waste management behavior in children.

Usability evaluation and Compatibility test of digital self-management support system for children with cancer and their caregivers: using cloud automation testing platform (Preprint)

BACKGROUND

Despite the increasing development of different smartphone apps in the health care domain, most of these apps lack proper evaluation. In fact, with the rapid development of smartphones and wireless communication infrastructure, many health care systems around the world are using these apps to provide health services for people without sufficient scientific efforts to design, develop, and evaluate them.

OBJECTIVE

The objective of this study was to evaluate the usability of CanSelfMan, a self-management app that provides access to reliable information to improve communication between health care providers and children with cancer and their parents/caregivers, facilitating remote monitoring and promoting medication adherence.

METHODS

We performed debugging and compatibility tests in a simulated environment to identify possible errors. Then, at the end of the 3-week period of using the app, children with cancer and their parents/caregivers filled out the User Experience Questionnaire (UEQ) to evaluate the usability of the CanSelfMan app and their level of user satisfaction.

RESULTS

During the 3 weeks of CanSelfMan use, 270 cases of symptom evaluation and 194 questions were recorded in the system by children and their parents/caregivers and answered by oncologists. After the end of the 3 weeks, 44 users completed the standard UEQ user experience questionnaire. According to the children's evaluations, attractiveness (mean 1.956, SD 0.547) and efficiency (mean 1.934, SD 0.499) achieved the best mean results compared with novelty (mean 1.711, SD 0.481). Parents/caregivers rated efficiency at a mean of 1.880 (SD 0.316) and attractiveness at a mean of 1.853 (SD 0.331). The lowest mean score was reported for novelty (mean 1.670, SD 0.225).

CONCLUSIONS

In this study, we describe the evaluation process of a self-management system to support children with cancer and their families. Based on the feedback and scores obtained from the usability evaluation, it seems that the children and their parents find CanSelfMan to be an interesting and practical idea to provide reliable and updated information on cancer and help them manage the complications of this disease.

Serious games and eating behaviors: A systematic review of the last 5 years (2018–2022)

Background

Serious game intervention has emerged over the years as a popular strategy for solving the problem of unhealthy eating behavior. This has prompted several scholars to explore its significant impact on eating behaviors, identifying its positive effect on nutritional knowledge and eating behaviors. However, since this research field is yet nascent, an update in knowledge is required to further inform the real-world practice as an alternative intervention for instating healthy eating behavior. Therefore, this current research utilized a systematic review method to reveal the latest state of this concept of a serious game and eating behavior, to identify the position of the literature and shed light on under-researched and emerging areas by recommending future investigations.

Method

To achieve the object of this research, four electronic databases- Science Direct, Web of Science (WoS), APA PsyclNFO, and Emerald- were searched using predefined keywords (search string) relating to the review topic. A total of 15,107 results were retrieved from the databases. After title, abstract, and full-text screening, 15 studies were included following inclusion criteria.

Key findings

The result of this research demonstrated that various designs of serious games comprise an effective intervention for changing eating behavior in both children and adults and addressed the risks of childhood obesity and overweight. The findings also show that the design of the games is co-designed by different specialists such as a nutritionist, psychologist and developer, among others, as either single or multiple players. The effectiveness of the games was attributed to behavior techniques (BT), cognitive theories (CT), and socio-cognitive theories (SCT) of behavior change technique (BCT), incorporating an element of implicit learning in serious games. Feedback and reward were the most reported influencing strategies and self-reporting the evaluation approach.

Conclusion

This research contributed significantly to the body of knowledge in the field of serious games as the most recent review of evidence in the research area. Evidence from 93.33% of the included studies confirmed the effectiveness of serious games in addressing eating behavior. This study concludes that serious games are an effective intervention for improving healthy eating behavior and decreasing unhealthy eating behavior and that various elements of behavior change techniques are essential components of implicit nutritional learning through the games. In addition, it is concluded that the risk of childhood obesity and overweight can be reduced or prevented by leveraging the strength of these games. The need for future research in this field was also pointed out by this study.

The Content, Quality, and Behavior Change Techniques in Nutrition-Themed Mobile Apps for Children in Canada: App Review and Evaluation Study

Background

Children increasingly use mobile apps. Strategies to increase child engagement with apps include the use of gamification and images that incite fun and interaction, such as food. However, the foods and beverages that children are exposed to while using apps are unknown and may vary by app type.

Objective

The aim of this study is to identify the app content (ie, types of foods and beverages) included in nutrition-themed apps intended for children, to assess the use of game-like features, and to examine app characteristics such as overall quality and behavior change techniques (BCTs).

Methods

This analysis used a cross-sectional database of nutrition-themed apps intended for children (≤12 years), collected between May 2018 and June 2019 from the Apple App Store and Google Play Store (n=259). Apps were classified into four types: food games or nongames that included didactic nutrition guides, habit trackers, and other. Food and beverages were identified in apps and classified into 16 food categories, as recommended (8/16, 50%) and as not recommended (8/16, 50%) by dietary guidelines, and quantified by app type. Binomial logistic regression assessed whether game apps were associated with foods and beverages not recommended by guidelines. App quality, overall and by subscales, was determined using the Mobile App Rating Scale. The BCT Taxonomy was used to classify the different behavioral techniques that were identified in a subsample of apps (124/259, 47.9%).

Results

A total of 259 apps displayed a median of 6 (IQR 3) foods and beverages. Moreover, 62.5% (162/259) of apps were classified as food games, 27.4% (71/259) as didactic nutrition guides, 6.6% (17/259) as habit trackers, and 3.5% (9/259) as other. Most apps (198/259, 76.4%) displayed at least one food or beverage that was not recommended by the dietary guidelines. Food game apps were almost 3 times more likely to display food and beverages not recommended by the guidelines compared with nongame apps (β=2.8; P<.001). The overall app quality was moderate, with a median Mobile App Rating Scale score of 3.6 (IQR 0.7). Functionality was the subscale with the highest score (median 4, IQR 0.3). Nutrition guides were more likely to be educational and contain informative content on healthy eating (score 3.7), compared with the other app types, although they also scored significantly lower in engagement (score 2.3). Most apps (105/124, 84.7%) displayed at least one BCT, with the most common BCT being information about health consequences.

Conclusions

Findings suggest nutrition-themed apps intended for children displayed food and beverage content not recommended by dietary guidelines, with gaming apps more likely to display not recommended foods than their nongame counterparts. Many apps have a moderate app quality, and the use of consequences (instead of rewards) was the most common BCT.

Early Development of a Virtual Coach for Healthy Coping Interventions in Type 2 Diabetes Mellitus: Validation Study

Background

Mobile health solutions aimed at monitoring tasks among people with diabetes mellitus (DM) have been broadly applied. However, virtual coaches (VCs), embedded or not in mobile health, are considered valuable means of improving patients’ health-related quality of life and ensuring adherence to self-care recommendations in diabetes management. Despite the growing need for effective, healthy coping digital interventions to support patients’ self-care and self-management, the design of psychological digital interventions that are acceptable, usable, and engaging for the target users still represents the main challenge, especially from a psychosocial perspective.

Objective

This study primarily aims to test VC interventions based on psychoeducational and counseling approaches to support and promote healthy coping behaviors in adults with DM. As a preliminary study, university students have participated in it and have played the standardized patients’ (SPs) role with the aim of improving the quality of the intervention protocol in terms of user acceptability, experience, and engagement. The accuracy of users’ role-playing is further analyzed.

Methods

This preliminary study is based on the Obesity-Related Behavioral Intervention Trial model, with a specific focus on its early phases. The healthy coping intervention protocol was initially designed together with a team of psychologists following the main guidelines and recommendations for psychoeducational interventions for healthy coping in the context of DM. The protocol was refined with the support of 3 experts in the design of behavioral intervention technologies for mental health and well-being, who role-played 3 SPs’ profiles receiving the virtual coaching intervention in a Wizard of Oz setting via WhatsApp. A refined version of the healthy coping protocol was then iteratively tested with a sample of 18 university students (mean age 23.61, SD 1.975 years) in a slightly different Wizard of Oz evaluation setting. Participants provided quantitative and qualitative postintervention feedback by reporting their experiences with the VC. Clustering techniques on the logged interactions and dialogs between the VC and users were collected and analyzed to identify additional refinements for future VC development.

Results

Both quantitative and qualitative analyses showed that the digital healthy coping intervention was perceived as supportive, motivating, and able to trigger self-reflection on coping strategies. Analyses of the logged dialogs showed that most of the participants accurately played the SPs’ profile assigned, confirming the validity and usefulness of this testing approach in preliminary assessments of behavioral digital interventions and protocols.

Conclusions

This study outlined an original approach to the early development and iterative testing of digital healthy coping interventions for type 2 DM. Indeed, the intervention was well-accepted and proved its effectiveness in the definition and refinement of the initial protocol and of the user experience with a VC before directly involving real patients in its subsequent use and testing.

Conceptual Ambiguity Surrounding Gamification and Serious Games in Health Care: Literature Review and Development of Game-Based Intervention Reporting Guidelines (GAMING)

BACKGROUND

In health care, the use of game-based interventions to increase motivation, engagement, and overall sustainability of health behaviors is steadily becoming more common. The most prevalent types of game-based interventions in health care research are gamification and serious games. Various researchers have discussed substantial conceptual differences between these 2 concepts, supported by empirical studies showing differences in the effects on specific health behaviors. However, researchers also frequently report cases in which terms related to these 2 concepts are used ambiguously or even interchangeably. It remains unclear to what extent existing health care research explicitly distinguishes between gamification and serious games and whether it draws on existing conceptual considerations to do so.

OBJECTIVE

This study aims to address this lack of knowledge by capturing the current state of conceptualizations of gamification and serious games in health care research. Furthermore, we aim to provide tools for researchers to disambiguate the reporting of game-based interventions.

METHODS

We used a 2-step research approach. First, we conducted a systematic literature review of 206 studies, published in the Journal of Medical Internet Research and its sister journals, containing terms related to gamification, serious games, or both. We analyzed their conceptualizations of gamification and serious games, as well as the distinctions between the two concepts. Second, based on the literature review findings, we developed a set of guidelines for researchers reporting on game-based interventions and evaluated them with a group of 9 experts from the field.

RESULTS

Our results show that less than half of the concept mentions are accompanied by an explicit definition. To distinguish between the 2 concepts, we identified four common approaches: implicit distinction, synonymous use of terms, serious games as a type of gamified system, and distinction based on the full game dimension. Our Game-Based Intervention Reporting Guidelines (GAMING) consist of 25 items grouped into four topics: conceptual focus, contribution, mindfulness about related concepts, and individual concept definitions.

CONCLUSIONS

Conceptualizations of gamification and serious games in health care literature are strongly heterogeneous, leading to conceptual ambiguity. Following the GAMING can support authors in rigorous reporting on study results of game-based interventions.

Development and Pilot Testing of a Nutrition Attitudes and Knowledge Questionnaire to Measure Changes of Child Nutrition Knowledge related to the Canada's Food Guide

Foodbot Factory is a serious game developed to teach children about the 2019 Canada's Food Guide (CFG) healthy eating principles. Because no measurement tools existed to assess changes in children's knowledge of the CFG, the Nutrition Attitudes and Knowledge (NAK) questionnaire was developed for this purpose. The NAK is based on the 2019 CFG nutrition content and aligned with the Foodbot Factory modules (Drinks, Whole Grain foods, Vegetables and Fruit, Protein foods). Seven experts assessed face and content validity of the draft NAK questionnaire. Three sections were deemed valid, while the remaining two required minor revisions. The NAK was pilot tested for changes in nutrition attitudes and knowledge among children 9-10 years-old (n=23), who answered the NAK questionnaire before and after using Foodbot Factory. Significant increases were found in overall nutrition knowledge, and knowledge of Whole Grain foods, Vegetables and Fruit and Protein foods. Knowledge of Drinks and nutrition attitudes remained unchanged. The NAK showed a moderate reliability when tested among a group of children (n=23). While the NAK questionnaire is a promising tool for assessing changes nutrition knowledge related to the 2019 CFG guidelines in children, further research is required to test construct validity of this instrument. Novelty bullets: • The Nutrition Attitudes and Knowledge (NAK) questionnaire was developed by educators and dietitians. • The NAK underwent face and content validity assessments and was pilot tested among children. • The NAK questionnaire is a potential tool to detect changes in children's knowledge of the 2019 Canada's Food Guide.

The Effectiveness of the Foodbot Factory Mobile Serious Game on Increasing Nutrition Knowledge in Children

The interactive and engaging nature of serious games (i.e., video games designed for educational purposes) enables deeper learning and facilitates behavior change; however, most do not specifically support the dissemination of national dietary guidelines, and there are limited data on their impact on child nutrition knowledge. The Foodbot Factory serious game mobile application was developed to support school children in learning about Canada's Food Guide; however, its impacts on nutrition knowledge have not been evaluated. The objective of this study was to determine if Foodbot Factory effectively improves children's knowledge of Canada's Food Guide, compared to a control group (control app). This study was a single-blinded, parallel, randomized controlled pilot study conducted among children ages 8-10 years attending Ontario Tech University day camps. Compared to the control group (n = 34), children who used Foodbot Factory (n = 39) had significant increases in overall nutrition knowledge (10.3 ± 2.9 to 13.5 ± 3.8 versus 10.2 ± 3.1 to 10.4 ± 3.2, p < 0.001), and in Vegetables and Fruits (p < 0.001), Protein Foods (p < 0.001), and Whole Grain Foods (p = 0.040) sub-scores. No significant difference in knowledge was observed in the Drinks sub-score. Foodbot Factory has the potential to be an effective educational tool to support children in learning about nutrition.