Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based Ecological Momentary Assessment tool

Design of a Mobile App for Nutrition Education (TreC-LifeStyle) and Formative Evaluation With Families of Overweight Children

BACKGROUND

Nutrition and diet apps represent today a popular area of mobile health (mHealth), offering the possibility of delivering behavior change (BC) interventions for healthy eating and weight management in a scalable and cost-effective way. However, if commercial apps for pediatric weight management fail to retain users because of a lack of theoretical background and evidence-based content, mHealth apps that are more evidence-based are found less engaging and popular among consumers. Approaching the apps development process from a multidisciplinary and user-centered design (UCD) perspective is likely to help overcome these limitations, raising the chances for an easier adoption and integration of nutrition education apps within primary care interventions.

OBJECTIVE

The aim of this study was to describe the design and development of the TreC-LifeStyle nutrition education app and the results of a formative evaluation with families.

METHODS

The design of the nutrition education intervention was based on a multidisciplinary UCD approach, involving a team of BC experts, working with 2 nutritionists and 3 pediatricians from a primary care center. The app content was derived from evidence-based knowledge founded on the Food Pyramid and Mediterranean Diet guidelines used by pediatricians in primary care. A formative evaluation of the TreC-LifeStyle app involved 6 families of overweight children (aged 7-12 years) self-reporting daily food intake of children for 6 weeks and providing feedback on the user experience with the mHealth intervention. Analysis of the app's usage patterns during the intervention and of participants' feedback informed the refinement of the app design and a tuning of the nutrition education strategies to improve user engagement and compliance with the intervention.

RESULTS

Design sessions with the contribution of pediatricians and nutritionists helped define the nutrition education app and intervention, providing an effective human and virtual coaching approach to raise parents' awareness about children's eating behavior and lifestyle. The 6 families participating in the pilot study found the app usable and showed high compliance with the intervention over the 6 weeks, but analysis of their interaction and feedback showed the need for improving some of the app features related to the BC techniques "monitoring of the behavior" and "information provision."

CONCLUSIONS

The UCD and formative evaluation of TreC-LifeStyle show that nutrition education apps are feasible and acceptable solutions to support health promotion interventions in primary care.

Factors important for women who breastfeed in public: a content analysis of review data from FeedFinder

OBJECTIVE

To examine how the breastfeeding experience is represented by users of FeedFinder (a mobile phone application for finding, reviewing and sharing places to breastfeed in public).

DESIGN

Content analysis using FeedFinder database.

SETTING

FeedFinder, UK, September 2013-June 2015.

METHODS

Reviews obtained through FeedFinder over a period of 21 months were systematically coded using a conventional content analysis approach, average review scores were calculated for the rating criteria in FeedFinder (comfort, hygiene, privacy, baby facilities) and review texts were analysed for sentiment. We used data from Foursquare to describe the type of venues visited and cross-referenced the location of venues with the Indices of Multiple Deprivation.

RESULTS

A total of 1757 reviews were analysed. Of all the reviews obtained, 80% of those were classified as positive, 15.4% were classified as neutral and 4.3% were classified as negative. Important factors that were discussed by women include facilities, service, level of privacy available and qualities of a venue. The majority of venues were classified as cafes (26.4%), shops (24.4%) and pubs (13.4%). Data on IMD were available for 1229 venues mapped within FeedFinder, 23% were located within the most deprived quintile and 16% were located in the least deprived quintile.

CONCLUSIONS

Women create content that is positive and informative when describing their breastfeeding experience in public. Public health bodies and business owners have the potential to use the data from FeedFinder to impact on service provision. Further work is needed to explore the demographic differences that may help to tailor public health interventions aimed at increasing breastfeeding rates in the UK.

Evaluation of a Serious Self-Regulation Game Intervention for Overweight-Related Behaviors ("Balance It"): A Pilot Study

Background

Serious games have the potential to promote health behavior. Because overweight is still a major issue among secondary vocational education students in the Netherlands, this study piloted the effects of “Balance It,” a serious self-regulation game intervention targeting students’ overweight-related behaviors: dietary intake and physical activity (PA).

Objective

We aimed to pilot the effects of Balance It on secondary vocational education students’ dietary intake and PA.

Methods

In total, 501 secondary vocational education students participated at baseline (intervention: n=250; control: n=251) in this pre-post cluster randomized trial. After 4 weeks, at immediate posttest, 231 students filled in the posttest questionnaire (intervention: n=105; control: n=126). The sample had a mean age of 17.28 (SD 1.26, range 15-21) years, 62.8% (145/231) were female, and 26.8% (62/231) had a non-Dutch background. Body mass index (BMI kg/m²) ranged from 14.4 to 31.1 (mean 21.1, SD 3.3). The intervention and control groups were compared on the primary (behavioral) outcomes of dietary intake (fruit and vegetable consumption, snack consumption, and soft drink consumption) and PA (moderate and vigorous). Additionally, we explored (1) differences between the intervention and control groups in determinants of dietary intake and PA, including attitude, self-efficacy, intention, barrier identification, action planning, and action control, and (2) differences between active (intervention) users and the control group in dietary intake, PA, and associated determinants.

Results

After corrections for multiple testing, we did not find significant differences between the intervention group and control group in terms of dietary intake, PA, and determinants of dietary intake and PA. Exploratory research indicated that only 27.6% (29/105) of the intervention group reported actual intervention use (ie, active users). For exploratory reasons, we compared the active users (n=29) with the control group (n=124) and corrected for multiple testing. Results showed that active users’ snack consumption decreased more strongly (active users: mean change=–0.20; control group: mean change=–0.08; beta=–0.36, P=.01, R² change=.05), and their use of active transport had a stronger increase (active users: mean change=0.92; control group=–0.12; beta=1.58, P=.02, R² change=.03) than the control group. Results also revealed significant differences in action planning (active users: mean change=0.42; control group: mean change=0.07; beta=0.91, P=.01, R² change=.04) and action control (active users: mean change=0.63; control group: mean change=–0.05; beta=1.25, P=.001, R² change=.08) in terms of unhealthy eating.

Conclusions

The Balance It intervention did not show favorable effects on dietary intake and PA compared to the control condition. However, only a small number of people in the intervention condition actually used Balance It (27.6%). Exploratory analyses did suggest that, if used as planned, Balance It could contribute to changing dietary intake and PA behaviors, albeit it remains debatable whether this would be sufficient to prevent overweight.

Ecologic Momentary Assessment: Perspectives on Applications and Opportunities in Research and Practice Regarding Nutrition Behaviors

Retrospective self-reported data have limitations, making it important to evaluate alternative forms of measurement for nutrition behaviors. Ecological momentary assessment (EMA) attempts to overcome the challenges of recalled data with real-time data collection in a subject's natural environment, often leveraging technology. This perspective piece 1) introduces the concepts and terminology of EMA, 2) provides an overview of the methodological and analytical considerations, 3) gives examples of past research using EMA, and 4) suggests new opportunities (including combining assessment and intervention) and limitations (including the need for technology) for the application of EMA to research and practice regarding nutrition behaviors.

Taking mHealth Forward: Examining the Core Characteristics

The emergence of mobile health (mHealth) offers unique and varied opportunities to address some of the most difficult problems of health. Some of the most promising and active efforts of mHealth involve the engagement of mobile phone technology. As this technology has spread and as this technology is still evolving, we begin a conversation about the core characteristics of mHealth relevant to any mobile phone platform. We assert that the relevance of these characteristics to mHealth will endure as the technology advances, so an understanding of these characteristics is essential to the design, implementation, and adoption of mHealth-based solutions. The core characteristics we discuss are (1) the penetration or adoption into populations, (2) the availability and form of apps, (3) the availability and form of wireless broadband access to the Internet, and (4) the tethering of the device to individuals. These collectively act to both enable and constrain the provision of population health in general, as well as personalized and precision individual health in particular.

A Mobile Ecological Momentary Assessment Tool (devilSPARC) for Nutrition and Physical Activity Behaviors in College Students: A Validation Study

BACKGROUND

The majority of nutrition and physical activity assessments methods commonly used in scientific research are subject to recall and social desirability biases, which result in over- or under-reporting of behaviors. Real-time mobile-based ecological momentary assessments (mEMAs) may result in decreased measurement biases and minimize participant burden.

OBJECTIVE

The aim was to examine the validity of a mEMA methodology to assess dietary and physical activity levels compared to 24-hour dietary recalls and accelerometers.

METHODS

This study was a pilot test of the SPARC (Social impact of Physical Activity and nutRition in College) study, which aimed to determine the mechanism by which friendship networks impact weight-related behaviors among young people. An mEMA app, devilSPARC, was developed to assess weight-related behaviors in real time. A diverse sample of 109 freshmen and community mentors attending a large southwestern university downloaded the devilSPARC mEMA app onto their personal mobile phones. Participants were prompted randomly eight times per day over the course of 4 days to complete mEMAs. During the same 4-day period, participants completed up to three 24-hour dietary recalls and/or 4 days of accelerometry. Self-reported mEMA responses were compared to 24-hour dietary recalls and accelerometry measures using comparison statistics, such as match rate, sensitivity and specificity, and mixed model odds ratios, adjusted for within-person correlation among repeated measurements.

RESULTS

At the day level, total dietary intake data reported through the mEMA app reflected eating choices also captured by the 24-hour recall. Entrées had the lowest match rate, and fruits and vegetables had the highest match rate. Widening the window of aggregation of 24-hour dietary recall data on either side of the mEMA response resulted in increased specificity and decreased sensitivity. For physical activity behaviors, levels of activity reported through mEMA differed for sedentary versus non-sedentary activity at the day level as measured by accelerometers.

CONCLUSIONS

The devilSPARC mEMA app is valid for assessing eating behaviors and the presence of sedentary activity at the day level. This mEMA may be useful in studies examining real-time weight-related behaviors.

A Systematic Review of Methods and Procedures Used in Ecological Momentary Assessments of Diet and Physical Activity Research in Youth: An Adapted STROBE Checklist for Reporting EMA Studies (CREMAS)

BACKGROUND

Ecological momentary assessment (EMA) is a method of collecting real-time data based on careful timing, repeated measures, and observations that take place in a participant's typical environment. Due to methodological advantages and rapid advancement in mobile technologies in recent years, more studies have adopted EMA in addressing topics of nutrition and physical activity in youth.

OBJECTIVE

The aim of this systematic review is to describe EMA methodology that has been used in studies addressing nutrition and physical activity in youth and provide a comprehensive checklist for reporting EMA studies.

METHODS

Thirteen studies were reviewed and analyzed for the following 5 areas of EMA methodology: (1) sampling and measures, (2) schedule, (3) technology and administration, (4) prompting strategy, and (5) response and compliance.

RESULTS

Results of this review showed a wide variability in the design and reporting of EMA studies in nutrition and physical activity among youth. The majority of studies (69%) monitored their participants during one period of time, although the monitoring period ranged from 4 to 14 days, and EMA surveys ranged from 2 to 68 times per day. More than half (54%) of the studies employed some type of electronic technology. Most (85%) of the studies used interval-contingent prompting strategy. For studies that utilized electronic devices with interval-contingent prompting strategy, none reported the actual number of EMA prompts received by participants out of the intended number of prompts. About half (46%) of the studies failed to report information about EMA compliance rates. For those who reported, compliance rates ranged from 44-96%, with an average of 71%.

CONCLUSIONS

Findings from this review suggest that in order to identify best practices for EMA methodology in nutrition and physical activity research among youth, more standardized EMA reporting is needed. Missing the key information about EMA design features and participant compliance might lead to misinterpretation of results. Future nutrition and physical activity EMA studies need to be more rigorous and thorough in descriptions of methodology and results. A reporting checklist was developed with the goal of enhancing reliability, efficacy, and overall interpretation of the findings for future studies that use EMAs.

Usability in telemedicine systems-A literature survey

INTRODUCTION

The rapid development of sensors and communication technologies enable the growth of new innovative services in healthcare, such as Telemedicine. An essential ingredient in the development of a telemedicine system and its final acceptance by end users are usability studies. The principles of usability engineering, evaluations and telemedicine are well established, and it may contribute to the adoption and eventually deployment of such systems and services. An in-depth usability analysis, including performance and attitude measures, requires knowledge about available usability techniques, and is depending on the amount of resources. Therefore it is worth investigating how usability methods are applied in developing telemedicine systems. Our hypothesis is: with increasing research and development of telemedicine systems, we expect that various usability methods are more equally employed for different end-user groups and applications.

METHOD

A literature survey was conducted to find telemedicine systems that have been evaluated for usability or ease of use. The elements of the PICO framework were used as a basis for the selection criteria in the literature search. The search was not limited by year. Two independent reviewers screened all search results first by title, and then by abstract for inclusion. Articles were included up to May 2015.

RESULTS

In total, 127 publications were included in this survey. The number of publications on telemedicine systems significantly increased after 2008. Older adults and end-users with cardiovascular conditions were among largest target end-user groups. Remote monitoring systems were found the most, in 90 publications. Questionnaires are the most common means for evaluating telemedicine systems, and were found in 88 publications. Questionnaires are used frequently in studies focusing on cardiovascular diseases, Parkinson's disease and older adult conditions. Interviews are found the most in publications related to stroke. In total 71% of the publications were trial-orientated and the remaining process orientated. An increase in telemedicine research, development and applications is found worldwide, with the majority of publications conducted in America.

DISCUSSION AND CONCLUSION

Monitoring patients in their homes can lead to better healthcare at lower costs which implies an increased demand of new healthcare strategies like telemedicine. We expected that with the increase in telemedicine research and development, a greater range of usability methods would also be employed in the included publications. This is not the case. Researchers employed questionnaires as a preferred usability method for each type of telemedicine system and most end-users. However, in process-orientated studies a greater range of usability evaluations were applied, with fewer differences found in the amount of publications for each evaluation method. Questionnaires enable researchers to evaluate a system quickly on end users, as it requires less expertise on the evaluation method compared to the other methods. They are easily distributed and are customizable. The use of questionnaires is therefore an evaluation method of choice for a variety of telemedicine systems and end-users.

Ecological Momentary Assessment in Eating Disorder and Obesity Research: a Review of the Recent Literature

Our current understanding of the etiology and maintenance of eating disorders and obesity continues to be far from complete. Similarly, our understanding of determinants of both successful and unsuccessful weight loss surgery is also quite limited. While a number of research methodologies have been applied to these areas, one methodology that has recently seen a rise in popularity is the use of ecological momentary assessment (EMA). EMA allows one to study a variety of variables of interest in the natural environment. The study of eating disorders, obesity, and bariatric surgery has all been conducted using EMA recently. The current study is a review of these areas and summarizes the recent literature (past 3 years) in eating disorders, obesity, and bariatric surgery using EMA methodology.

Technologies That Assess the Location of Physical Activity and Sedentary Behavior: A Systematic Review

Background

The location in which physical activity and sedentary behavior are performed can provide valuable behavioral information, both in isolation and synergistically with other areas of physical activity and sedentary behavior research. Global positioning systems (GPS) have been used in physical activity research to identify outdoor location; however, while GPS can receive signals in certain indoor environments, it is not able to provide room- or subroom-level location. On average, adults spend a high proportion of their time indoors. A measure of indoor location would, therefore, provide valuable behavioral information.

Objective

This systematic review sought to identify and critique technology which has been or could be used to assess the location of physical activity and sedentary behavior.

Methods

To identify published research papers, four electronic databases were searched using key terms built around behavior, technology, and location. To be eligible for inclusion, papers were required to be published in English and describe a wearable or portable technology or device capable of measuring location. Searches were performed up to February 4, 2015. This was supplemented by backward and forward reference searching. In an attempt to include novel devices which may not yet have made their way into the published research, searches were also performed using three Internet search engines. Specialized software was used to download search results and thus mitigate the potential pitfalls of changing search algorithms.

Results

A total of 188 research papers met the inclusion criteria. Global positioning systems were the most widely used location technology in the published research, followed by wearable cameras, and radio-frequency identification. Internet search engines identified 81 global positioning systems, 35 real-time locating systems, and 21 wearable cameras. Real-time locating systems determine the indoor location of a wearable tag via the known location of reference nodes. Although the type of reference node and location determination method varies between manufacturers, Wi-Fi appears to be the most popular method.

Conclusions

The addition of location information to existing measures of physical activity and sedentary behavior will provide important behavioral information.

What features do Dutch university students prefer in a smartphone application for promotion of physical activity? A qualitative approach

BACKGROUND

The transition from adolescence to early adulthood is a critical period in which there is a decline in physical activity (PA). College and university students make up a large segment of this age group. Smartphones may be used to promote and support PA. The purpose of this qualitative study was to explore Dutch students' preferences regarding a PA application (PA app) for smartphones.

METHODS

Thirty Dutch students (aged 18-25 years) used a PA app for three weeks and subsequently attended a focus group discussion (k = 5). To streamline the discussion, a discussion guide was developed covering seven main topics, including general app usage, usage and appreciation of the PA app, appreciation of and preferences for its features and the sharing of PA accomplishments through social media. The discussions were audio and video recorded, transcribed and analysed according to conventional content analysis.

RESULTS

The participants, aged 21 ± 2 years, were primarily female (67%). Several themes emerged: app usage, technical aspects, PA assessment, coaching aspects and sharing through social media. Participants most often used social networking apps (e.g., Facebook or Twitter), communication apps (e.g., WhatsApp) and content apps (e.g., news reports or weather forecasts). They preferred a simple and structured layout without unnecessary features. Ideally, the PA app should enable users to tailor it to their personal preferences by including the ability to hide features. Participants preferred a companion website for detailed information about their accomplishments and progress, and they liked tracking their workout using GPS. They preferred PA apps that coached and motivated them and provided tailored feedback toward personally set goals. They appreciated PA apps that enabled competition with friends by ranking or earning rewards, but only if the reward system was transparent. They were not willing to share their regular PA accomplishments through social media unless they were exceptionally positive.

CONCLUSIONS

Participants prefer PA apps that coach and motivate them, that provide tailored feedback toward personally set goals and that allow competition with friends.

Web-based assessments of physical activity in youth: considerations for design and scale calibration

This paper describes the design and methods involved in calibrating a Web-based self-report instrument to estimate physical activity behavior. The limitations of self-report measures are well known, but calibration methods enable the reported information to be equated to estimates obtained from objective data. This paper summarizes design considerations for effective development and calibration of physical activity self-report measures. Each of the design considerations is put into context and followed by a practical application based on our ongoing calibration research with a promising online self-report tool called the Youth Activity Profile (YAP).

We first describe the overall concept of calibration and how this influences the selection of appropriate self-report tools for this population. We point out the advantages and disadvantages of different monitoring devices since the choice of the criterion measure and the strategies used to minimize error in the measure can dramatically improve the quality of the data. We summarize strategies to ensure quality control in data collection and discuss analytical considerations involved in group- vs individual-level inference. For cross-validation procedures, we describe the advantages of equivalence testing procedures that directly test and quantify agreement. Lastly, we introduce the unique challenges encountered when transitioning from paper to a Web-based tool. The Web offers considerable potential for broad adoption but an iterative calibration approach focused on continued refinement is needed to ensure that estimates are generalizable across individuals, regions, seasons and countries.