Importance of user interaction with automated dietary assessment methods

How willing are adolescents to record their dietary intake? The mobile food record

Background

Accurately assessing the diets of children and adolescents can be problematic. Use of technologies, such as mobile apps designed to capture food and beverages consumed at eating occasions with images taken using device-embedded cameras, may address many of the barriers to gathering accurate dietary intake data from adolescents.

Objective

The objectives of this study were to assess the willingness of adolescents to take images of food and beverages at their eating occasions using a novel mobile food record (mFR) and to evaluate the usability of the user confirmation component of the mFR app, referred to as the “review process.”

Methods

Mixed methods combining quantitative and qualitative protocols were used in this study. Adolescents (11-15-year olds) attending a summer camp were recruited to participate in the study. First, the participants were asked to take images of foods and beverages consumed as meals and snacks for 2 consecutive days using the mFR app running on an iPhone and the number of images taken was noted. This was followed by focus group sessions to evaluate usability, which was analyzed by content and themes. After using the mFR, a think-aloud method was used to evaluate the usability of the mFR method for reviewing system-identified foods (ie, the review process). A usability questionnaire was administered at the end of all activities.

Results

The mFR was accepted by the majority of the 24 boys and 17 girls (n=41) but varied according to gender and eating occasion. Girls were significantly more likely than boys to capture images of their eating occasions (Fisher exact test, P=.03). Participants were more likely to take images of their breakfasts (90%, 36/40) and lunches (90%, 72/80) and least likely to capture afternoon and evening snacks, 54% (43/80) and 40% (32/80), respectively. The major themes from the focus groups with regard to using the mFR were games, rewards, and the need to know more about why they were using the app. Results of the usability questionnaire indicated that including a game component would be important to increase willingness to use the mFR, and a high majority of the participants indicated a willingness to use the mFR for 7 days or more. The image review process was found to be easy to use except for some confusion with overlapping markers on the screen.

Conclusions

The adolescents’ experiences with and feedback about the mFR highlighted the importance of increased training, reminders, entertainment (eg, games), and training with practice in using the device to capture complete dietary intake as part of their active lifestyles.

A Mobile Phone User Interface for Image-Based Dietary Assessment

Many chronic diseases, including obesity and cancer, are related to diet. Such diseases may be prevented and/or successfully treated by accurately monitoring and assessing food and beverage intakes. Existing dietary assessment methods such as the 24-hour dietary recall and the food frequency questionnaire, are burdensome and not generally accurate. In this paper, we present a user interface for a mobile telephone food record that relies on taking images, using the built-in camera, as the primary method of recording. We describe the design and implementation of this user interface while stressing the solutions we devised to meet the requirements imposed by the image analysis process, yet keeping the user interface easy to use.