Image-Based Dietary Assessment and Tailored Feedback Using Mobile Technology: Mediating Behavior Change in Young Adults

Health and Sustainability Co-Benefits of Eating Behaviors: Towards a Science of Dietary Eco-Wellness

Two of the greatest challenges of our times - climate change and the linked epidemics of obesity, diabetes, and cardiovascular disease - are fueled in part by the over-consumption of carbon-intensive high calorie foodstuffs. Converging evidence from hundreds of studies has confirmed that transitioning from diets high in meat and dairy to largely plant-based diets not only is necessary for climate change mitigation but will also lead to substantive reductions in morbidity and mortality. Nevertheless, there are only the faintest beginnings of a robust science of behavioral eco-wellness, defined here as the study of how individual choices, behaviors, and habits impact both personal health and environmental sustainability. This paper focusses on the sub-field of dietary eco-wellness, which looks at health and sustainability impacts of food production, procurement, preparation, and consumption. To advance this crucial agenda, investigators will need to invent, develop, and assess approaches aimed at helping people transition towards healthier and more sustainable diets. In order to accurately and reliably assess appropriate outcomes, existing assessment methods will need to be refined, new techniques will need to be advanced, and all measurement methods will need to be validated. Local conditions will influence the effectiveness of various approaches, and so it is important that scientists and communities share their stories of success and challenge for others to learn from. This paper reviews emerging evidence from relevant studies in dozens of countries, suggesting next steps, potential pathways, and a framework for interpretation.

An Active Image-Based Mobile Food Record Is Feasible for Capturing Eating Occasions among Infants Ages 3–12 Months Old in Hawai‘i

The ability to comprehensively assess the diet of infants is essential for monitoring adequate growth; however, it is challenging to assess dietary intake with a high level of accuracy. Infants rely on surrogate reporting by caregivers. This study aimed to determine if surrogate reporters (e.g., caregivers) could use an image-based mobile food record adapted (baby mFR) to record infants’ eating occasions, and via caregiver feedback, could assess the usability and feasibility of the baby mFR in recording infants’ diets. This was a cross-sectional study in which surrogate reporters (e.g., caregivers) recorded all food and beverage intake (including human milk) of the infant over a 4-day period. Trained research staff evaluated all images submitted during data collection for different indicators of quality. All surrogate reporters were asked to complete a usability questionnaire at the end of the 4-day data collection period. Basic descriptive analyses were performed on the infants 3–12 months of age (n = 70). A total of 91% (n = 64) of surrogate reporters used the baby mFR to record their infants’ eating occasions. The mean number of images submitted daily per participant via the mFR was 4.2 (SD 0.2). A majority of submitted images contained the fiducial marker and the food and/or beverage was completely visible. The mFR was found to be easy to use; however, suggestions were provided to increase utility of the application such as the inclusion of a bottle button and reminders. An image-based dietary assessment method using a mobile app was found to be feasible for surrogate reporters to record an infant’s food and beverage intake throughout the day.

[Validation, reproducibility, and reliability of food photographic record for food intake assessment]

Introduction

Introduction: food intake records are a useful resource for diet assessment, as well as for self-evaluation, self-control, and self-motivation to change an eating behavior. New technologies based on mobile phones permit a different way of recording food intake. Objective: to validate and assess food photographic record (FPR) as a useful instrument in professional practice for assessing food intake. Methodology: forty nutrition professionals participated. In a first stage, food variables obtained through FPR were analyzed and correlated with data from the frequency of food consumption questionnaire (FFQ) and a 24-hour recall (24HR). In a second stage, FPR was applied again to evaluate temporal stability (FPR 1 versus FPR 2). Wilcoxon's test and Spearman's correlation test were applied. Results: a moderate and significant positive association was found for total caloric intake (TCI) and total fat between FPR and 24HR (r = 0.68, p = 0.0008, and r = 0.52, p = 0.01, respectively). In addition, a positive and moderate association was found for TCI, proteins and fats between FPR 1 and FPR 2 (r = 0.61, p = 0.0004; r = 0.60, p = 0.0005; r = 0.64, p = 0.0002, respectively). Conclusion: FPR is a valid method for professional practice to estimate dietary intake, with greater consistency with 24HR data than FFQ, and presents temporal stability for TCI, protein and fat recordings. In addition, FPR may facilitate the adoption of positive eating habits such as more conscious intakes, among other benefits.

Review of the validity and feasibility of image-assisted methods for dietary assessment

Accurately quantifying dietary intake is essential to understanding the effect of diet on health and evaluating the efficacy of dietary interventions. Self-report methods (e.g., food records) are frequently utilized despite evident inaccuracy of these methods at assessing energy and nutrient intake. Methods that assess food intake via images of foods have overcome many of the limitations of traditional self-report. In cafeteria settings, digital photography has proven to be unobtrusive and accurate and is the method of choice for assessing food provision, plate waste, and food intake. In free-living conditions, image capture of food selection and plate waste via the user's smartphone, is promising and can produce accurate energy intake estimates, though accuracy is not guaranteed. These methods foster (near) real-time transfer of data and eliminate the need for portion size estimation by the user since the food images are analyzed by trained raters. A limitation that remains, similar to self-report methods where participants must truthfully record all consumed foods, is intentional and/or unintentional underreporting of foods due to social desirability or forgetfulness. Methods that rely on passive image capture via wearable cameras are promising and aim to reduce user burden; however, only pilot data with limited validity are currently available and these methods remain obtrusive and cumbersome. To reduce analysis-related staff burden and to allow real-time feedback to the user, recent approaches have aimed to automate the analysis of food images. The technology to support automatic food recognition and portion size estimation is, however, still in its infancy and fully automated food intake assessment with acceptable precision not yet a reality. This review further evaluates the benefits and challenges of current image-assisted methods of food intake assessment and concludes that less burdensome methods are less accurate and that no current method is adequate in all settings.

Validity and Usability of a Smartphone Image-Based Dietary Assessment App Compared to 3-Day Food Diaries in Assessing Dietary Intake Among Canadian Adults: Randomized Controlled Trial

Background

Accurate dietary assessment is needed in studies that include analysis of nutritional intake. Image-based dietary assessment apps have gained in popularity for assessing diet, which may ease researcher and participant burden compared to traditional pen-to-paper methods. However, few studies report the validity of these apps for use in research. Keenoa is a smartphone image-based dietary assessment app that recognizes and identifies food items using artificial intelligence and permits real-time editing of food journals.

Objective

This study aimed to assess the relative validity of an image-based dietary assessment app — Keenoa — against a 3-day food diary (3DFD) and to test its usability in a sample of healthy Canadian adults.

Methods

We recruited 102 participants to complete two 3-day food records. For 2 weeks, on 2 non-consecutive days and 1 weekend day, in random order, participants completed a traditional pen-to-paper 3DFD and the Keenoa app. At the end of the study, participants completed the System Usability Scale. The nutrient analyses of the 3DFD and Keenoa data before (Keenoa-participant) and after they were reviewed by dietitians (Keenoa-dietitian) were analyzed using analysis of variance. Multiple tests, including the Pearson coefficient, cross-classification, kappa score, % difference, paired t test, and Bland-Altman test, were performed to analyze the validity of Keenoa (Keenoa-dietitian).

Results

The study was completed by 72 subjects. Most variables were significantly different between Keenoa-participant and Keenoa-dietitian (P<.05) except for energy, protein, carbohydrates, fiber, vitamin B1, vitamin B12, vitamin C, vitamin D, and potassium. Significant differences in total energy, protein, carbohydrates, % fat, saturated fatty acids, iron, and potassium were found between the 3DFD and Keenoa-dietitian data (P<.05). The Pearson correlation coefficients between the Keenoa-dietitian and 3DFD ranged from .04 to .51. Differences between the mean intakes assessed by the 3DFD and Keenoa-dietitian were within 10% except for vitamin D (misclassification rate=33.8%). The majority of nutrients were within an acceptable range of agreement in the Bland-Altman analysis; no agreements were seen for total energy, protein, carbohydrates, fat (%), saturated fatty acids, iron, potassium, and sodium (P<.05). According to the System Usability Scale, 34.2% of the participants preferred using Keenoa, while 9.6% preferred the 3DFD.

Conclusions

The Keenoa app provides acceptable relative validity for some nutrients compared to the 3DFD. However, the average intake of some nutrients, including energy, protein, carbohydrates, % fat, saturated fatty acids, and iron, differed from the average obtained using the 3DFD. These findings highlight the importance of verifying data entries of participants before proceeding with nutrient analysis. Overall, Keenoa showed better validity at the group level than the individual level, suggesting it can be used when focusing on the dietary intake of the general population. Further research is recommended with larger sample sizes and objective dietary assessment approaches.

Future Directions for Integrative Objective Assessment of Eating Using Wearable Sensing Technology

Established methods for nutritional assessment suffer from a number of important limitations. Diaries are burdensome to complete, food frequency questionnaires only capture average food intake, and both suffer from difficulties in self estimation of portion size and biases resulting from misreporting. Online and app versions of these methods have been developed, but issues with misreporting and portion size estimation remain. New methods utilizing passive data capture are required that address reporting bias, extend timescales for data collection, and transform what is possible for measuring habitual intakes. Digital and sensing technologies are enabling the development of innovative and transformative new methods in this area that will provide a better understanding of eating behavior and associations with health. In this article we describe how wrist-worn wearables, on-body cameras, and body-mounted biosensors can be used to capture data about when, what, and how much people eat and drink. We illustrate how these new techniques can be integrated to provide complete solutions for the passive, objective assessment of a wide range of traditional dietary factors, as well as novel measures of eating architecture, within person variation in intakes, and food/nutrient combinations within meals. We also discuss some of the challenges these new approaches will bring.

Type, Timing, and Diversity of Complementary Foods Among Native Hawaiian, Pacific Islander, and Filipino Infants

Prevention is the recommended strategy for addressing childhood obesity and may be particularly important for minority groups such as Native Hawaiians, Pacific Islanders, and Filipinos (NHPIF) who display poorer health outcomes than other race/ethnic groups. Complementary feeding is a critical milestone in the first 1,000 days of life and plays a critical role in growth and eating habit formation. This cross-sectional study recruited NHPIF infants between 3 - 12 months of age residing on O'ahu, Hawai'i to examine timing and types of complementary foods introduced first as well as the dietary diversity of those infants 6 - 12 months of age. Basic demographic information and early feeding practices were assessed via online questionnaire. Diet was evaluated using the image-based mobile food record completed over 4-days. Images were evaluated to derive the World Health Organization's minimum dietary diversity (MDD) score. Data were analyzed using descriptive statistics and linear regressions. Seventy participants completed the study with a majority being between the ages of 6 - 12 months (n=56). About half of the participants were provided a complementary food prior to 6 months of age with the most common first complementary food being poi (steamed, mashed taro). Grains were the most commonly reported food group while the high protein food groups was the least commonly reported. Approximately 25% of infants 6 - 12 months of age met MDD all four days. Meeting MDD was significantly associated with age. Findings illuminate opportunities for improvement (eg, delayed introduction) and for promotion (eg, cultural foods) in NHPIF complementary feeding.