Validity and reliability of a simple, low-cost measure to quantify children's dietary intake in afterschool settings

Reliability and Validity of Digital Images to Assess Child Dietary Intake in a Quick-Service Restaurant Setting

BACKGROUND

Development of methods to accurately measure dietary intake in free-living situations-restaurants or otherwise-is critically needed to understand overall dietary patterns.

OBJECTIVE

This study aimed to develop and test reliability and validity of digital images (DI) for measuring children's dietary intake in quick-service restaurants (QSRs), validating against weighed plate waste (PW) and bomb calorimetry (BC).

DESIGN

In 2016, cross-sectional data were collected at two time points within a randomized controlled trial assessing children's leftovers in QSRs from parents of 4- to 12-year-old children.

PARTICIPANTS/SETTING

Parents (n = 640; mean age = 35.9 y; 70.8% female) consented and agreed to provide their child's PW for digital imaging, across 11 QSRs in Massachusetts in areas with low socioeconomic status and ethnically diverse populations.

OUTCOME MEASURES

Outcome measures were interrater reliability for DIs, correspondence between methods for energy consumed and left over, and correspondence between methods across varying quantities of PW.

ANALYSES PERFORMED

Intraclass correlations, percent agreement, Spearman correlations, Wilcoxon signed rank tests, and Bland-Altman plots were used.

RESULTS

Interrater reliability ratings for DIs had substantial intraclass correlations (ICC = 0.94) but not acceptable exact percent agreement (80.2%); DI and PW energy consumed were significantly correlated (r = 0.96, P < 0.001); DI slightly underestimated energy consumed compared with PW (Mdiff = -1.61 kcals, P < 0.001). Bland-Altman plots showed high DI-PW correspondence across various energy amounts and revealed few outliers. Energy left over by BC was highly correlated with DI (r = 0.87, P < 0.001) and PW (r = 0.90, P < 0.001); and mean differences were not significantly different from DI (Mdiff = 9.77 kcal, P = 0.06) or PW (Mdiff = -2.84 kcal, P = 0.20).

CONCLUSIONS

Correspondence was high between PW and DI assessments of energy consumed, and high with BC energy left over. Results demonstrate reliability and practical validity of digital images for assessing child meal consumption in QSR settings.

Identification and Evaluation of Tools Utilised for Measuring Food Provision in Childcare Centres and Primary Schools: A Systematic Review

BACKGROUND

Children aged 2-11 years spend significant hours per week in early childhood education and care (ECEC) and primary schools. Whilst considered important environments to influence children's food intake, there is heterogeneity in the tools utilised to assess food provision in these settings. This systematic review aimed to identify and evaluate tools used to measure food provision in ECEC and primary schools.

METHODS

The Preferred Reporting Items for Systematic Reviews (PRISMA) was followed. Publications (2003-2020) that implemented, validated, or developed measurement tools to assess food provision within ECEC or primary schools were included. Two reviewers extracted and evaluated studies, cross checked by a third reviewer and verified by all authors. The Academy of Nutrition and Dietetics Quality Criteria Checklist (QCC) was used to critically appraise each study.

RESULTS

Eighty-two studies were included in the review. Seven measurement tools were identified, namely, Menu review; Observation; Weighed food protocol; Questionnaire/survey; Digital photography; Quick menu audit; and Web-based menu assessment. An evidence-based evaluation was conducted for each tool.

CONCLUSIONS

The weighed food protocol was found to be the most popular and accurate measurement tool to assess individual-level intake. Future research is recommended to develop and validate a tool to assess service-level food provision.

Impact of changes to the Child and Adult Care Food Program on children's dietary intake in family child care homes

OBJECTIVE

To estimate the impact of recent changes to the Child and Adult Care Food Program (CACFP) meal pattern on young children's diets in family child care homes (FCCHs) serving racially/ethnically diverse children.

DESIGN

In a natural experimental study of thirteen CACFP-participating FCCHs, we used digital photographs taken of children's plates before and after meals matched with menus to measure children's dietary intake both prior to implementation of the new meal patterns (summer/fall of 2017) and again 1 year later (summer/fall of 2018). Generalised estimating equations tested for change in intake of fruits, vegetables, whole grains, 100 % juice, grain-based desserts, meat/meat alternates and milk, adjusting for clustering of observations within providers.

SETTING

FCCHs in Boston, MA, USA.

PARTICIPANTS

Three- to 5-year-old children attending FCCHs.

RESULTS

We observed 107 meals consumed by twenty-eight children at the thirteen FCCHs across an average of 2·5 (sd 1·3) d before the CACFP policy change, and 239 meals consumed by thirty-nine children across 3·8 d (sd 1·4) 1 year later. During lunch, fruit intake increased by about a third of a serving (+0·38 serving, 95 % CI 0·04, 0·73, P = 0·03), and whole grain intake increased by a half serving (+0·50 serving, 95 % CI 0·19, 0·82, P = 0·002). No changes were seen in other meal components.

CONCLUSION

Young children's dietary intake in CACFP-participating FCCHs improved following the CACFP meal pattern change, particularly for fruits and whole grains, which were targets of the new policy. Additional research should examine impacts of the changes in other child care settings, age groups and locales.

Impact of the Out-of-School Nutrition and Physical Activity (OSNAP) Group Randomized Controlled Trial on Children's Food, Beverage, and Calorie Consumption among Snacks Served

BACKGROUND

Afterschool interventions have been found to improve the nutritional quality of snacks served. However, there is limited evidence on how these interventions affect children's snacking behaviors.

OBJECTIVE

Our aim was to determine the impact of an afterschool intervention focused at the school district, site, family, and child levels on dietary consumption of foods and beverages served at snack.

DESIGN

This was a secondary analysis of a group-randomized controlled trial.

PARTICIPANTS/SETTING

Data were collected from 400 children at 20 afterschool sites in Boston, MA before (fall 2010) and after (spring 2011) intervention implementation.

INTERVENTION

The Out-of-School Nutrition and Physical Activity intervention aimed to promote fruits, vegetables, whole grains, and water, while limiting sugary drinks and trans fats. Researchers worked with district foodservice staff to change snack foods and beverages. Teams of afterschool staff participated in three 3-hour learning collaborative sessions to build skills and created action plans for changing site practices. The intervention included family and child nutrition education.

MAIN OUTCOME MEASURES

Research assistants observed dietary snack consumption using a validated measure on 2 days per site at baseline and follow-up.

STATISTICAL ANALYSES PERFORMED

This study used multivariable regression models, accounting for clustering of observations, to assess the intervention effect, and conducted post-hoc stratified analyses by foodservice type.

RESULTS

Children in intervention sites had greater decreases in consumption of juice (-0.61 oz/snack, 95% CI -1.11 to -0.12), beverage calories (-29.1 kcal/snack, 95% CI -40.2 to 18.0), foods with trans fats (-0.12 servings/snack, 95% CI -0.19 to -0.04), total calories (-47.7 kcal/snack, 95% CI -68.2 to -27.2), and increases in consumption of whole grains (0.10 servings/snack, 95% CI 0.02 to 0.18) compared to controls. In post-hoc analyses, sites with on-site foodservice had significant improvements for all outcomes (P<0.001), with no effect for sites with satellite foodservice.

CONCLUSIONS

Results demonstrate that an afterschool intervention can improve children's dietary snack consumption, particularly at sites with on-site foodservice.

Micronutrient Adequacy in Preschool Children Attending Family Child Care Homes

Limited data is available on the micronutrient intake and adequacy in preschool children enrolled in family child care homes (FCCH). The goal of this paper is to describe the micronutrient adequacy relative to age-specific recommendations of preschool-aged children (aged 2-5 years) attending FCCH in Rhode Island (RI). Dietary data among younger preschoolers (aged 2-3 years), n = 245) and older preschoolers (aged 4-5 years), n = 121) in 118 RI FCCH (N = 366 children) were analyzed. Nutrient adequacy was assessed as the amount of nutrient per 1000 kcal of the diet that would meet the Institute of Medicine nutrient requirements (critical nutrient density), and it was compared to the observed nutrient densities of the children. The sodium:potassium ratio was also calculated. For most micronutrients, the observed density met or exceeded the recommendation, meaning the children's intake was adequate. However, a high proportion of children had nutrient densities under the recommendation for vitamins D, E, K, and potassium (86.1%, 89.1%, 70.8%, and 99.2% of children, respectively). The mean vitamin B12, potassium, and zinc densities were statistically higher in younger vs. older preschoolers (p < 0.05 for all). Low densities in calcium and vitamins K and B5 were more frequent in older children vs. younger children (p < 0.05). In addition, older preschoolers had a higher sodium:potassium ratio than younger children (p < 0.05). The micronutrient intake density was adequate for most nutrients. However, intake of some nutrients was of concern. Further attention to training and compliance in FCCH may improve the diet quality of those cared for in these settings.

Measuring beverage consumption in US children and adolescents: a systematic review

Beverage consumption habits are associated with weight outcomes for children and adolescents. Many studies have examined youth's beverage consumption, but little is known about what methods are commonly used to assess youth beverage consumption and whether these strategies are valid and reliable. This study aimed to systematically review articles assessing beverage consumption among children and adolescents. We searched PubMed and Scopus for English-language articles published between February 2007 and February 2017 that measured and reported on American youth's (ages 2-18 years) beverage consumption. Searches yielded 17,165 articles, of which 589 articles describing 615 measures were extracted. We examined the types of assessment methods used, characteristics of these methods (e.g. validity, reliability, and literacy level), characteristics of study samples, and beverages assessed. The most common assessment methods were questionnaires/screeners (used by 65.4% of articles) and recalls (24.4%). About three-quarters of articles did not address validity (70.5%) or reliability (79.5%) of any measures used. Study populations were diverse: 54.7% of articles included low-income children, and 90.2% included non-White children. The most commonly assessed beverage category was sugar-sweetened beverages. Findings suggest that improved measurement techniques and reporting are both needed to track progress towards a goal of ensuring all youth have healthy beverage consumption.

Validation of a Questionnaire to Measure Fruits and Vegetables Selected and Consumed at School Lunch among Second- and Third-Grade Students

BACKGROUND

Interventions designed to encourage fruit and vegetable (F/V) consumption within schools are increasingly common. Thus, there is a need for valid, practical dietary assessment instruments to evaluate their effectiveness.

OBJECTIVE

The aim of this study was to examine the validity of a group-administered, paper-and-pencil questionnaire to assess F/V selection and consumption at school lunch relative to digital photography.

DESIGN

This was a five-phase, method-comparison study in which the questionnaire was iteratively modified between each phase.

PARTICIPANTS/SETTING

The study examined sets of questionnaires and photographs of lunch trays (n=1,213) collected on 44 days between May 2015 and June 2016 among second-grade students from three New York City schools (phases 1 to 4) and second- and third-grade students from 20 schools across eight states (phase 5).

MAIN OUTCOME MEASURES

Outcomes assessed were selection, amount eaten, preference, and intention to consume F/V.

STATISTICAL ANALYSES PERFORMED

Validity was assessed by percent agreement (categorized as "match, omission, or intrusion" for items on or off tray and "match, overestimation, or underestimation" for amount eaten), Spearman correlation coefficients, and intraclass correlation coefficients (ICC).

RESULTS

The total match rate for items on tray was substantial (phases 1 to 5: 83%, 84%, 92%, 93%, and 89%), with items more frequently intruded than omitted. For amounts eaten, the total match rates were moderate, but generally improved throughout the study (phases 1 to 5: 65%, 64%, 83%, 83%, and 76%), with overestimations more frequent than underestimations. There was good correspondence between methods in the estimates of amount eaten in a quantitative, cup equivalent amount (fruit ICC=0.61; vegetables ICC=0.64). Significant differences (α=.05) were not observed between second- and third-grade students, respectively, in the match rate for fruits (86% and 89%) or vegetable (89% and 86%) items on tray or fruit (69% and 73%) and vegetables (74% and 76%) amount eaten. Excellent correlations were observed between amount eaten and preference for fruit (r=0.91) and vegetables (r=0.93).

CONCLUSIONS

The questionnaire offers a feasible, valid instrument for assessing F/V selection and consumption among elementary students in schools participating in the National School Lunch Program. Additional research is recommended to test the instrument's sensitivity and to reproduce these findings using an alternative reference method, such as direct observations.

Sustained impact of energy-dense TV and online food advertising on children's dietary intake: a within-subject, randomised, crossover, counter-balanced trial

Background

Policies restricting children’s exposure to unhealthy food marketing have been impeded by the lack of evidence showing a direct link between food advertising exposure and children’s energy intake and body weight. Food advertising exposure increases children’s immediate food consumption, but whether this increased intake is compensated for at later eating occasions is not known; consequently the sustained effect on diets remains unclear.

Methods

We conducted a within-subject, randomised, crossover, counterbalanced study across four, six-day holiday camps in New South Wales, Australia between April 2016 and January 2017. Children (7–12 years, n = 160) were recruited via local schools, email networks and social media. Two gender- and age-balanced groups were formed for each camp (n = 20), randomised to either a multiple- or single- media condition and exposed to food and non-food advertising in an online game and/or a television cartoon. Children’s food consumption (kilojoules) was measured at a snack immediately after exposure and then at lunch later in the day. Linear mixed models were conducted to examine relationships between food advertising exposure and dietary intake, taking into account gender, age and weight status.

Results

All children in the multiple-media condition ate more at a snack after exposure to food advertising compared with non-food advertising; this was not compensated for at lunch, leading to additional daily food intake of 194 kJ (95% CI 80–308, p = 0.001, d = 0.2). Exposure to multiple-media food advertising compared with a single-media source increased the effect on snack intake by a difference of 182 kJ (95% CI 46–317, p = 0.009, d = 0.4). Food advertising had an increased effect among children with heavier weight status in both media groups.

Conclusion

Online (‘advergame’) advertising combined with TV advertising exerted a stronger influence on children’s food consumption than TV advertising alone. The lack of compensation at lunch for children’s increased snack intake after food advertising exposure suggests that unhealthy food advertising exposure contributes to a positive energy-gap, which could cumulatively lead to the development of overweight.

Trial registration

Australian New Zealand Clinical Trials Registry, number ACTRN12617001230347 (Retrospectively registered).

What Do Children Eat in the Summer? A Direct Observation of Summer Day Camps That Serve Meals

BACKGROUND

More than 14 million children in the United States attend summer camp annually, yet little is known about the food environment in day camps.

OBJECTIVE

Our aim was to describe the nutritional quality of meals served to, brought by, and consumed by children attending summer day camps serving meals and snacks, and to describe camp water access.

DESIGN

We conducted a cross-sectional study.

PARTICIPANTS/SETTINGS

Participants were 149 children attending five summer camps in Boston, MA, in 2013.

MAIN OUTCOME MEASURES

Foods and beverages served were observed for 5 consecutive days. For 2 days, children's dietary intake was directly observed using a validated protocol. Outcome measures included total energy (kilocalories) and servings of different types of foods and beverages served and consumed during breakfast, lunch, and snack.

STATISTICAL ANALYSES PERFORMED

Mean total energy, trans fats, sodium, sugar, and fiber served per meal were calculated across the camps, as were mean weekly frequencies of serving fruits, vegetables, meat/meat alternates, grains, milk, 100% juice, sugar-sweetened beverages, whole grains, red/highly processed meats, grain-based desserts, and salty snacks. Mean consumption was calculated per camper per day.

RESULTS

Camps served a mean (standard deviation) of 647.7 (134.3) kcal for lunch, 401.8 (149.6) kcal for breakfast, and 266.4 (150.8) kcal for snack. Most camps served red/highly processed meats, salty snacks, and grain-based desserts frequently, and rarely served vegetables or water. Children consumed little (eg, at lunch, 36.5% of fruit portions, 35.0% of meat/meat alternative portions, and 37.6% of milk portions served) except for salty snacks (66.9% of portions) and grain-based desserts (64.1% of portions). Sugar-sweetened beverages and salty snacks were frequently brought to camp. One-quarter of campers drank nothing throughout the entire camp day.

CONCLUSIONS

The nutritional quality of foods and beverages served at summer day camps could be improved. Future studies should assess barriers to consumption of healthy foods and beverages in these settings.

Impact of implementation factors on children's water consumption in the Out-of-School Nutrition and Physical Activity group-randomized trial

National data suggest that children are not consuming enough water. Experimental evidence has linked increased water consumption to obesity prevention, and the National AfterSchool Association has named serving water as ones of its standards for healthy eating and physical activity in out-of-school time settings. From fall 2010 to spring 2011, twenty Boston afterschool program sites participated in the Out-of-School Nutrition and Physical Activity (OSNAP) initiative, a group-randomized trial investigating nutrition and physical activity policies and practices that promote child health. Researchers used data from OSNAP to study the key factors that influence the implementation of practices that promote water intake. Aspects of the organizational capacity of the afterschool programs, characteristics of the providers, and the community context were hypothesized to impact changes in children's water consumption. This chapter demonstrates the effectiveness of an afterschool intervention on increases in children's water consumption. It also outlines the substantial influence that implementation factors can have on the effectiveness of an obesity prevention intervention, highlighting the importance of understanding how interventions are delivered in real-world settings.

Grab a Cup, Fill It Up! An Intervention to Promote the Convenience of Drinking Water and Increase Student Water Consumption During School Lunch

OBJECTIVES

We evaluated a low-cost strategy for schools to improve the convenience and appeal of drinking water.

METHODS

We conducted a group-randomized, controlled trial in 10 Boston, Massachusetts, schools in April through June 2013 to test a cafeteria-based intervention. Signage promoting water and disposable cups were installed near water sources. Mixed linear regression models adjusting for clustering evaluated the intervention impact on average student water consumption over 359 lunch periods.

RESULTS

The percentage of students in intervention schools observed drinking water during lunch nearly doubled from baseline to follow-up compared with controls (+ 9.4%; P < .001). The intervention was associated with a 0.58-ounce increase in water intake across all students (P < .001). Without cups, children were observed drinking 2.4 (SE = 0.08) ounces of water from fountains; with cups, 5.2 (SE = 0.2) ounces. The percentage of intervention students observed with sugar-sweetened beverages declined (-3.3%; P < .005).

CONCLUSIONS

The current default of providing water through drinking fountains in cafeterias results in low water consumption. This study shows that an inexpensive intervention to improve drinking water's convenience by providing cups can increase student water consumption.

Validity of a practitioner-administered observational tool to measure physical activity, nutrition, and screen time in school-age programs

BACKGROUND

Nutrition and physical activity interventions have been effective in creating environmental changes in afterschool programs. However, accurate assessment can be time-consuming and expensive as initiatives are scaled up for optimal population impact. This study aims to determine the criterion validity of a simple, low-cost, practitioner-administered observational measure of afterschool physical activity, nutrition, and screen time practices and child behaviors.

METHODS

Directors from 35 programs in three cities completed the Out-of-School Nutrition and Physical Activity Observational Practice Assessment Tool (OSNAP-OPAT) on five days. Trained observers recorded snacks served and obtained accelerometer data each day during the same week. Observations of physical activity participation and snack consumption were conducted on two days. Correlations were calculated to validate weekly average estimates from OSNAP-OPAT compared to criterion measures. Weekly criterion averages are based on 175 meals served, snack consumption of 528 children, and physical activity levels of 356 children.

RESULTS

OSNAP-OPAT validly assessed serving water (r = 0.73), fruits and vegetables (r = 0.84), juice >4oz (r = 0.56), and grains (r = 0.60) at snack; sugary drinks (r = 0.70) and foods (r = 0.68) from outside the program; and children's water consumption (r = 0.56) (all p <0.05). Reports of physical activity time offered were correlated with accelerometer estimates (minutes of moderate and vigorous physical activity r = 0.59, p = 0.02; vigorous physical activity r = 0.63, p = 0.01). The reported proportion of children participating in moderate and vigorous physical activity was correlated with observations (r = 0.48, p = 0.03), as were reports of computer (r = 0.85) and TV/movie (r = 0.68) time compared to direct observations (both p < 0.01).

CONCLUSIONS

OSNAP-OPAT can assist researchers and practitioners in validly assessing nutrition and physical activity environments and behaviors in afterschool settings.

TRIAL REGISTRATION

Phase 1 of this measure validation was conducted during a study registered at clinicaltrials.gov NCT01396473.