Design of process evaluation within the Child and Adolescent Trial for Cardiovascular Health (CATCH)

What do we want to get out of this? a critical interpretive synthesis of the value of process evaluations, with a practical planning framework

BACKGROUND

Process evaluations aim to understand how complex interventions bring about outcomes by examining intervention mechanisms, implementation, and context. While much attention has been paid to the methodology of process evaluations in health research, the value of process evaluations has received less critical attention. We aimed to unpack how value is conceptualised in process evaluations by identifying and critically analysing 1) how process evaluations may create value and 2) what kind of value they may create.

METHODS

We systematically searched for and identified published literature on process evaluation, including guidance, opinion pieces, primary research, reviews, and discussion of methodological and practical issues. We conducted a critical interpretive synthesis and developed a practical planning framework.

RESULTS

We identified and included 147 literature items. From these we determined three ways in which process evaluations may create value or negative consequences: 1) through the socio-technical processes of 'doing' the process evaluation, 2) through the features/qualities of process evaluation knowledge, and 3) through using process evaluation knowledge. We identified 15 value themes. We also found that value varies according to the characteristics of individual process evaluations, and is subjective and context dependent.

CONCLUSION

The concept of value in process evaluations is complex and multi-faceted. Stakeholders in different contexts may have very different expectations of process evaluations and the value that can and should be obtained from them. We propose a planning framework to support an open and transparent process to plan and create value from process evaluations and negotiate trade-offs. This will support the development of joint solutions and, ultimately, generate more value from process evaluations to all.

School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18

BACKGROUND

Physical activity among children and adolescents is associated with lower adiposity, improved cardio-metabolic health, and improved fitness. Worldwide, fewer than 30% of children and adolescents meet global physical activity recommendations of at least 60 minutes of moderate to vigorous physical activity per day. Schools may be ideal sites for interventions given that children and adolescents in most parts of the world spend a substantial amount of time in transit to and from school or attending school.

OBJECTIVES

The purpose of this review update is to summarise the evidence on effectiveness of school-based interventions in increasing moderate to vigorous physical activity and improving fitness among children and adolescents 6 to 18 years of age. Specific objectives are: • to evaluate the effects of school-based interventions on increasing physical activity and improving fitness among children and adolescents; • to evaluate the effects of school-based interventions on improving body composition; and • to determine whether certain combinations or components (or both) of school-based interventions are more effective than others in promoting physical activity and fitness in this target population.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, CINAHL, PsycINFO, BIOSIS, SPORTDiscus, and Sociological Abstracts to 1 June 2020, without language restrictions. We screened reference lists of included articles and relevant systematic reviews. We contacted primary authors of studies to ask for additional information.

SELECTION CRITERIA

Eligible interventions were relevant to public health practice (i.e. were not delivered by a clinician), were implemented in the school setting, and aimed to increase physical activity among all school-attending children and adolescents (aged 6 to 18) for at least 12 weeks. The review was limited to randomised controlled trials. For this update, we have added two new criteria: the primary aim of the study was to increase physical activity or fitness, and the study used an objective measure of physical activity or fitness. Primary outcomes included proportion of participants meeting physical activity guidelines and duration of moderate to vigorous physical activity and sedentary time (new to this update). Secondary outcomes included measured body mass index (BMI), physical fitness, health-related quality of life (new to this update), and adverse events (new to this update). Television viewing time, blood cholesterol, and blood pressure have been removed from this update.  DATA COLLECTION AND ANALYSIS: Two independent review authors used standardised forms to assess each study for relevance, to extract data, and to assess risk of bias. When discrepancies existed, discussion occurred until consensus was reached. Certainty of evidence was assessed according to GRADE. A random-effects meta-analysis based on the inverse variance method was conducted with participants stratified by age (children versus adolescents) when sufficient data were reported. Subgroup analyses explored effects by intervention type.

MAIN RESULTS

Based on the three new inclusion criteria, we excluded 16 of the 44 studies included in the previous version of this review. We screened an additional 9968 titles (search October 2011 to June 2020), of which 978 unique studies were potentially relevant and 61 met all criteria for this update. We included a total of 89 studies representing complete data for 66,752 study participants. Most studies included children only (n = 56), followed by adolescents only (n = 22), and both (n = 10); one study did not report student age. Multi-component interventions were most common (n = 40), followed by schooltime physical activity (n = 19), enhanced physical education (n = 15), and before and after school programmes (n = 14); one study explored both enhanced physical education and an after school programme. Lack of blinding of participants, personnel, and outcome assessors and loss to follow-up were the most common sources of bias.  Results show that school-based physical activity interventions probably result in little to no increase in time engaged in moderate to vigorous physical activity (mean difference (MD) 0.73 minutes/d, 95% confidence interval (CI) 0.16 to 1.30; 33 studies; moderate-certainty evidence) and may lead to little to no decrease in sedentary time (MD -3.78 minutes/d, 95% CI -7.80 to 0.24; 16 studies; low-certainty evidence). School-based physical activity interventions may improve physical fitness reported as maximal oxygen uptake (VO₂max) (MD 1.19 mL/kg/min, 95% CI 0.57 to 1.82; 13 studies; low-certainty evidence). School-based physical activity interventions may result in a very small decrease in BMI z-scores (MD -0.06, 95% CI -0.09 to -0.02; 21 studies; low-certainty evidence) and may not impact BMI expressed as kg/m² (MD -0.07, 95% CI -0.15 to 0.01; 50 studies; low-certainty evidence). We are very uncertain whether school-based physical activity interventions impact health-related quality of life or adverse events.

AUTHORS' CONCLUSIONS

Given the variability of results and the overall small effects, school staff and public health professionals must give the matter considerable thought before implementing school-based physical activity interventions. Given the heterogeneity of effects, the risk of bias, and findings that the magnitude of effect is generally small, results should be interpreted cautiously.

Using Process Evaluation for Implementation Success of Preschool-Based Programs for Obesity Prevention: The TX Childhood Obesity Research Demonstration Study

BACKGROUND

Through the Texas Childhood Obesity Research Demonstration study, we implemented and evaluated a system-oriented model of primary and secondary prevention approaches to mitigate obesity among low-income Texas children aged 2 to 12 years. Primary prevention included implementing the Coordinated Approach To Child Health Early Childhood (CATCH EC) program in Head Start preschools. In this paper, we describe the methods and results of CATCH EC program process evaluation over 2 years of implementation.

METHODS

We used a quasi-experimental design with serial cross-sectional data collected from Head Start centers across intervention and comparison catchment areas in Houston and Austin, Texas (intervention: N = 12 centers in 2012-2013 [Year 1], N = 12 in 2013-2014 [Year 2]; comparison: N = 13 centers in Year 1, N = 12 in Year 2). Process evaluation included center director and teacher surveys conducted in both years of implementation. We developed indices for implementation of CATCH EC and non-CATCH health events at the centers.

RESULTS

Implementation scores were higher among intervention centers as compared to comparison centers across both years of implementation, and these differences were statistically significant (p < .01). There was also high variability in program implementation in intervention centers across both years ranging from 55% to 95%.

CONCLUSION

These implementation index strategies may inform future evaluation of preschool-based obesity prevention program implementation.

Process Evaluation of a Policy, Systems, and Environmental Change Intervention in an Urban School District

OBJECTIVE

To conduct a comprehensive process evaluation of a policy, systems, and environmental (PSE) change intervention.

DESIGN

Quasi-experimental, mixed methods.

SETTING

Low-income urban school district.

PARTICIPANTS

Fifth-grade students in 4 schools assigned to 2 intervention and 2 comparison schools (intervention, n = 142; comparison, n = 170).

INTERVENTION

Both groups received a nutrition curriculum delivered by classroom teachers. Intervention schools also received 10 PSE lessons taught by paraprofessional educators.

MAIN OUTCOME MEASURES

Quantitative data were obtained from fidelity and observation checklists, grading rubrics and self-reported student surveys. Focus group and interviews provided qualitative data. Quantitative measures included assessments of PSE and fruit and vegetable knowledge, as well as assessment of times fruits and vegetables (FV) were consumed yesterday.

ANALYSES

Qualitative data were analyzed using inductive content analysis. Quantitative data were analyzed using repeated measures analysis of variance and analysis of co-variance.

RESULTS

Fidelity, dose, reach, and acceptance of PSE intervention were high; students felt more empowered, although PSE lessons were considered lengthy and complicated. Intervention PSE and FV knowledge scores were significantly higher than comparison scores (F_37.56, P < .001; and F_3.94, P < .05, respectively). However, issues in communication were identified between school staff and researchers.

CONCLUSIONS AND IMPLICATIONS

Policy, systems, and environmental classroom interventions commented on the differences between quantitative and qualitative assessments, and this suggests the need for more sensitive quantitative assessments. Future research should look at long-term outcomes as this study only looked at short-term outcomes.

Implementation and scale up of population physical activity interventions for clinical and community settings: the PRACTIS guide

Background

Few efficacious physical activity interventions are successfully translated and sustained in practice. We propose a practical guide for researchers to increase the likelihood of successful implementation and scale up of physical activity interventions in practice contexts. The guide is based on two principles: (i) differences between the research and practice context can be addressed during intervention development and implementation planning by focusing on system, delivery personnel, and intervention characteristics; and (ii) early planning for implementation barriers and facilitators can improve subsequent translation into practice.

Methods

From the published literature, we identified evidence of strategies to improve research-practice translation, along with narrative descriptions of different approaches to addressing translational challenges. These, along with constructs taken from widely cited implementation outcome, process, and mechanistic models were collated and inform the guide.

Results

The resultant PRACTIS guide (PRACTical planning for Implementation and Scale-up) comprised the following four iterative steps: Step 1) Characterize the parameters of the implementation setting; Step 2) Identify and engage key stakeholders across multiple levels within the delivery system(s); Step 3) Identify contextual barriers and facilitators to implementation, and; Step 4) Address potential barriers to effective implementation.

Conclusions

A lack of practical guidance for researchers on how to effectively plan implementation and scale up of physical activity interventions prevents us moving quickly from evidence to action. We recommend that intervention development and adaptation for broad and sustained implementation be prioritized early in intervention planning and include active engagement from delivery organizations and stakeholders. The PRACTIS guide is also relevant for clinical and public health researchers in other areas of prevention.

Electronic supplementary material

The online version of this article (10.1186/s12966-018-0678-0) contains supplementary material, which is available to authorized users.

Exposure to a multi-level multi-component childhood obesity prevention community-randomized controlled trial: patterns, determinants, and implications

BACKGROUND

For community interventions to be effective in real-world conditions, participants need to have sufficient exposure to the intervention. It is unclear how the dose and intensity of the intervention differ among study participants in low-income areas. We aimed to understand patterns of exposure to different components of a multi-level multi-component obesity prevention program to inform our future impact analyses.

METHODS

B'more Healthy Communities for Kids (BHCK) was a community-randomized controlled trial implemented in 28 low-income zones in Baltimore in two rounds (waves). Exposure to three different intervention components (corner store/carryout restaurants, social media/text messaging, and youth-led nutrition education) was assessed via post-intervention interviews with 385 low-income urban youths and their caregivers. Exposure scores were generated based on self-reported viewing of BHCK materials (posters, handouts, educational displays, and social media posts) and participating in activities, including taste tests during the intervention. For each intervention component, points were assigned for exposure to study materials and activities, then scaled (0-1 range), yielding an overall BHCK exposure score [youths: mean 1.1 (range 0-7.6 points); caregivers: 1.1 (0-6.7), possible highest score: 13]. Ordered logit regression analyses were used to investigate correlates of youths' and caregivers' exposure level (quartile of exposure).

RESULTS

Mean intervention exposure scores were significantly higher for intervention than comparison youths (mean 1.6 vs 0.5, p < 0.001) and caregivers (mean 1.6 vs 0.6, p < 0.001). However, exposure scores were low in both groups and 10% of the comparison group was moderately exposed to the intervention. For each 1-year increase in age, there was a 33% lower odds of being highly exposed to the intervention (odds ratio 0.77, 95% confidence interval 0.69; 0.88) in the unadjusted and adjusted model controlling for youths' sex and household income.

CONCLUSION

Treatment effects may be attenuated in community-based trials, as participants may be differentially exposed to intervention components and the comparison group may also be exposed. Exposure should be measured to provide context to impact evaluations in multi-level trials. Future analyses linking exposure scores to the outcome should control for potential confounders in the treatment-on-the-treated approach, while recognizing that confounding and selection bias may exist affecting causal inference.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02181010 . Retrospectively registered on 2 July 2014.

Aquatic therapy for children with Duchenne muscular dystrophy: a pilot feasibility randomised controlled trial and mixed-methods process evaluation

BACKGROUND

Duchenne muscular dystrophy (DMD) is a rare disease that causes the progressive loss of motor abilities such as walking. Standard treatment includes physiotherapy. No trial has evaluated whether or not adding aquatic therapy (AT) to land-based therapy (LBT) exercises helps to keep muscles strong and children independent.

OBJECTIVES

To assess the feasibility of recruiting boys with DMD to a randomised trial evaluating AT (primary objective) and to collect data from them; to assess how, and how well, the intervention and trial procedures work.

DESIGN

Parallel-group, single-blind, randomised pilot trial with nested qualitative research.

SETTING

Six paediatric neuromuscular units.

PARTICIPANTS

Children with DMD aged 7-16 years, established on corticosteroids, with a North Star Ambulatory Assessment (NSAA) score of 8-34 and able to complete a 10-m walk without aids/assistance. Exclusions: > 20% variation between baseline screens 4 weeks apart and contraindications.

INTERVENTIONS

Participants were allocated on a 1 : 1 ratio to (1) optimised, manualised LBT (prescribed by specialist neuromuscular physiotherapists) or (2) the same plus manualised AT (30 minutes, twice weekly for 6 months: active assisted and/or passive stretching regime; simulated or real functional activities; submaximal exercise). Semistructured interviews with participants, parents (n = 8) and professionals (n = 8) were analysed using Framework analysis. An independent rater reviewed patient records to determine the extent to which treatment was optimised. A cost-impact analysis was performed. Quantitative and qualitative data were mixed using a triangulation exercise.

MAIN OUTCOME MEASURES

Feasibility of recruiting 40 participants in 6 months, participant and therapist views on the acceptability of the intervention and research protocols, clinical outcomes including NSAA, independent assessment of treatment optimisation and intervention costs.

RESULTS

Over 6 months, 348 children were screened - most lived too far from centres or were enrolled in other trials. Twelve (30% of target) were randomised to AT (n = 8) or control (n = 4). People in the AT (n = 8) and control (n = 2: attrition because of parental report) arms contributed outcome data. The mean change in NSAA score at 6 months was -5.5 [standard deviation (SD) 7.8] for LBT and -2.8 (SD 4.1) in the AT arm. One boy suffered pain and fatigue after AT, which resolved the same day. Physiotherapists and parents valued AT and believed that it should be delivered in community settings. The independent rater considered AT optimised for three out of eight children, with other children given programmes that were too extensive and insufficiently focused. The estimated NHS costs of 6-month service were between £1970 and £2734 per patient.

LIMITATIONS

The focus on delivery in hospitals limits generalisability.

CONCLUSIONS

Neither a full-scale frequentist randomised controlled trial (RCT) recruiting in the UK alone nor a twice-weekly open-ended AT course delivered at tertiary centres is feasible. Further intervention development research is needed to identify how community-based pools can be accessed, and how families can link with each other and community physiotherapists to access tailored AT programmes guided by highly specialised physiotherapists. Bayesian RCTs may be feasible; otherwise, time series designs are recommended.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN41002956.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 27. See the NIHR Journals Library website for further project information.

Process Evaluation of an Integrated Health Promotion/Occupational Health Model in WellWorks-2

Disparities in chronic disease risk by occupation call for newapproaches to health promotion. Well Works-2 was a randomized, controlled study comparing the effectiveness of a health promotion/occupational health program (HP/OHS) with a standard intervention (HP). Interventions in both studies were based on the same theoretical foundations. Results from process evaluation revealed that a similar number of activities were offered in both conditions and that in the HP/OHS condition there were higher levels of worker participation using three measures: mean participation per activity (HP: 14.2% vs. HP/OHS: 21.2%), mean minutes of worker exposure to the intervention/site (HP: 14.9 vs. HP/OHS: 33.3), and overall mean participation per site (HP: 34.4% vs. HP/ OHS: 45.8%). There were a greater number of contacts with management (HP: 8.8 vs. HP/OHS: 24.9) in the HP/ OHS condition. Addressing occupational health may have contributed to higher levels of worker and management participation and smoking cessation among blue-collar workers.

Tracking the relationship between children's aerobic fitness and cognitive control

OBJECTIVE

To investigate if changes in aerobic fitness over a 3-year period are associated with modulations in children's cognitive control.

METHOD

A sample of 2nd/3rd-grade children (N = 290) completed baseline measures in Fall of 2011, and again in Spring of 2014 at the end of 4th/5th grade. Children completed the Progressive Aerobic Cardiovascular Endurance Run (PACER) test to measure aerobic capacity, a flanker task to evaluate inhibitory control, and an n-back task to assess working memory. Aerobic fitness was included as an independent variable in hierarchical regression analyses conducted at both time points, in addition to analyses examining changes in cognition over time.

RESULTS

At baseline, higher fit children exhibited shorter overall flanker reaction time (RT), as well as superior accuracy and d' scores (i.e., target discrimination) for both 1- and 2-back conditions. Approximately 3 years later, higher levels of fitness were associated with better performance for only the most difficult conditions of each task, including greater incongruent flanker accuracy and less interference during the compatible condition, as well as better accuracy and target discrimination for the 2-back condition of the n-back task. Importantly, increases in fitness were independently related to improvements in incongruent flanker accuracy and 2-back d' scores.

CONCLUSIONS

The current findings indicate that both higher aerobic fitness levels as well as increases in children's fitness are associated with better performance for task conditions eliciting greater cognitive demand. Such evidence is vital for implementing future health recommendations intended to foster improved cognitive performance in children. (PsycINFO Database Record

Physical activity and academic achievement across the curriculum (A + PAAC): rationale and design of a 3-year, cluster-randomized trial

Background

Improving academic achievement and reducing the rates of obesity in elementary school students are both of considerable interest. Increased physical activity during academic instruction time during school offers a potential intervention to address both issues. A program titled “Physical Activity Across the Curriculum” (PAAC) was developed in which classroom teachers in 22 elementary schools were trained to deliver academic instruction using physical activity with a primary aim of preventing increased BMI. A secondary analysis of data assessed the impact of PAAC on academic achievement using the Weschler Individual Achievement Test-II and significant improvements were shown for reading, math and spelling in students who participated in PAAC. Based on the results from PAAC, an adequately powered trial will be conducted to assess differences in academic achievement between intervention and control schools called, “Academic Achievement and Physical Activity Across the Curriculum (A + PAAC).”

Methods/design

Seventeen elementary schools were cluster randomized to A + PAAC or control for a 3-year trial. Classroom teachers were trained to deliver academic instruction through moderate-to-vigorous physical activity with a target of 100+ minutes of A + PAAC activities per week. The primary outcome measure is academic achievement measured by the Weschler Individual Achievement Test-III, which was administered at baseline (Fall 2011) and will be repeated in the spring of each year by assessors blinded to condition. Potential mediators of any association between A + PAAC and academic achievement will be examined on the same schedule and include changes in cognitive function, cardiovascular fitness, daily physical activity, BMI, and attention-to-task. An extensive process analysis will be conducted to document the fidelity of the intervention. School and student recruitment/randomization, teacher training, and baseline testing for A + PAAC have been completed. Nine schools were randomized to the intervention and 8 to control. A random sample of students in each school, stratified by gender and grade (A + PAAC = 370, Control = 317), was selected for outcome assessments from those who provided parental consent/child assent. Baseline data by intervention group are presented.

Discussion

If successful, the A + PAAC approach could be easily and inexpensively scaled and disseminated across elementary schools to improve both educational quality and health. Funding source: R01- DK85317. Trial registration: US NIH Clinical Trials, http://NCT01699295.

Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change

OBJECTIVE

To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk.

DESIGN

A process evaluation study based on a systematic conceptual model.

SETTING

Five middle schools in New York City.

PARTICIPANTS

Five hundred sixty-two students in 20 classes and their science teachers (n = 8).

MAIN OUTCOME MEASURES

Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers' curriculum evaluation, and satisfaction with teaching the curriculum.

ANALYSIS

Descriptive statistics and Spearman ρ correlation for quantitative analysis and content analysis for qualitative data were used.

RESULTS

Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and the student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teacher satisfaction with teaching the curriculum was highly correlated with student satisfaction (P < .05). Teacher perception of amount of student work was negatively correlated with implementation and with student satisfaction (P < .05).

CONCLUSIONS AND IMPLICATIONS

Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed.

School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18

BACKGROUND

The World Health Organization (WHO) estimates that 1.9 million deaths worldwide are attributable to physical inactivity and at least 2.6 million deaths are a result of being overweight or obese. In addition, WHO estimates that physical inactivity causes 10% to 16% of cases each of breast cancer, colon, and rectal cancers as well as type 2 diabetes, and 22% of coronary heart disease and the burden of these and other chronic diseases has rapidly increased in recent decades.

OBJECTIVES

The purpose of this systematic review was to summarize the evidence of the effectiveness of school-based interventions in promoting physical activity and fitness in children and adolescents.

SEARCH METHODS

The search strategy included searching several databases to October 2011. In addition, reference lists of included articles and background papers were reviewed for potentially relevant studies, as well as references from relevant Cochrane reviews. Primary authors of included studies were contacted as needed for additional information.

SELECTION CRITERIA

To be included, the intervention had to be relevant to public health practice (focused on health promotion activities), not conducted by physicians, implemented, facilitated, or promoted by staff in local public health units, implemented in a school setting and aimed at increasing physical activity, included all school-attending children, and be implemented for a minimum of 12 weeks. In addition, the review was limited to randomized controlled trials and those that reported on outcomes for children and adolescents (aged 6 to 18 years). Primary outcomes included: rates of moderate to vigorous physical activity during the school day, time engaged in moderate to vigorous physical activity during the school day, and time spent watching television. Secondary outcomes related to physical health status measures including: systolic and diastolic blood pressure, blood cholesterol, body mass index (BMI), maximal oxygen uptake (VO2max), and pulse rate.

DATA COLLECTION AND ANALYSIS

Standardized tools were used by two independent reviewers to assess each study for relevance and for data extraction. In addition, each study was assessed for risk of bias as specified in the Cochrane Handbook for Systematic Reviews of Interventions. Where discrepancies existed, discussion occurred until consensus was reached. The results were summarized narratively due to wide variations in the populations, interventions evaluated, and outcomes measured.

MAIN RESULTS

In the original review, 13,841 records were identified and screened, 302 studies were assessed for eligibility, and 26 studies were included in the review. There was some evidence that school-based physical activity interventions had a positive impact on four of the nine outcome measures. Specifically positive effects were observed for duration of physical activity, television viewing, VO2 max, and blood cholesterol. Generally, school-based interventions had little effect on physical activity rates, systolic and diastolic blood pressure, BMI, and pulse rate. At a minimum, a combination of printed educational materials and changes to the school curriculum that promote physical activity resulted in positive effects.In this update, given the addition of three new inclusion criteria (randomized design, all school-attending children invited to participate, minimum 12-week intervention) 12 of the original 26 studies were excluded. In addition, studies published between July 2007 and October 2011 evaluating the effectiveness of school-based physical interventions were identified and if relevant included. In total an additional 2378 titles were screened of which 285 unique studies were deemed potentially relevant. Of those 30 met all relevance criteria and have been included in this update. This update includes 44 studies and represents complete data for 36,593 study participants. Duration of interventions ranged from 12 weeks to six years.Generally, the majority of studies included in this update, despite being randomized controlled trials, are, at a minimum, at moderate risk of bias. The results therefore must be interpreted with caution. Few changes in outcomes were observed in this update with the exception of blood cholesterol and physical activity rates. For example blood cholesterol was no longer positively impacted upon by school-based physical activity interventions. However, there was some evidence to suggest that school-based physical activity interventions led to an improvement in the proportion of children who engaged in moderate to vigorous physical activity during school hours (odds ratio (OR) 2.74, 95% confidence interval (CI), 2.01 to 3.75). Improvements in physical activity rates were not observed in the original review. Children and adolescents exposed to the intervention also spent more time engaged in moderate to vigorous physical activity (with results across studies ranging from five to 45 min more), spent less time watching television (results range from five to 60 min less per day), and had improved VO2max (results across studies ranged from 1.6 to 3.7 mL/kg per min). However, the overall conclusions of this update do not differ significantly from those reported in the original review.

AUTHORS' CONCLUSIONS

The evidence suggests the ongoing implementation of school-based physical activity interventions at this time, given the positive effects on behavior and one physical health status measure. However, given these studies are at a minimum of moderate risk of bias, and the magnitude of effect is generally small, these results should be interpreted cautiously. Additional research on the long-term impact of these interventions is needed.

Psychometric characteristics of process evaluation measures for a rural school-based childhood obesity prevention study: Louisiana Health

PURPOSE

To evaluate the implementation of intervention components of the Louisiana Health study, which was a multicomponent childhood obesity prevention program conducted in rural schools.

DESIGN

Content analysis.

SETTING

Process evaluation assessed implementation in classrooms, gym classes, and cafeterias.

SUBJECTS

Classroom teachers (n  =  232), physical education teachers (n  =  53), food service managers (n  =  33), and trained observers (n  =  9).

MEASURES

Five process evaluation measures were created: Physical Education Questionnaire (PEQ), Intervention Questionnaire (IQ), Food Service Manager Questionnaire (FSMQ), Classroom Observation (CO), and School Nutrition Environment Observation (SNEO).

ANALYSIS

Interrater reliability and internal consistency were assessed on all measures. Analysis of variance and χ(2) were used to compare differences across study groups on questionnaires and observations.

RESULTS

The PEQ and one subscale from the FSMQ were eliminated because their reliability coefficients fell below acceptable standards. The subscale internal consistencies for the IQ, FSMQ, CO, and SNEO (all Cronbach α > .60) were acceptable.

CONCLUSIONS

After the initial 4 months of intervention, there was evidence that the Louisiana Health intervention was being implemented as it was designed. In summary, four process evaluation measures were found to be sufficiently reliable and valid for assessing the delivery of various aspects of a school-based obesity prevention program. These process measures could be modified to evaluate the delivery of other similar school-based interventions.

Trends in snacking among U.S. children

Nationally representative surveys of food intake in U.S. children show large increases in snacking between the 1989-91 to 1994-98 and 1994-98 to 2003-06 periods. Childhood snacking trends are moving toward three snacks per day, and more than 27 percent of children's daily calories are coming from snacks. The largest increases have been in salty snacks and candy. Desserts and sweetened beverages remain the major sources of calories from snacks.

Cost-effectiveness model for youth EFNEP programs: what do we measure and how do we do it?

The Youth Expanded Food and Nutrition Education Program (EFNEP) is one of the United States Department of Agriculture's hallmark nutrition education programs for limited-resource youth. The objective of this study was to gather opinions from experts in EFNEP and related content areas to identify costs, effects (impacts), and related instruments to develop a cost-effectiveness model (instrument) for youth EFNEP, which does not exist. A cost-effectiveness model determines the economic or financial cost of producing an impact. The findings highlight several challenges in identifying inputs through consensus and provide a roadmap for the creation of a model that can be adopted by state EFNEP coordinators.

Long-term process evaluation of a school-based programme for overweight prevention

BACKGROUND

The epidemic increase in childhood overweight demands effective and also feasible prevention programmes. A school-based environmental and educational intervention focusing on the promotion of water consumption was found to be effective for overweight prevention in children. Process evaluation and long-term surveillance are necessary to evaluate the feasibility and sustainability of the intervention programme in a school setting.

METHODS

Process evaluation was conducted during the intervention period (one school year) and a 19-month follow-up after the intervention trial on the prevention of overweight in 17 elementary schools. Data were collected through measuring the water flow of water fountains installed in schools, and questionnaires and interviews were administered to teachers and headmasters of intervention schools. Main outcomes were implementation of the intervention components, behavioural modification of the children concerning water consumption, and teacher and headmaster attitudes towards the intervention.

RESULTS

Eleven out of 17 intervention schools maintained the water fountains until 19-month follow-up. The mean water flow of the fountains decreased initially, but remained stable after the during the follow-up period. The implementation rate of the educational units by teachers varied between the units from 13% to 84%. Teachers graded the overall concept of the intervention as good, continuously during the intervention and follow-up period. The majority of teachers organized the water supply of the fountains on the class level during the intervention period but not during the follow-up.

CONCLUSIONS

The long-term process evaluation showed that the combined educational and environmental intervention has potential for sustained modifications in the beverage consumption habits of children. It also identified barriers and promoting factors of a sustainable and feasible implementation of the preventive programme in a school setting.

A multi-method process evaluation for a skin cancer prevention diffusion trial

This article describes process evaluation methods for the Pool Cool diffusion trial across 4 years. Pool Cool is a skin cancer prevention program that was found to improve behaviors and environments for sun protection at swimming pools in a randomized efficacy trial, which was followed by a national diffusion trial. The process evaluation focus shifted from measuring program satisfaction to assessing widespread program implementation, barriers and facilitators to implementation, and program maintenance and sustainability. Data collection methods include training surveys, database tracking, field coordinator activity logs, e-mails, surveys of parents, lifeguards and pool managers, and process evaluation interviews and site visits. The data revealed high levels of implementation of major program components when disseminated in the diffusion trial, including sun safety lessons, sun safety signs, and sunscreen use. This article describes program features and participant factors that facilitated local implementation, maintenance and sustainability across dispersed pools such as linkage agents, a packaged program, and adaptations of program elements.

Measuring food environments: a historical perspective

Food and nutrition environments are believed to contribute to obesity and chronic diseases. There is a need for valid, reliable measures of nutrition environments. Familiarity with previous efforts to measure food and nutrition environments can help researchers and practitioners build on past accomplishments. This article describes sources of food-environment data, discusses how they have been used, and places the definition and measurement of food and nutrition environments in historical context. Review articles, agency websites, and peer-reviewed articles were the main sources of information. The review is organized around three main types of data sources identified as historic traditions: government, industry, and research. Types of data include archives, business monitoring records, surveys, observational assessments, and self-report surveys. Future development of clear, adaptable measures of food and nutrition environments will build on lessons of the past and will update and improve on past tools.

School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6-18

BACKGROUND

The World Health Organization estimates that 1.9 million deaths worldwide are attributable to physical inactivity. Chronic diseases associated with physical inactivity include cancer, diabetes and coronary heart disease.

OBJECTIVES

The purpose of this systematic review is to summarize the evidence of the effectiveness of school-based interventions in promoting physical activity and fitness in children and adolescents.

SEARCH STRATEGY

The search strategy included searching several databases. In addition, reference lists of included articles and background papers were reviewed for potentially relevant studies, as well as references from relevant Cochrane reviews. Primary authors of included studies were contacted as needed for additional information.

SELECTION CRITERIA

To be included, the intervention had to be relevant to public health practice, implemented, facilitated, or promoted by staff in local public health units, implemented in a school setting and aimed at increasing physical activity, report on outcomes for children and adolescents (aged 6 to 18 years), and use a prospective design with a control group.

DATA COLLECTION AND ANALYSIS

Standardized tools were used by two independent reviewers to rate each study's methodological quality and for data extraction. Where discrepancies existed discussion occurred until consensus was reached. The results were summarized narratively due to wide variations in the populations, interventions evaluated and outcomes measured.

MAIN RESULTS

13,841 titles were identified and screened and 482 articles were retrieved. Multiple publications on the same project were combined and counted as one project, resulting in 395 distinct project accounts (studies). Of the 395 studies 104 were deemed relevant and of those, four were assessed as having strong methodological quality, 22 were of moderate quality and 78 were considered weak. In total 26 studies were included in the review. There is good evidence that school-based physical activity interventions have a positive impact on four of the nine outcome measures. Specifically positive effects were observed for duration of physical activity, television viewing, VO2 max, and blood cholesterol. Generally school-based interventions had no effect on leisure time physical activity rates, systolic and diastolic blood pressure, body mass index, and pulse rate. At a minimum, a combination of printed educational materials and changes to the school curriculum that promote physical activity result in positive effects.

AUTHORS' CONCLUSIONS

Given that there are no harmful effects and that there is some evidence of positive effects on lifestyle behaviours and physical health status measures, ongoing physical activity promotion in schools is recommended at this time.

Process Evaluation of the Hunter Illawarra Kids Challenge Using Parent Support Study: A Multisite Randomized Controlled Trial for the Management of Child Obesity

The purposes of this article are to (a) outline findings from secondary or process outcome data of the Hunter Illawarra Kids Challenge Using Parent Support (HIKCUPS) study and (b) inform the design and development of future research interventions and practice in the management of child obesity. Data were collected by means of facilitator evaluations, independent session observation, attendance records, and parent questionnaires. Internal validity and reliability of the program delivery were high. All parents reported positive changes in their children as a result of the physical activity program, the dietary modification program, or both. Most participants completed the home activities, but more than half reported that finding time to do them was problematic. Facilitator review indicated that future programs should specifically cater to children of similar age or same sex, allow adequate time for explanation of complex nutritional concepts, and use intrinsic motivators for participants. Recommendations for future interventions, specifically the implementation of subsequent HIKCUPS or other multisite effectiveness studies, are detailed.

Physical activity across the curriculum: year one process evaluation results

BACKGROUND

Physical Activity Across the Curriculum (PAAC) is a 3-year elementary school-based intervention to determine if increased amounts of moderate intensity physical activity performed in the classroom will diminish gains in body mass index (BMI). It is a cluster-randomized, controlled trial, involving 4905 children (2505 intervention, 2400 control).

METHODS

We collected both qualitative and quantitative process evaluation data from 24 schools (14 intervention and 10 control), which included tracking teacher training issues, challenges and barriers to effective implementation of PAAC lessons, initial and continual use of program specified activities, and potential competing factors, which might contaminate or lessen program effects.

RESULTS

Overall teacher attendance at training sessions showed exceptional reach. Teachers incorporated active lessons on most days, resulting in significantly greater student physical activity levels compared to controls (p < 0.0001). Enjoyment ratings for classroom-based lessons were also higher for intervention students. Competing factors, which might influence program results, were not carried out at intervention or control schools or were judged to be minimal.

CONCLUSION

In the first year of the PAAC intervention, process evaluation results were instrumental in identifying successes and challenges faced by teachers when trying to modify existing academic lessons to incorporate physical activity.

Determining client need in a multi-state fetal alcohol syndrome consortium: from training to practice

Background

A multi-state consortium was developed in the US to conduct baseline data collection and intervention research on fetal alcohol syndrome. Each state employed support specialists whose job it was to reduce or eliminate alcohol consumption in women who were at high risk for drinking alcohol during their pregnancy. The purpose of this paper is to report how support specialists in three primarily rural/frontier states were trained to assess client need and how client need was actually assessed in the field.

Methods

A qualitative process evaluation was conducted using semi-structured interviews. Interviews were conducted with state staff involved in support specialist training and consortium activities and the support specialists themselves. Inductive analyses were conducted with interview data.

Results

Need determination varied by state and for one state within the state. How support specialists were trained to assess need and how need was assessed in the field was mostly congruent.

Conclusion

Process evaluation is an effective method for providing practical and useful answers to questions that cannot be answered by outcome evaluation alone.

Implementation and evaluation of an HIV/STD intervention in Peru

This paper presents the lessons learned through a process evaluation (PE) after 1 year of implementation of a 2-year community intervention in Lima, Peru. The intervention consisted of training and motivating community popular opinion leaders (CPOLs) for three marginal population segments to disseminate prevention messages among their peers. PE data included: observations, qualitative interviews with CPOLS, conversations and messages delivered by CPOLs, training facilitators' perceptions about implementation, and a survey of CPOLs. The PE helped to document and enhance the intervention. CPOLs were motivated to talk to their peers. CPOLs perceived that their participation had an effect on their own risk behaviors and saw their role as beneficial to their community. The PE was helpful in examining training delivery and the feasibility and acceptability of the intervention in order to assess the elements related to program success necessary to replicate the CPOL model.

Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP)

Lifestyle Education for Activity Program (LEAP) was a comprehensive, school-based intervention designed to promote physical activity in high school girls. The intervention focused on changes in instructional practices and the school environment to affect personal, social, and environmental factors related to physical activity. Multiple process evaluation tools and an organizational assessment tool were developed to monitor program implementation from a framework called the LEAP essential elements, which characterized complete and acceptable intervention delivery; secular trends were also monitored. Using process data, LEAP intervention schools were categorized into low- and high-implementing groups and compared with control schools on nine essential elements assessed at the organizational level. The Wilcoxon scores test revealed that low- and high-implementing intervention, and control schools differed significantly on two of nine administrator-reported organizational-level components: having a physical activity team and having a faculty-staff health promotion program. A mixed-model analysis of covariance indicated that, compared to control schools, a greater percentage of girls in high-implementing schools reported engaging in vigorous physical activity. Process evaluation can be used to understand the relationship between level of implementation and successful program outcome.

Process evaluation results from the Healthy Directions-Small Business study

The Healthy Directions-Small Business randomized, controlled study aimed to reduce cancer risk among multiethnic workers in small manufacturing businesses by increasing fruit and vegetable consumption, physical activity, and daily multivitamin in take and decreasing consumption of red meat. The intervention incorporated participatory strategies and was built on a social-contextual framework that addressed people with varying cultural backgrounds and literacy levels. In addition, the intervention aimed to reduce worker exposure to occupational hazards. Process evaluation was conducted using quantitative and qualitative research methods. Quantitative results showed high levels of worker awareness of and participation in programs. Qualitative findings suggested that management support, worker input, and a history of social interaction between workers and management may have contributed to high participation rates. Future studies need to examine characteristics associated with participation and nonparticipation of both managers and nonmanagers to increase the likelihood of participation and ultimately improve health behavior.

Process evaluation of a store-based environmental obesity intervention on two American Indian Reservations

Obesity and other diet-related chronic diseases are widespread in American Indian communities. Inadequate access to healthy food on many reservations has led to a high-fat, high-sugar diet. The purpose of this paper is to report on the results of the process evaluation of a food store-based program to improve diet on two American Indian reservations. Process data were collected from 11 intervention stores to document the implementation of the Apache Healthy Stores (AHS) program. Process evaluation instruments recorded the stocking of promoted foods, presence of in-store communication materials, implementation of and participation in the cooking demonstrations and taste tests, and the transmission of mass-media messages. At the store level, the program was implemented with a high level of dose and reach, and a moderate to high level of fidelity. At the community level, the AHS program was implemented with a moderate degree of fidelity and dose. At the individual level, the cooking demonstrations and taste tests reached a large number of community members with a high dose. Implementing the AHS program on multiple levels (store, community, individual) was challenging, and differed between levels. Overall, improvements were seen from start to finish as program staff monitored, documented and responded to barriers to implementation. Process data will be tied to outcomes and will be useful for the planning of future store-based programs.

Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide

Process evaluation is used to monitor and document program implementation and can aid in understanding the relationship between specific program elements and program outcomes. The scope and implementation of process evaluation has grown in complexity as its importance and utility have become more widely recognized. Several practical frameworks and models are available to practitioners to guide the development of a comprehensive evaluation plan, including process evaluation for collaborative community initiatives. However, frameworks for developing a comprehensive process-evaluation plan for targeted programs are less common. Building from previous frameworks, the authors present a comprehensive and systematic approach for developing a process-evaluation plan to assess the implementation of a targeted health promotion intervention. Suggested elements for process-evaluation plans include fidelity, dose (delivered and received), reach, recruitment, and context. The purpose of this article is to describe and illustrate the steps involved in developing a process evaluation plan for any health promotion program.

Influence of gender, race, and ethnicity on suspected fatty liver in obese adolescents

OBJECTIVES

Fatty liver is a common cause of liver disease in children. However, the epidemiology of pediatric fatty liver is limited to single-center case series of nonalcoholic fatty liver disease (NAFLD). Obesity and insulin resistance are major established risk factors for NAFLD. The role of gender, race, and ethnicity on the prevalence of fatty liver in obese children is unknown.

METHODS

We recruited obese 12th-grade participants from the Child and Adolescent Trial for Cardiovascular Health in California, Louisiana, Minnesota, and Texas. Serum samples were collected at school when the participants were well. Alanine aminotransferase (ALT) was measured by kinetic enzymatic assay, and ALT >40 U/L was defined as abnormal. Causes of abnormal ALT other than NAFLD were excluded by serum testing.

RESULTS

A total of 127 obese students (73 female, 54 male) had a mean BMI of 35.2 kg/m2. Unexplained ALT elevation was present in 23% of participants overall. The mean ALT for participants with normal values was 28 U/L and for participants with an abnormal ALT was 56 U/L. Abnormal ALT was significantly more prevalent in boys (44%) than in girls (7%). The prevalence of abnormal ALT differed significantly by race and ethnicity (Hispanic: 36%; white: 22%; black: 14%). Serum ALT value was significantly predicted by the combination of gender, race/ethnicity, and BMI. After controlling for gender and BMI, Hispanic ethnicity significantly predicted greater ALT than black race.

CONCLUSIONS

In a national, school-based sample of obese adolescents, boys were 6 times more likely than girls to have an unexplained elevated ALT. Given that participants were well and causes of chronic liver disease were excluded, we speculate that obese adolescent boys have an increased prevalence of fatty liver compared with obese adolescent girls. This population-based study also supports the hypothesis that NAFLD is more common in Hispanic adolescents. These findings have implications for both disease screening and studies of fatty liver pathophysiology.

Feasibility of implementing intervention methods in an adolescent worksite tobacco control study

OBJECTIVE

To present feasibility data on SMART, the first teen worksite behavioural tobacco control intervention.

DESIGN

This phase II study was designed to estimate the efficacy and feasibility of a small scale, randomised, controlled intervention.

SETTING AND SUBJECTS

This study, addressing youths aged 15-18 years, was implemented in four intervention and five control grocery stores that had an average of 44 eligible teens.

INTERVENTIONS

The tobacco use cessation and prevention interventions were based on social influences and peer leader models. Employee break rooms served as centres both for interactive activities including open houses, teen advisory boards, peer leader interviews, games and contests; and non-interactive interventions including bulletin boards and table tents with health messages and home mailings. MAIN PROCESS MEASURES: Project staff collected process data on the extent of implementation of intervention activities, participation rates in activities, and contacts with peer leaders. On the final survey, teens reported on awareness of, participation in, and motivation for participating in project activities.

RESULTS

Indicators of feasibility were identified and discussed, including the number of activities implemented, teen participation, management support, cost, and barriers to and facilitators of implementation. During the 12 month intervention, a mean of 24.1 interactive activities and 55.3 non-interactive activities were implemented, and a mean 14.2% participation rate per activity per site was achieved. Eighty four per cent of teens reported being aware of SMART, and 39% reported participating in interactive and 67% in non-interactive activities.

CONCLUSIONS

Teen smoking cessation rates in worksite programmes might be improved if they are conducted in companies where there is job stability and if teen programmes are part of worksite-wide tobacco control programmes that include both teens and adults.

Development and process evaluation of a web-based smoking cessation program for college smokers: innovative tool for education

Smoking cessation interventions are needed for young adults. Innovative approaches to behavior change for this population should be tested. Formative research and process evaluation of those approaches would result in more effective programs. This paper presents the development process and process evaluation of a web-based smoking cessation program. A description of the stages of development is presented with formative research, development of the web-based intervention, formative evaluation, and process evaluation. The smokers reported high usage of the intervention and satisfaction with the intervention in that it helped to raise their consciousness about quitting, encouraged them to set behavioral goals, provided stages of change feedback, and offered interactivity in presenting information and strategies about quitting. The Internet may be a promising tool for patient education according to the process results.

Formative evaluation of a multisite alcohol consumption intervention in pregnant women

The purpose of this preliminary study was to conduct an analysis of the time spent in intervention activities designed to decrease alcohol consumption in high-risk pregnant women across three States. Based on the program's logic model an intervention dosage form was developed specifically for the process evaluation. The form enabled the researchers to generate six client measures of intervention dosage. Descriptive statistics of time spent in various intervention domains were generated for the three states. Also, logistic regression and Tobit estimations were used to see if at risk clients received more intervention dosage than their no risk counterparts. The data were collected on 109 pregnant women who had been involved with the intervention for 6 months or less. The results revealed dramatic differences in the amount of dosage given to clients across the three states in categories such as average time spent with each client and the distribution of time across the logic model domains. The detailed information generated through the analysis allowed the consortium members to identify how much and what type of intervention was being given to clients in the multisite FAS intervention. A number of important questions were generated that will be used to promote dialogue and discussion among the consortium members. Through this interaction it is hoped that the consortium members will be able to enhance the quality and effectiveness of the program's intervention.

Pathways process evaluation results: a school-based prevention trial to promote healthful diet and physical activity in American Indian third, fourth, and fifth grade students

BACKGROUND

Pathways was a large-scale, multisite, 3-year, study testing a school-based intervention designed to lower percent body fat in American Indian children.

METHODS

At the 21 intervention schools process evaluation data were collected for training of school personnel; implementation of the classroom and physical activity curricula; implementation of the project's food service guidelines in the school cafeterias; adult participation in the family events; and, students' perceived exposure to the Pathways interventions.

RESULTS

Students received about 93% of the classroom curriculum lessons. The minimum requirement of physical education being taught three times per week for at least 30 minutes duration was achieved by the fifth grade. The implementation of the food service behavioral guidelines increased from 51% in the third grade to 87% in the fifth grade. The family events had lower than anticipated adult participation. The participation rates were 45% during the third grade, and 41 and 63% during the fourth and fifth grades, respectively. There was a significant difference between intervention and control students' perceived exposure to Pathways type interventions.

CONCLUSION

The Pathways interventions were successfully implemented with good reach, high extent, and fidelity.

Reliability and validity of the School Health Policies and Programs Study 2000 questionnaires

To help assess the quality of the questionnaires developed for the School Health Policies and Programs Study (SHPPS) 2000, the Centers for Disease Control and Prevention (CDC) conducted a data quality substudy in conjunction with SHPPS 2000. The substudy assessed validity of the state- and district-level questionnaires through telephone interviews with a subsample of the original state- and district-level respondents, and the test-retest reliability of the school- and classroom-level questionnaires through computer-assisted repeat interviews with a subsample of the school- and classroom-level respondents. Results indicated that although a few threats to the validity of responses to the state- and district-level questionnaires were identified, the questionnaires generally produced valid data. Among the school- and classroom-level questionnaires, some questions demonstrated poor reliability, but most exhibited moderate or substantial reliability, and some exhibited almost perfect reliability. CDC will use these results to revise the SHPPS 2000 questionnaires and will consider alternative methods of data collection to improve the quality of data collected in future versions of SHPPS.

Toward a better understanding of the influences on physical activity: the role of determinants, correlates, causal variables, mediators, moderators, and confounders

BACKGROUND

For research on physical activity interventions to progress systematically, the mechanisms of action must be studied. In doing so, the research methods and their associated concepts and terminology become more complex. It is particularly important to clearly distinguish among determinants, correlates, mediators, moderators, and confounder variables used in physical activity research. This article examines the factors that are correlated with and that may have a causal relationship to physical activity.

METHODS AND RESULTS

We propose that the term "correlate" be used, instead of "determinant," to describe statistical associations or correlations between measured variables and physical activity. Studies of the correlates of physical activity are reviewed. The findings of these studies can help to critique existing theories of health behavior change and can provide hypotheses to be tested in intervention studies from which it is possible to draw causal inferences. Mediator, moderator, and confounder variables can act to influence measured changes in physical activity. Intervening causal variables that are necessary to complete a cause-effect pathway between an intervention and physical activity are termed "mediators." The relationship between an intervention and physical activity behaviors may vary for different groups; the strata by which they vary are levels of "moderators" of the relationship. Other factors may distort or affect the observed relationships between program exposure and physical activity, and are known as "confounders."

CONCLUSIONS

Consistent use of terms and additional research on mediators and moderators of intervention effects will improve our ability to understand and influence physical activity.

Evaluation of the institutionalization of the coordinated approach to child health (CATCH) in a U.S./Mexico border community

El Paso Coordinated Approach to Child Health (El Paso CATCH) was evaluated in 24 schools for outcome measures of moderate to vigorous physical activity (MVPA) during physical education (PE), content of PE lessons, content of school meals, and numerous process measures. Chi-square analyses compared frequency data across time for activity during PE and percentage fat in school meals. Descriptive summaries were used for process questionnaire results. Data were also compared to CATCH program goals. For most intervention schools, El Paso CATCH significantly increased MVPA, decreased fat in school meals, and decreased sodium in school breakfasts. However, some schools were not meeting the fat content goals for school lunches, and no schools met the vigorous physical activity (VPA) goals for PE or the sodium goals for school lunches.

Serum cholesterol levels in children are associated with dietary fat and fatty acid intake

BACKGROUND

Recent studies in adults suggest that individual dietary fatty acids differ markedly in their effects on serum lipids and lipoprotein levels. However, these associations have rarely been studied in children.

OBJECTIVE

To assess, using regression procedures, the associations in children between specific fatty acids and nonfasting serum lipids and cholesterol after controlling for total energy and total fat intake,

SUBJECTS

The sample consisted of 1,182 children who participated in the Child and Adolescent Trial for Cardiovascular Health. The sample was equally distributed across 4 sites (Louisiana, Texas, Minnesota, California). The sample was 48% boys; 71% white, 15% Hispanic-American, 10% African-American, 2% Asian, and 2% from other or unspecified racial/ethnic heritage.

DESIGN

In this randomized multicenter trial with 56 intervention and 40 control elementary schools, food record-assisted 24-hour dietary recalls and serum lipid measurements were collected for each child at baseline (3rd grade) and at the 5th grade follow-up.

STATISTICAL ANALYSES

Repeated-measures analysis of variance was used to evaluate the association between nutrient composition of the diet and serum lipids. Independent dietary variables included amount and type of fat, individual fatty acids, protein, carbohydrate, and fiber. The dependent variables were the absolute values of serum total cholesterol (TC) and high-density lipoprotein cholesterol (HDL-C) both at baseline (3rd grade) and at follow-up (5th grade).

RESULTS

Increased total fat (b=0.053; P<.03) was associated with increased TC in the model when energy was held constant, whereas increased carbohydrate was associated with decreased TC (b=-0.021, P<.02) and HDL-C (b=-0.010, P<.005) levels. Increased total protein (b=0.017, P<.05) was associated with increased HDL-C when energy was held constant. Saturated fat (b=0.004, P<.04), unsaturated fat (b=0.004, P<.03), and myristic fatty acid (b=0.021, P<.01) all increased TC in the model when total fat and total energy were held constant.

CONCLUSIONS/APPLICATIONS

We conclude that using a modeling approach, the effect of diet on serum lipids in children is similar to that observed in adults. Total fat and saturated fat were positively associated with TC and HDLC levels, saturated fat was positively associated with TC, and carbohydrate was inversely associated with both TC and HDL-C. In the statistical model, substitution of unsaturated fatty acids, monounsaturated fatty acids, or oleic acid for saturated fat, while holding total fat and energy constant, slightly lowered TC. In contrast, substitution of total fat for carbohydrate in the model increased TC and, thus, did not seem to be associated with an apparent health advantage except for HDL-C elevating effects. However, consumption of individual fats tends to be highly correlated, and we were unable to determine if these biological effects were operating independently.

The Team Nutrition pilot study: lessons learned from implementing a comprehensive school-based intervention

Team Nutrition (TN) is an educational and promotional initiative developed by the US Department of Agriculture to change children's eating behaviors through social marketing techniques. This article reports on the process evaluation of a TN pilot project targeting students in kindergarten to grade 4 and systematically documents the implementation experience. Even with a very short start-up period, schools implemented most components of this multichannel nutrition intervention and formed new, supportive relationships with local media and community partners. School teachers and administrators, along with foodservice professionals, generally expressed support for and satisfaction with TN, citing the positive experience and gains for students. The lessons learned from this study highlight the management and organizational issues involved in a comprehensive intervention. These include the importance of local coordinators to support and create a bridge between teachers and cafeteria staff and to forge links with key external partners. To function effectively, coordinators themselves may need training in coalition building and working with media. Relationships formed with parents, local businesses, other educational institutions, health organizations, and the media offer promise for helping to sustain nutrition education efforts. The TN process evaluation identified multiple ideas for pursuing these partnerships more successfully.

Designing effective nutrition interventions for adolescents

By altering dietary behaviors, nutrition interventions during adolescence have the potential of affecting children at that time and later in life. The majority of interventions implemented in the teen years have occurred in schools, but other intervention sites have included after-school programs, summer camps, community centers, libraries, and grocery stores. Programs with successful outcomes have tended to be behaviorally based, using theories for the developmental framework; included an environmental component; delivered an adequate number of lessons; and emphasized developmentally appropriate strategies. One planning method that can be used in the development of nutrition interventions is Intervention Mapping. The steps of Intervention Mapping include conducting a needs assessment, developing proximal program objectives, mapping appropriate strategies and methods to address the objectives, planning the program design, planning program adoption and implementation, and evaluation. The use of intervention-planning techniques, coordination of nutrition and physical education interventions, using technological advances such as CD-ROMs, incorporation of policy changes into intervention efforts, and dissemination of effective programs are all trends that will influence the future development of effective nutrition programs for adolescents.

Effects of the CATCH physical education intervention: teacher type and lesson location

BACKGROUND

Substantial differences exist in how and where physical education (PE) is conducted in elementary schools throughout the United States. Few effectiveness studies of large-scale interventions to improve PE have been reported.

DESIGN

Multicenter randomized trial.

SETTING/ PARTICIPANTS

The Child and Adolescent Trial for Cardiovascular Health (CATCH) was implemented in PE classes in 96 schools (56 intervention, 40 control) in four study centers: California, Louisiana, Minnesota, and Texas.

INTERVENTION

The 2.5-year PE intervention consisted of professional development sessions, curricula, and follow-up consultations.

MAIN OUTCOME MEASURES

Intervention effects on student physical activity and lesson context in PE were examined by teacher type (PE specialists and classroom teachers) and lesson location (indoors and outdoors).

RESULTS

Differential effects by teacher type and lesson location were evidenced for both physical activity and lesson context. Observations of 2016 lessons showed that intervention schools provided more moderate-to-vigorous physical activity (p=0.002) and vigorous physical activity (p=0.02) than controls. Classroom teachers improved physical activity relatively more than PE specialists, but PE specialists still provided longer lessons and more physical activity. Classroom teachers increased lesson length (p=0.02) and time for physical fitness (p=0.03).

CONCLUSIONS

The intervention improved PE of both specialists' and classroom teachers' lessons. States and districts should ensure that the most qualified staff teaches PE. Interventions need to be tailored to meet local needs and conditions, including teacher type and location of lessons.

Process of conducting a 5-a-day intervention with high school students: Gimme 5 (Louisiana)

Gimme 5: A Fresh Nutrition Concept for Students (Gimme 5) was a 4-year intervention targeting increased fruit and vegetable consumption by high school students. Twelve schools were randomized to intervention or control conditions. The cohort (2,213 students; 56% female, 84% Euro-American) were followed from 9th to 12th grade. Interventions were composed of a school-based media campaign, classroom workshops, school meal modification, and parental involvement. For each of the four Gimme 5 intervention components, process evaluation measures were developed to assess program dose, penetration, and utilization, as well as external competing factors. Process evaluation results are presented to illustrate the various functions of process evaluation data. These include, but are not limited to, describing program implementation, quality control and monitoring, and explaining study outcomes. The implementation of process evaluation systems to complement the outcome measures in a high school-based intervention provides useful strategies for a more comprehensive approach to program evaluation.

The role of process evaluation in the training of facilitators for an adolescent health education program

This article reports on the process evaluation of the training of facilitators for the Adolescent Social Action Program, a health education program in Albuquerque, New Mexico that trained college students and adult volunteers to work with middle school students. From the process evaluation data collected throughout a four-year period (1995-1998), data relevant to training are described: facilitator characteristics, facilitator training, curriculum implementation, and use of the program's model designed to promote critical thinking and dialogue. Results indicated that, though most facilitators reported the training was sufficient to enable them to implement the curriculum, they did not completely do so, especially as groups reached their final sessions. Facilitators covered the core curriculum content, but often failed to follow through with the more abstract activities. The need to perform and report the process evaluation in time to provide ample opportunity for trainers and curriculum designers to make appropriate adjustments is discussed.

Uses of process evaluation in the Maryland WIC 5-a-day promotion program

Using a crossover design, the authors conducted a 6-month intervention program aimed at increasing fruit and vegetable consumption among women served by the Women, Infants, and Children program in Baltimore City and six Maryland counties. The theoretical framework for the interventions was the Transtheoretical Model of Change. At 2 months postintervention, mean daily consumption had increased significantly more in intervention participants than in control participants. Extensive process evaluation data were collected to assess the quantity and quality of program services delivered. These included participant nutrition session evaluation forms and attendance logs, focus groups of attenders and nonattenders of sessions, information about peer educators, and postintervention surveys. Many lessons were learned about program delivery, factors affecting attendance, and the obstacles to dietary change. Strategies to increase participants' consumption of fruits and vegetables were modified based on these lessons and the process evaluations.

5-a-day Power Plus: process evaluation of a multicomponent elementary school program to increase fruit and vegetable consumption

The 5-a-Day Power Plus program targeted multiethnic fourth- and fifth-grade students in 10 intervention and 10 control urban elementary schools in St. Paul, Minnesota, to increase fruit and vegetable consumption. The intervention included behavioral curricula in classrooms, parental involvement, school food service changes, and food industry support. Process evaluation was conducted by using surveys and classroom and lunchroom observations to assess the characteristics of teachers and food service staff, the degree the intervention was implemented as intended, and exteral factors that may have affected the program results. Results showed high levels of participation, dose, and fidelity for all of the intervention components, with the exception of parental involvement. The process evaluation findings help explain why the increase in fruit and vegetable consumption occurred mostly at school lunch and not at home. Future intervention research should focus on creating new and potent strategies for parental involvement and for increasing the appeal and availability of vegetables.