Increasing children's physical activity through a teaching-assistant led extracurricular intervention: process evaluation of the action 3:30 randomised feasibility trial

Process Evaluation of Project FFAB (Fun Fast Activity Blasts): A Multi-Activity School-Based High-Intensity Interval Training Intervention

Introduction: Over the last decade, research into the impact of school-based high-intensity interval training (HIIT) on young people's health has markedly increased. Despite this, most authors have focused on the outcomes of their intervention, rather than the process of how the study was conducted. The aim of our study, therefore, was to conduct a mixed methods process evaluation of Project FFAB (Fun Fast Activity Blasts), a school-based HIIT intervention for adolescents. The objectives were to explore study recruitment, reach, intervention dose, fidelity, participants' experiences, context, and future implementation.

Methods: Recruitment was assessed by comparing the number of students who received study information, to those who provided consent. Reach was described as the number of participants who completed the intervention. Dose was reported via the number of HIIT sessions delivered, total exercise time commitment, HIIT exercise time, and session attendance. Post-intervention focus groups were conducted with intervention participants (n = 33; aged 14.1 ± 0.3 years; mean ± standard deviation). These discussions explored aspects of intervention fidelity (extent that the intervention was delivered as intended); participants' experiences of the HIIT sessions; context (exploration of the nuances of school-based HIIT); and ideas for future implementation.

Results: Recruitment, reach, and dose data indicate that Project FFAB was largely delivered as planned. Focus group data identified a mismatch between perceived vs. prescribed work: rest ratio for the multi-activity HIIT drills. Generally, the HIIT drills were well-received; participants often reported they were fun to complete, and the use of heart rate monitors was helpful for interpreting exercise intensity. Some participants stated that greater variety in the HIIT drills would be preferable. The timing and structure of the HIIT sessions that took place outside of physical education lessons received mixed responses.

Conclusion: Collectively, our study supports the use of school-based HIIT and provides valuable insights into how such interventions can be implemented. Project FFAB could be modified to account for individuals' preferences on when the exercise sessions took place. In addition, a wider range of activities could be included, and the prescribed work: rest ratio of the HIIT drills could be better communicated.

School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18

BACKGROUND

Physical activity among children and adolescents is associated with lower adiposity, improved cardio-metabolic health, and improved fitness. Worldwide, fewer than 30% of children and adolescents meet global physical activity recommendations of at least 60 minutes of moderate to vigorous physical activity per day. Schools may be ideal sites for interventions given that children and adolescents in most parts of the world spend a substantial amount of time in transit to and from school or attending school.

OBJECTIVES

The purpose of this review update is to summarise the evidence on effectiveness of school-based interventions in increasing moderate to vigorous physical activity and improving fitness among children and adolescents 6 to 18 years of age. Specific objectives are: • to evaluate the effects of school-based interventions on increasing physical activity and improving fitness among children and adolescents; • to evaluate the effects of school-based interventions on improving body composition; and • to determine whether certain combinations or components (or both) of school-based interventions are more effective than others in promoting physical activity and fitness in this target population.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, CINAHL, PsycINFO, BIOSIS, SPORTDiscus, and Sociological Abstracts to 1 June 2020, without language restrictions. We screened reference lists of included articles and relevant systematic reviews. We contacted primary authors of studies to ask for additional information.

SELECTION CRITERIA

Eligible interventions were relevant to public health practice (i.e. were not delivered by a clinician), were implemented in the school setting, and aimed to increase physical activity among all school-attending children and adolescents (aged 6 to 18) for at least 12 weeks. The review was limited to randomised controlled trials. For this update, we have added two new criteria: the primary aim of the study was to increase physical activity or fitness, and the study used an objective measure of physical activity or fitness. Primary outcomes included proportion of participants meeting physical activity guidelines and duration of moderate to vigorous physical activity and sedentary time (new to this update). Secondary outcomes included measured body mass index (BMI), physical fitness, health-related quality of life (new to this update), and adverse events (new to this update). Television viewing time, blood cholesterol, and blood pressure have been removed from this update.  DATA COLLECTION AND ANALYSIS: Two independent review authors used standardised forms to assess each study for relevance, to extract data, and to assess risk of bias. When discrepancies existed, discussion occurred until consensus was reached. Certainty of evidence was assessed according to GRADE. A random-effects meta-analysis based on the inverse variance method was conducted with participants stratified by age (children versus adolescents) when sufficient data were reported. Subgroup analyses explored effects by intervention type.

MAIN RESULTS

Based on the three new inclusion criteria, we excluded 16 of the 44 studies included in the previous version of this review. We screened an additional 9968 titles (search October 2011 to June 2020), of which 978 unique studies were potentially relevant and 61 met all criteria for this update. We included a total of 89 studies representing complete data for 66,752 study participants. Most studies included children only (n = 56), followed by adolescents only (n = 22), and both (n = 10); one study did not report student age. Multi-component interventions were most common (n = 40), followed by schooltime physical activity (n = 19), enhanced physical education (n = 15), and before and after school programmes (n = 14); one study explored both enhanced physical education and an after school programme. Lack of blinding of participants, personnel, and outcome assessors and loss to follow-up were the most common sources of bias.  Results show that school-based physical activity interventions probably result in little to no increase in time engaged in moderate to vigorous physical activity (mean difference (MD) 0.73 minutes/d, 95% confidence interval (CI) 0.16 to 1.30; 33 studies; moderate-certainty evidence) and may lead to little to no decrease in sedentary time (MD -3.78 minutes/d, 95% CI -7.80 to 0.24; 16 studies; low-certainty evidence). School-based physical activity interventions may improve physical fitness reported as maximal oxygen uptake (VO₂max) (MD 1.19 mL/kg/min, 95% CI 0.57 to 1.82; 13 studies; low-certainty evidence). School-based physical activity interventions may result in a very small decrease in BMI z-scores (MD -0.06, 95% CI -0.09 to -0.02; 21 studies; low-certainty evidence) and may not impact BMI expressed as kg/m² (MD -0.07, 95% CI -0.15 to 0.01; 50 studies; low-certainty evidence). We are very uncertain whether school-based physical activity interventions impact health-related quality of life or adverse events.

AUTHORS' CONCLUSIONS

Given the variability of results and the overall small effects, school staff and public health professionals must give the matter considerable thought before implementing school-based physical activity interventions. Given the heterogeneity of effects, the risk of bias, and findings that the magnitude of effect is generally small, results should be interpreted cautiously.

Development of a School-Based Intervention to Increase Physical Activity Levels Among Chinese Children: A Systematic Iterative Process Based on Behavior Change Wheel and Theoretical Domains Framework

Regular physical activity has a range of benefits for children's health, academic achievement, and behavioral development, yet they face barriers to participation. The aim of the study was to systematically develop an intervention for improving Chinese children's physical activity participation, using the Behavior Change Wheel (BCW) and Theoretical Domains Framework (TDF). The BCW and TDF were used to (i) understand the behavior (through literature review), (ii) identify intervention options (through the TDF-intervention function mapping table), (iii) select content and implementation options [through behavior change technique (BCT) taxonomy and literature review], and (iv) finalize the intervention content (through expert consultation, patient and public involvement and engagement, and piloting). A systematic iterative process was followed to design the intervention by following the steps recommended by the BCW. This systematic process identified 10 relevant TDF domains to encourage engagement in physical activity among Chinese children: knowledge, memory, attention and decision processes, social influences, environmental context and resources, beliefs about capabilities, beliefs about consequences, social/professional role and identity, emotions, and physical skills. It resulted in the selection of seven intervention functions (education, persuasion, environmental restricting, modeling, enablement, training, and incentivization) and 21 BCTs in the program, delivered over a period of 16 weeks. The BCW and TDF allowed an in-depth consideration of the physical activity behavior among Chinese children and provided a systematic framework for developing the intervention. A feasibility study is now being undertaken to determine its acceptability and utility.

A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions

BACKGROUND

Evaluation of physical activity interventions is vital to inform, and justify, evidence-based policy and practice to support population-wide changes in physical activity. Several evaluation frameworks and guidance documents have been developed to facilitate the evaluation and reporting of evaluation studies in public health. However, there is a lack of evidence about whether frameworks are being used to guide evaluation. There continues to be claims of poor and inconsistent reporting in evaluation studies. The aim of this review was to assess the use of evaluation frameworks and the quality of reporting of how they were applied within evaluation studies of physical activity interventions.

OBJECTIVES

1. To identify whether evaluation frameworks are reported to have been used within evaluation studies of physical activity interventions, and which frameworks have been used. 2. To appraise the quality of reporting with regards to how evaluation frameworks have been used.

METHOD

We developed a checklist of indicators to enable a critical appraisal of the use and reporting of different evaluation frameworks in evaluation studies. We conducted a systematic search and review of evaluation studies published between 2015 and the date of the search to appraise the use and reporting of evaluation frameworks. A narrative synthesis is provided.

RESULTS

The review identified 292 evaluation studies of physical activity interventions, only 69 (23%) of these mentioned using an evaluation framework, and only 16 different frameworks were referred to. There was variation in the quality of reporting of framework use. 51 (74%) studies were identified as being explicitly based on the stated framework, however only 26 (38%) provided detailed descriptions consistently across all the checklist indicators. Details of adaptations and limitations in how frameworks were applied were less frequently reported. The review also highlighted variability in the reporting of intervention components. More consistent and precise reporting of framework and intervention components is needed.

CONCLUSION

Evaluation frameworks can facilitate a more systematic evaluation report and we argue their limited use suggests missed opportunities to apply frameworks to guide evaluation and reporting in evaluation studies. Variability in the quality of reporting of framework use limits the comparability and transferability of evidence. Where a framework has been used, the checklist of indicators can be employed to facilitate the reporting of an evaluation study and to review the quality of an evaluation report.

Formative Process Evaluation of the "Connect" Physical Activity Feasibility Trial for Adolescents

Most interventions do not reach full implementation in real-world settings. Due to this issue, formative process evaluation during pilot programs can be especially useful to understand implementation strengths and areas for improvement so that full implementation can be reached in future iterations. This study demonstrated how a formative process evaluation of the Connect through Positive Leisure Activities for Youth (Connect) pilot informed course corrections for year 2 implementation. Connect is an intervention to promote a positive social motivational climate for physical activity (PA) in pre-existing after school programs. Connect ran 3 days a week for 8 weeks and had 2 components: a 30-minute “Get-to-Know-You” (GTKY) session and a 60-minute PA session. Formative evaluation was assessed using an observational tool and staff surveys. Changes in youth PA during program hours was assessed as a process outcome using the System for Observing Children’s Activity and Relationships during Play (SOCARP). All Connect essential elements were assessed with the observational tool including (a) social goal-oriented support; (b) collaborative, cooperative play; (c) equal treatment/access; and (d) an inclusive and engaging climate. Adequate dose was achieved on all items in all sessions. Although GTKY and PA sessions both reached high fidelity in promoting equal treatment and access, success in reaching fidelity varied for the 3 remaining essential elements. Post-intervention staff surveys indicated acceptability/adoptability of the Connect program and SOCARP observations indicated significant increases in PA from baseline to post-intervention. Changes for year 2 implementation based on the findings are discussed.

A revised teaching assistant-led extracurricular physical activity programme for 8- to 10-year-olds: the Action 3:30R feasibility cluster RCT

Background

Many children do not meet the recommended guidelines for physical activity. The after-school period may be a critical time for children to participate in physical activity. Teaching assistants are important within the school system and could be trained to deliver after-school physical activity programmes. Our previous work showed that a teaching assistant-led after-school physical activity intervention held promise.

Objectives

To examine the feasibility, evidence of promise and cost of Action 3:30R, a revised after-school physical activity intervention.

Design

A cluster-randomised feasibility study, including process and economic evaluations.

Setting

The setting was 12 primary schools in south-west England.

Participants

The participants were Year 4 and 5 children (aged 8–10 years).

Intervention

Two teaching assistants from each intervention school attended a 25-hour (5-day) training course focused on how to deliver an after-school physical activity programme. As Action 3:30 is grounded in self-determination theory, the training focused on promoting children’s autonomy, belonging and competence. Teaching assistants received resources to aid them in delivering a 60-minute after-school physical activity programme twice per week for 15 weeks (i.e. 30 sessions).

Main outcome measures

Measures focused on feasibility outcomes and evidence of promise. Feasibility measures included the recruitment of schools and pupils and the attendance at the after-school programme. Evidence of promise was measured by comparing accelerometer-determined minutes of moderate to vigorous physical activity between the arms at follow-up. Process evaluation measures were conducted using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. The cost of delivery was also assessed.

Results

Twelve primary schools were recruited and 41% of eligible pupils consented, 49% of whom were girls. Schools were randomised after baseline measures: six to the intervention arm (n = 170 pupils) and six to the control arm (n = 165 pupils). Two schools allocated to the intervention arm withdrew from the study before the start of the intervention, leaving 111 pupils in the intervention arm. The intervention training was well attended and positively received; eight out of nine teaching assistants attended 100% of the sessions. Action 3:30R clubs were well attended; 74% of pupils attended at least 50% of the 30 sessions. Mean weekday moderate to vigorous physical activity did not differ between the arms at follow-up (–0.5 minutes, 95% confidence interval –4.57 to 3.57 minutes). The process evaluation revealed that Action 3:30R was received positively by pupils, teaching assistants and key contacts in intervention schools. Pupils enjoyed Action 3:30R, and teaching assistants and pupils perceived the teaching style to be autonomy-supportive. Economic evaluation showed that Action 3:30R is inexpensive; the estimated cost of the programme after 1 year was £1.64 per pupil per session.

Limitations

A reason for withdrawing was given by one school but not by the other. The reason given was an inability to release staff for training.

Conclusions

Action 3:30R is a low-cost, feasible after-school programme that engages a range of pupils and offers continuing professional development to teaching assistants. However, Action 3:30R does not show evidence of promise in increasing levels of moderate to vigorous physical activity and does not warrant a trial evaluation.

Future work

Future research should focus on improving the quality of current after-school provision in primary schools to increase physical activity.

Trial registration

Current Controlled Trials ISRCTN34001941.

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 7, No. 19. See the NIHR Journals Library website for further project information.

Action 3:30R: process evaluation of a cluster randomised feasibility study of a revised teaching assistant-led extracurricular physical activity intervention for 8 to 10 year olds

Background

Numerous interventions to increase children’s physical activity levels are published, yet, few studies report indicators of external validity. Process evaluations are critical for assessing intervention implementation, sustainability and effectiveness. A mixed-methods process evaluation, using the RE-AIM framework, was conducted to evaluate the internal and external validity of Action 3:30R, a revised teaching assistant-led after-school intervention which aimed to increase physical activity in children aged 8–10 years and was underpinned by Self-determination Theory (SDT).

Methods

Data were collected and reported in line with the five components of RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance). Quantitative measures included logbooks, registers and self-reported teaching-efficacy, autonomy support, child enjoyment and perceived exertion questionnaires. Questionnaire data were collected at three points throughout the 15-week intervention. Observations by trained researchers were also conducted to assess fidelity to the intervention manual and its underpinning theory. Post-intervention focus groups with pupils and interviews with teaching assistants (TAs), school staff and external stakeholders explored the implementation and potential sustainability of Action 3:30R from stakeholders’ perspectives.

Results

Action 3:30R appealed to a broad range of pupils, including girls and less-active pupils. The Action 3:30R TA training was implemented as intended and was perceived as valuable professional development. Releasing staff for training was a barrier in two of the six intervention schools, which were unable to deliver the intervention as a result. Pupils enjoyed the intervention, and the Action 3:30R core principles underpinned by SDT were implemented with high fidelity, as was the intervention itself. Scheduling conflicts with other clubs and lack of parental support were perceived as the main barriers to recruitment and attendance. Lack of space and season were cited as the main barriers affecting the quality of delivery. The study shows evidence of maintenance, as one intervention school decided to continue Action 3:30R beyond the study. Funding and continued TA training were suggested as factors which may affect the maintenance of Action 3:30R.

Conclusions

Action 3:30R is an enjoyable, autonomy-supportive after-school programme, which engages a range of pupils and offers TAs valuable training. RE-AIM provided helpful structure and is recommended for intervention evaluations.

Trial registration

ISRCTN34001941. Prospectively registered 01/12/2016.

Electronic supplementary material

The online version of this article (10.1186/s12889-019-7347-3) contains supplementary material, which is available to authorized users.

The iCook 4-H Study: Report on Physical Activity and Sedentary Time in Youth Participating in a Multicomponent Program Promoting Family Cooking, Eating, and Playing Together

OBJECTIVE

To report physical activity and sedentary time outcomes of youth in iCook 4-H.

STUDY DESIGN AND SETTING

iCook 4-H was a 5-state, randomized, control-treatment, family-based childhood obesity prevention intervention promoting cooking, eating, and playing together.

PARTICIPANTS AND INTERVENTION

Youth aged 9-10 years and the main preparer of their meals participated in the 12-week program followed by monthly newsletters and biyearly booster sessions until 24 months.

MAIN OUTCOME MEASURE(S)

A total of 155 youth were fitted with an Actigraph GT3X+ accelerometer, which they wore for 7 days at baseline and 4, 12, and 24 months to measure mean daily minutes per hour of waking wear time for sedentary time (ST), light physical activity (PA) (LPA), moderate PA, vigorous PA, and moderate to vigorous PA. Self-reported PA was assessed using the Block Kids Physical Activity Screener and additional questions querying for the program goal of the frequency of family actively playing together. Linear mixed models were used to determine differences from baseline to 24 months. Significance was set at P ≤ .05.

RESULTS

There was a significant (P < .05) group × time interaction for LPA (adjusted interaction B estimate, 95% confidence interval; 0.18 [0.05, 0.30]) and ST (-0.15 [-0.26, -0.04]); ST increased and LPA decreased in the treatment group. There were no differences in other accelerometer-derived PA measures, self-report Block Kids Physical Activity Screener measures, or frequency of family actively playing together at any time point.

CONCLUSIONS AND IMPLICATIONS

iCook 4-H was a multicomponent program observing youth aged 9-10 years for 24 months that focused on enhancing cooking skills, mealtime behavior and conversation, and PA through daily family activities. Greater emphasis on developing PA skills, changing environmental factors, and increasing PA both in and after school may be needed.

Heart rate, energy expenditure, and affective responses from children participating in trampoline park sessions compared with traditional extra-curricular sports clubs

BACKGROUND

Lack of physical activity (PA) is becoming an issue in younger populations. Trampoline parks are newly popular environments for PA yet research on their use is scarce. Thus the present study compared heart rate, energy expenditure, and affective responses in children participating in trampoline park sessions compared with extracurricular sports clubs.

METHODS

Children (aged 6-11 years; N.=16 females, N.=10 males) participated in 3 trampoline park sessions and 3 extracurricular sports club sessions lasting ~45 minutes over 3 weeks. Heart rate, energy expenditure, and affective responses through the circumplex model, were measured.

RESULTS

Both conditions elicited moderate-vigorous PA. Average heart rate (mean difference [95%CIs]=27.6 fc [23.5 to 31.8]), peak heart rate (mean difference [95%CIs]=24.2 fc [20.8 to 27.6]) and energy expenditure (mean difference [95%CIs]=3.2 kcals.min-1 [2.7 to 3.6]) were all significantly higher for the trampoline sessions. Affective responses for both conditions elicited feelings of "excitement."

CONCLUSIONS

Both extracurricular sports clubs and trampoline park activities provide moderate-vigorous PA, though the latter may result in higher heart rate and energy expenditure responses. Both however produce similar positive affective responses. As such, both could be valuable options for PA opportunities for children.

Action 3:30R: Results of a Cluster Randomised Feasibility Study of a Revised Teaching Assistant-Led Extracurricular Physical Activity Intervention for 8 to 10 Year Olds

Many children are not sufficiently physically active. We conducted a cluster-randomised feasibility trial of a revised after-school physical activity (PA) programme delivered by trained teaching assistants (TAs) to assess the potential evidence of promise for increasing moderate-to-vigorous physical activity (MVPA). Participants (n = 335) aged 8–10 years were recruited from 12 primary schools in South West England. Six schools were randomised to receive the intervention and six acted as non-intervention controls. In intervention schools, TAs were trained to deliver an after-school programme for 15 weeks. The difference in mean accelerometer-assessed MVPA between intervention and control schools was assessed at follow-up (T1). The cost of programme delivery was estimated. Two schools did not deliver the intervention, meaning four intervention and six control schools were analysed at T1. There was no evidence for a difference in MVPA at T1 between intervention and control groups. Programme delivery cost was estimated at £2.06 per pupil per session. Existing provision in the 12 schools cost £5.91 per pupil per session. Action 3:30 was feasible to deliver and considerably cheaper than existing after-school provision. No difference in weekday MVPA was observed at T1 between the two groups, thus progression to a full trial is not warranted.

Process evaluation of a pilot multi-component physical activity intervention - active schools: Skelmersdale

BACKGROUND

Schools have been identified as key environments to promote child physical activity (PA). Implementation of multi-component PA interventions within schools is advocated but research has showed that they may not always be effective at increasing child PA. Results of the Active Schools: Skelmersdale (AS:Sk) multi-component pilot intervention indicated no significant positive change to child PA levels. Process evaluations can provide information on which aspects of an intervention were delivered and how. Therefore, the purpose of this study was to use a combination of methods to elicit child and teacher perceptions regarding the feasibility and acceptability of the AS:Sk intervention, alongside systematic researcher observations. The overarching study aim was to understand how schools implemented the AS:Sk intervention, with a specific focus on the frequency of intervention component implementation, and how the components were incorporated into the school day.

METHODS

The study generated five data sets. Data elicited from 18 participating children via a write draw, show and tell task included, frequency counts of most enjoyable intervention components, drawings, and verbatim data. Teacher verbatim data was collected from 3 interviews, and 18 researcher observations were recorded using field notes. The data sources were pooled to produce the themes presented in the results section.

RESULTS

The combination of data sources revealed four themes and 16 sub-themes. Implementation methods: how and when the components were implemented in schools. Child engagement: enjoyment and positive behaviour. Facilitators: peer influence, teacher influence, staggered implementation, incentives, rewards, challenges and competition, flexibility and adaptability, child ownership, routine. Barriers: time within an intense curriculum, space, sustaining child interest, parental support, school policies.

CONCLUSIONS

This study revealed that teachers believed classroom based activities were most feasible and acceptable due to the reduced implementation barriers of sufficient time and space. In contrast, children reported that the activities outside of the classroom were preferred. Future school-based PA interventions should aim to achieve a balance between routine PA at a set time and PA that is flexible and adaptable. Further process evaluations of multi-component school-based PA interventions are warranted to develop the limited evidence base.

Mixed method evaluation of the Virtual Traveller physically active lesson intervention: An analysis using the RE-AIM framework

BACKGROUND

Physically active lessons integrating movement into academic content are a way to increase children's physical activity levels. Virtual Traveller was a physically active lesson intervention set in Year 4 (aged 8-9) primary school classes in Greater London, UK. Implemented by classroom teachers, it was a six-week intervention providing 10-min physically active Virtual Field Trips three times a week. The aim of this paper is to report the process evaluation of the Virtual Traveller randomized controlled trial according to RE-AIM framework criteria (Reach, Effectiveness, Adoption, Implementation and Maintenance).

METHODS

A mixed methods approach to evaluation was conducted with five intervention group classes. Six sources of data were collected via informed consent logs, teacher session logs, teacher and pupil questionnaires, teacher interviews and pupil focus groups.

RESULTS

High participation and low attrition rates were identified (Reach) alongside positive evaluations of Virtual Traveller sessions from pupil and teachers (Effectiveness). Participants were from more deprived and ethnic backgrounds than local and national averages, with Virtual Traveller having the potential to be a free intervention (Adoption). 70% of sessions were delivered overall (Implementation) but no maintenance of the programme was evident at three month follow-up (Maintenance).

CONCLUSIONS

Mixed method evaluation of Virtual Traveller showed potential for it to be implemented as a low-cost physically active lesson intervention in UK primary schools.

Action 3:30R: protocol for a cluster randomised feasibility study of a revised teaching assistant-led extracurricular physical activity intervention for 8- to 10-year-olds

Background

Approximately half of 7-year-old children do not meet physical activity (PA) recommendations. Interventions targeting primary school children’s afterschool discretionary time could increase PA. Teaching assistants (TAs) are a school resource and could be trained to deliver after-school PA programmes. Building on earlier work, this paper describes the protocol for a cluster randomised feasibility study of a teaching assistant-led after-school intervention aimed at increasing PA levels of year 4 and 5 children (8–10 years old).

Methods

Phase 1—pre-baseline: 12 schools will be recruited. In all schools, self-reported PA will be measured in all consenting year 3 and 4 children. In four schools, pupils will additionally wear a waist-worn Actigraph accelerometer for 7 days.

Phase 2—baseline: schools will be randomised to one of two enhanced recruitment strategies being tested for children: (1) a club briefing and (2) the briefing plus a taster Action 3:30 session. Up to 30 children per school will be able to attend Action 3:30 sessions and will provide baseline data on height, weight, psychosocial variables and accelerometer-measured PA.

Phase 3—intervention and follow-up: Schools randomised into intervention or control arm. Intervention schools (n = 6) will receive a 15-week after-school programme when children are in years 4 and 5, run by TAs who have attended a 25-h Action 3:30 training programme. Control schools (n = 6) will continue with normal practice. Follow-up measures will be a repeat of baseline measures at the end of the 15-week intervention.

Phase 4—process evaluation: session attendance, perceived enjoyment and perceived exertion will be assessed during the intervention, as well as the economic impact on schools. Post-study qualitative assessments with TAs, school contacts and pupils will identify how the programme could be refined. Accelerometer-determined minutes of moderate-to-vigorous physical activity (MVPA) per day will be calculated as this is likely to be the primary outcome in a future definitive trial.

Discussion

The Action 3:30 cluster randomised feasibility trial will assess the public health potential of this intervention approach and provide the information necessary to progress to a definitive cluster randomised controlled trial.

Trial registration

ISRCTN34001941. Registered 01/12/2016.

Strategies for enhancing the implementation of school-based policies or practices targeting risk factors for chronic disease

BACKGROUND

A number of school-based policies or practices have been found to be effective in improving child diet and physical activity, and preventing excessive weight gain, tobacco or harmful alcohol use. Schools, however, frequently fail to implement such evidence-based interventions.

OBJECTIVES

The primary aims of the review are to examine the effectiveness of strategies aiming to improve the implementation of school-based policies, programs or practices to address child diet, physical activity, obesity, tobacco or alcohol use.Secondary objectives of the review are to: Examine the effectiveness of implementation strategies on health behaviour (e.g. fruit and vegetable consumption) and anthropometric outcomes (e.g. BMI, weight); describe the impact of such strategies on the knowledge, skills or attitudes of school staff involved in implementing health-promoting policies, programs or practices; describe the cost or cost-effectiveness of such strategies; and describe any unintended adverse effects of strategies on schools, school staff or children.

SEARCH METHODS

All electronic databases were searched on 16 July 2017 for studies published up to 31 August 2016. We searched the following electronic databases: Cochrane Library including the Cochrane Central Register of Controlled Trials (CENTRAL); MEDLINE; MEDLINE In-Process & Other Non-Indexed Citations; Embase Classic and Embase; PsycINFO; Education Resource Information Center (ERIC); Cumulative Index to Nursing and Allied Health Literature (CINAHL); Dissertations and Theses; and SCOPUS. We screened reference lists of all included trials for citations of other potentially relevant trials. We handsearched all publications between 2011 and 2016 in two specialty journals (Implementation Science and Journal of Translational Behavioral Medicine) and conducted searches of the WHO International Clinical Trials Registry Platform (ICTRP) (http://apps.who.int/trialsearch/) as well as the US National Institutes of Health registry (https://clinicaltrials.gov). We consulted with experts in the field to identify other relevant research.

SELECTION CRITERIA

'Implementation' was defined as the use of strategies to adopt and integrate evidence-based health interventions and to change practice patterns within specific settings. We included any trial (randomised or non-randomised) conducted at any scale, with a parallel control group that compared a strategy to implement policies or practices to address diet, physical activity, overweight or obesity, tobacco or alcohol use by school staff to 'no intervention', 'usual' practice or a different implementation strategy.

DATA COLLECTION AND ANALYSIS

Citation screening, data extraction and assessment of risk of bias was performed by review authors in pairs. Disagreements between review authors were resolved via consensus, or if required, by a third author. Considerable trial heterogeneity precluded meta-analysis. We narratively synthesised trial findings by describing the effect size of the primary outcome measure for policy or practice implementation (or the median of such measures where a single primary outcome was not stated).

MAIN RESULTS

We included 27 trials, 18 of which were conducted in the USA. Nineteen studies employed randomised controlled trial (RCT) designs. Fifteen trials tested strategies to implement healthy eating policies, practice or programs; six trials tested strategies targeting physical activity policies or practices; and three trials targeted tobacco policies or practices. Three trials targeted a combination of risk factors. None of the included trials sought to increase the implementation of interventions to delay initiation or reduce the consumption of alcohol. All trials examined multi-strategic implementation strategies and no two trials examined the same combinations of implementation strategies. The most common implementation strategies included educational materials, educational outreach and educational meetings. For all outcomes, the overall quality of evidence was very low and the risk of bias was high for the majority of trials for detection and performance bias.Among 13 trials reporting dichotomous implementation outcomes-the proportion of schools or school staff (e.g. classes) implementing a targeted policy or practice-the median unadjusted (improvement) effect sizes ranged from 8.5% to 66.6%. Of seven trials reporting the percentage of a practice, program or policy that had been implemented, the median unadjusted effect (improvement), relative to the control ranged from -8% to 43%. The effect, relative to control, reported in two trials assessing the impact of implementation strategies on the time per week teachers spent delivering targeted policies or practices ranged from 26.6 to 54.9 minutes per week. Among trials reporting other continuous implementation outcomes, findings were mixed. Four trials were conducted of strategies that sought to achieve implementation 'at scale', that is, across samples of at least 50 schools, of which improvements in implementation were reported in three trials.The impact of interventions on student health behaviour or weight status were mixed. Three of the eight trials with physical activity outcomes reported no significant improvements. Two trials reported reductions in tobacco use among intervention relative to control. Seven of nine trials reported no between-group differences on student overweight, obesity or adiposity. Positive improvements in child dietary intake were generally reported among trials reporting these outcomes. Three trials assessed the impact of implementation strategies on the attitudes of school staff and found mixed effects. Two trials specified in the study methods an assessment of potential unintended adverse effects, of which, they reported none. One trial reported implementation support did not significantly increase school revenue or expenses and another, conducted a formal economic evaluation, reporting the intervention to be cost-effective. Trial heterogeneity, and the lack of consistent terminology describing implementation strategies, were important limitations of the review.

AUTHORS' CONCLUSIONS

Given the very low quality of the available evidence, it is uncertain whether the strategies tested improve implementation of the targeted school-based policies or practices, student health behaviours, or the knowledge or attitudes of school staff. It is also uncertain if strategies to improve implementation are cost-effective or if they result in unintended adverse consequences. Further research is required to guide efforts to facilitate the translation of evidence into practice in this setting.

Examining reach, dose, and fidelity of the "Girls on the Move" after-school physical activity club: a process evaluation

Background

After-school programs represent a promising opportunity to assist adolescent girls’ in attaining adequate physical activity. Although evaluating the process of intervention implementation is important for determining if an intervention was delivered and received as intended, comprehensive information about process evaluation methods and results are rarely reported. The purpose of this article was to evaluate the reach, dose, and fidelity of a 90-minute after-school physical activity club offered 3 days a week. The club is 1 of 3 components included in a 17-week intervention designed for 5th-8th grade girls, the majority of whom were of minority and/or low socioeconomic status.

Methods

A total of 24 schools (12 intervention; 12 control) and 56–67 girls per school (total N = 1519 girls) were included in the Girls on the Move group randomized controlled trial. At the beginning of each of 3 academic years (2012–2015), 8 schools per year were randomized to receive either the intervention (n = 4) or control condition (n = 4). To evaluate the club, data collected via surveys from girls, club coaches and managers, and process evaluators were analyzed. To evaluate the opportunity for physical activity provided by the coaches and managers, process evaluators used an observation tool based on the System for Observing Fitness Instruction Time and Academic Learning Time - Physical Education. Girls wore accelerometers every other week during the club time.

Results

Mean attendance was 41 % with the average attendance in year 3 being higher than rates for years 1 or 2. Mean moderate-to-vigorous physical activity time was 21.85 minutes measured via accelerometry and 21.81 minutes observed by process evaluators. Satisfaction with the intervention was high. For the most part, process evaluators perceived the club was delivered as planned and reflected constructs of the Health Promotion Model and Self-Determination Theory. Areas contributing to success included using incentives and offering a variety of activities. Issues negatively impacting implementation included managing behavioral problems, having limited space for moderate-to-vigorous physical activity, dealing with inclement weather, and getting coaches to actively participate in all physical activities with the girls.

Conclusions

This process evaluation provides important information to guide future school-based physical activity intervention delivery. Barriers to implementation have been identified. Ways to overcome them warrant consideration when designing physical activity interventions. Research is needed to test innovative approaches for enhancing attendance and increasing girls’ moderate-to-vigorous physical activity in after-school programs.

Trial registration

ClinicalTrials.gov Identifier NCT01503333. Registered 23 December, 2011.

Bristol Girls Dance Project: a cluster randomised controlled trial of an after-school dance programme to increase physical activity among 11- to 12-year-old girls

Background

Many children do not meet UK physical activity (PA) guidelines. Girls are less active than boys, and the age-related decline in activity is steeper for girls. Dance is the favourite form of PA among adolescent girls in the UK. Participation in after-school dance classes could significantly contribute to girls’ PA. Therefore, after-school dance may be effective for increasing PA levels.

Objectives

To determine the effectiveness and cost-effectiveness of a dance-based intervention to increase the objectively assessed mean weekday minutes of moderate- to vigorous-intensity physical activity (MVPA) of Year 7 girls (11- and 12-year olds) 1 year after baseline measurement.

Design

Two-arm cluster randomised controlled trial and economic evaluation. Year 7 girls in participant schools received a ‘taster’ session and were invited to participate. Up to 33 girls per school were able to participate. Schools were randomly assigned (equal numbers) to intervention or control arms.

Setting

A total of 18 mainstream secondary schools across greater Bristol.

Participants

Year 7 girls in participating schools who could participate in physical education.

Intervention

Nine intervention schools received an after-school dance intervention (40 × 75-minute sessions) underpinned by self-determination theory, which attempts to improve intrinsic motivation for being active, and delivered by external dance instructors. Control schools continued as normal.

Main outcome measures

The main outcome was accelerometer-assessed mean minutes of MVPA at T2. Measures were assessed at baseline (T0), the end of the intervention (T1) and at T0 + 52 weeks (T2).

Results

Baseline MVPA levels were high. A total of 508 girls were included in the primary analysis, which found no difference in weekday MVPA between trial arms. There was no effect on secondary accelerometer outcomes. Data were subjected to a per-protocol analysis and no effect was found. However, at T1, girls who attended dance classes had 4.61 minutes more of MVPA and 14.27 minutes more of light-intensity activity between 15.00 and 17.00 on the days on which they attended intervention sessions. The intervention was inexpensive at £73 per participant (£63 when excluding dance instructor travel) but was not cost-effective owing to the ineffectiveness of the intervention. The European Quality of Life-5 Dimensions Youth survey data were unresponsive to changes in the sample. The process evaluation reported that girls in attendance enjoyed the sessions, that exertion levels were low during sessions and that attendance was low and declined. Fidelity to the session-plan manual was low but theoretical fidelity (to self-determination theory) was good. Qualitative information provides information for improving future interventions.

Conclusions

The intervention was enjoyed by participants. However, there was no difference in the MVPA levels (which were high at baseline) of girls allocated to receive dance compared with girls receiving the control. High baseline MVPA levels indicate that the study appealed to an already active cohort and, therefore, may not have targeted those most in need of an intervention. Dance is an enjoyable activity for adolescent girls and could be further trialled as a means by which to increase PA. Research might consider the impact of dividing the intervention period into smaller blocks.

Trial Registration

Current Controlled Trials ISRCTN52882523.

Funding

The National Institute for Health Research Public Health Research programme. The work was also undertaken with the support of the Centre for the Development and Evaluation of Complex Interventions for Public Health Improvement (DECIPHer), a UK Clinical Research Collaboration (UKCRC) PHR Centre of Excellence. Joint funding (MR/KO232331/1) from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the Welsh Government and the Wellcome Trust, under the auspices of the UKCRC, is gratefully acknowledged. This study was designed and delivered in collaboration with the Bristol Randomised Trials Collaboration, a UKCRC Registered Clinical Trials Unit in receipt of NIHR Clinical Trials Unit support funding. All intervention costs were funded by the respective councils to which the participant schools were affiliated, namely North Somerset Council, Bristol City Council, and Bath and North East Somerset Council.

Process evaluation of the Bristol girls dance project

Background

The Bristol Girls Dance Project was a cluster randomised controlled trial that aimed to increase objectively measured moderate-to-vigorous physical activity (MVPA) levels of Year 7 (age 11–12) girls through a dance-based after-school intervention. The intervention was delivered in nine schools and consisted of up to forty after-school dance sessions. This paper reports on the main findings from the detailed process evaluation that was conducted.

Methods

Quantitative and qualitative data were collected from intervention schools. Dose and fidelity were reported by dance instructors at every session. Intervention dose was defined as attending two thirds of sessions and was measured by attendance registers. Fidelity to the intervention manual was reported by dance instructors. On four randomly-selected occasions, participants reported their perceived level of exertion and enjoyment. Reasons for non-attendance were self-reported at the end of the intervention. Semi-structured interviews were conducted with all dance instructors who delivered the intervention (n = 10) and school contacts (n = 9) in intervention schools. A focus group was conducted with girls who participated in each intervention school (n = 9).

Results

The study did not affect girls’ MVPA. An average of 31.7 girls participated in each school, with 9.1 per school receiving the intervention dose. Mean attendance and instructors’ fidelity to the intervention manual decreased over time. The decline in attendance was largely attributed to extraneous factors common to after-school activities. Qualitative data suggest that the training and intervention manual were helpful to most instructors. Participant ratings of session enjoyment were high but perceived exertion was low, however, girls found parts of the intervention challenging.

Conclusions

The intervention was enjoyed by participants. Attendance at the intervention sessions was low but typical of after-school activities. Participants reported that the intervention brought about numerous health and social benefits and improved their dance-based knowledge and skills. The intervention could be improved by reducing the number of girls allowed to participate in each school and providing longer and more in-depth training to those delivering the intervention.

Trial registration

ISRCTN52882523 Registered 25th April 2013.