Optimizing Implementation of Obesity Prevention Programs: A Qualitative Investigation Within a Large-Scale Randomized Controlled Trial

Quantitative and Qualitative Strategies to Strengthen Internal Validity in Randomized Trials

Although the randomized controlled trial (RCT) is the most reliable design to infer causality, evidence suggests that it is vulnerable to biases that weaken internal validity. In this paper, we review factors that introduce biases in RCTs and we propose quantitative and qualitative strategies for colleting relevant data to strengthen internal validity. The factors are related to participants' reactions to randomization, attrition, treatment perceptions, and implementation of the intervention. The way in which these factors operate is explained and pertinent empirical evidence is synthesized. Quantitative and qualitative strategies are described. Researchers can plan to assess these factors and examine their influence, providing evidence of what actually contributed to the interventions' causal impact.

A description of health care system factors in the implementation of universal weight management services for children with overweight or obesity: case studies from Queensland and New South Wales, Australia

Background

The prevalence of childhood obesity poses an urgent global challenge. The World Health Organization (WHO) Commission on Ending Childhood Obesity recommends the provision of appropriate family-based, lifestyle weight management services through universal health care to support families of children with overweight or obesity; however, there are few examples of their implementation ‘at scale’. The purpose of this research was to compare and contrast the impact of system and organisational factors on the implementation of childhood obesity management services within two Australian States (New South Wales and Queensland) to comprehensively describe their influence on the achievement of the WHO recommendation.

Methods

Purposeful stratified sampling was used to select health service study sites (n = 16) representative of program implementation (none, discontinued, repeated) and geographic location within each State. Within each health service site, staff involved in program delivery, co-ordination and management roles participated (n = 39). An additional 11 staff involved in implementation at State level also participated. The Consolidated Framework for Implementation Research (CFIR) was used to develop interview scripts. Telephone interviews were recorded and transcribed. Transcripts were thematically coded and scored according to CFIR constructs and rating rules to identify enablers and barriers to implementation according to sample characteristics.

Results

New South Wales achieved ongoing implementation; Queensland did not. Enablers included a quality evidence-based program, State government recognition of the urgency of the health issue and a commitment to address it, formally appointed and funded internal implementation leaders, strong communication and reporting at all levels. Barriers included the complexity of the health issue, in particular a lack of clear roles and responsibilities for local health service delivery, inadequate ongoing funding and challenges in meeting the diverse needs of families.

Conclusions

This research is an important progression of the evidence base in relation to the translation of childhood obesity management trials into routine health service delivery. Understanding enablers and barriers to program implementation ‘at scale’ is imperative to inform future planning and investment by Australia and WHO member states to meet their commitment to deliver childhood weight management services as part of universal health coverage.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0801-2) contains supplementary material, which is available to authorized users.

Evaluation of a large healthy lifestyle program: informing program implementation and scale-up in the prevention of obesity

BACKGROUND

The Healthy Lifestyle Program for women (HeLP-her) is a low-intensity, self-management program which has demonstrated efficacy in preventing excess weight gain in women. However, little is known about the implementation, reach, and sustainability of low-intensity prevention programs in rural settings, where risk for obesity in women is higher than urban settings. We aimed to evaluate a low-intensity healthy lifestyle program delivered to women in a rural setting to inform development of effective community prevention programs.

METHODS

A mixed method hybrid implementation and evaluation study, guided by the RE-AIM framework (addressing the Reach, Effectiveness, Adoption, Implementation, and Maintenance), was undertaken. Data collection tools included anthropometric measures, program checklists, questionnaires, and semi-structured interviews with participants and local stakeholders. The RE-AIM self-audit tool was applied to assess evaluation rigor.

RESULTS

Six hundred and forty-nine women from 41 relatively socio-economic disadvantaged communities in Australia participated: mean age 39.6 years (±SD 6.7) and body mass index of 28.8 kg/m2 (±SD 6.9). A between-group weight difference of -0.92 kg (95% CI -1.67 to -0.16) showed program effectiveness. Reach was broad across 41 towns with 62% of participants reporting influencing some of the health behaviors of their families. Strong implementation fidelity was achieved with good retention rates at 1 year (76%) and high participant satisfaction (82% of participants willing to recommend this program). Over 300 multi-level community partnerships were established supporting high adoption. Stakeholders reported potential capacity to implement and sustain the prevention program in resource poor rural settings, due to the low-intensity design and minimal resources required.

CONCLUSIONS

Our comprehensive RE-AIM evaluation demonstrates that an evidence-based obesity prevention program can be successfully implemented in real-world settings. The program achieved broad reach, effectiveness, and satisfaction at the community and stakeholder level, revealing potential for program sustainability. The evaluation addressed implementation knowledge gaps to support future obesity prevention program scale-up.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trial Registry ACTRN 12612000115831 [ http://www.anzctr.org.au/ ].