The design of a real-time formative evaluation of the implementation process of lifestyle interventions at two worksites using a 7-step strategy (BRAVO@Work)

A study protocol of the adaptation and evaluation by means of a cluster-RCT of an integrated workplace health promotion program based on a European good practice

Background

An integrated workplace health promotion program (WHPP) which targets multiple lifestyle factors at different levels (individual and organizational) is potentially more effective than a single component WHPP. The aim of this study is to describe the protocol of a study to tailor a European good practice of such an integral approach to the Dutch context and to evaluate its effectiveness and implementation.

Methods

This study consists of two components. First, the five steps of the Map of Adaptation Process (MAP) will be followed to tailor the Lombardy WHP to the Dutch context. Both the employers and employees will be actively involved in this process. Second, the effectiveness of the integrated Dutch WHPP will be evaluated in a clustered randomized controlled trial (C-RCT) with measurements at baseline, 6 months and 12 months. Clusters will be composed based on working locations or units - dependent on the organization’s structure and randomization within each organization takes place after baseline measurements. Primary outcome will be a combined lifestyle score. Secondary outcomes will be the separate lifestyle behaviors targeted, stress, work-life balance, need for recovery, general health, and well-being. Simultaneously, a process evaluation will be conducted. The study population will consist of employees from multiple organizations in different industry sectors. Organizations in the intervention condition will receive the integrated Dutch WHPP during 12 months, consisting of an implementation plan and a catalogue with activities for multiple lifestyle themes on various domains: 1) screening and support; 2) information and education; 3) adjustments in the social, digital or physical environment; and 4) policy.

Discussion

The MAP approach provides an appropriate framework to systematically adapt an existing WHPP to the Dutch context, involving both employers and employees and retaining the core elements, i.e. the catalogue with evidence-based activities on multiple lifestyle themes and domains enabling an integrated approach. The following process and effect evaluation will contribute to further insight in the actual implementation and effectiveness of the integrated WHP approach.

Trial registration

NTR (trialregister.nl), NL9526. Registered on 3 June 2021.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13352-0.

Frameworks for implementation of policies promoting healthy nutrition and physically active lifestyle: systematic review

Background

Policy frameworks focusing on policy implementation may vary in terms of their scope, included constructs, relationships between the constructs, and context factors. Although multiple policy implementation frameworks exist, the overarching synthesis characterizing differences between the frameworks is missing. This study investigated frameworks guiding implementation of policies aiming at healthy nutrition, physical activity promotion, and a reduction of sedentary behavior. In particular, we aimed at examining the scope of the frameworks and the content of included constructs (e.g., referring to implementation processes, determinants, or implementation evaluation), the level at which these constructs operate (e.g., the individual level, the organizational/community level), relationships between the constructs, and the inclusion of equity factors.

Methods

A systematic review (the PROSPERO registration no. CRD42019133251) was conducted using 9 databases and 8 stakeholder websites. The content of 38 policy implementation frameworks was coded and analyzed.

Results

Across the frameworks, 47.4% (18 in 38) addressed three aims: description of the process, determinants, and the evaluation of implementation. The majority of frameworks (65.8%; 25 in 38) accounted for constructs from three levels: individual, organizational/community, and the system level. System-level constructs were included less often (76.3%; 29 in 38) than individual-level or organizational/community-level constructs (86.8% [33 in 38 frameworks] and 94.7% [36 in 38 frameworks] respectively). The majority of frameworks (84.2%, 32 in 38) included at least some sections that were solely of descriptive character (a list of unassociated constructs); 50.0% (19 in 38) included sections of prescriptive character (general steps of implementation); 60.5% (23 in 38) accounted for explanatory sections (assuming bi- or uni-directorial associations). The complex system approach was accounted for only in 21.1% (8 in 38) of frameworks. More than half (55.3%; 21 in 38) of frameworks did not account for any equity constructs (e.g., socioeconomic status, culture).

Conclusions

The majority of policy implementation frameworks have two or three aims (combining processes, determinants and/or the evaluation of implementation), include multi-level constructs (although the system-level determinants are less frequently included than those from the individual- or organizational/community-level), combine sections of purely descriptive character with sections accounting for prescriptive and/or explanatory associations, and are likely to include a little or no equity constructs.

Registration

PROSPERO, #CRD42019133251.

Choice Architecture Cueing to Healthier Dietary Choices and Physical Activity at the Workplace: Implementation and Feasibility Evaluation

Redesigning choice environments appears a promising approach to encourage healthier eating and physical activity, but little evidence exists of the feasibility of this approach in real-world settings. The aim of this paper is to portray the implementation and feasibility assessment of a 12-month mixed-methods intervention study, StopDia at Work, targeting the environment of 53 diverse worksites. The intervention was conducted within a type 2 diabetes prevention study, StopDia. We assessed feasibility through the fidelity, facilitators and barriers, and maintenance of implementation, building on implementer interviews (n = 61 informants) and observations of the worksites at six (t1) and twelve months (t2). We analysed quantitative data with Kruskall-Wallis and Mann-Whitney U tests and qualitative data with content analysis. Intervention sites altogether implemented 23 various choice architectural strategies (median 3, range 0-14 strategies/site), employing 21 behaviour change mechanisms. Quantitative analysis found implementation was successful in 66%, imperfect in 25%, and failed in 9% of evaluated cases. These ratings were independent of the ease of implementation of applied strategies and reminders that implementers received. Researchers' assistance in intervention launch (p = 0.02) and direct contact to intervention sites (p < 0.001) predicted higher fidelity at t1, but not at t2. Qualitative content analysis identified facilitators and barriers related to the organisation, intervention, worksite environment, implementer, and user. Contributors of successful implementation included apt implementers, sufficient implementer training, careful planning, integration into worksite values and activities, and management support. After the study, 49% of the worksites intended to maintain the implementation in some form. Overall, the choice architecture approach seems suitable for workplace health promotion, but a range of practicalities warrant consideration while designing real-world implementation.

Prevention and management of musculoskeletal pain in nursing staff by a multifaceted intervention in the workplace: design of a cluster randomized controlled trial with effectiveness, process and economic evaluation (INTEVAL_Spain)

Background

Musculoskeletal pain (MSP) is the leading cause of years lived with disability. In consequence, to reduce MSP and its associated sickness absence is a major challenge. Previous interventions have been developed to reduce MSP and improve return to work of workers with MSP, but combined approaches and exhaustive evaluation are needed. The objective of the INTEVAL_Spain project is to evaluate the effectiveness of a multifaceted intervention in the workplace to prevent and manage MSP in nursing staff.

Methods

The study is designed as a two-armed cluster randomized controlled trial with a late intervention control group. The hospital units are the clusters of randomization and participants are nurses and aides. An evidence-based multi-component intervention was designed combining participatory ergonomics, case management and health promotion. Both the intervention and the control groups receive occupational health care as usual. Data are collected at baseline, and after six and 12 months. The primary outcomes are prevalence of MSP and incidence and duration of sickness absence due to MSP. Secondary outcomes are work role functioning and organizational preventive culture. The intervention process will be assessed through quantitative indicators of recruitment, context, reach, dose supplied, dose received, fidelity and satisfaction, and qualitative approaches including discussion groups of participants and experts. The economic evaluation will include cost-effectiveness and cost-utility, calculated from the societal and the National Health System perspectives.

Discussion

Workplace health programs are one of the best options for the prevention and control of non-communicable diseases. The main feature of this study is its multifaceted, multidisciplinary and de-medicalized intervention, which encompasses three evidence-based interventions and covers all three levels of prevention, which have not been previously unified in a single intervention. Also, it includes a comprehensive quantitative and qualitative evaluation of the intervention process, health results, and economic impact. This study could open the possibility of a new paradigm for the prevention and management of MSP and associated sickness absence approach at the workplace.

Trial registration

Current Controlled Trials ISRCTN15780649 Retrospectively registered 13th July 2018.

Strategies to improve the implementation of workplace-based policies or practices targeting tobacco, alcohol, diet, physical activity and obesity

BACKGROUND

Given the substantial period of time adults spend in their workplaces each day, these provide an opportune setting for interventions addressing modifiable behavioural risk factors for chronic disease. Previous reviews of trials of workplace-based interventions suggest they can be effective in modifying a range of risk factors including diet, physical activity, obesity, risky alcohol use and tobacco use. However, such interventions are often poorly implemented in workplaces, limiting their impact on employee health. Identifying strategies that are effective in improving the implementation of workplace-based interventions has the potential to improve their effects on health outcomes.

OBJECTIVES

To assess the effects of strategies for improving the implementation of workplace-based policies or practices targeting diet, physical activity, obesity, tobacco use and alcohol use.Secondary objectives were to assess the impact of such strategies on employee health behaviours, including dietary intake, physical activity, weight status, and alcohol and tobacco use; evaluate their cost-effectiveness; and identify any unintended adverse effects of implementation strategies on workplaces or workplace staff.

SEARCH METHODS

We searched the following electronic databases on 31 August 2017: CENTRAL; MEDLINE; MEDLINE In Process; the Campbell Library; PsycINFO; Education Resource Information Center (ERIC); Cumulative Index to Nursing and Allied Health Literature (CINAHL); and Scopus. We also handsearched all publications between August 2012 and September 2017 in two speciality journals: Implementation Science and Journal of Translational Behavioral Medicine. We conducted searches up to September 2017 in Dissertations and Theses, the WHO International Clinical Trials Registry Platform, and the US National Institutes of Health Registry. We screened the reference lists of included trials and contacted authors to identify other potentially relevant trials. We also consulted experts in the field to identify other relevant research.

SELECTION CRITERIA

Implementation strategies were defined as strategies specifically employed to improve the implementation of health interventions into routine practice within specific settings. We included any trial with a parallel control group (randomised or non-randomised) and conducted at any scale that compared strategies to support implementation of workplace policies or practices targeting diet, physical activity, obesity, risky alcohol use or tobacco use versus no intervention (i.e. wait-list, usual practice or minimal support control) or another implementation strategy. Implementation strategies could include those identified by the Effective Practice and Organisation of Care (EPOC) taxonomy such as quality improvement initiatives and education and training, as well as other strategies. Implementation interventions could target policies or practices directly instituted in the workplace environment, as well as workplace-instituted efforts encouraging the use of external health promotion services (e.g. gym membership subsidies).

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently performed citation screening, data extraction and 'Risk of bias' assessment, resolving disagreements via consensus or a third reviewer. We narratively synthesised findings for all included trials by first describing trial characteristics, participants, interventions and outcomes. We then described the effect size of the outcome measure for policy or practice implementation. We performed meta-analysis of implementation outcomes for trials of comparable design and outcome.

MAIN RESULTS

We included six trials, four of which took place in the USA. Four trials employed randomised controlled trial (RCT) designs. Trials were conducted in workplaces from the manufacturing, industrial and services-based sectors. The sample sizes of workplaces ranged from 12 to 114. Workplace policies and practices targeted included: healthy catering policies; point-of-purchase nutrition labelling; environmental supports for healthy eating and physical activity; tobacco control policies; weight management programmes; and adherence to guidelines for staff health promotion. All implementation interventions utilised multiple implementation strategies, the most common of which were educational meetings, tailored interventions and local consensus processes. Four trials compared an implementation strategy intervention with a no intervention control, one trial compared different implementation interventions, and one three-arm trial compared two implementation strategies with each other and a control. Four trials reported a single implementation outcome, whilst the other two reported multiple outcomes. Investigators assessed outcomes using surveys, audits and environmental observations. We judged most trials to be at high risk of performance and detection bias and at unclear risk of reporting and attrition bias.Of the five trials comparing implementation strategies with a no intervention control, pooled analysis was possible for three RCTs reporting continuous score-based measures of implementation outcomes. The meta-analysis found no difference in standardised effects (standardised mean difference (SMD) -0.01, 95% CI -0.32 to 0.30; 164 participants; 3 studies; low certainty evidence), suggesting no benefit of implementation support in improving policy or practice implementation, relative to control. Findings for other continuous or dichotomous implementation outcomes reported across these five trials were mixed. For the two non-randomised trials examining comparative effectiveness, both reported improvements in implementation, favouring the more intensive implementation group (very low certainty evidence). Three trials examined the impact of implementation strategies on employee health behaviours, reporting mixed effects for diet and weight status (very low certainty evidence) and no effect for physical activity (very low certainty evidence) or tobacco use (low certainty evidence). One trial reported an increase in absolute workplace costs for health promotion in the implementation group (low certainty evidence). None of the included trials assessed adverse consequences. Limitations of the review included the small number of trials identified and the lack of consistent terminology applied in the implementation science field, which may have resulted in us overlooking potentially relevant trials in the search.

AUTHORS' CONCLUSIONS

Available evidence regarding the effectiveness of implementation strategies for improving implementation of health-promoting policies and practices in the workplace setting is sparse and inconsistent. Low certainty evidence suggests that such strategies may make little or no difference on measures of implementation fidelity or different employee health behaviour outcomes. It is also unclear if such strategies are cost-effective or have potential unintended adverse consequences. The limited number of trials identified suggests implementation research in the workplace setting is in its infancy, warranting further research to guide evidence translation in this setting.

A 7-Step Strategy for the Implementation of Worksite Lifestyle Interventions: Helpful or Not?

OBJECTIVE

The aim of this study was to evaluate the use of and adherence to a 7-step strategy for the development, implementation, and continuation of a comprehensive, multicomponent lifestyle program.

METHODS

Strategy use and adherence was assessed with 12 performance indicators. Data were collected by combining onsite monitoring with semi-structured interviews at baseline and follow-up (6, 12, and 18 months).

RESULTS

Not all performance indicators were met so partial strategy adherence was obtained. The strategy could be improved on the following aspects: support among management, project structure, adaptation to needs of employees, planning, and maintenance.

CONCLUSION

The results of this evaluation indicate that strategy adherence facilitated structured development and implementation. On the basis of the qualitative data, this study suggests that when improvements will be made on both the content and performance, the 7-step strategy could be an effective tool to successfully implement a multicomponent WHPP.

The implementation of multiple lifestyle interventions in two organizations: a process evaluation

Objective:

To evaluate the implementation of a multicomponent lifestyle intervention at two different worksites.

Methods:

Data on eight process components were collected by means of questionnaires and interviews. Data on the effectiveness were collected using questionnaires.

Results:

The program was implemented partly as planned, and 84.0% (max 25) and 85.7% (max 14) of all planned interventions were delivered at the university and hospital, respectively. Employees showed high reach (96.6%) and overall participation (75.1%) but moderate overall satisfaction rates (6.8 ± 1.1). Significant intervention effects were found for days of fruit consumption (β = 0.44 days/week, 95% CI: 0.02 to 0.85) in favor of the intervention group.

Conclusions:

The study showed successful reach, dose, and maintenance but moderate fidelity and satisfaction. Mainly relatively simple and easily implemented interventions were chosen, which were effective only in improving employees’ days of fruit consumption.

Determining organisation-specific factors for developing health interventions in companies by a Delphi procedure: Organisational Mapping

Companies, seen as social communities, are major health promotion contexts. However, health promotion in the work setting is often less successful than intended. An optimal adjustment to the organisational context is required. Knowledge of which organisation-specific factors are relevant to health promotion is scarce. A Delphi procedure is used to identify these factors. The aim is to contribute to more effective workplace health promotion. The identified factors are described and embedded into a practical methodology (Intervention Mapping). A systematic use of these factors (called 'Organisational Mapping') is likely to contribute to more effective health promotion in the work setting.

Design of a process evaluation of the implementation of a physical activity and sports stimulation programme in Dutch rehabilitation setting: ReSpAct

Background

There is a growing interest to study the transfer of evidence-based information into daily practice. The evidence-based programme Rehabilitation, Sports and Exercise (RSE) that aims to stimulate an active lifestyle during and after a rehabilitation period in people with a disability and/or chronic disease is prepared for nationwide dissemination. So far, however, little is known about the implementation of a new programme to stimulate physical activity in people with a disability in a rehabilitation setting. Therefore, a process evaluation of the implementation of the RSE programme within 18 Dutch rehabilitation centres and hospitals is performed in order to gain more insight into the implementation process itself and factors that facilitate or hamper the implementation process. This paper describes the study design of this process evaluation.

Methods

During a three-year period, the adoption, implementation and continuation of the RSE programme is monitored and evaluated in 12 rehabilitation centres and 6 hospitals with a rehabilitation department in The Netherlands. The main process outcomes are: recruitment, reach, dose delivered, dose received, fidelity, satisfaction, maintenance and context. The process outcomes are evaluated at different levels (organisational and patient) and different time points. Data collection includes both quantitative (online registration system and questionnaires) and qualitative (focus groups and semi-structured interviews) methods.

Discussion

The nationwide dissemination of an evidence-based programme to stimulate physical activity and sports during and after a rehabilitation period is extensively monitored and evaluated on different levels (organization and patients) using mixed methods. The study will contribute to the science of translating evidence-based programmes into daily practice of the rehabilitation care. The results of the study can be used to further optimize the content of the RSE programme and to facilitate the implementation in other health facilities. Furthermore, the results of the study can help future implementation processes in the rehabilitation setting.

Trial registration

The study is registered by The Netherlands National Trial Register: NTR3961.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-014-0127-7) contains supplementary material, which is available to authorized users.

Prevention and management of non-communicable disease: the IOC consensus statement, Lausanne 2013

Morbidity and mortality from preventable, non-communicable chronic disease (NCD) threatens the health of our populations and our economies. The accumulation of vast amounts of scientific knowledge has done little to change this. New and innovative thinking is essential to foster new creative approaches that leverage and integrate evidence through the support of big data, technology, and design thinking. The purpose of this paper is to summarize the results of a consensus meeting on NCD prevention sponsored by the International Olympic Committee (IOC) in April, 2013. Within the context of advocacy for multifaceted systems change, the IOC's focus is to create solutions that gain traction within health care systems. The group of participants attending the meeting achieved consensus on a strategy for the prevention and management of chronic disease that includes the following: 1. Focus on behavioural change as the core component of all clinical programs for the prevention and management of chronic disease. 2. Establish actual centres to design, implement, study, and improve preventive programs for chronic disease. 3. Use human-centered design in the creation of prevention programs with an inclination to action, rapid prototyping and multiple iterations. 4. Extend the knowledge and skills of Sports and Exercise Medicine (SEM) professionals to build new programs for the prevention and treatment of chronic disease focused on physical activity, diet and lifestyle. 5. Mobilize resources and leverage networks to scale and distribute programs of prevention. True innovation lies in the ability to align thinking around these core strategies to ensure successful implementation of NCD prevention and management programs within health care. The IOC and SEM community are in an ideal position to lead this disruptive change. The outcome of the consensus meeting was the creation of the IOC Non-Communicable Diseases ad-hoc Working Group charged with the responsibility of moving this agenda forward.

Prevention and management of non-communicable disease: the IOC consensus statement, Lausanne 2013

Morbidity and mortality from preventable, non-communicable chronic disease (NCD) threatens the health of our populations and our economies. The accumulation of vast amounts of scientific knowledge has done little to change this. New and innovative thinking is essential to foster new creative approaches that leverage and integrate evidence through the support of big data, technology and design thinking. The purpose of this paper is to summarise the results of a consensus meeting on NCD prevention sponsored by the IOC in April 2013. Within the context of advocacy for multifaceted systems change, the IOC's focus is to create solutions that gain traction within healthcare systems. The group of participants attending the meeting achieved consensus on a strategy for the prevention and management of chronic disease that includes the following: (1) Focus on behavioural change as the core component of all clinical programmes for the prevention and management of chronic disease. (2) Establish actual centres to design, implement, study and improve preventive programmes for chronic disease. (3) Use human-centred design in the creation of prevention programmes with an inclination to action, rapid prototyping and multiple iterations. (4) Extend the knowledge and skills of Sports and Exercise Medicine (SEM) professionals to build new programmes for the prevention and treatment of chronic disease focused on physical activity, diet and lifestyle. (5) Mobilise resources and leverage networks to scale and distribute programmes of prevention. True innovation lies in the ability to align thinking around these core strategies to ensure successful implementation of NCD prevention and management programmes within healthcare. The IOC and SEM community are in an ideal position to lead this disruptive change. The outcome of the consensus meeting was the creation of the IOC Non-Communicable Diseases ad hoc Working Group charged with the responsibility of moving this agenda forward.

What is actually measured in process evaluations for worksite health promotion programs: a systematic review

Background

Numerous worksite health promotion program (WHPPs) have been implemented the past years to improve employees’ health and lifestyle (i.e., physical activity, nutrition, smoking, alcohol use and relaxation). Research primarily focused on the effectiveness of these WHPPs. Whereas process evaluations provide essential information necessary to improve large scale implementation across other settings. Therefore, this review aims to: (1) further our understanding of the quality of process evaluations alongside effect evaluations for WHPPs, (2) identify barriers/facilitators affecting implementation, and (3) explore the relationship between effectiveness and the implementation process.

Methods

Pubmed, EMBASE, PsycINFO, and Cochrane (controlled trials) were searched from 2000 to July 2012 for peer-reviewed (randomized) controlled trials published in English reporting on both the effectiveness and the implementation process of a WHPP focusing on physical activity, smoking cessation, alcohol use, healthy diet and/or relaxation at work, targeting employees aged 18-65 years.

Results

Of the 307 effect evaluations identified, twenty-two (7.2%) published an additional process evaluation and were included in this review. The results showed that eight of those studies based their process evaluation on a theoretical framework. The methodological quality of nine process evaluations was good. The most frequently reported process components were dose delivered and dose received. Over 50 different implementation barriers/facilitators were identified. The most frequently reported facilitator was strong management support. Lack of resources was the most frequently reported barrier. Seven studies examined the link between implementation and effectiveness. In general a positive association was found between fidelity, dose and the primary outcome of the program.

Conclusions

Process evaluations are not systematically performed alongside effectiveness studies for WHPPs. The quality of the process evaluations is mostly poor to average, resulting in a lack of systematically measured barriers/facilitators. The narrow focus on implementation makes it difficult to explore the relationship between effectiveness and implementation. Furthermore, the operationalisation of process components varied between studies, indicating a need for consensus about defining and operationalising process components.

Prevention and management of noncommunicable disease: the IOC Consensus Statement, Lausanne 2013

Morbidity and mortality from preventable, noncommunicable chronic disease (NCD) threatens the health of our populations and our economies. The accumulation of vast amounts of scientific knowledge has done little to change this. New and innovative thinking is essential to foster new creative approaches that leverage and integrate evidence through the support of big data, technology, and design thinking. The purpose of this paper is to summarize the results of a consensus meeting on NCD prevention sponsored by the International Olympic Committee (IOC) in April 2013. Within the context of advocacy for multifaceted systems change, the IOC's focus is to create solutions that gain traction within health care systems. The group of participants attending the meeting achieved consensus on a strategy for the prevention and management of chronic disease that includes the following: 1. Focus on behavioral change as the core component of all clinical programs for the prevention and management of chronic disease. 2. Establish actual centers to design, implement, study, and improve preventive programs for chronic disease. 3. Use human-centered design (HCD) in the creation of prevention programs with an inclination to action, rapid prototyping and multiple iterations. 4. Extend the knowledge and skills of Sports and Exercise Medicine (SEM) professionals to build new programs for the prevention and treatment of chronic disease focused on physical activity, diet, and lifestyle. 5. Mobilize resources and leverage networks to scale and distribute programs of prevention. True innovation lies in the ability to align thinking around these core strategies to ensure successful implementation of NCD prevention and management programs within health care. The IOC and SEM community are in an ideal position to lead this disruptive change. The outcome of the consensus meeting was the creation of the IOC Non-Communicable Diseases ad hoc Working Group charged with the responsibility of moving this agenda forward.