Study protocol: evaluation of a community health promotion program in a socioeconomically deprived city district in the Netherlands using mixed methods and guided by action research

Navigating process evaluation in co-creation: a Health CASCADE scoping review of used frameworks and assessed components

BACKGROUND

Co-creation is seen as a way to ensure all relevant needs and perspectives are included and to increase its potential for beneficial effects and uptake process evaluation is crucial. However, existing process evaluation frameworks have been built on practices characterised by top-down developed and implemented interventions and may be limited in capturing essential elements of co-creation. This study aims to provide a review of studies planning and/or conducting a process evaluation of public health interventions adopting a co-creation approach and aims to derive assessed process evaluation components, used frameworks and insights into formative and/or participatory evaluation.

METHODS

We searched for studies on Scopus and the Health CASCADE Co-Creation Database. Co-authors performed a concept-mapping exercise to create a set of overarching dimensions for clustering the identified process evaluation components.

RESULTS

54 studies were included. Conceptualisation of process evaluation included in studies concerned intervention implementation, outcome evaluation, mechanisms of impact, context and the co-creation process. 22 studies (40%) referenced ten existing process evaluation or evaluation frameworks and most referenced were the frameworks developed by Moore et al (14%), Saunders et al (5%), Steckler and Linnan (5%) and Nielsen and Randall (5%).38 process evaluation components were identified, with a focus on participation (48%), context (40%), the experience of co-creators (29%), impact (29%), satisfaction (25%) and fidelity (24%).13 studies (24%) conducted formative evaluation, 37 (68%) conducted summative evaluation and 2 studies (3%) conducted participatory evaluation.

CONCLUSION

The broad spectrum of process evaluation components addressed in co-creation studies, covering both the evaluation of the co-creation process and the intervention implementation, highlights the need for a process evaluation tailored to co-creation studies. This work provides an overview of process evaluation components, clustered in dimensions and reflections which researchers and practitioners can use to plan a process evaluation of a co-creation process and intervention.

Intersectoral collaboration in a Dutch community health promotion programme: building a coalition and networks

In health promotion programmes (HPP), it is crucial to have intersectoral collaboration within coalitions and to build networks between health and other societal sectors. A health broker role is recognized as being helpful in connecting the coalition with the broader network, and participatory action research (PAR) is deemed supportive because it facilitates evaluation, reflection, learning and action. However, there is a lack of insight into how processes that affect collaboration develop over time. Therefore, this study aimed to provide insights into the coalition's processes that facilitate building and maintaining intersectoral collaboration within a HPP coalition and network and how these processes contribute to the coalition's ambitions. As part of PAR, the coalition members used the coordinated action checklist (CAC) and composed network analysis (CNA) in 2018 and 2019. The CAC and CNA results were linked back into the coalition in five group sessions and used for reflection on pro-gress and future planning. Coalition governance, interaction with the context, network building and brokerage, and generating visibility emerged as the most prominent processes. Important insights concerned the health broker's role and positioning, the programme coordinator's leadership and the importance of visibility and trust leading to investment in continuation. The combined research instruments and group sessions supported discussion and reflection, sharing visions and adjusting working strategies, thereby strengthening the coalition's capacity. Thus, PAR was useful for evaluating and simultaneously facilitating the processes that affect collaboration.

Unravelling mechanisms underlying the action principles of a community-based health promotion programme: a realist evaluation

BACKGROUND

Since 1986, WHO has advised that applying action principles such as citizen participation and intersectoral collaboration leads to better health. However, less is known about the workability of these principles and how they trigger specific outcomes in interaction with the context. A critical realist perspective was applied to get a better understanding of what worked, and why it worked, in the context of a Dutch community-based health promotion programme (CBHPP). The aim of the study was to unravel the mechanisms underlying the action principles and find combinations of contextual factors and mechanisms that trigger outcomes in a CBHPP.

METHODS

In this single case study, a critical realist methodology was followed. Qualitative data used in this study originated from multiple sources and methods to ensure validity. They include evaluation sessions with coalition members (n = 6) and individual interviews (n = 6); group sessions with community workers (n = 1), a health broker (n = 1), and citizens (n = 12); and seven semi-annual progress reports and minutes of the coalition meetings. The collected data were then compared with the programme theory through a heuristic process of constructing, exploring, and refining context-mechanism-outcome configurations.

RESULTS

The programme initiated a variety of new activities that differed in content, intensity, duration, and number of participants, organised and implemented together with citizens. The most prominent mechanism underlying both action principles were programme-related, namely, patience, personal contact, contribution of budget, and the programme coordinator's leadership. Another important mechanism was creating visibility, which resulted in the involvement of the municipality and a budget to sustain the programme.

CONCLUSION

In this case study, personal contact, patience, perseverance, participatory action research activities, and visibility were found to be the most notable mechanisms underlying the citizen participation and intersectoral collaboration action principles. As the principle-based approach added value to the existing context and introduced most of the mechanisms that triggered the outcomes, it is recommended to include citizen participation and intersectoral collaboration not only as action principles but explicitly as targets in a CBHPP.

Tobacco-Free Duo Adult-Child Contract for Prevention of Tobacco Use Among Adolescents and Parents: Protocol for a Mixed-Design Evaluation

BACKGROUND

Universal tobacco-prevention programs targeting youths usually involve significant adults, who are assumed to be important social influences. Commitment not to use tobacco, or to quit use, as a formal contract between an adolescent and a significant adult is a preventive model that has not been widely practiced or explored and has been formally evaluated even less. In this paper, we present the rationale and protocol for the evaluation of the Swedish Tobacco-free Duo program, a multicomponent school-based program the core of which rests on a formal agreement between an adolescent and an adult. The adolescent's commitment mainly concerns avoiding the onset of any tobacco use while the adult commits to support the adolescent in staying tobacco free, being a role model by not using tobacco themselves.

OBJECTIVE

To assess (1) whether Tobacco-free Duo is superior to an education-only program in preventing smoking onset among adolescents and promoting cessation among their parents, (2) whether exposure to core components (adult-child agreement) entails more positive effects than exposure to other components, (3) the impact of the program on whole school tobacco use, (4) potential negative side effects, and (5) school-level factors related to fidelity of the program's implementation.

METHODS

A mixed-design approach was developed. First, a cluster randomized controlled trial was designed with schools randomly assigned to either the comprehensive multicomponent program or its educational component only. Primary outcome at the adolescent level was identified as not having tried tobacco during the 3-year junior high school compulsory grades (12-15 years of age). An intention-to-treat cohort-wise approach and an as-treated approach complemented with a whole school repeated cross-sectional approach was devised as analytical methods of the trial data. Second, an observational study was added in order to compare smoking incidence in the schools participating in the experiment with that of a convenience sample of schools that were not part of the experimental study. Diverse secondary outcomes at both adolescent and adult levels were also included.

RESULTS

The study was approved by the Umeå Regional Ethics Review Board (registration number 2017/255-31) in 2017. Recruitment of schools started in fall 2017 and continued until June 2018. In total, 43 schools were recruited to the experimental study, and 16 schools were recruited to the observational study. Data collection started in the fall 2018, is ongoing, and is planned to be finished in spring 2021.

CONCLUSIONS

Methodological, ethical, and practical implications of the evaluation protocol were discussed, especially the advantage of combining several sources of data, to triangulate the study questions. The results of these studies will help revise the agenda of this program as well as those of similar programs.

TRIAL REGISTRATION

International Standard Randomized Controlled Trial Number (ISRCTN) 52858080; https://doi.org/10.1186/ISRCTN52858080.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/21100.

"We Don't Assume That Everyone Has the Same Idea About Health, Do We?" Explorative Study of Citizens' Perceptions of Health and Participation to Improve Their Health in a Low Socioeconomic City District

In community health promotion programs that aim to reduce health inequities, citizen participation is recommended, as it strengthens citizens’ active involvement and has a positive impact on health. A prerequisite for citizen participation is recognizing and incorporating citizens’ perceptions of health. Therefore, this study aimed to explore these perceptions and actions needed to improve the health of citizens living in a low socioeconomic city district. Concept mapping was used to actively engage community members as part of the action research method. Eleven community groups (n = 89 citizens) together with community workers participated in the study. Participants in all groups agreed that health entails more than the absence of disease, and therefore it is a multidimensional concept. Social relations, physical activity, positive life attitude, healthy eating, and being in control were important perceptions about health. Although the participants were aware of the relation between lifestyle and health, actions to improve health included doing things together, collaboration, self-confidence, focusing on possibilities, and socially shared meanings. Creating a supportive environment to address health behavior appeared to be the most important action for citizens to facilitate behavior change. Concept mapping helped to involve citizens and provided community workers with valuable information to shape the program together with citizens.