A System Dynamics and Participatory Action Research Approach to Promote Healthy Living and a Healthy Weight among 10-14-Year-Old Adolescents in Amsterdam: The LIKE Programme

Facilitating co-research: lessons learned from reflection forms within three participatory action research projects

BACKGROUND

Mutual learning and shared decision-making are key elements of Participatory Action Research (PAR), highlighting the important role of the facilitator to support this. This study aims to illustrate how a facilitator can contribute to successful PAR sessions based on the reflection of three PAR projects.

METHODS

Participatory sessions took place with adolescents for 3-4 school years. After each session (n = 252 sessions across three projects), facilitators filled in a reflection form that assessed the group process and their facilitating role. Facilitators independently coded a selection of 135 reflection forms partly deductive and partly inductive based on core PAR principles derived from a pragmatic literature search.

RESULTS

A well-prepared session - for example, including active and creative participatory methods and a clearly stated goal - contributed to efficiency and the necessary flexibility. Making agreements, making sure everyone is heard and taking 'fun-time' appeared important for creating and maintaining a safe, functional and positive atmosphere. Finally, facilitators needed to encourage co-researchers to take the lead and adapt to the group dynamics, to ensure ownership and shared decision-making.

CONCLUSION

In-depth qualitative analyses of a standardized reflection form used in three different PAR projects resulted in various lessons to support facilitators in collaborating with co-researchers in PAR projects.

Follow the Arrows: Using a Co-Created Causal Loop Diagram to Explore Leverage Points to Strengthen Population Physical Activity Promotion in British Columbia, Canada

BACKGROUND

Population physical activity promotion (PPAP) is one of the most effective noncommunicable disease prevention strategies, yet coordination is lacking around the world. Whole-of-system approaches and complex systems methods are called for to advance PPAP. This paper reports on a project which (1) used an Attributes Framework with system mapping (group model building and causal loop diagramming of feedback loops) and (2) identified potential leverage points to address the challenge of effective coordination of multisectoral PPAP in British Columbia.

METHODS

Key findings from stakeholder interviews and workshops described the current system for PPAP in terms of attributes and dimensions in the framework. These were translated into variables and used in group model building. Participants prioritized the importance of variables to address the coordination challenge and then created causal loop diagrams in 3 small groups. One collective causal loop diagram was created, and top priority variables and associated feedback loops were highlighted to explore potential leverage points.

RESULTS

Leverage points included the relationships and feedback loops among priority variables: political leadership, visible policy support and governance, connectivity for knowledge translation, collaborative multisector grants, multisector collaboration, and integrating co-benefits. Leveraging and altering "vicious" cyclical patterns to increase coordinated multisector PPAP are key.

CONCLUSIONS

The Attributes Framework, group model building and causal loop diagrams, and emergent feedback loops were useful to explore potential leverage points to address the challenge of multisectoral coordination of PPAP. Future research could apply the same methods in other jurisdictions and compare and contrast resultant frameworks, variables, feedback loops, and leverage points.

Estimating the contribution of overweight and obesity to ethnic inequalities in cardio-metabolic diseases in the Netherlands: a simulation study

OBJECTIVES

Overweight and obesity (OWOB) starts in childhood, influences adult cardiovascular risk, and is not equally distributed across ethnic groups. It is unclear which effects can be expected from reductions in OWOB across the life course on inequalities in cardio-metabolic diseases in a multi-ethnic population. This study aims to estimate the effects of three scenarios of changes in OWOB (the Normal-Weight-for-All scenario, the No-Ethnic-Difference-over-the-Life-Course scenario, the and No-Ethnic-Differences-in-Childhood scenario).

STUDY DESIGN

A simulation study.

METHODS

We combine data from multiple data sources and use the Dynamic Modeling for Health Impact Assessment (DYNAMO-HIA) model to estimate the effects of three scenarios on the cumulative incidence of diabetes mellitus, ischaemic heart disease (IHD) and stroke between 18 and 70 years in the five largest ethnic groups in the Netherlands.

RESULTS

In the scenario where all individuals have normal weight, the cumulative incidence decreased in all ethnic minority groups for all diseases, with largest decreases among South-Asian Surinamese, where the reduction of diabetes incidence exceeded 50%. In the scenario where the prevalence of OWOB in each ethnic-minority group was reduced to the current level among the Dutch-origin population, ethnic inequalities in cardio-metabolic diseases were substantially reduced, particularly when lowered prevalence of OWOB persisted across the lifespan. Reductions were the largest for diabetes and for the Asian Surinamese population.

CONCLUSIONS

A substantial part of the well-known ethnic inequalities in incidence of diabetes, IHD, and stroke can be attributed to OWOB. Interventions aimed at reducing OWOB have clear potential to reduce the health inequalities in these outcomes, especially for diabetes, in particular when they have an impact across the lifespan.

Applying systems thinking in youth-centred participatory action research for health promotion in an underserved neighbourhood

Purpose

Childhood overweight is considered a complex problem influenced by a range of factors, including energy balance-related behaviours (EBRBs) and interacting drivers of these behaviours. There is growing support that applying a systems approach is required to tackle complex problems resulting in actions that attempt to change the system's dynamics. Additionally, a participatory approach is advocated to include the lived experience of the population of interest both in the understanding of the system as well as the development, implementation and evaluation of relevant actions. We therefore combined Intervention Mapping, Participatory Action Research (PAR) and system dynamics in the development, implementation and evaluation of actions contributing to healthy EBRBs together with adolescents.

Methods

Four PAR groups comprising of 6-8 adolescent co-researchers (10-14 years) and 1-2 adult facilitators met weekly during 3-4 years. The structured Intervention Mapping protocol guided the process of the systematic development, implementation and evaluation of actions. System dynamics tools were included for the creation of Causal Loop Diagrams and development of systemic actions.

Results

Our approach comprised six steps that were executed by the PAR groups: (1) build Causal Loop Diagrams for each EBRB through peer research and identify overarching mechanisms, (2) determine leverage points using the Intervention Level Framework, (3) develop action ideas, (4) develop detailed actions including an implementation plan, (5) implement and, (6) evaluate the actions. PAR ensured that the actions fitted the lived experience of the adolescents, whilst system dynamics promoted actions at different levels of the system. The Intervention Mapping protocol ensured that the actions were theory-based. The main challenge involved integrating system dynamics within our practise in cooperation with adolescent co-researchers.

Conclusion

We experienced that combining Intervention Mapping, PAR and system dynamics worked well in developing, implementing and evaluating actions that target different levels of the system that drive adolescents' EBRBs. This study serves as an example to other studies aimed at developing, implementing and evaluating actions using a participatory and systems approach.

Experts' perceptions on motivators and barriers of healthy and sustainable dietary behaviors among adolescents: The SWITCH project

The interplay of influences shaping dietary behaviors of adolescents needs to be well-understood to develop effective strategies stimulating healthy and sustainable behaviors. This study aimed to identify the most relevant, urgent, changeable and effective motivators and barriers of healthy and sustainable dietary behaviors among adolescents (10-19 years), as perceived by an inter- and transdisciplinary expert panel. Experts working in practice (N = 19) and academia (N = 13) - in the field of sustainability, health, nutrition and/or education - participated in this exploratory mixed-methods study. Five online semi-structured focus groups were conducted (6-7 participants). Data was thematically analyzed by two coders independently, using the socioecological framework. Subsequently, the same experts individually selected the five most relevant determinants and rated those on their urgency, changeability and effectiveness through an online questionnaire (N = 21). Participants revealed a wide system of 31 main determinants including 173 sub-determinants that motivate or hinder healthy and sustainable eating among adolescents. This system of determinants was mapped on the different layers of the socioecological model: individual factors (25 motivators; 30 barriers), social environments (15 motivators; 13 barriers), physical environments (18 motivators; 15 barriers), macro-level environments (19 motivators; 38 barriers). 'Role of peers' (social environment) was selected most as a determinant to be targeted in interventions (N = 13; urgency (M = 6.38) changeability (M = 3.85), effectiveness (M = 5.62)), followed by 'food environment around school' (N = 9; urgency (M = 5.78) changeability (M = 3.44), effectiveness (M = 5.44)), 'social influences' (N = 7; urgency (M = 5.43) changeability (M = 4.00), effectiveness (M = 5.71)), 'autonomy in development' (N = 7; urgency (M = 6.00) changeability (M = 4.29), effectiveness (M = 5.86)) and 'food availability' (N = 7; urgency (M = 6.29) changeability (M = 3.29), effectiveness (M = 6.29)). The prioritized determinants indicate that adolescents should be provided more supportive social and physical environments that promote healthy and sustainable dietary behaviors, taking into account their growing autonomy.

Development of an action programme tackling obesity-related behaviours in adolescents: a participatory system dynamics approach

System dynamics approaches are increasingly addressing the complexity of public health problems such as childhood overweight and obesity. These approaches often use system mapping methods, such as the construction of causal loop diagrams, to gain an understanding of the system of interest. However, there is limited practical guidance on how such a system understanding can inform the development of an action programme that can facilitate systems changes. The Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme combines system dynamics and participatory action research to improve obesity-related behaviours, including diet, physical activity, sleep and sedentary behaviour, in 10-14-year-old adolescents in Amsterdam, the Netherlands. This paper illustrates how we used a previously obtained understanding of the system of obesity-related behaviours in adolescents to develop an action programme to facilitate systems changes. A team of evaluation researchers guided interdisciplinary action-groups throughout the process of identifying mechanisms, applying the Intervention Level Framework to identify leverage points and arriving at action ideas with aligning theories of change. The LIKE action programme consisted of 8 mechanisms, 9 leverage points and 14 action ideas which targeted the system's structure and function within multiple subsystems. This illustrates the feasibility of developing actions targeting higher system levels within the confines of a research project timeframe when sufficient and dedicated effort in this process is invested. Furthermore, the system dynamics action programme presented in this study contributes towards the development and implementation of public health programmes that aim to facilitate systems changes in practice.

Developing and Evaluating a Data-Driven and Systems Approach to Health Promotion Among Vocational Students: Protocol for the Data Health Study

BACKGROUND

Vocational school students exhibit significant risk behaviors in terms of poor diet, frequent use of nicotine products, inadequate fruit and vegetable intake, low levels of physical activity, and poor mental health. This makes vocational students vulnerable to the development of noncommunicable diseases. Therefore, effective health promotion programs targeting vocational students are required.

OBJECTIVE

The Danish study "Data-driven and Systems Approach to Health Promotion Among Vocational Students" (Data Health) aims to develop, implement, and evaluate a systems approach to support vocational schools, municipalities, and local communities in implementing locally relevant health promotion actions among and for vocational students. This paper describes the Data Health program and how implementation and preliminary effectiveness will be evaluated.

METHODS

The Data Health program offers an iterative 5-step process to develop changes in the systems that shape health behavior and well-being among vocational students. The program will be implemented and evaluated in 8 Danish vocational schools in 4 municipalities. The implementation of the process and actions will be explored using a systems-based evaluation design that assesses contextual differences and the mechanisms through which the program leads to changes in the systems. Preliminary effectiveness at the individual level (students' self-reported health behavior and well-being) and organizational level (school organizational readiness reported by school staff) will be assessed using a quasi-experimental design, and cross-sectional data will be collected at all 8 schools simultaneously 4 times during the 2-year study period.

RESULTS

This study was launched in 2021, and data collection is expected to be completed in June 2024. The first results are expected to be submitted for publication in January 2024.

CONCLUSIONS

We expect that the Data Health study will make significant contributions to complex intervention research by contributing to the paucity of research studies that have used systems approaches in school settings. The study will also provide evidence of successful elements for systems change and effectiveness to determine whether a national scale-up can be recommended.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05308459; https://clinicaltrials.gov/study/NCT05308459.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52571.

Healthy Lifestyle in Adolescence: Associations with Stress, Self-Esteem and the Roles of School Violence

A healthy lifestyle is considered by young people as the adoption of positive behaviors, such as a balanced diet, regular exercise, or the decreased consumption of harmful substances. Living a healthy lifestyle during adolescence promotes a better quality of life and psychological well-being in adulthood. The objective of this research is to identify how a healthy lifestyle is related to stress, self-esteem, and school violence roles. The sample is composed of a total of 743 adolescents aged between 14 and 19 years. The instruments used were the Healthy Lifestyles Questionnaire (CEVS-II), the Student Stress Inventory (SSI-SM), the Rosenberg Self-Esteem Scale (RSES), and an ad hoc questionnaire to evaluate school violence roles. The results obtained indicate that there are negative correlations between healthy lifestyle and stress, but positive correlations between healthy lifestyle and self-esteem. Adolescents who participate in situations of school violence have a higher mean of substance use and stress. However, those who do not experience such situations have higher mean self-esteem and lead a healthy lifestyle. In addition, the fact of suffering stress increases the probability of being a victim or an aggressor. Living a healthy lifestyle can have significant implications for health promotion and positive adolescent development.

Comprehensive application of a systems approach to obesity prevention: a scoping review of empirical evidence

A systems approach to obesity prevention is increasingly urged. However, confusion exists on what a systems approach entails in practice, and the empirical evidence on this new approach is unclear. This scoping review aimed to identify and synthesise studies/programmes that have comprehensively applied a systems approach to obesity prevention in intervention development, delivery/implementation, and evaluation. By searching international databases and grey literature, only three studies (10 publications) met inclusion criteria, which might be explained partially by suboptimal reporting. No conclusion on the effectiveness of this approach can be drawn yet due to the limited evidence base. We identified common features shared by the included studies, such as measuring ongoing changes, in addition to endpoint outcomes, and supporting capacity building. Some facilitators and barriers to applying a comprehensive systems approach in practice were identified. More well-designed and reported studies are needed, especially from low- and middle-income countries.

Increasing use of systems science in cardiovascular disease prevention to understand how to address geographic health disparities in communities with a disproportionate burden of risk

Objective

Marginalized communities shoulder a disproportionate burden of cardiovascular disease (CVD) driven by concentrated neighborhood social risk factors. We provide a case study of systems science application to address geographic CVD health disparities at the community level - informing the science of CVD health disparities research.

Methods

We conducted a two-phased, multi-methods needs assessment in the Denver, Colorado area. Phase I consisted of a social network analysis to map a two-mode network of existing CVD prevention interventions and their implementing organizations. In Phase II, group model building (GMB) sessions with key community, public health, and healthcare provider stakeholders, were utilized to identify and visualize community factors contributing to disparities in CVD risk, producing a consensus-based causal loop diagram.

Results

Between May 2021 and June 2022, we conducted 24 virtual, semi-structured interviews in Phase I to describe CVD prevention interventions, and 7 virtual GMB sessions in Phase II to describe experiences of disparities in CVD risk. For the purposes of this paper, we focus on a subset of results for both phases. In Phase I we identified 89 active CVD prevention interventions, 29 of which addressed tobacco use. In Phase II, causal loop diagrams revealed root causes of disparities in CVD risk. We provide an example of a causal loop diagram that focuses on the community prevalence of tobacco use, identifying stress as a key underlying factor driving disparities. The integration of findings from both phases highlighted the alignment and misalignment between quit tobacco intervention goals and how they are being experienced in marginalized communities.

Conclusion

Systems science methods were useful to organize a large number of CVD prevention efforts, and evaluate the root causes of CVD health disparities in a high risk community. By integrating these two aspects, interventions may be reoriented to more effectively address the root causes of CVD health disparities.

A Proposed Strategy against Obesity: How Government Policy Can Counter the Obesogenic Environment

An epidemic of obesity emerged in the USA in 1976-1980. The epidemic then spread to many other Westernized nations. Many interventions have been carried out with the goal of lowering the prevalence of obesity. These have mostly taken the form of various types of health promotion (i.e., providing people with education, advice, and encouragement). These actions have achieved, at most, only limited success. A strategy with a better chance of success starts with the recognition that the fundamental cause of obesity is that we live in an obesogenic environment. It is therefore necessary to change the environment so that it fosters a generally healthy lifestyle, thereby leading to enhanced health for the population, including improved weight control. A major goal is to increase the intake of healthy foods (especially fruit, vegetables, and whole grains), while decreasing intake of unhealthy foods (especially ultra-processed foods such as sugar). This will require major changes of many government policies. Some of the required policies are as follows. Schools should implement policies that create a healthy environment for children. For example, they should adopt a policy that only foods of high nutritional quality are sold in vending machines or given to students within school meals. Policies need to go well beyond the school setting; a broad strategy is needed that creates a healthy environment for children. Another important policy is the manipulation of food prices in order to shift the diet toward healthy foods. This requires using subsidies to lower the price of healthy foods, while adding a tax to less healthy foods to increase the price. This policy has been implemented in many cities and countries in the form of a tax on sugar-sweetened beverages (SSBs). The advertising of unhealthy foods (including fast-food restaurants) should be banned, especially where children and adolescents are the major target. Such a ban could be extended to a complete ban on all advertising for unhealthy foods, including that directed at adults. The proposed policy measures are likely to be strongly opposed by food corporations.

Understanding the system dynamics of obesity-related behaviours in 10- to 14-year-old adolescents in Amsterdam from a multi-actor perspective

Introduction and Methods

To develop an understanding of the dynamics driving obesity-related behaviours in adolescents, we conducted systems-based analysis on a causal loop diagram (CLD) created from a multi-actor perspective, including academic researchers, adolescents and local stakeholders.

Results

The CLD contained 121 factors and 31 feedback loops. We identified six subsystems with their goals: (1) interaction between adolescents and the food environment, with profit maximisation as goal, (2) interaction between adolescents and the physical activity environment, with utility maximisation of outdoor spaces as goal, (3) interaction between adolescents and the online environment, with profit maximisation from technology use as goal, (4) interaction between adolescents, parenting and the wider socioeconomic environment, with a goal focused on individual parental responsibility, (5) interaction between healthcare professionals and families, with the goal resulting in treating obesity as an isolated problem, and (6) transition from childhood to adolescence, with the goal centring around adolescents' susceptibility to an environment that stimulates obesity-related behaviours.

Discussion

Analysis showed that inclusion of the researchers' and stakeholders' perspectives contributed to an understanding of how the system structure of an environment works. Integration of the adolescents' perspective enriched insights on how adolescents interact with that environment. The analysis further showed that the dynamics driving obesity-related behaviours are geared towards further reinforcing such behaviours.

How to Evaluate the Effectiveness of Health Promotion Actions Developed Through Youth-Centered Participatory Action Research

Most actions targeting children's health behaviors have limited involvement of children in the development, potentially contributing to disappointing effectiveness. Therefore, in the 3-year "Kids in Action" study, 9- to 12-year-old children from a lower-socioeconomic neighborhood were involved as coresearchers in the development, implementation, and evaluation of actions targeting health behaviors. The current study describes the controlled trial that evaluated the effects on children's energy balance-related behaviors, physical fitness, and self-rated health, as well as experienced challenges and recommendations for future evaluations. Primary school children from the three highest grades of four intervention and four control schools were eligible for participation. Outcome measures assessed at baseline, and at 1- and 2-year follow-up were as follows: motor fitness by the MOPER test (N = 656, N = 485, N = 608, respectively), physical activity and sedentary behavior by accelerometry (N = 223, N = 149, N = 164, respectively), and consumption of sugar sweetened beverages and snacks and self-rated health by a questionnaire (N = 322, N = 281, N = 275, respectively). Mixed-model analyses were performed adjusted for clustering within schools and relevant confounders. Significant beneficial intervention effects were found on self-reported consumption of energy/sports drinks at T2 versus T0, and on total time and ≥5-minute bouts of moderate-to-vigorous physical activity at T1 versus T0. Significant adverse effects were found on "speed and agility" and "coordination and upper-limb speed." No other significant effects were found. The inconsistent intervention effects may be explained by the dynamic cohort and suboptimal outcome measures. We advise future studies with a similar approach to apply alternative evaluation designs, such as the delayed baseline design.

Our Healthy Community Conceptual Framework and Intervention Model for Health Promotion and Disease Prevention in Municipalities

This paper introduces the conceptual framework and intervention model of Our Healthy Community (OHC), a new, coordinated, and integrated approach towards health promotion and disease prevention in municipalities. The model is inspired by systems-based approaches and employs a supersetting approach for engaging stakeholders across sectors in the development and implementation of interventions to increase health and well-being among citizens. The conceptual model includes a combination of a bottom-up approach emphasizing involvement of citizens and other community-based stakeholders combined with a top-down approach emphasizing political, legal, administrative, and technical support from a variety of councils and departments in local municipality government. The model operates bidirectionally: (1) by pushing political and administrative processes to promote the establishment of conducive structural environments for making healthy choices, and (2) by involving citizens and professional stakeholders at all levels in co-creating processes of shaping their own community and municipality. An operational intervention model was further developed by the OHC project while working with the OHC in two Danish municipalities. The operational intervention model of OHC comprises three main phases and key actions to be implemented at the levels of local government and community: (1) Local government: Situational analysis, dialogue, and political priorities; (2) Community: Thematic co-creation among professional stakeholders; and (3) Target area: Intervention development and implementation. The OHC model will provide municipalities with new tools to improve the citizens' health and well-being with available resources. Health promotion and disease prevention interventions are developed, implemented, and anchored in the local community by citizens and local stakeholders at municipal and local community levels using collaboration and partnerships as leverage points.

Ethical considerations in engaging young people in European obesity prevention research: The CO-CREATE experience

Engaging youth in obesity prevention research and policy action is essential to develop strategies that are relevant and sensitive to their needs. Research with young people requires critical reflection to safeguard their rights, dignity, and well-being. The CO-CREATE project used various methods to engage approximately 300 European youth aged 15-19 years in the development of policies to prevent adolescent obesity. This paper discusses ethical considerations made in the project pertaining to the youth's voluntary participation, their protection from obesity stigma, respect for their time, data privacy and confidentiality, power balance, and equality of opportunity to participate in the research. We describe measures implemented to prevent or limit the emergence of ethical challenges in our interaction with youth and discuss their relevance based on our experience with implementation. While some challenges seemingly were prevented, others arose related to the youth's voluntary participation, time burdens on them, and the sustainability of participation under the Covid-19 pandemic. Concrete and ongoing ethical guidance may be useful in projects aiming to interact and build collaborative relationships with youth for long periods of time.

A scoping review of systems approaches for increasing physical activity in populations

Introduction

The past decade has increasingly seen systems approaches as a featured theme in public health studies and policy documents. This trend is evident in the area of physical activity, which is a significant global health risk factor that is addressed in WHO’s Global Action Plan on Physical Activity. We undertook a comprehensive scoping review to characterize the application of systems approaches to physical activity, to develop a typology of the objectives, themes and methods of research papers that purported to apply systems thinking to this issue.

Methods

We searched electronic databases (PubMed, Web of Science, Scopus and PsycINFO) for studies published during the period 2010–2021 that explicitly applied systems approaches or methods to investigate and/or address population physical activity. A framework using systems-based methodological approaches was adapted to classify physical activity studies according to their predominant approach, covering basic descriptive, complex analytical and advanced forms of practice. We selected case studies from retained studies to depict the current “state of the art”.

Results

We included 155 articles in our narrative account. Literature reporting the application of systems approaches to physical activity is skewed towards basic methods and frameworks, with most attention devoted to conceptual framing and predictive modelling. There are few well-described examples of physical activity interventions which have been planned, implemented and evaluated using a systems perspective. There is some evidence of “retrofitted” complex system framing to describe programmes and interventions which were not designed as such.

Discussion

We propose a classification of systems-based approaches to physical activity promotion together with an explanation of the strategies encompassed. The classification is designed to stimulate debate amongst policy-makers, practitioners and researchers to inform the further implementation and evaluation of systems approaches to physical activity.

Conclusion

The use of systems approaches within the field of physical activity is at an early stage of development, with a preponderance of descriptive approaches and a dearth of more complex analyses. We need to see movement towards a more sophisticated research agenda spanning the development, implementation and evaluation of systems-level interventions.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00906-2.

Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review

INTRODUCTION

Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs.

MATERIALS AND METHODS

A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework.

RESULTS

The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts.

DISCUSSION & CONCLUSION

The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods.

Participatory Systems Modelling for Youth Mental Health: An Evaluation Study Applying a Comprehensive Multi-Scale Framework

The youth mental health sector is persistently challenged by issues such as service fragmentation and inefficient resource allocation. Systems modelling and simulation, particularly utilizing participatory approaches, is offering promise in supporting evidence-informed decision making with limited resources by testing alternative strategies in safe virtual environments before implementing them in the real world. However, improved evaluation efforts are needed to understand the critical elements involved in and to improve methods for implementing participatory modelling for youth mental health system and service delivery. An evaluation protocol is described to evaluate the feasibility, value, impact, and sustainability of participatory systems modelling in delivering advanced decision support capabilities for youth mental health. This study applies a comprehensive multi-scale evaluation framework, drawing on participatory action research principles as well as formative, summative, process, and outcome evaluation techniques. Novel data collection procedures are presented, including online surveys that incorporate gamification to enable social network analysis and patient journey mapping. The evaluation approach also explores the experiences of diverse stakeholders, including young people with lived (or living) experience of mental illness. Social and technical opportunities will be uncovered, as well as challenges implementing these interdisciplinary methods in complex settings to improve youth mental health policy, planning, and outcomes. This study protocol can also be adapted for broader international applications, disciplines, and contexts.

The ENCOMPASS framework: a practical guide for the evaluation of public health programmes in complex adaptive systems

Background

Systems thinking embraces the complexity of public health problems, including childhood overweight and obesity. It aids in understanding how factors are interrelated, and it can be targeted to produce favourable changes in a system. There is a growing call for systems approaches in public health research, yet limited practical guidance is available on how to evaluate public health programmes within complex adaptive systems. The aim of this paper is to present an evaluation framework that supports researchers in designing systems evaluations in a comprehensive and practical way.

Methods

We searched the literature for existing public health systems evaluation studies. Key characteristics on how to conduct a systems evaluation were extracted and compared across studies. Next, we overlaid the identified characteristics to the context of the Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme evaluation and analyzed which characteristics were essential to carry out the LIKE evaluation. This resulted in the Evaluation of Programmes in Complex Adaptive Systems (ENCOMPASS) framework.

Results

The ENCOMPASS framework includes five iterative stages: (1) adopting a system dynamics perspective on the overall evaluation design; (2) defining the system boundaries; (3) understanding the pre-existing system to inform system changes; (4) monitoring dynamic programme output at different system levels; and (5) measuring programme outcome and impact in terms of system changes.

Conclusions

The value of ENCOMPASS lies in the integration of key characteristics from existing systems evaluation studies, as well as in its practical, applied focus. It can be employed in evaluating public health programmes in complex adaptive systems. Furthermore, ENCOMPASS provides guidance for the entire evaluation process, all the way from understanding the system to developing actions to change it and to measuring system changes. By the nature of systems thinking, the ENCOMPASS framework will likely evolve further over time, as the field expands with more completed studies.

Evaluation proposal of a national community-based obesity prevention programme: a novel approach considering the complexity perspective

Community-based obesity prevention programmes are considered an important strategy to curb the obesity epidemic. The JOGG (Youth At a Healthy Weight) approach is a large-scale community-based programme for childhood obesity prevention in the Netherlands that has been implemented over the past ten years. Practice-based development of the programme, both at the national and local level, increasingly poses challenges for its evaluation. One considerable challenge is the increasing acknowledgement of the complexity in the JOGG-approach, characterized by (a) objectives that vary locally, (b) adaptions to the programme over time in response to a community's shifting needs, challenges and opportunities, and (c) emergent outcomes and non-linear causality.We propose an evaluation framework that highlights elements of the complex local practice, including the local programme theory, implementation, adaption, the influence of context and feedback loops and intended as well as emergent and unintended outcomes. By studying each of these elements in practice, we hope to learn about principles that guide effective obesity prevention across contexts. The results of the proposed evaluation will inform both practice and research.Considering complexity in evaluation is a relatively new challenge in public health and therefore an emergent research area. The proposed framework for complex evaluations allows to retrospectively evaluate a programme that was implemented and developed in practice, and enables us to learn from practice-based experiences. Following the ISBNPA Dare2Share initiative, we kindly invite other researchers in the field to share their ideas and experiences regarding integration of complexity in evaluation.

The Public Health 12 framework: interpreting the 'Meadows 12 places to act in a system' for use in public health

BACKGROUND

Systems science approaches have demonstrated effectiveness in identifying underlying drivers of complex problems and facilitating the emergence of potential interventions that are locally tailored, feasible, sustainable and evidence informed. Despite the potential usefulness of system dynamics simulation modelling and other systems science modelling techniques in guiding implementation, time and cost constraints have limited its ability to provide strong guidance on how to implement complex interventions in communities. Guidance is required to ensure systems interventions lead to impactful systems solutions, implemented utilising strategies from the intersecting fields of systems science and implementation science. To provide cost-effective guidance on how and where to implement in systems, we offer a translation of the 'Meadows 12 places to act in a system' (Meadows 12) into language useful for public health.

METHODS

This translation of Meadows 12 was informed by our experience in working with 31 communities across two complex large scale randomised control trials and one large whole of community case study. These research projects utilised systems science and implementation science to co-create childhood obesity prevention interventions. The team undertaking this translation comprised research academics, implementation specialists and practitioners, practice-based researchers and a systems dynamicist. Our translation of each of the Meadows 12 levels to act in the system maintains the fidelity and nuance of the 12 distinct levels. We provide examples of each level of the Public Health 12 framework (PH12) drawn from 31 communities. All research was conducted in Victoria, Australia between 2016 and 2020.

RESULTS

PH12 provides a framework to guide both research and practice in real world contexts to implement targeted system level interventions. PH12 can be used with existing implementation science theory to identify relevant strategies for implementation of these interventions to impact the system at each of the leverage points.

CONCLUSION

To date little guidance for public health practitioners and researchers exists regarding how to implement systems change in community-led public health interventions. PH12 enables operationalisation Meadows 12 systems theory into public health interventions. PH12 can help research and practice determine where leverage can be applied in the system to optimise public health systems level interventions and identify gaps in existing efforts.

TRIAL REGISTRATION

WHO STOPS: ANZCTR: 12616000980437 .

RESPOND

ANZCTR: 12618001986268p .

Developing a Personalized Integrative Obesity-Coaching Program: A Systems Health Perspective

Current obesity management strategies are failing to achieve sustainable and favorable long-term results. We propose a more personalized, dynamic, and systemic perspective on the interactions of key determinants and coaching advice on obesity. The aim of this study was to use a systems view on overweight, complexity science, and a transdisciplinary process to develop a five-year personalized integrative obesity-coaching and research program. Managers, medical specialists, clinical psychologists, dieticians, physical- and psychomotor therapists, and lifestyle coaches aligned their perspectives and objectives with experts in systems thinking and systems biology. A systems health model of obesity was used to identify the causal relations of variables with the most influence on obesity. The model helped to align and design a personalized integrative obesity-coaching program and to identify the key variables to monitor the progress and to adjust the personalized program, depending on the goals and needs of the participant. It was decided to use subtyping of participants by a systems biologist, based on traditional Chinese medicine symptoms, as a novel method to personalize the intervention. The collaborative transdisciplinary approach based upon a systems view on obesity was successful in developing a personalized and adaptive five-year obesity-coaching and research program.

'It provides practical tips, practical solutions!': acceptability, usability, and satisfaction of a digital parenting intervention across African countries

The parenting evidence base is well established, and the question is how best to transfer the evidence to an app. App-based interventions could expand access to evidence-based parenting support; however, current provision lacks rigorous evidence, shows low user engagement, and is primarily for commercial gain. This study aimed at testing the feasibility and acceptability of ParentApp for Teens, an open-source, mobile parenting intervention application based on the Parenting for Lifelong Health Teens programme targeting parents of teens. The objective was to gather feedback from users on the relevance, acceptability, satisfaction, and usability of ParentApp for Teens across contexts in Africa, and subsequently, use the feedback to improve the app experience for target users. Caregivers and their adolescents aged 10-17 years, from nine different countries, were purposefully selected for user testing. The study involved 18 caregivers participating in the programme by using the app for 13 weeks and providing feedback on it through remote, semi-structured interviews that explored the app's acceptability and usability. Adolescents of six caregivers were also interviewed. Data were analysed thematically. Participants expressed a high level of satisfaction with the app's content and described it as easy to use and useful. However, views on the app's animated characters varied. Although effectiveness was not a primary aim of the user testing, several caregivers commented that they perceived their participation in the study had helped to enforce positive parenting skills in themselves. Adolescents' data supported the caregivers' reports of less harsh parenting and improved relationships between caregivers and their children due to the caregivers' participation in the study. Findings indicate the app could be relevant and acceptable in participants' communities, but possible barriers to its uptake may be lack of android smartphones, lack of data for app download, and inability of non-literate caregivers to read the content.

Promoting Fruit and Vegetable Consumption for Childhood Obesity Prevention

Currently, food marketing for unhealthy foods is omnipresent. Foods high in fat, salt, and sugar (HFSS) are advertised intensively on several media platforms, including digital platforms that are increasingly used by children, such as social media, and can be bought almost everywhere. This could contribute to the obesity epidemic that we are facing. As the majority of children and adolescents do not eat the recommended amount of fruits and vegetables (F&V), which leads to chronic diseases, we need to change the obesogenic environment to a healthogenic environment. Reducing the marketing of energy-dense snacks to children and increasing the promotion of healthier foods, such as fruits and vegetables, may be an effective and necessary instrument to improve the dietary intake of children and reduce the risk of their experiencing some chronic diseases later in life. With this focused narrative review, we provide an overview of how children and adolescents react to food promotions and how food promotional efforts might be a useful tool to increase the attractiveness of fruit and vegetables. This review therefore contributes to the question of how changing the advertising and media environment of children and adolescents could help create a world where the healthy choice is the easier choice, which would reduce childhood obesity and improve children’s health, as well as to make the food system more sustainable.

Developing the logic framework underpinning a whole-systems approach to childhood overweight and obesity prevention: Amsterdam Healthy Weight Approach

BACKGROUND

Whole-systems approaches (WSAs) are well placed to tackle the complex local environmental influences on overweight and obesity, yet there are few examples of WSAs in practice. Amsterdam Healthy Weight Approach (AHWA) is a long-term, municipality-led program to improve children's physical activity, diet, and sleep through action in the home, neighborhood, school, and city. Adopting a WSA, local political, physical, social, educational, and healthcare drivers of childhood obesity are viewed as a complex adaptive system. Since 2013, AHWA has reached >15,000 children. During this time, the estimated prevalence of 2-18-year-olds with overweight or obesity in Amsterdam has declined from 21% in 2012 to 18.7% in 2017. Declining trends are rarely observed in cities. There is a need to formally articulate AHWA program theory in order to: (i) inform future program evaluation which can interpret this decline within the context of AHWA and (ii) contribute a real-life example of a WSA to the literature.

METHODS

This study aimed to formally document the program theory of AHWA to permit future evaluation. A logic framework was developed through extensive document review and discussion, during program implementation.

RESULTS

The working principles of the WSA underpinning AHWA were made explicit in an overarching theory of change, articulated in a logic framework. The framework was operationalized using an illustrative example of sugar intake.

CONCLUSIONS

The logic framework will inform AHWA development, monitoring, and evaluation and responds to a wider need to outline the working principles of WSAs in public health.

Understanding obesity-related behaviors in youth from a systems dynamics perspective: The use of causal loop diagrams

This paper reports how we applied systems dynamics methods to gain insight into the complexity of obesity-related behaviors in youth, including diet, physical activity, sedentary behavior, and sleep, by integrating a literature review into causal loop diagrams (CLDs). Results showed that the CLDs consisted of multiple subsystems and three types of dynamics appeared, including (1) feedback loops, (2) connections between feedback loops and subsystems, and (3) mechanisms. We observed clear similarities in the dynamics for the four behaviors in that they relate to "traditional" subsystems, such as home and school environments, as well as to newly added subsystems, including macroeconomics, social welfare, and urban systems. The CLDs provided insights that can support the development of intervention strategies, including (1) the confirmation that a range of mechanisms cover and connect multiple levels and settings, meaning that there is no silver bullet to address obesity; (2) understanding of how interventions in one particular setting, such as school, might be influenced by the interactions with other settings, such as urban systems; and (3) a comprehensive view of (un)intended consequences. This way of framing the problem will assist moving towards public health interventions that respond to and operate in the complexity of the real world.