A whole system approach to increasing children's physical activity in a multi-ethnic UK city: a process evaluation protocol

Reflections on co-producing an obesity-prevention toolkit for Islamic Religious Settings: a qualitative process evaluation

BACKGROUND

Islamic leaders, staff, and Muslim parents in the UK are supportive of healthy lifestyle intervention delivery through Islamic Religious Settings. Such interventions are necessary given high obesity rates in British South Asian (40%) compared to White British (32%) children of equivalent age. Co-production can facilitate the development of culturally appropriate health interventions, however it can be theoretically and practically challenging, and evaluation of co-production within an Islamic Religious Setting context is lacking. The aim of this study was to examine the feasibility and acceptability of taking a co-production approach to develop an obesity-prevention toolkit for Islamic Religious Settings.

METHODS

An obesity-prevention toolkit for use in Islamic Religious Settings, incorporating physical activity, healthy diet, and organisational change, has been co-produced to be evidence-informed and contextually relevant. A qualitative process evaluation was employed to examine experiences of co-production. Semi-structured interviews (n = 15) and a focus group (n = 5) were conducted with toolkit co-production stakeholders, e.g., subject experts, an Islamic scholar, and Islamic Religious Setting staff. Transcripts were analysed inductively using reflexive thematic analysis.

RESULTS

The analysis revealed four major themes regarding stakeholders' experiences of co-producing a childhood obesity-prevention toolkit for Islamic Religious Settings. These themes are: (1) attitudes towards obesity-prevention through Islamic Religious Settings, (2) benefits of co-production including capacity building and ownership (3) negotiating involvement, power, and perspectives within the co-production process, and (4) the complexities of effective communication in co-production.

CONCLUSION

This study adds to the evidence-base in support of delivering health promotion through faith settings. Taking a co-production approach to develop an obesity-prevention toolkit for Islamic Religious Settings provided benefit to the toolkit product and local stakeholders. The toolkit is currently being implemented across Bradford, UK and there is potential to adapt the toolkit to other geographical contexts, and for evaluating effectiveness for preventing obesity in British Muslim families.

A structured approach to applying systems analysis methods for examining implementation mechanisms

BACKGROUND

It is challenging to identify and understand the specific mechanisms through which an implementation strategy affects implementation outcomes, as implementation happens in the context of complex, multi-level systems. These systems and the mechanisms within each level have their own dynamic environments that change frequently. For instance, sequencing may matter in that a mechanism may only be activated indirectly by a strategy through another mechanism. The dosage or strength of a mechanism may vary over time or across different health care system levels. To elucidate the mechanisms relevant to successful implementation amidst this complexity, systems analysis methods are needed to model and manage complexity.

METHODS

The fields of systems engineering and systems science offer methods-which we refer to as systems analysis methods-to help explain the interdependent relationships between and within systems, as well as dynamic changes to systems over time. When applied to studying implementation mechanisms, systems analysis methods can help (i) better identify and manage unknown conditions that may or may not activate mechanisms (both expected mechanisms targeted by a strategy and unexpected mechanisms that the methods help detect) and (ii) flexibly guide strategy adaptations to address contextual influences that emerge after the strategy is selected and used.

RESULTS

In this paper, we delineate a structured approach to applying systems analysis methods for examining implementation mechanisms. The approach includes explicit steps for selecting, tailoring, and evaluating an implementation strategy regarding the mechanisms that the strategy is initially hypothesized to activate, as well as additional mechanisms that are identified through the steps. We illustrate the approach using a case example. We then discuss the strengths and limitations of this approach, as well as when these steps might be most appropriate, and suggest work to further the contributions of systems analysis methods to implementation mechanisms research.

CONCLUSIONS

Our approach to applying systems analysis methods can encourage more mechanisms research efforts to consider these methods and in turn fuel both (i) rigorous comparisons of these methods to alternative mechanisms research approaches and (ii) an active discourse across the field to better delineate when these methods are appropriate for advancing mechanisms-related knowledge.

Born in Bradford Age of Wonder cohort: A protocol for qualitative longitudinal research

Bradford is multi-ethnic and one of the most deprived districts in the United Kingdom where around a quarter of children live in low-income families. Born in Bradford (BiB) has followed the lives of 13,776 children born in the district between 2007 and 2011. Children in the birth cohort are now entering adolescence, and the next phase of the research - Age of Wonder (AoW) - will be a whole city cohort capturing the experiences of 30,000 adolescents progressing into young adulthood. This protocol focuses on one component of the AoW programme: qualitative longitudinal research (QLR). The study will gather in depth and detailed accounts from a sub-sample of 100 young people across four major research priorities: personal life; social and community life; growing up with difference, and growing up in Bradford. As well as using traditional qualitative methods such as interviews, focus group discussions, and ethnography, we are adopting innovative creative methods including expressions through art, activism, online and digital content, portraits, and critical events. The process of engaging in and co-producing QLR potentially provides a route to empowering young people to shape the narrative of their own lives as well as informing intervention development.

Interventions targeting children and young people's physical activity behavior at home: A systematic review

BACKGROUND AND PURPOSE

Increased time at home during the COVID-19 pandemic significantly decreased children's physical activity. This systematic review aimed to evaluate the effectiveness of children's home-based physical activity interventions, and identify 'active ingredients' underpinning these.

METHODS

Databases searched-AMED, PsychINFO, CINAHL, Cochrane, EMBASE, PubMed/Medline, Scopus, SPORTDiscus and Web of Science, from inception until June 2022. Eligibility criteria-children aged 2-16 years, targeting home-based physical activity, a control group, and physical activity measured pre- and post- intervention. Studies were excluded if it was not possible to identify change in physical activity at home. The review was written following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidance. Study quality was evaluated using the quality assessment tool for quantitative studies. Study design, intervention characteristics, outcome data, behavior change theory, Behavior Change Techniques (BCTs) and process evaluation data were extracted and discussed using narrative syntheses.

RESULTS

13 studies (including 1,182 participants) from 25,967 were included. Interventions primarily involved active video games, with the addition of coaching or telehealth support (n = 5). Three of the 13 studies significantly increased children's physical activity (1 = Moderate to vigorous physical activity, 2 = total volume, P<0.05). The largest effect size (d = 3.45) was for moderate to vigorous physical activity. 29% of BCTs were identified across included interventions; the most common being adding objects to the environment. The most effective intervention scored strong for design quality, incorporated telehealth coaching, and included the most commonly coded BCTs. Variation among studies and insufficient reporting of data made a meta-analysis unfeasible.

CONCLUSION

COVID-19 emphasized the importance of the home for physical activity. Whilst effectiveness of interventions was limited, building social support and self-efficacy are mechanisms that should be explored further. The review provides recommendations to improve the design and evaluation of future interventions.

TRIAL REGISTRATION

Prospero registration number: CRD42020193110.

Meta-evaluation of a whole systems programme, ActEarly: A study protocol

INTRODUCTION

Living in an area with high levels of child poverty predisposes children to poorer mental and physical health. ActEarly is a 5-year research programme that comprises a large number of interventions (>20) with citizen science and co-production embedded. It aims to improve the health and well-being of children and families living in two areas of the UK with high levels of deprivation; Bradford in West Yorkshire, and the London Borough of Tower Hamlets. This protocol outlines the meta-evaluation (an evaluation of evaluations) of the ActEarly programme from a systems perspective, where individual interventions are viewed as events in the wider policy system across the two geographical areas. It includes investigating the programme's impact on early life health and well-being outcomes, interdisciplinary prevention research collaboration and capacity building, and local and national decision making.

METHODS

The ActEarly meta-evaluation will follow and adapt the five iterative stages of the 'Evaluation of Programmes in Complex Adaptive Systems' (ENCOMPASS) framework for evaluation of public health programmes in complex adaptive systems. Theory-based and mixed-methods approaches will be used to investigate the fidelity of the ActEarly research programme, and whether, why and how ActEarly contributes to changes in the policy system, and whether alternative explanations can be ruled out. Ripple effects and systems mapping will be used to explore the relationships between interventions and their outcomes, and the degree to which the ActEarly programme encouraged interdisciplinary and prevention research collaboration as intended. A computer simulation model ("LifeSim") will also be used to evaluate the scale of the potential long-term benefits of cross-sectoral action to tackle the financial, educational and health disadvantages faced by children in Bradford and Tower Hamlets. Together, these approaches will be used to evaluate ActEarly's dynamic programme outputs at different system levels and measure the programme's system changes on early life health and well-being.

DISCUSSION

This meta-evaluation protocol presents our plans for using and adapting the ENCOMPASS framework to evaluate the system-wide impact of the early life health and well-being programme, ActEarly. Due to the collaborative and non-linear nature of the work, we reserve the option to change and query some of our evaluation choices based on the feedback we receive from stakeholders to ensure that our evaluation remains relevant and fit for purpose.

People powered research: what do communities identify as important for happy and healthy children and young people? A multi-disciplinary community research priority setting exercise in the City of Bradford, United Kingdom (UK)

BACKGROUND

Involving communities in research priority setting can increase the relevance and efficiency of research, leading to better health outcomes. However these exercises often lack clarity in how communities are involved and the extent to which priorities are acted upon is unclear. Seldom-heard groups, for example ethnic minorities may experience barriers to participation. We report methods and outcomes of an inclusive co-produced community research priority setting exercise within the multicultural and deprived city of Bradford, UK. The aim was to identify priorities for keeping children happy and healthy and was undertaken by the Born in Bradford (BiB) research programme to inform future research agendas.

METHODS

A 12 member multi-disciplinary, multi-ethnic community steering group led the process using a modified James Lind Alliance approach between December 2018-March 2020. Research priorities were collected through a widely distributed paper and online survey. Respondents were asked to list three important things to keep children i) happy, ii) healthy and what needs to change to improve either health or happiness. Free text data were coded iteratively by community researchers, and shared priorities were co-produced in a series of workshops and meetings with the community steering group and community members.

RESULTS

Five hundred eighty-eight respondents to the survey identified 5748 priorities, which were coded into 22 themes. These covered a range of individual, social and wider socioeconomic, environmental and cultural priorities. Diet/nutrition and exercise were most commonly identified as important for health, including what needs to change to improve health. For happiness, home life and family relationships, listening to children, and education/activities were the most commonly identified. Community assets were identified as important to change for both health and happiness. From the survey response the steering group developed 27 research questions. There were mapped onto existing and planned research agendas within BiB.

CONCLUSIONS

Communities identified both structural and individual factors as important priorities for health and happiness. We demonstrate how communities can be involved in priority setting using a co-productive approach in the hope this can be used as a model for others. The resulting shared research agenda will shape future research to improve the health of families living in Bradford.

Child and family experiences of a whole-systems approach to physical activity in a multiethnic UK city: a citizen science evaluation protocol

INTRODUCTION

Whole-systems approaches are being adopted to tackle physical inactivity. The mechanisms contributing to changes resulting from whole-systems approaches are not fully understood. The voices of children and families that these approaches are designed for need to be heard to understand what is working, for whom, where and in what context. This paper describes the protocol for the children and families' citizen science evaluation of the Join Us: Move, Play (JU:MP) programme, a whole-systems approach to increasing physical activity in children and young people aged 5-14 years in Bradford, UK.

METHODS AND ANALYSIS

The evaluation aims to understand the lived experiences of children and families' relationship with physical activity and participation in the JU:MP programme. The study takes a collaborative and contributory citizen science approach, including focus groups, parent-child dyad interviews and participatory research. Feedback and data will guide changes within this study and the JU:MP programme. We also aim to examine participant experience of citizen science and the suitability of a citizen science approach to evaluate a whole-systems approach. Data will be analysed using framework approach alongside iterative analysis with and by citizen scientists in the collaborative citizen science study.

ETHICS AND DISSEMINATION

Ethical approval has been granted by the University of Bradford: study one (E891-focus groups as part of the control trial, E982-parent-child dyad interviews) and study two (E992). Results will be published in peer-reviewed journals and summaries will be provided to the participants, through schools or directly. The citizen scientists will provide input to create further dissemination opportunities.

Assessing the Impacts of Creating Active Schools on Organisational Culture for Physical Activity

BACKGROUND

National and international guidance recommends whole-school approaches to physical activity, but there are few studies assessing their effectiveness, especially at an organisational level. This study assesses the impact of the Creating Active School's (CAS) programme on organisational changes to physical activity provision.

METHODS

In-school CAS leads completed a 77-item questionnaire assessing school-level organisational change. The questionnaire comprised 19 domains aligned with the CAS framework and COM-B model of behaviour change. Wilcoxon Signed Rank Tests assessed the pre-to-nine-month change.

RESULTS

>70% of schools (n = 53) pre-CAS had inadequate whole-school physical activity provision. After nine months (n = 32), CAS had a significant positive effect on organisational physical activity. The positive change was observed for: whole-school culture and ethos, teachers and wider school staff, academic lessons, physical education (PE) lessons, commute to/from school and stakeholder behaviour.

CONCLUSIONS

This study provides preliminary evidence that CAS is a viable model to facilitate system-level change for physical activity in schools located within deprived areas of a multi-ethnic city. To confirm the results, future studies are required which adopt controlled designs combined with a holistic understanding of implementation determinants and underlying mechanisms.

Born in Bradford Age of Wonder cohort: A protocol for qualitative longitudinal research

Born in Bradford (BiB) has followed the lives of 13,776 children born in the district between 2007 and 2011. Children in the birth cohort are now entering adolescence, and the next phase of the research - Age of Wonder (AoW) - will be a whole city cohort capturing the experiences of 30,000 adolescents progressing into young adulthood. This protocol focuses on one component of the AoW programme: qualitative longitudinal research (QLR). The study will gather in depth and detailed accounts from a sub-sample of 100 young people across four major research priorities: personal life; social and community life; growing up with difference, and growing up in Bradford. As well as using traditional qualitative methods such as interviews, focus group discussions, and ethnography, we are adopting innovative creative methods including expressions through art, activism, online and digital content, portraits, and critical events. The process of engaging in and co-producing QLR potentially provides a route to empowering young people to shape the narrative of their own lives as well as informing intervention development.

A study protocol for evaluating the effectiveness of a whole-system intervention (Join Us: Move Play, JUMP) implemented at the neighbourhood level, to increase children’s (aged 5-11 years) accelerometer measured physical activity: a quasi-experimental trial (Preprint)

BACKGROUND

Daily physical activity is vital for the health and development of children. However, many children are inactive. Previous attempts to achieve sustained increases in daily physical activity in children have been ineffective. Join Us: Move Play (JU:MP) is a whole-system, complex, community-based intervention aiming to increase the physical activity levels of children aged 7 to 11 years who live in areas of Bradford, England, which are multicultural and have high levels of deprivation.

OBJECTIVE

The purpose of this quasiexperimental controlled trial is to assess whether the JU:MP program increases primary school children's physical activity.

METHODS

The study has a 2-arm, quasiexperimental, nonblinded, nonequivalent group design and will be conducted with primary school children aged 5 to 11 years at 3 timepoints, including baseline (before intervention), 24 months (during intervention), and 36 months (after intervention). Children attending primary schools within the intervention area will be invited to participate. Children attending similar schools within similar neighborhoods based on school and community census demographics (deprivation, free school meals, and ethnicity) outside of the JU:MP geographical area will be invited to participate in the control condition. At each timepoint, consenting participants will wear an accelerometer for 7 consecutive days (24 hours a day) to measure the primary outcome (average daily moderate-to-vigorous physical activity). Multivariable mixed effects linear regression will be applied to estimate differences in the primary outcome between the 2 arms at 24 months and 36 months on an intention-to-treat basis. The secondary outcome analysis will explore changes in socioemotional well-being (teacher reported), quality of life (parental/carer reported), and other contextual factors (parents/carer reported), as well as segments of the day activity, sleep, sedentary screen time, frequency of places to be active, parent practices (nondirective support and autonomy support), social cohesion, and neighborhood walking/exercise environment.

RESULTS

Recruitment occurred from July 2021 to March 2022, and baseline data were collected from September 2021 to March 2022. As of March 2022 (end of baseline data collection), a total of 1454 children from 37 schools (17 intervention schools and 20 control schools) have been recruited. The first follow-up data collection will occur from September 2023 to March 2024, and the second and final follow-up data collection will occur from September 2024 to March 2025. Data analysis has not begun, and the final results will be published in December 2025.

CONCLUSIONS

This article describes the protocol for a quasiexperimental controlled trial examining a novel whole-system intervention.

TRIAL REGISTRATION

ISRCTN ISRCTN14332797; https://www.isrctn.com/ISRCTN14332797.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/43619.

A scoping review of systems approaches for increasing physical activity in populations

Introduction

The past decade has increasingly seen systems approaches as a featured theme in public health studies and policy documents. This trend is evident in the area of physical activity, which is a significant global health risk factor that is addressed in WHO’s Global Action Plan on Physical Activity. We undertook a comprehensive scoping review to characterize the application of systems approaches to physical activity, to develop a typology of the objectives, themes and methods of research papers that purported to apply systems thinking to this issue.

Methods

We searched electronic databases (PubMed, Web of Science, Scopus and PsycINFO) for studies published during the period 2010–2021 that explicitly applied systems approaches or methods to investigate and/or address population physical activity. A framework using systems-based methodological approaches was adapted to classify physical activity studies according to their predominant approach, covering basic descriptive, complex analytical and advanced forms of practice. We selected case studies from retained studies to depict the current “state of the art”.

Results

We included 155 articles in our narrative account. Literature reporting the application of systems approaches to physical activity is skewed towards basic methods and frameworks, with most attention devoted to conceptual framing and predictive modelling. There are few well-described examples of physical activity interventions which have been planned, implemented and evaluated using a systems perspective. There is some evidence of “retrofitted” complex system framing to describe programmes and interventions which were not designed as such.

Discussion

We propose a classification of systems-based approaches to physical activity promotion together with an explanation of the strategies encompassed. The classification is designed to stimulate debate amongst policy-makers, practitioners and researchers to inform the further implementation and evaluation of systems approaches to physical activity.

Conclusion

The use of systems approaches within the field of physical activity is at an early stage of development, with a preponderance of descriptive approaches and a dearth of more complex analyses. We need to see movement towards a more sophisticated research agenda spanning the development, implementation and evaluation of systems-level interventions.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00906-2.