Increasing the scale and adoption of population health interventions: experiences and perspectives of policy makers, practitioners, and researchers

Achieving Equity Through Global Neurosurgery Research

Since the release of the Lancet Commission on Global Surgery report in 2015, there has been an increase in the number of published papers on global neurosurgery, gaining widespread support from major neurosurgery journals. However, there remains no consensus on what may be considered part of global neurosurgery literature. Here, we propose that global neurosurgery research encompasses all scholarly work that measure, explore, or address inequity in the care of neurosurgical disease. We describe the growth of global neurosurgery research, cite landmark papers, and discuss barriers to participation, particularly among neurosurgeons in low- and middle-income countries. We introduce the 3Rs framework, advocating for global neurosurgery research that is rigorous, responsive, and responsible. This narrative review aims to guide young neurosurgeons and other researchers interested in the field, and to provide a framework through which global neurosurgery practitioners and advocates can evaluate previously accomplished work, paving the way toward neurosurgery that is timely, safe, and affordable to all.

How long does it take to scale-up obesity prevention interventions?

OBJECTIVE

The scale-up of evidence-based interventions is necessary to reverse high rates of obesity. However, scale-up doesn't occur frequently nor in a timely manner. While it has been estimated that takes 14-17 years for research translation to occur, the time taken to scale-up prevention interventions is largely unknown. This study examined the time taken to scale-up obesity prevention interventions across four scale-up pathways.

METHODS

A sample of obesity prevention interventions that had been scaled-up or implemented at scale were found using a structured search strategy. Included interventions were mapped against four scale-up pathways and timeframes associated with each stage of the scale-up pathway were identified to determine the time taken to scale-up.

RESULTS

Of the 90 interventions found that were scaled-up to at least a city-wide level, less than half reported a comprehensive research pathway to scale-up and a third did not report any evidence of efficacy or effectiveness prior to scale-up. The time taken to scale-up ranged from 0 to 5 years depending on the pathway taken. Those following a comprehensive pathway took approximately 5 years to scale-up, while interventions that had only one evidence generating step took between 1 and 1.5 years to scale-up. For the remaining interventions, scale-up occurred immediately post-development without evidence generation.

CONCLUSIONS

Our findings indicate that the scale-up of obesity prevention interventions can occur more quickly than previous estimates of 14-17 years. Our findings support previous research that scale-up of interventions occurs through a variety of pathways and often scale-up occurs in absence of prior evidence of effectiveness.

The Secret Sauce? Taking the Mystery Out of Scaling-Up School-Based Physical Activity Interventions

Over the last 4 decades, physical activity researchers have invested heavily in determining "what works" to promote healthy behaviors in schools. Single and multicomponent school-based interventions that target physical education, active transportation, and/or classroom activity breaks effectively increased physical activity among children and youth. Yet, few of these interventions are ever scaled-up and implemented under real-world conditions and in diverse populations. To achieve population-level health benefits, there is a need to design school-based health-promoting interventions for scalability and to consider key aspects of the scale-up process. In this opinion piece, we aim to identify challenges and advance knowledge and action toward scaling-up school-based physical activity interventions. We highlight the key roles of planning for scale-up at the outset, scale-up pathways, trust among partners and program support, program adaptation, evaluation of scale-up, and barriers and facilitators to scaling-up. We draw upon our experience scaling-up effective school-based interventions and provide a solid foundation from which others can work toward bridging the implementation-to-scale-up gap.

Mobilizing stakeholders for implant removals in Burkina Faso using landscape assessment data

BACKGROUND

Successful efforts to encourage uptake of subdermal contraceptive implants, with a lifespan of three to five years, necessitate planning to ensure that quality removal services are available when desired. In Burkina Faso, implant use has tripled over the past 8 years and now comprises almost half of the contraceptive method mix. Population Monitoring for Action (PMA) surveys identified barriers to obtaining quality removal when desired, particularly when the implant is not palpable, or providers lack needed skills or supplies. The Expanding Family Planning Choices (EFPC) project supported ministries of health in four countries with evaluation and strengthening of implant removal services.

METHODS

An implant removal landscape assessment was conducted at 24 health facilities in three regions of Burkina Faso with high implant use that included provider observations of implant removal, interviews with providers and health facility managers, and facility readiness surveys. The project used landscape data to mobilize stakeholders through a series of participatory workshops to develop a collaborative roadmap and commit to actions supporting quality implant removals.

RESULTS

Landscape findings revealed key gaps in provision of quality removal services, including high levels of provider confidence for implant insertion and removal (82% and 71%, respectively), low competence performing simple and difficult removals (19.2% and 11.1%, respectively), inadequate supplies and equipment (no facilities had all necessary materials for removal), lack of difficult removal management systems, and a lack of standard data collection tools for removal. Exposure to the data convinced stakeholders to focus on removals rather than expanding insertion services. While not all roadmap commitments were achieved, the process led to critical investments in quality implant removals.

CONCLUSION

Landscape data revealed that facilities lack needed supplies and equipment, and providers lack skills needed to perform quality implant removals, limiting client reproductive choice. Disseminating this data enabled stakeholders to identify and commit to evidence-based priority actions. Stakeholders have since capitalized on program learnings and the roadmap, including following MOH guidance for implant removal supplies and health provider training. Our experience in Burkina Faso offers a replicable model of how data can direct collective action to improve quality of contraceptive implant removals.

Research outcomes informing the selection of public health interventions and strategies to implement them: A cross-sectional survey of Australian policy-maker and practitioner preferences

BACKGROUND

A key role of public health policy-makers and practitioners is to ensure beneficial interventions are implemented effectively enough to yield improvements in public health. The use of evidence to guide public health decision-making to achieve this is recommended. However, few studies have examined the relative value, as reported by policy-makers and practitioners, of different broad research outcomes (that is, measures of cost, acceptability, and effectiveness). To guide the conduct of research and better inform public health policy and practice, this study aimed at describing the research outcomes that Australian policy-makers and practitioners consider important for their decision-making when selecting: (a) public health interventions; (b) strategies to support their implementation; and (c) to assess the differences in research outcome preferences between policy-makers and practitioners.

METHOD

An online value-weighting survey was conducted with Australian public health policy-makers and practitioners working in the field of non-communicable disease prevention. Participants were presented with a list of research outcomes and were asked to select up to five they considered most critical to their decision-making. They then allocated 100 points across these - allocating more points to outcomes perceived as more important. Outcome lists were derived from a review and consolidation of evaluation and outcome frameworks in the fields of public health knowledge translation and implementation. We used descriptive statistics to report relative preferences overall and for policy-makers and practitioners separately.

RESULTS

Of the 186 participants; 90 primarily identified as policy-makers and 96 as public health prevention practitioners. Overall, research outcomes of effectiveness, equity, feasibility, and sustainability were identified as the four most important outcomes when considering either interventions or strategies to implement them. Scores were similar for most outcomes between policy-makers and practitioners.

CONCLUSION

For Australian policy-makers and practitioners working in the field of non-communicable disease prevention, outcomes related to effectiveness, equity, feasibility, and sustainability appear particularly important to their decisions about the interventions they select and the strategies they employ to implement them. The findings suggest researchers should seek to meet these information needs and prioritize the inclusion of such outcomes in their research and dissemination activities. The extent to which these outcomes are critical to informing the decision of policy-makers and practitioners working in other jurisdictions or contexts warrants further investigation.

Primary Technology Enhanced Care Home HbA1c Testing (PTEC HAT) programme: a feasibility pilot study in Singapore

BACKGROUND

Considering time-consuming, cost-related limitations of laboratory-based HbA1c testing and follow-up clinic visits for diabetes management, it is important to explore alternative care models which incorporate point-of-care testing for HbA1c to monitor glycaemic control and related management.

METHODS

Therefore, we adopted an implementation perspective to conduct one group pre- and post-intervention feasibility pilot assessing feasibility, acceptability and satisfaction with conducting home HbA1c test by patients with type 2 diabetes coupled with telemonitoring and teleconsultations (i.e., the Primary Technology Enhanced Care (PTEC) Home HbA1c Testing (HAT) Programme) in Singaporean primary care setting. The secondary objective was to compare the HbA1c, blood pressure and primary care visits at the end or during intervention, vs. 6 months before. Adult patients with type 2 diabetes with HbA1c ≤ 8% without any diabetes complications and having phone compatibility were recruited. Data was collected via patient self-reports and electronic medical records extraction. While summary statistics and paired t-test were computed for quantitative data, open-ended feedback was analysed using content analysis.

RESULTS

A total of 33 participants completed the intervention out of 37 (33/37 = 89%) recruited from 73 eligible (37/73 = 51%). Most were either 51 to 60 years old (46.9%) or more than 60 years (37.5%), with more males (53.1%) and majority Chinese (93.8%). Majority (81.3%) felt that home HbA1c testing was beneficial with most commonly reported benefit of not having a clinic visit. A key finding was the average of diabetes-related visits being significantly lower post-intervention with comparable HbA1c values pre- and post-intervention. The most commonly reported challenge was using Bluetooth to transmit the reading (43.7%), followed by having too many steps to remember (28.1%). While participants reported being overall satisfied with the intervention, only 22% were willing to pay for it.

CONCLUSION

Our findings support home HbA1c testing by patients coupled with telemonitoring and teleconsultations. Following are practical recommendations for the implementation scaling phase: offering PTEC HAT Programme to suitable patients who are self-motivated and have adequate digital literacy, provision of adequate educational and training support, sending reminders and exploring enabling manual submission of HbA1c readings considering Bluetooth-related challenges.

Evaluator's alignment as an important indicator of adequacy of the criteria and assessment procedure for recognizing the good practice in public health

Background

Public health interventions aim to reduce the burden of chronic non-communicable diseases. Implementing evidence-based interventions that are proven to be successful and effective is widely recognized as the best approach to addressing public health challenges. To avoid the development and implementation of less effective or successful or even harmful practices, clear criteria for the assessment of practices, that consider different dimensions of the interventions in public health, are needed. The main aim of the research was to test our Criteria and assessment procedure for recognizing good practices in the field of public health by estimating the consistency between the evaluators and thereby gaining insight into the adequacy and reliability of the criteria as well as to check how the evaluators understand the criteria and methodology and if it is properly used in assessing the interventions.

Methods

The assessment of the interventions took place from 2021 to 2022. The individual evaluator's scores on the scale from 1 to 5 for each specific sub-criterion were collected, which was followed by a panel discussion to reach a final score for each sub-criterion. The inter-rater agreement was measured using percent overall agreement and Fleiss' kappa coefficient.

Results

We found moderate inter-rater agreement on the level of the assessment criteria group. The lowest agreement was observed for the effectiveness and efficiency sub-criteria group, which also received the lowest scores from the evaluators. Challenges identified with the scoring process were due to the descriptive 1 to 5 scale and the varying specificity of the criteria.

Conclusion

The results showed that studying consistency between evaluators can highlight areas for improvement or adjustment in the assessment criteria and enhance the quality of the assessment instrument. Therefore, such analysis would be useful part of both newly and well-established health promotion and prevention program registries.

A collaborative network trial to evaluate the effectiveness of implementation strategies to maximize adoption of a school-based healthy lunchbox program: a study protocol

Introduction

An important impediment to the large-scale adoption of evidence-based school nutrition interventions is the lack of evidence on effective strategies to implement them. This paper describes the protocol for a "Collaborative Network Trial" to support the simultaneous testing of different strategies undertaken by New South Wales Local Health Districts to facilitate the adoption of an effective school-based healthy lunchbox program ('SWAP IT'). The primary objective of this study is to assess the effectiveness of different implementation strategies to increase school adoption of the SWAP across New South Wales Local Health Districts.

Methods

Within a Master Protocol framework, a collaborative network trial will be undertaken. Independent randomized controlled trials to test implementation strategies to increase school adoption of SWAP IT within primary schools in 10 different New South Wales Local Health Districts will occur. Schools will be randomly allocated to either the intervention or control condition. Schools allocated to the intervention group will receive a combination of implementation strategies. Across the 10 participating Local Health Districts, six broad strategies were developed and combinations of these strategies will be executed over a 6 month period. In six districts an active comparison group (containing one or more implementation strategies) was selected. The primary outcome of the trial will be adoption of SWAP IT, assessed via electronic registration records captured automatically following online school registration to the program. The primary outcome will be assessed using logistic regression analyses for each trial. Individual participant data component network meta-analysis, under a Bayesian framework, will be used to explore strategy-covariate interactions; to model additive main effects (separate effects for each component of an implementation strategy); two way interactions (synergistic/antagonistic effects of components), and full interactions.

Discussion

The study will provide rigorous evidence of the effects of a variety of implementation strategies, employed in different contexts, on the adoption of a school-based healthy lunchbox program at scale. Importantly, it will also provide evidence as to whether health service-centered, collaborative research models can rapidly generate new knowledge and yield health service improvements.

Clinical trial registration

This trial is registered prospectively with the Australian New Zealand Clinical Trials Registry (ACTRN12623000558628).

Peer-led lifestyle interventions for the primary prevention of cardiovascular disease in community: a systematic review of randomised controlled trials

BACKGROUND

Peer-led lifestyle interventions have gained recognition as effective approaches for managing and preventing chronic diseases. However, there remains a critical knowledge gap regarding the impact and effectiveness of peer-led interventions specifically in the primary prevention of cardiovascular disease (CVD). Our systematic review aims to synthesise the available evidence and evaluate the impact of peer-led lifestyle interventions, providing invaluable insights that can guide the development of peer-led strategies for preventing CVD.

METHODS

Systematic database searches were conducted on Ovid Medline, Embase, Cochrane Centre for Controlled Trials, PubMed and Scopus to source peer-reviewed articles published between 2013 and 2023. Reference lists of the included publications were also manually searched.

RESULTS

Fourteen unique randomised controlled trials were identified, of which three were pilot studies. Most of the interventions were conducted among individuals at moderate to high risk of CVD and lasted for a year. There is a variety of components in intervention delivery, including group discussions and individual counselling. Peer leader training mostly covered intervention delivery, communication, and research-specific skills. Systolic blood pressure showed the most promising CVD-related improvement, while mixed results were found for several other dietary and lifestyle behavioural outcomes.

CONCLUSION

Peer-led lifestyle interventions have shown varying effectiveness in cardiovascular health outcomes. The competencies and roles of peer leaders were identified to guide future intervention development with a more comprehensive approach to the primary prevention of CVD.

Healthcare providers' perceived acceptability of a warning signs intervention for rural hospital-to-home transitional care: A cross-sectional study

INTRODUCTION

There is a pressing need for transitional care that prepares rural dwelling medical patients to identify and respond to the signs of worsening health conditions. An evidence-based warning signs intervention has the potential to address this need. While the intervention is predominantly delivered by nurses, other healthcare providers may be required to deliver it in rural communities where human health resources are typically limited. Understanding the perspectives of other healthcare providers likely to be involved in delivering the intervention is a necessary first step to avert consequences of low acceptability, such as poor intervention implementation, uptake, and effectiveness. This study examined and compared nurses' and other healthcare providers' perceived acceptability of an evidence-based warning signs intervention proposed for rural transitional care.

METHODS

A cross-sectional design was used. The convenience sample included 45 nurses and 32 other healthcare providers (e.g., physical and occupational therapists, physicians) who self-identified as delivering transitional care to patients in rural Ontario, Canada. In an online survey, participants were presented with a description of the warning signs intervention and completed established measures of intervention acceptability. The measures captured 10 intervention acceptability attributes (effectiveness, appropriateness, risk, convenience, relevance, applicability, usefulness, frequency of current use, likelihood of future use, and confidence in ability to deliver the intervention). Ratings ≥ 2 indicated acceptability. Data analysis included descriptive statistics, independent samples t-tests, as well as effect sizes to quantify the magnitude of any differences in acceptability ratings between nurses and other healthcare providers.

RESULTS

Nurses and other healthcare providers rated all intervention attributes > 2, except the attributes of convenience and frequency of current use. Differences between the two groups were found for only three attributes: nurses' ratings were significantly higher than other healthcare providers on perceived applicability, frequency of current use, and the likelihood of future use of the intervention (all p's < .007; effect sizes .58 - .68, respectively).

DISCUSSION

The results indicate that both participant groups had positive perspectives of the intervention on most of the attributes and suggest that initiatives to enhance the convenience of the intervention's implementation are warranted to support its widespread adoption in rural transitional care. However, the results also suggest that other healthcare providers may be less receptive to the intervention in practice. Future research is needed to explore and mitigate the possible reasons for low ratings on perceived convenience and frequency of current use of the intervention, as well as the between group differences on perceived applicability, frequency of current use, and the likelihood of future use of the intervention.

CONCLUSIONS

The intervention represents a tenable option for rural transitional care in Ontario, Canada, and possibly other jurisdictions emphasizing transitional care.

Informing the development of the SUCCEED reporting guideline for studies on the scaling of health interventions: A systematic review

BACKGROUND

Quality reporting contributes to effective translation of health research in practice and policy. As an initial step in the development of a reporting guideline for scaling, the Standards for reporting stUdies of sCaling evidenCEd-informED interventions (SUCCEED), we performed a systematic review to identify relevant guidelines and compile a list of potential items.

METHODS

We conducted a systematic review according to Cochrane method guidelines. We searched the following databases: MEDLINE, Embase, PsycINFO, Cochrane Library, CINAHL, Web of Science, from their respective inceptions. We also searched websites of relevant organizations and Google. We included any document that provided instructions or recommendations, e.g., reporting guideline, checklist, guidance, framework, standard; could inform the design or reporting of scaling interventions; and related to the health sector. We extracted characteristics of the included guidelines and assessed their methodological quality using a 3-item internal validity assessment tool. We extracted all items from the guidelines and classified them according to the main sections of reporting guidelines (title, abstract, introduction, methods, results, discussion and other information). We performed a narrative synthesis based on descriptive statistics.

RESULTS

Of 7704 records screened (published between 1999 and 2019), we included 39 guidelines, from which data were extracted from 57 reports. Of the 39 guidelines, 17 were for designing scaling interventions and 22 for reporting implementation interventions. At least one female author was listed in 31 guidelines, and 21 first authors were female. None of the authors belonged to the patient stakeholder group. Only one guideline clearly identified a patient as having participated in the consensus process. More than half the guidelines (56%) had been developed using an evidence-based process. In total, 750 items were extracted from the 39 guidelines and distributed into the 7 main sections.

CONCLUSION

Relevant items identified could inform the development of a reporting guideline for scaling studies of evidence-based health interventions. This and our assessment of guidelines could contribute to better reporting in the science and practice of scaling.

Population health interventions for cardiometabolic diseases in primary care: a scoping review and RE-AIM evaluation of current practices

Introduction

Cardiometabolic diseases (CMD) are the leading cause of death in high-income countries and are largely attributable to modifiable risk factors. Population health management (PHM) can effectively identify patient subgroups at high risk of CMD and address missed opportunities for preventive disease management. Guided by the Reach, Efficacy, Adoption, Implementation and Maintenance (RE-AIM) framework, this scoping review of PHM interventions targeting patients in primary care at increased risk of CMD aims to describe the reported aspects for successful implementation.

Methods

A comprehensive search was conducted across 14 databases to identify papers published between 2000 and 2023, using Arksey and O'Malley's framework for conducting scoping reviews. The RE-AIM framework was used to assess the implementation, documentation, and the population health impact score of the PHM interventions.

Results

A total of 26 out of 1,100 studies were included, representing 21 unique PHM interventions. This review found insufficient reporting of most RE-AIM components. The RE-AIM evaluation showed that the included interventions could potentially reach a large audience and achieve their intended goals, but information on adoption and maintenance was often lacking. A population health impact score was calculated for six interventions ranging from 28 to 62%.

Discussion

This review showed the promise of PHM interventions that could reaching a substantial number of participants and reducing CMD risk factors. However, to better assess the generalizability and scalability of these interventions there is a need for an improved assessment of adoption, implementation processes, and sustainability.

Prioritising and planning scale-up research projects targeting non-communicable diseases: a mixed-method study by the Global Alliance for Chronic Diseases upscaling working group

INTRODUCTION

Governments must scale-up evidence-based interventions to reduce the burden of non-communicable diseases (NCDs). Implementation research can help develop contextually appropriate strategies and optimise interventions for scale-up. We aimed to determine the priorities of the Global Alliance for Chronic Diseases (GACD) 2019 funding round for scale-up research targeting NCD interventions. The research questions were: (a) What was the purpose of the call and what were the specific issues considered by funders when supporting the selected projects? (b) How did the selected research projects align with the objectives of GACD scale-up call?

METHODS

We undertook a mixed-methods study to examine the projects funded by the GACD in 2019. We completed semistructured interviews with representatives from 5 out of 8 funding agencies and complemented this by reviewing project documents from 21 (78%) of the 27 funded studies. A literature review of scale-up frameworks informed the interview guide and data extraction template. The transcripts were open-coded using thematic analysis to identify critical issues for funders. Data were extracted to identify the common elements considered when planning, implementing and evaluating interventions for scale-up.

RESULTS

Interviews with the funders revealed three enabling themes related to scale-up: local research priorities (contextualisation through engagement), capacity building (developing knowledge base) and connections (networking opportunities). We further identified that timelines (more flexibility) and equity (funding low-income and middle-income researchers) could be considered for future funding investments. Multidisciplinary international research teams led the development of diverse studies to address funder's priorities. The detailed plans included a range of implementation frameworks to help develop contextual scale-up strategies.

CONCLUSIONS

Fundamental to NCD scale-up research are (1) funding opportunities that reflect the complexity and time necessary to enable contextualisation; (2) investment in building multidisciplinary research capacity and leadership and (3) better networking to encourage cohesive action and align NCD-related scale-up research activities globally.

Strategies used throughout the scaling-up process of eConsult - Multiple case study of four Canadian Provinces

BACKGROUND

eConsult is a model of asynchronous communication connecting primary care providers to specialists to discuss patient care. This study aims to analyze the scaling-up process and identify strategies used to support scaling-up efforts in four provinces in Canada.

METHODS

We conducted a multiple case study with four cases (ON, QC, MB, NL). Data collection methods included document review (n = 93), meeting observations (n = 65) and semi-structured interviews (n = 40). Each case was analyzed based on Milat's framework.

RESULTS

The first scaling-up phase was marked by the rigorous evaluation of eConsult pilot projects and the publication of over 90 scientific papers. In the second phase, provinces implemented provincial multi-stakeholder committees, institutionalized the evaluation, and produced documents detailing the scaling-up plan. During the third phase, efforts were made to lead proofs of concept, obtain the endorsement of national and provincial organizations, and mobilize alternate sources of funding. The last phase was mainly observed in Ontario, where the creation of a provincial governance structure and strategies were put in place to monitor the service and manage changes.

CONCLUSIONS

Various strategies need to be used throughout the scaling-up process. The process remains challenging and lengthy because health systems lack clear processes to support innovation scaling-up.

Scaling-Up eConsult: Promising Strategies to Address Enabling Factors in Four Jurisdictions in Canada

BACKGROUND

Effective healthcare innovations are often not scaled up beyond their initial local context. Lack of practical knowledge on how to move from local innovations to large-system improvement hinders innovation and learning capacity in health systems. Studying scale-up processes can lead to a better understanding of how to facilitate the scale-up of interventions. eConsult is a digital health innovation that aims to connect primary care professionals with specialists through an asynchronous electronic consultation. The recent implementation of eConsult in the public health systems of four Canadian jurisdictions provides a unique opportunity to identify different enabling strategies and related factors that promote the scaling up of eConsult across jurisdictions.

METHODS

We conducted a narrative case study in four Canadian provinces, Quebec, Ontario, Manitoba, and Newfoundland & Labrador, over a 3-year period (2018-2021). We observed provincial eConsult committee meetings (n=65) and national eConsult forums (n=3), and we reviewed internal documents (n=93). We conducted semi-structured interviews with key actors in each jurisdiction (eg, researchers, primary care professionals, specialists, policy-makers, and patient partners) (n=40). We conducted thematic analysis guided by the literature on factors and strategies used to scale up innovations.

RESULTS

We identified a total of 31 strategies related to six key enabling factors to scaling up eConsult, including: (1) multi-actor engagement; (2) relative advantage; (3) knowledge transfer; (4) strong evidence base; (5) physician leadership; and (6) resource acquisition (eg, human, material, and financial resources). More commonly used strategies, such as leveraging research infrastructure and bringing together various actors, were used to address multiple enabling factors.

CONCLUSION

Actors used various strategies to scale up eConsult within their respective contexts, and these helped address six key factors that seemed to be essential to the scale-up of eConsult.

From trials to communities: implementation and scale-up of health behaviour interventions

BACKGROUND

To maximise their potential benefits to communities, effective health behaviour interventions need to be implemented, ideally 'at scale', and are often adapted as part of this. To inform future implementation and scale-up efforts, this study broadly sought to understand (i) how often health behaviour interventions are implemented in communities, (ii) the adaptations that occur; (iii) how frequency it occurred 'at scale'; and (iv) factors associated with 'scale-up'.

METHODS

A cross-sectional survey was conducted of corresponding authors of trials (randomised or non-randomised) assessing the effects of preventive health behaviour interventions. Included studies of relevant Cochrane reviews served as a sampling frame. Participants were asked to report on the implementation and scale-up (defined as investment in large scale delivery by a (non)government organisation) of their intervention in the community following trial completion, adaptations made, and any research dissemination strategies employed. Information was extracted from published reports of the trial including assessments of effectiveness and risk of bias.

RESULTS

Authors of 104 trials completed the survey. Almost half of the interventions were implemented following trial completion (taking on average 19 months), and 54% of those were adapted prior to doing so. The most common adaptations were adding intervention components, and adapting the intervention to fit within the local service setting. Scale-up occurred in 33% of all interventions. There were no significant associations between research trial characteristics such as intervention effectiveness, risk of bias, setting, involvement of end-user, and incidence of scale-up. However the number of research dissemination strategies was positively associated to the odds of an intervention being scaled-up (OR = 1.50; 95% CI: 1.19, 1.88; p < 0.001).

CONCLUSIONS

Adaptation of implemented trials is often undertaken. Most health behaviour interventions are not implemented or scaled-up following trial completion. The use of a greater number of dissemination strategies may increase the likelihood of scaled up.

Challenges and opportunities from using abortion harm reduction and value clarification and attitude transformation engagements for safe abortion advocacy in Uganda

BACKGROUND

From 2018, the International Federation of Gynecologists and Obstetricians (FIGO) implemented the Advocating Safe Abortion project to support national obstetrics and gynecology (Obs/gyn) societies from ten member countries to become leaders of Sexual and Reproductive Health and Rights (SRHR). We share experiences and lessons learnt about using value clarification and attitude transformation (VCAT) and abortion harm reduction (AHR) as strategies for our advocacy engagements.

METHODS

The advocacy goal of ending abortion-related deaths followed predefined pathways from an extensive needs assessment prior to the project. These pathways were strengthening capacity of the Obs/gyn society as safe abortion advocates; establishing a vibrant network of partners; transforming social and gender norms; raising awareness of the legal and policy environment regarding abortion, and promoting the generation and use abortion data for evidence-informed policy and practice. Our advocacy targeted multiple stakeholders including media, policy makers judicio-legal, political and religious leaders, health workers and the public.

RESULTS

During each engagement, facilitators required audiences to identify what roles they can play along the continuum of strategies that can reduce maternal death from abortion complications. The audiences acknowledged abortion complications as a major problem in Uganda. Among the root causes for the abortion context, audiences noted absence of an enabling environment for abortion care, which was characterized by low awareness about the abortion laws and policy, restricted abortion laws, cultural and religious beliefs, poor quality of abortion care services and abortion stigma.

CONCLUSION

VCAT and AHR were critical in enabling us to develop appropriate messages for different stakeholders. Audiences were able to recognize the abortion context, distinguish between assumptions, myths and realities surrounding unwanted pregnancy and abortion; recognize imperative to address conflict between personal and professional values, and identify different roles and values which inform empathetic attitudes and behaviors that mitigate abortion harms. The five pathways of the theory of change reinforced each other. Using the AHR model, we delineate strategies and activities which stakeholders could use to end abortion deaths. VCAT enables critical reflection of views, beliefs and values versus professional obligations and responsibilities, and promotes active attitude and behavior change and commitment to end abortion-related deaths.

Multi-level stakeholders' perspectives on implementation and scaling up community-based health promotion in Germany

Community-based health promotion has the potential to address existing health inequities, although such approaches are scarcely scaled up. For a successful scale up, various stakeholders at different levels and sectors need to be involved. The article's aims are to assess what kind of external support communities need for implementation and to identify facilitators and barriers for scaling up community-based health promotion. Two national digital workshops were conducted in Germany with stakeholders at the community level (n = 161) and with stakeholders at the federal and state levels (n = 84). Protocols were compiled and coded using qualitative content analysis. During the first workshop, we revealed 11 themes for external support needs ('Strategic approach', 'Define & compare indicators', 'International human resource', 'Tools & Aids', 'External conduction of the assessment', 'Involvement of people in difficult life situations', 'Overview of actors', 'Moderation', 'Obtain funding', 'Quality assurance/evaluation' and 'External support'). Eleven facilitators and barriers were identified for scaling up ('Assessment and evaluation', 'Intersectoral collaboration and partnerships', 'Communication', 'Characteristics of the program', 'Political and legal conditions', 'Political support', 'Local coordinator', 'Resources', 'Participation', 'Strategic planning/methods' and 'Intermediary organization'). The identified results provide practice-based evidence on support needed for scaling up, facilitators that promote scaling up and barriers that might hinder scaling up community-based health promotion in Germany. In a next step, this practice-based evidence needs to be systematically integrated with scientific-based evidence on key components for scaling up such approaches for the development of an effective scaling-up concept.

Development and Application of the Scale-Up Reflection Guide (SRG)

Scaling up effective interventions in public health is complex and comprehensive, and published accounts of the scale-up process are scarce. Key aspects of the scale-up experience need to be more comprehensively captured. This study describes the development of a guide for reflecting on and documenting the scale-up of public health interventions, to increase the depth of practice-based information of scaling up. Reviews of relevant scale-up frameworks along with expert input informed the development of the guide. We evaluated its acceptability with potential end-users and applied it to two real-world case studies. The Scale-up Reflection Guide (SRG) provides a structure and process for reflecting on and documenting key aspects of the scale-up process of public health interventions. The SRG is comprised of eight sections: context of completion; intervention delivery, history/background; intervention components; costs/funding strategies and partnership arrangements; the scale-up setting and delivery; scale-up process; and evidence of effectiveness and long-term outcomes. Utilization of the SRG may improve the consistency and reporting for the scale-up of public health interventions and facilitate knowledge sharing. The SRG can be used by a variety of stakeholders including researchers, policymakers or practitioners to more comprehensively reflect on and document scale-up experiences and inform future practice.

Factors related to the implementation and scale-up of physical activity interventions in Ireland: a qualitative study with policy makers, funders, researchers and practitioners

BACKGROUND

Current literature reports a gap between development of effective interventions to promote physical activity and the systematic uptake into real-world settings. Factors relating to implementation and scale-up of physical activity interventions have been examined, however the perspectives of multiple stakeholders from different domains are not well researched. The purpose of this study was to examine the perceived factors related to physical activity intervention implementation and scale-up in different domains from different stakeholders on the island of Ireland.

METHODS

Practitioners, researchers, funders and policy makers in Ireland were invited to take part in a semi-structured interview exploring factors related to the implementation and scale-up of eleven different physical activity interventions. A thematic analysis was conducted to identify factors related to the implementation and scale-up of the included interventions. The data collection and analysis were guided by the Consolidated Framework for Implementation Research.

RESULTS

Thirty-eight participants took part in the interviews which identified factors related to 1) intervention planning and practical considerations; 2) organisational structures, staffing and resources related to delivery; 3) reflection, evaluation and updating of the intervention; and 4) practical consideration related to scale-up. Furthermore, participants referred to the ongoing commitment, engagement, and support needed throughout the implementation process.

CONCLUSIONS

Future research and practice needs to consider how different factors are experienced at different implementation stages and by the different stakeholder groups involved. The findings highlight multiple inter-related factors that influence the implementation and scale-up of physical activity interventions, but also identifies many strategies that can be utilised to aid future successes.

Defining and measuring multimorbidity in primary care in Singapore: Results of an online Delphi study

Multimorbidity, common in the primary care setting, has diverse implications for both the patient and the healthcare system. However, there is no consensus on the definition of multimorbidity globally. Thus, we aimed to conduct a Delphi study to gain consensus on the definition of multimorbidity, the list and number of chronic conditions used for defining multimorbidity in the Singapore primary care setting. Our Delphi study comprised three rounds of online voting from purposively sampled family physicians in public and private settings. Delphi round 1 included open-ended questions for idea generation. The subsequent two rounds used questions with pre-selected options. Consensus was achieved based on a pre-defined criteria following an iterative process. The response rates for the three rounds were 61.7% (37/60), 86.5% (32/37) and 93.8% (30/32), respectively. Among 40 panellists who responded, 46.0% were 31-40 years old, 64.9% were male and 73.0% were from the public primary healthcare setting. Based on the findings of rounds 1, 2 and 3, consensus on the definition of a chronic condition, multimorbidity and finalised list of chronic conditions were achieved. For a condition to be chronic, it should last for six months or more, be recurrent or persistent, impact patients across multiple domains and require long-term management. The consensus-derived definition of multimorbidity is the presence of three or more chronic conditions from a finalised list of 23 chronic conditions. We anticipate that our findings will inform multimorbidity conceptualisation at the national level, standardise multimorbidity measurement in primary care and facilitate resource allocation for patients with multimorbidity.

A Program Evaluation of a Dietary Sodium Reduction Research Consortium of Five Low- and Middle-Income Countries in Latin America

Excess dietary sodium is a global public health priority, particularly in low- and middle-income countries where rates of hypertension and cardiovascular disease are high. The International Development Research Centre funded a research consortium of five Latin American countries (LAC) to inform public health policy for dietary sodium reduction (2016-2020). The objective of this study was to determine the outcomes of this funding on short-term (e.g., research, capacity building) and intermediary outcomes (e.g., policies). A summative program evaluation was conducted, using a logic model and multiple data sources including document review, surveys and interviews. Researchers from Argentina, Costa Rica, Brazil, Peru and Paraguay produced a significant amount of scientific evidence to guide decision making on sodium policy related to its content in foods, consumer behaviors (social marketing), and the health and economic benefits of dietary reduction. A substantive number of knowledge translation products were produced. The funding enabled training opportunities for researchers who developed skills that can be scaled-up to other critical nutrients and health issues. It was unexpected that intermediary policy changes would occur, however several countries demonstrated early policy improvements derived from this research. A funded research consortium of LAC is a practical approach to invoke policy innovations.

"For me, it's just a piece of freedom"-Increased empowerment through physical activity promotion among socially disadvantaged women

Introduction

Community-based participatory research (CBPR) is an effective health promotion approach for reaching socially disadvantaged groups. However, there is limited evidence on how such interventions and their effects can be reproduced across time and place. The present study examines the effects of BIG (i.e., movement as an investment in health), a long-standing German CBPR project. Since 2005, BIG has aimed to empower women in difficult life situations to increase control over their health determinants and reduce social inequalities by promoting physical activity. One of BIG's key features is its implementation in several German municipalities since 2005. This study explores (a) whether participation could change women's empowerment, and (b) how increased empowerment affects other areas of women's lives.

Methods

With a total of 63 interviewees (i.e., 40 participating women, 7 trainers, 3 project coordinators, and 13 stakeholders), we conducted 53 semi-structured qualitative interviews in five BIG communities between 2007 and 2011. Some interviews were conducted with two people simultaneously. The interview guide contained questions on various dimensions of empowerment (e.g., project engagement, increased self-efficacy, and developed competencies). Framework analysis was used for the analytical process.

Results

BIG contributed to women's empowerment in various ways, including increased self-efficacy, social network promotion, competency development, and increased motivation to change physical activity behavior. Women who took on added tasks and became more involved in project planning also strengthened their organizational empowerment. Furthermore, increased empowerment had a positive influence on the women's quality of life, family, and professional lives.

Conclusion

The novel findings helped in understanding the effects of a complex empowerment-based approach that promoted physical activity among women in difficult life situations. Future research should focus on the long-term effects of these programs and their transferability to other sites. Further effort is necessary in the area of public health policy.

[Decision-making process and evaluation of public health interventions]

Objectif

Nous proposons un cadre méthodologique destiné aux experts impliqués dans l'appui à la décision concernant les interventions de santé publique.

Méthodes

Le cadre méthodologique comprend quatre éléments : 1) une série de neuf questions, formulées en termes non techniques, pertinentes pour juger de l'utilité d'une intervention, considérée à un moment donné dans un contexte donné ; 2) une traduction de ces questions en concepts liés à l'évaluation des interventions (définition de l'intervention, de sa cible et de son objectif, efficacités potentielle et réelle, sécurité, efficience et équité) ; 3) une organisation logique des informations nécessaires pour répondre aux questions ; 4) un algorithme permettant de traduire les informations disponibles en recommandations sur l'utilité réelle de l'intervention dans le contexte où les questions ont été posées.

Résultats

Chaque étape est illustrée par des questions posées sur des interventions de sécurité routière, le dépistage, la transfusion sanguine et des mesures proposées pendant la pandémie de COVID-19.

Conclusion

La décision peut être facilitée si les experts fournissent aux décideurs un résumé formel des forces et faiblesses des connaissances, fondé sur une analyse de toutes les facettes de l'utilité potentielle d'une intervention.

Practice-based evidence: Perspectives of effective characteristics of Australian group-based physical activity programs for postpartum women

ISSUE ADDRESSED

Many postpartum women often do not achieve recommendations of at least 150 minutes moderate-to-vigorous physical activity (MVPA) each week. Previous qualitative work has focused on postpartum women's barriers and challenges to being active, with recent research starting to explore the characteristics of PA programs and women who are active during the postpartum period. Yet, little research has focused on the characteristics of key stakeholders and community organisations that support women to sustain their PA engagement during the postpartum period.

METHODS

This research generates practice-based evidence to provide essential insights for effective implementation, strategies and actions of community group-based PA programs that recruit and retain postpartum women to ensure future interventions are scalable and sustainable. Ten participants (90% female), ranging in age from 34 to 40 years, were recruited from nine community organisations/businesses. The ten participants engaged in semi-structured interviews for an average length of 31 minutes.

RESULTS

Inductive thematic analysis revealed four overarching themes (i) effective practitioners have a history of, and passion for women's health and PA; (ii) low-cost, connected approaches attract postpartum women into community group-based PA programs; (iii) inclusive, flexible, varied, and holistic approaches sustain postpartum women's participation; and (iv) utilise connections to overcome barriers to community group-based PA programs. These four themes were informed by twelve sub-themes relating to the background of stakeholders and practitioners and the approaches that they use to attract and sustain postpartum women in community group-based PA programs.

CONCLUSIONS

Practice-based findings should inform future practices and the development of future real-world group-based PA interventions for postpartum women. SO WHAT?: Specifically, interventions will need to be designed and implemented by practitioners who have a history of, and passion for women's health and PA, be low-cost, connected approaches, that are inclusive, flexible, varied, and holistic that prioritise physical, emotional, and social wellbeing.

Scaling up tobacco cessation within TB programmes: findings from a multi-country, mixed-methods implementation study

BACKGROUND

Brief behavioural support can effectively help tuberculosis (TB) patients quit smoking and improve their outcomes. In collaboration with TB programmes in Bangladesh, Nepal and Pakistan, we evaluated the implementation and scale-up of cessation support using four strategies: (1) brief tobacco cessation intervention, (2) integration of tobacco cessation within routine training, (3) inclusion of tobacco indicators in routine records and (4) embedding research within TB programmes.

METHODS

We used mixed methods of observation, interviews, questionnaires and routine data. We aimed to understand the extent and facilitators of vertical scale-up (institutionalization) within 59 health facility learning sites in Pakistan, 18 in Nepal and 15 in Bangladesh, and horizontal scale-up (increased coverage beyond learning sites). We observed training and surveyed all 169 TB health workers who were trained, in order to measure changes in their confidence in delivering cessation support. Routine TB data from the learning sites were analysed to assess intervention delivery and use of TB forms revised to report smoking status and cessation support provided. A purposive sample of TB health workers, managers and policy-makers were interviewed (Bangladesh n = 12; Nepal n = 13; Pakistan n = 19). Costs of scale-up were estimated using activity-based cost analysis.

RESULTS

Routine data indicated that health workers in learning sites asked all TB patients about tobacco use and offered them cessation support. Qualitative data showed use of intervention materials, often with adaptation and partial implementation in busy clinics. Short (1-2 hours) training integrated within existing programmes increased mean confidence in delivering cessation support by 17% (95% CI: 14-20%). A focus on health system changes (reporting, training, supervision) facilitated vertical scale-up. Dissemination of materials beyond learning sites and changes to national reporting forms and training indicated a degree of horizontal scale-up. Embedding research within TB health systems was crucial for horizontal scale-up and required the dynamic use of tactics including alliance-building, engagement in the wider policy process, use of insider researchers and a deep understanding of health system actors and processes.

CONCLUSIONS

System-level changes within TB programmes may facilitate routine delivery of cessation support to TB patients. These strategies are inexpensive, and with concerted efforts from TB programmes and donors, tobacco cessation can be institutionalized at scale.

Complexities and Context of Scaling Up: A Qualitative Study of Stakeholder Perspectives of Scaling Physical Activity and Nutrition Interventions in Australia

Background

Scaling up population health interventions is a context-orientated, dynamic and multi-stakeholder process; understanding its influences is essential to enhance future scaling efforts. Using physical activity and nutrition interventions in Australia as case examples, the aim of this paper is to identify core influences involved in scaling up physical activity and nutrition interventions, and how these may differ by context and stakeholder.

Methods

A qualitative study involving semi-structured telephone interviews with individuals representing academic, government and non-government organizations with involvement in scaling up state and national physical activity and nutrition interventions. Interview questions were derived from the WHO report “20 Questions for Developing a Scaling up Case Study”, and mapped against four key principles and five core areas in the WHO ExpandNet framework for scaling up: (1) The innovation; (2) User organization; (3) Environment; (4) Resource team and; (5) Scale up strategy. Data were analyzed thematically.

Results

Nineteen interviews were conducted (government = 3; non-government = 5; and academic = 11 sectors) involving eight scaled up interventions, targeting nutrition (n = 2), physical activity (n = 1) or a combination (n = 5). Most themes aligned to the “Environment”, including: (i) political (e.g., personal agendas); (ii) social (e.g., lack of urgency); and (iii) sector/workforce (e.g., scale up accountability) factors. Themes relating to “Scale up strategy” (e.g., flexibility and evaluation transparency) were next most commonly occurring. Whilst themes were broadly consistent across participants, government participants had a more policy-oriented perspective on the scale up process. Academics discussed a tension between the generation and use of evidence, and the influence of political climates/interest on scale up decisions.

Conclusion

Attributes of the “Environment” and “Scale up strategy” consistently featured as major influences on successful outcomes, while the role of evidence differed greatly between participant groups. A multisector scale up strategy for future interventions may enable the complexities of environmental and political contexts to be incorporated into scale up planning.

A systematic review of adaptations and effectiveness of scaled-up nutrition interventions

CONTEXT

Public health nutrition interventions shown to be effective under optimal research conditions need to be scaled up and implemented in real-world settings.

OBJECTIVES

The primary aim for this review was to assess the effectiveness of scaled-up public health nutrition interventions with proven efficacy, as examined in a randomized controlled trial. Secondary objectives were to: 1) determine if the effect size of scaled-up interventions were comparable to the prescale effect, and; 2) identify any adaptations made during the scale-up process.

DATA SOURCES

Six electronic databases were searched and field experts contacted.

STUDY SELECTION

An intervention was considered scaled up if it was delivered on a larger scale than a preceding randomized controlled trial ("prescale") in which a significant intervention effect (P ≤ 0.05) was reported on a measure of nutrition.

DATA EXTRACTION

Two reviewers independently performed screening and data extraction. Effect size differences between prescale and scaled-up interventions were quantified. Adaptations to scale-up studies were coded according to the Adaptome model.

RESULTS

Ten scaled-up nutrition interventions were identified. The effect size difference between prescale trials and scaled-up studies ranged from -32.2% to 222% (median, 50%). All studies made adaptations between prescale to scaled-up interventions.

CONCLUSION

The effects of nutrition interventions implemented at scale typically were half that achieved in prior efficacy trials. Identifying effective scale-up strategies and methods to support retainment of the original prescale effect size is urgently needed to inform public health policy.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO registration no.CRD42020149267.

Soft infrastructure: the critical community-level resources reportedly needed for program success

Background

The mechanisms typically used to fund health promotion in communities, either as part of an effort to scale-up programs or to support the design of local activities, often pay insufficient attention to the foundational means of enhancing well-being. Only recently have researchers begun to critically ‘unpack’ how funding processes connect with and activate local community capacities.

Methods

We conducted a thematic analysis of 33 interviews with policy and program administrators in public health and local community workers and volunteers. We invited them to expound on their understandings of resources - specifically, what needs to be in place to make funded programs successful and/or what do communities draw on to make funded programs effective.

Results

Policy and program administrators reflected mostly on the importance of traditional resources, such as adequate funding and staffing. Community-based participants often went further to describe psychological and sociological resources – the “soft infrastructure” which included trust and hope. Both groups emphasised the importance of building networks and relationships at multiple levels. Community workers also provided examples of how resources grow and improve in value in combination with other processes or through pathways of resource use or resource distribution. So, resources like information/knowledge are made more valuable when relayed locally. Physical amenities (e.g., meeting spaces, kitchens) have an instrumental role, but also act powerfully as a symbolic resource for identity. Participants reported that funding processes can damage the resources required for community health improvement. Funding instability undermines capacity. The ongoing threat of funding removal was described by one administrator as community “bullying”.

Conclusions

Processes of health promotion funding, and even standard processes of program scale-up and readiness assessment, risk underestimating the range of resources that are fundamental for community health improvement, particularly among disadvantaged communities. Funders should design ways to resource communities so that there is constant attention to and coaching of critically important diverse processes of resource growth, independent of program-specific funds.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-12788-8.

Health promotion innovations scale up: combining insights from framing and actor-network to foster reflexivity

There are numerous hurdles down the road for successfully scaling up health promotion innovations into formal programmes. The challenges of the scaling-up process have mainly been conceived in terms of available resources and technical or management problems. However, aiming for greater impact and sustainability involves addressing new contexts and often adding actors whose perspectives may challenge established orientations. The social dimension of the scaling-up process is thus critical. Building on existing conceptualizations of interventions as dynamic networks and of evolving framing of health issues, this paper elaborates a social view of scaling up that accounts for the transformations of innovations, using framing analysis and the notion of 'expanding scaling-up networks'. First, we discuss interventions as dynamic networks. Second, we conceptualize scaling-up processes as networks in expansion within which social learning and change occur. Third, we propose combining a 'representational approach' to frame analysis and an 'interactional approach' that illustrates framing processes related to the micro-practices of leading public health actors within expanding networks. Using an example concerning equity in early childhood development, we show that this latter approach allows documenting how frames evolve in the process. Considering the process in continuity with existing conceptualizations of interventions as actor-networks and transformation of meanings enriches our conceptualization of scaling up, improves our capacity to anticipate its outcomes, and promotes reflexivity about health promotion goals and means.

Assessing the scalability of an integrated falls prevention service for community-dwelling older people: a mixed methods study

Background

There is growing acknowledgement of the need for a phased approach to scaling up health interventions, beginning with an assessment of ‘scalability’, that is, the capacity of an individual intervention to be scaled up. This study aims to assess the scalability of a multi-component integrated falls prevention service for community-dwelling older people and to examine the applicability of the Intervention Scalability Assessment Tool (ISAT). The ISAT consists of 10 domains for consideration when determining the scalability of an intervention, and each domain comprises a series of questions aimed at examining readiness for scale-up.

Methods

Multiple methods were used sequentially as recommended by the ISAT: a review of policy documents, results from a service evaluation and falls-related literature; one-to-one interviews (n = 11) with key stakeholders involved in management and oversight of the service; and a follow-up online questionnaire (n = 10) with stakeholders to rate scalability and provide further feedback on reasons for their scores.

Results

Three of the ISAT domains were rated highly by the participants. Analysis of the qualitative feedback and documents indicated that the issue of falls prevention among older people was of sufficient priority to warrant scale-up of the service and that the service aligned with national health policy priorities. Some participants also noted that benefits of the service could potentially outweigh costs through reduced hospital admissions and serious injuries such as hip fracture. The remaining domains received a moderate score from participants, however, indicating considerable barriers to scale-up. In the qualitative feedback, barriers identified included the perceived need for more healthcare staff to deliver components of the service, for additional infrastructure such as adequate room space, and for an integrated electronic patient management system linking primary and secondary care and to prevent duplication of services.

Conclusions

Plans to scale up the service are currently under review given the practical barriers that need to be addressed. The ISAT provides a systematic and structured framework for examining the scalability of this multi-component falls prevention intervention, although the iterative nature of the process and detailed and technical nature of its questions require considerable time and knowledge of the service to complete.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12877-021-02717-6.

Identifying priorities for sport and physical activity research in Canada: an iterative priority-setting study

BACKGROUND

There is a need for better alignment between research on sport and physical activity and the needs of those who are in a position to implement the findings. To facilitate advancement and alignment, we identified the top research priorities of sport and physical activity knowledge users from various sectors.

METHODS

For this priority-setting study, we used an iterative process of data collection and analysis. Sport and physical activity knowledge users from multiple sectors participated in a workshop (September 2019), which included small working group exercises followed by large-group syntheses leading to the identification of issues that required better understanding. We then sent an online questionnaire to participants for content validation and interim prioritization, to reduce the number of priorities (December 2019 to January 2020). A new questionnaire containing a shortened list of research priorities was sent to an expanded group of respondents to further streamline the list of priorities (January-March 2020).

RESULTS

The 24 workshop participants identified 68 issues, of which 21 were retained by the 18 participants in the interim priority-setting questionnaire. The final prioritization questionnaire was completed by 33 stakeholder groups; this step produced a final list of 8 top research priorities. The final priorities identified for sport and physical activity research related to financial support, suboptimal promotion, dropout, best interventions, participation among Indigenous populations, volunteer engagement, safe and inclusive experiences, and knowledge exchange.

INTERPRETATION

The 8 priorities identified in this study provide guidance to Canadian sport and physical activity researchers. Research efforts on these priorities will reflect pressing issues as identified by representatives of all sport and physical activity sectors.

Benefits of not smoking during pregnancy for non-Aboriginal women and their babies in New South Wales, Australia: a record linkage study

BACKGROUND

Smoking rates among pregnant women in New South Wales (NSW) have plateaued at 8-9%. To inform relevant smoking reduction efforts, we aimed to quantify the benefits of not smoking during pregnancy for non-Aboriginal NSW mothers and their babies. The benefits of not smoking during pregnancy for NSW Aboriginal mothers have previously been described. These data are important inputs in modelling health and economic impacts of smoking cessation interventions.

METHODS

This population-based cohort study used linked-data from routinely collected data sets. Not smoking during pregnancy was the exposure of interest among all NSW non-Aboriginal women who became mothers of singleton babies in 2012-2016. Unadjusted and adjusted relative risks (aRR) were used to examine associations between not smoking during pregnancy and adverse outcomes including severe morbidity, inter-hospital transfer, perinatal death, preterm birth and small-for-gestational age. Population attributable fractions (PAFs) were calculated to quantify adverse perinatal outcomes avoided in the population if all mothers were non-smokers.

RESULTS

Compared with babies born to mothers who smoked during pregnancy, babies born to non-smoking mothers had a lower risk of all adverse perinatal outcomes including perinatal death (aRR = 0.68, 95%CI 0.61-0.76), preterm birth (aRR = 0.58, 95%CI 0.56-0.61) and small-for-gestational age (aRR = 0.48, 95%CI 0.47-0.50). PAFs(%) were 3.9% for perinatal death, 5.6% for preterm birth and 7.3% for small-for-gestational-age. Compared with women who smoked during pregnancy (n = 36,518), those who did not smoke (n = 413,072) had a lower risk of suffering severe maternal morbidity (aRR = 0.87, 95%CI 0.81-0.93) and being transferred to another hospital (aRR = 0.92, 95%CI 0.86-0.99).

CONCLUSIONS

Mothers who reported not smoking during pregnancy had a small reduction in their risk of morbidity and of being transferred to another hospital whilst their babies had substantially reduced risks of all adverse perinatal outcomes. Results have implications for clinician training, clinical care standards, and performance management.

Improving access to primary health care: a cross-case comparison based on an a priori program theory

Background

Inequitable access to primary health care (PHC) remains a problem for most western countries. Failure to scale up effective interventions has been due, in part, to a failure to share the logic and essential elements of successful programs. The aim of this paper is to describe what we learned about improving access to PHC for vulnerable groups across multiple sites through use of a common theory-based program logic model and a common evaluation approach. This was the IMPACT initiative.

Methods

IMPACT’s evaluation used a mixed methods design with longitudinal (pre and post) analysis of six interventions. The analysis for this paper included four of the six sites that met study criteria. These sites were located in Canada (Alberta, Quebec and Ontario) and Australia (New South Wales). Using the overarching logic model, unexpected findings were reviewed, and alternative explanations were considered to understand how the mechanisms of each intervention may have contributed to results.

Results

Each site addressed their local access problem with different strategies and from different starting points. All sites observed changes in patient abilities to access PHC and provider access capabilities. The combination of intended and observed consequences for consumers and providers was different at each site, but all sites achieved change in both consumer ability and provider capability, even in interventions where there was no activity targeting provider behaviors.

Discussion

The model helped to identify, explore and synthesize intended and unintended consequences of four interventions that appeared to have more differences than similarities. Similar outcomes for different interventions and multiple impacts of each intervention on abilities were observed, implying complex causal pathways.

Conclusions

All the interventions were a low-cost incremental attempt to address unmet health care needs of vulnerable populations. Change is possible; sustaining change may be more challenging. Access to PHC requires attention to both patient abilities and provider characteristics. The logic model proved to be a valuable heuristic tool for defining the objectives of the interventions, evaluating their impacts, and learning from the comparison of ‘cases’.

Improving global maternal and newborn survival via innovation: Stakeholder perspectives on the Saving Lives at Birth Grand Challenge

The Saving Lives at Birth (SL@B) funding partners joined in 2011 to source, support, and scale maternal and newborn health (MNH) innovations to improve maternal and newborn survival by focusing on the 24 hours around the time of birth. A multi-methods, retrospective portfolio evaluation was conducted to determine SL@B's impact. Forty semi-structured, key informant interviews (KIIs) were conducted with experts in global MNH based in low- and middle-income and in high-income countries to assess the SL@B program. KIIs were conducted with global MNH technical experts, innovators, government officials in low- and middle-income countries, donors, private investors, and implementing partners to include the full spectrum of voices involved in identifying and scaling innovations. Data were analyzed using thematic analysis. Stakeholders believe the SL@B program has been successful in changing the way maternal and newborn health programs are delivered with a focus on doing things differently through innovation. The open approach to sourcing innovation was seen as positive to the extent that it brought more interdisciplinary stakeholders to think about the problem of maternal and newborn survival. However, a demand-driven approach that aims to source innovations that address MNH priority needs and takes into account the needs of end users (e.g. individuals and governments) was suggested as a strategy for ensuring that more innovations go to scale.

Key factors to facilitate locally driven family planning programming: a qualitative analysis of urban stakeholder perspectives in Africa and Asia

Background

There has been greater recognition of the importance of country ownership in global health and development. However, operationalising country ownership to ensure the scale up and sustainability of proven interventions remains elusive at best. To address this challenge, we undertook a thematic analysis of interviews collected from representatives of local governments, public health systems, and communities in poor urban areas of East Africa, Francophone West Africa, India, and Nigeria, supported by The Challenge Initiative (TCI), aiming to rapidly and sustainably scale up evidence-based reproductive health and family planning solutions.

Methods

The main objective of this study was to explore critical elements needed for implementing and scaling evidence-based family planning interventions. The research team conducted thematic analysis of 96 stories collected using the Most Significant Change (MSC) technique between July 2018 and September 2019. After generating 55 unique codes, the codes were grouped into related themes, using TCI’s model as a general analytical framework.

Results

Five key themes emerged: (1) strengthening local capacity and improving broader health systems, (2) shifting mindsets of government and community toward local ownership, (3) institutionalising the interventions within existing government structures, (4) improving data demand and use for better planning of health services, and (5) enhancing coordination of partners.

Conclusion

While some themes feature more prominently in a particular region than others, taken together they represent what stakeholders perceive to be essential elements for scaling up locally-driven health programmes in urban areas in Africa and Asia.

Scaling up Action Schools! BC: How Does Voltage Drop at Scale Affect Student Level Outcomes? A Cluster Randomized Controlled Trial

Action Schools! BC (AS! BC) was scaled-up from an efficacy trial to province-wide delivery across 11 years (2004-2015). In this study we: (1) describe strategies that supported implementation and scale-up; (2) evaluate implementation (teachers' physical activity (PA) delivery) and student's PA and cardiorespiratory fitness (CRF) within a cluster randomized controlled trial during years 2 and 3 of scale-up; and (3) assess relationships between teacher-level implementation and student-level outcomes. We classified implementation strategies as process, capacity-building or scale-up strategies. Elementary schools (n = 30) were randomized to intervention (INT; 16 schools; 747 students) or usual practice (UP; 14 schools; 782 students). We measured teachers' PA delivery (n = 179) using weekly logs; students' PA by questionnaire (n = 30 schools) and accelerometry (n = 9 schools); and students' CRF by 20-m shuttle run (n = 25 schools). INT teachers delivered more PA than UP teachers in year 1 (+33.8 min/week, 95% CI 12.7, 54.9) but not year 2 (+18.8 min/week, 95% CI -0.8, 38.3). Unadjusted change in CRF was 36% and 27% higher in INT girls and boys, respectively, compared with their UP peers (year 1; effect size 0.28-0.48). Total PA delivered was associated with change in children's self-reported MVPA (year 1; r = 0.17, p = 0.02). Despite the 'voltage drop', scaling-up school-based PA models is feasible and may enhance children's health. Stakeholders must conceive of new ways to effectively sustain scaled-up health promoting interventions if we are to improve the health of students at a population level. Clinical Trials registration: NCT01412203.

The Long-Term Public Health Impact of a Community-Based Participatory Research Project for Health Promotion Among Socially Disadvantaged Women-A Case Study Protocol

Introduction: Community-based participatory research (CBPR) is considered to be of high potential for health promotion among socially disadvantaged groups. However, the long-term implementation and transfer of these approaches remain challenging, and the public health impact they achieve is difficult to study. This also pertains to the potential health effects and cost-effectiveness of CBPR. This study protocol describes the follow-up case study (NU-BIG) after 15 years of the BIG project (“movement as investment in health”), a project to promote physical activity among socially disadvantaged women. Through a participatory approach, BIG empowers the addressed women to plan and implement low-threshold physical activity offers. Since the project started in 2005, it was transferred to 17 communities in Germany.

Materials and Analysis: NU-BIG intends to examine the long-term effects, including economic aspects, of the BIG project on individual and structural levels at all project sites, as well as its long-term implementation and transfer. NU-BIG is a cross-sectional and longitudinal study using a mixed method approach. For the longitudinal section, we re-analyze existing data from former BIG evaluations. For cross-sectional data collection, we use questionnaires and conduct qualitative interviews and focus groups. Women who take part in BIG program offers are part of the research team and will use the photo-voice approach to report on the effects of BIG. The study population consists of about 800 women who participate in BIG project offers and 50 persons involved in the implementation of the BIG project at local sites.

Discussion: The expected results from NU-BIG are highly relevant for studying the long-term public health impact of CBPR. In particular, this project intends to answer questions on how the transfer of such projects can succeed and which factors determine if a CBPR project can be sustained at the community level. Eventually, these results can contribute to the further development of participatory approaches to provide effective health promotion among socially disadvantaged groups.

Conclusion: Although CBPR is seen of having the potential to reduce health disparities, there is still a lack of research on its long-term effects and public health impact. NU-BIG aims at generating knowledge about the economic effects, reach, efficacy, adoption, implementation, and maintenance of a CBPR project. The expected results could be of high interest for BIG and other CBPR-projects.

The impact of school uniforms on primary school student's physical activity at school: outcomes of a cluster randomized controlled trial

Background

Many school-based physical activity (PA) interventions are complex and have modest effects when delivered in real world contexts. A commonly reported barrier to students’ PA, particularly among girls, are uniforms that are impractical (e.g. tunic/dress and black leather shoes). Modifying student uniforms may represent a simple intervention to enhance student PA. The primary aim of this trial was to assess the impact of a PA enabling uniform intervention (shorts, polo shirt and sports shoes) on girls’ moderate-to-vigorous physical activity (MVPA) and total PA i.e. counts per minute (cpm).

Methods

A cluster randomized controlled trial was undertaken in 42 primary schools in New South Wales, Australia. Schools were randomized on one school day to the intervention group, where students wore a PA enabling uniform (their sports uniform) or a control group, where students wore their usual traditional uniform. Student PA was measured using wrist-worn Actigraph GT3X and GT9X accelerometers. Linear mixed models controlling for student characteristics were used to examine the effects of the intervention..

Results

Of the 3351 eligible students, 2315 (69.1%) had parental consent and 2180 of these consenting students participated (94.2%) of which 1847 (84.7%) were included in the analysis. For the primary aim the study found no significant differences between girls at schools allocated to the intervention relative to the control on change in MVPA (0.76 min, 95% CI − 0.47 to 1.99, p = 0.22) or cpm (36.99, 95% CI − 13.88 to 87.86, p = 0.15). Exploratory analysis revealed small effects for a number of findings, including significant reduction in sedentary activity (− 1.77, 95% CI − 3.40 to − 0.14, p = 0.035) among all students at schools allocated to the intervention, and non-significant improvements in girls’ light intensity PA (1.47 min, 95% CI − 0.06 to 3.00, p = 0.059) and sedentary activity (− 2.23 min; 95% CI − 4.49 to 0.02, p = 0.052).

Conclusion

The findings suggests that the intervention may yield small improvements in some measure of PA and require substantiation in a larger RCT with longer-term follow-up. The inclusion of additional intervention components may be required to achieve more meaningful effects.

Trial registration

The trial was prospectively registered with Australian New Zealand Clinical Trials Register ACTRN12617001266358 1st September 2017.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-021-01084-0.

How effective are physical activity interventions when they are scaled-up: a systematic review

Background

The ‘scale-up’ of effective physical activity interventions is required if they are to yield improvements in population health. The purpose of this study was to systematically review the effectiveness of community-based physical activity interventions that have been scaled-up. We also sought to explore differences in the effect size of these interventions compared with prior evaluations of their efficacy in more controlled contexts, and describe adaptations that were made to interventions as part of the scale-up process.

Methods

We performed a search of empirical research using six electronic databases, hand searched reference lists and contacted field experts. An intervention was considered ‘scaled-up’ if it had been intentionally delivered on a larger scale (to a greater number of participants, new populations, and/or by means of different delivery systems) than a preceding randomised control trial (‘pre-scale’) in which a significant intervention effect (p < 0.05) was reported on any measure of physical activity. Effect size differences between pre-scale and scaled up interventions were quantified ([the effect size reported in the scaled-up study / the effect size reported in the pre-scale-up efficacy trial] × 100) to explore any scale-up ‘penalties’ in intervention effects.

Results

We identified 10 eligible studies. Six scaled-up interventions appeared to achieve significant improvement on at least one measure of physical activity. Six studies included measures of physical activity that were common between pre-scale and scaled-up trials enabling the calculation of an effect size difference (and potential scale-up penalty). Differences in effect size ranged from 132 to 25% (median = 58.8%), suggesting that most scaled-up interventions typically achieve less than 60% of their pre-scale effect size. A variety of adaptations were made for scale-up – the most common being mode of delivery.

Conclusion

The majority of interventions remained effective when delivered at-scale however their effects were markedly lower than reported in pre-scale trials. Adaptations of interventions were common and may have impacted on the effectiveness of interventions delivered at scale. These outcomes provide valuable insight for researchers and public health practitioners interested in the design and scale-up of physical activity interventions, and contribute to the growing evidence base for delivering health promotion interventions at-scale.

Trial registration

PROSPERO CRD42020144842.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-021-01080-4.

Factors associated with the institutionalization of a physical activity program in Australian elementary schools

The health benefits of classroom-based physical activity programs may only be sustained if programs are continually implemented over time. Despite the importance of instituting physical activity programs to ensure their continued implementation, little is known about factors associated with institutionalization of programs at a school level. The purpose of this study is to examine how school context, principal characteristics, and program attributes are associated with the institutionalization of Bluearth Foundation's Active Schools program in Australian elementary schools. Current principals from schools who participated in the Active Schools program between 2015 and 2017 reported the level of institutionalization of the program, school context, principal characteristics, and perceived attributes of the program. Univariate associations were calculated using Pearson's correlation coefficient, independent sample t-tests and one-way ANOVA. Linear regression using backward deletion was used to calculate significant or marginally significant (p < .1) multivariate associations. Thirty of the 211 eligible principals participated in the study. School capacity (r = .617, p < .001); perceived student behavioral (r = .577, p < .001), health (r = .499, p < .001), and enjoyment benefits (r = .529, p < .001), relative advantage (r = .417, p = .022), observability (r = .385, p = .036), and having the program delivered by a Bluearth coach at the time of the study (η 2 = .426, p < .001) all had a significant positive univariate association with institutionalization. School capacity (β = 1.802, p = .001), observability (β = 0.902, p = .061), and having the program delivered by a Bluearth coach at the time of the study (β = 2.580, p = .003) remained significant in the final multivariate model. Results suggest that schools that have someone who can provide support implementing a program are more likely to institute the program into policies and practices. It is also important that school administrators have the tools to evaluate the benefits of physical activity programs and to perceive them as being beneficial for their students. However, schools may struggle to institutionalize physical activity programs after formal program delivery has concluded.

Process Evaluation of a School-Based High-Intensity Interval Training Program for Older Adolescents: The Burn 2 Learn Cluster Randomised Controlled Trial

Process evaluations can help to optimise the implementation of school-based physical activity interventions. The purpose of this paper is to describe the process evaluation of a school-based high-intensity interval training (HIIT) program for older adolescent students, known as Burn 2 Learn (B2L). B2L was evaluated via a cluster randomised controlled trial in 20 secondary schools (10 intervention, 10 control) in New South Wales, Australia. Teachers (n = 22 (55% female)) from the 10 intervention schools, delivered the program over three phases (Phases 1 and 2, 6 months; Phase 3, 6 months) to older adolescent students (n = 337 (50% female); mean ± standard deviation (SD) age = 16.0 ± 0.4 years). Process evaluation data were collected across the 12-month study period. Teachers delivered 2.0 ± 0.8 and 1.7 ± 0.6 sessions/week in Phases 1 and 2 respectively (mean total 25.9 ± 5.2), but only 0.6 ± 0.7 sessions/week in Phase 3. Observational data showed that session quality was high, however heart rate (HR) data indicated that only half of the students reached the prescribed threshold of ≥85% predicted HRmax during sessions. Over 80% of teachers reported they intended to deliver the B2L program to future student cohorts. Almost 70% of students indicated they intended to participate in HIIT in the future. Teachers considered the program to be adaptable, and both students and teachers were satisfied with the intervention. B2L was implemented with moderate-to-high fidelity in Phases 1 and 2, but low in Phase 3. Our findings add to the relatively scant process evaluation literature focused on the delivery of school-based physical activity programs.

Self-organizing peer coach groups to increase daily physical activity in community dwelling older adults

Many older adults do not reach the recommended level of physical activity, despite many professional-delivered physical activity interventions. Here we study the implementation of a novel physical activity intervention for older adults that is self-sustainable (no financial support) and self-organizing (participants act as organizers) due to peer coaching. We implemented three groups and evaluated process and effect using participatory observations, questionnaires, six-minute walk tests and body composition measures from October 2016 to September 2018. The intervention was implemented by staff without experience in physical activity interventions. Facilitators were a motivated initiator and a non-professional atmosphere for participants to take ownership. Barriers were the absence of motivated participants to take ownership and insufficient participants to ensure the presence of participants at every exercise session. The groups exercised outside five days a week and were self-organizing after 114, 216 and 263 days. The initial investments were 170€ for sport equipment and 81–187 h. The groups reached 118 members and a retention of 86.4% in two years. The groups continue to exist at the time of writing and are self-sustainable. Quality of life increased 0.4 on a ten-point scale (95%CI 0.1–0.7; p = 0.02) and six-minute walk test results improved with 33 m (95%CI 18–48; p < 0.01) annually. Self-organizing peer coach groups for physical activity are feasible, have positive effects on health and require only a small investment at the start. It is a sustainable and potentially scalable intervention that could be a promising method to help many older adults age healthier.

Scaling up population health interventions from decision to sustainability - a window of opportunity? A qualitative view from policy-makers

Background

While known efficacious preventive health interventions exist, the current capacity to scale up these interventions is limited. In recent years, much attention has focussed on developing frameworks and methods for scale-up yet, in practice, the pathway for scale-up is seldom linear and may be highly dependent on contextual circumstances. Few studies have examined the process of scaling up from decision to implementation nor examined the sustainability of scaled-up interventions. This study explores decision-makers’ perceptions from real-world scaled-up case studies to examine how scale-up decisions were made and describe enablers of successful scale-up and sustainability.

Methods

This qualitative study included 29 interviews conducted with purposively sampled key Australian policy-makers, practitioners and researchers experienced in scale-up. Semi-structured interview questions obtained information regarding case studies of scaled-up interventions. The Framework Analysis method was used as the primary method of analysis of the interview data to inductively generate common and divergent themes within qualitative data across cases.

Results

A total of 31 case studies of public health interventions were described by interview respondents based on their experiences. According to the interviewees’ perceptions, decisions to scale up commonly occurred either opportunistically, when funding became available, or when a deliberate decision was made and funding allocated. The latter scenario was more common when the intervention aligned with specific political or strategic goals. Decisions to scale up were driven by a variety of key actors such as politicians, senior policy-makers and practitioners in the health system. Drivers of a successful scale-up process included good governance, clear leadership, and adequate resourcing and expertise. Establishing accountability structures and appropriate engagement mechanisms to encourage the uptake of interventions were also key enablers. Sustainability was influenced by evidence of impact as well as good acceptability among the general or target population.

Conclusions

Much like Kingdon’s Multiple Streams Theory of ‘policy windows’, there is a conceptually similar ‘window for scale-up’, driven by a complex interplay of factors such as political need, strategic context, funding and key actors. Researchers and policy-makers need to consider scalability from the outset and prepare for when the window for scale-up opens. Decision-makers need to provide longer term funding for scale-up to facilitate longer term sustainability and build on the resources already invested for the scale-up process.

Using Integrated Research-Practice Partnerships to Move Evidence-Based Principles Into Practice

The implementation of evidence-based physical activity interventions is improved when integrated research-practice partnerships are used. These partnerships consider both research- and practice-based evidence that moves beyond only assessing program efficacy. Our novel hypothesis is that integrated research-practice partnerships may lead to interventions that are practical and effective, reach more participants, and are more likely to be sustained in practice.

Building the Evidence Base to Inform Planned Intervention Adaptations by Practitioners Serving Health Disparity Populations

Many evidence-based interventions (EBIs) have been developed to prevent or treat major health conditions. However, many EBIs have exhibited limited adoption, reach, and sustainability when implemented in diverse community settings. This limitation is especially pronounced in low-resource settings that serve health disparity populations. Often, practitioners identify problems with existing EBIs originally developed and tested with populations different from their target population and introduce needed adaptations to make the intervention more suitable. Although some EBIs have been extensively adapted for diverse populations and evaluated, most local adaptations to improve fit for health disparity populations are not well documented or evaluated. As a result, empirical evidence is often lacking regarding the potential effectiveness of specific adaptations practitioners may be considering. We advocate an expansion in the emphasis of adaptation research from researcher-led interventions to research that informs practitioner-led adaptations. By presenting a research vision and strategies needed to build this area of science, we aim to inform research that facilitates successful adaptation and equitable implementation and delivery of EBIs that reduce health disparities.

The pitfalls of scaling up evidence-based interventions in health

Policy-makers worldwide are increasingly interested in scaling up evidence-based interventions (EBIs) to larger populations, and implementation scientists are developing frameworks and methodologies for achieving this. But scaling-up does not always produce the desired results. Why not? We aimed to enhance awareness of the various pitfalls to be anticipated when planning scale-up. In lower- and middle-income countries (LMICs), the scale-up of health programs to prevent or respond to outbreaks of communicable diseases has been occurring for many decades. In high-income countries, there is new interest in the scaling up of interventions that address communicable and non-communicable diseases alike. We scanned the literature worldwide on problems encountered when implementing scale-up plans revealed a number of potential pitfalls that we discuss in this paper. We identified and discussed the following six major pitfalls of scaling-up EBIs: 1) the cost-effectiveness estimation pitfall, i.e. accurate cost-effectiveness estimates about real-world implementation are almost impossible, making predictions of economies of scale unreliable; 2) the health inequities pitfall, i.e. some people will necessarily be left out and therefore not benefit from the scaled-up EBIs; 3) the scaled-up harm pitfall, i.e. the harms as well as the benefits may be amplified by the scaling-up; 4) the ethical pitfall, i.e. informed consent may be a challenge on a grander scale; 5) the top-down pitfall, i.e. the needs, preferences and culture of end-users may be forgotten when scale-up is directed from above; and 6) the contextual pitfall, i.e. it may not be possible to adapt the EBIs to every context. If its pitfalls are addressed head on, scaling-up may be a powerful process for translating research data into practical improvements in healthcare in both LMICs and high-income countries, ensuring that more people benefit from EBIs.

Researching social innovation: is the tail wagging the dog?

Background

Social Innovation in health initiatives have the potential to address unmet community health needs. For sustainable change to occur, we need to understand how and why a given intervention is effective. Bringing together communities, innovators, researchers, and policy makers is a powerful way to address this knowledge gap but differing priorities and epistemological backgrounds can make collaboration challenging.

Main text

To overcome these barriers, stakeholders will need to design policies and work in ways that provide an enabling environment for innovative products and services. Inherently about people, the incorporation of community engagement approaches is necessary for both the development of social innovations and accompanying research methodologies. Whilst the 'appropriate' level of participation is linked to intended outcomes, researchers have a role to play in better understanding how to harness the power of community engagement and to ensure that community perspectives form part of the evidence base that informs policy and practice.

Conclusions

To effectively operate at the intersection between policy, social innovation, and research, all collaborators need to enter the process with the mindset of learners, rather than experts. Methods – quantitative and qualitative – must be selected according to research questions. The fields of implementation research, community-based participatory research, and realist research, amongst others, have much to offer. So do other sectors, notably education and business. In all this, researchers must assume the mantel of responsibility for research and not transfer the onus to communities under the guise of participation. By leveraging the expertise and knowledge of different ecosystem actors, we can design responsive health systems that integrate innovative approaches in ways that are greater than the sum of their parts.

Intervention Scalability Assessment Tool: A decision support tool for health policy makers and implementers

Background

Promising health interventions tested in pilot studies will only achieve population-wide impact if they are implemented at scale across communities and health systems. Scaling up effective health interventions is vital as not doing so denies the community the most effective services and programmes. However, there remains a paucity of practical tools to assess the suitability of health interventions for scale-up. The Intervention Scalability Assessment Tool (ISAT) was developed to support policy-makers and practitioners to make systematic assessments of the suitability of health interventions for scale-up.

Methods

The ISAT was developed over three stages; the first stage involved a literature review to identify similar tools and frameworks that could be used to guide scalability assessments, and expert input to develop draft ISAT content. In the second stage, the draft ISAT tool was tested with end users. The third stage involved revising and re-testing the ISAT with end users to further refine the language and structure of the final ISAT.

Results

A variety of information and sources of evidence should be used to complete the ISAT. The ISAT consists of three parts. Part A: ‘setting the scene’ requires consideration of the context in which the intervention is being considered for scale-up and consists of five domains, as follows: (1) the problem; (2) the intervention; (3) strategic/political context; (4) evidence of effectiveness; and (5) intervention costs and benefits. Part B asks users to assess the potential implementation and scale-up requirements within five domains, namely (1) fidelity and adaptation; (2) reach and acceptability; (3) delivery setting and workforce; (4) implementation infrastructure; and (5) sustainability. Part C generates a graphical representation of the strengths and weaknesses of the readiness of the proposed intervention for scale-up. Users are also prompted for a recommendation as to whether the intervention (1) is recommended for scale-up, (2) is promising but needs further information before scaling up, or (3) does not yet merit scale-up.

Conclusion

The ISAT fills an important gap in applied scalability assessment and can become a critical decision support tool for policy-makers and practitioners when selecting health interventions for scale-up. Although the ISAT is designed to be a health policy and practitioner tool, it can also be used by researchers in the design of research to fill important evidence gaps.

Factors that influence implementation at scale of a community-based health promotion intervention for older adults

Background

Despite the many known benefits of physical activity (PA), relatively few older adults are active on a regular basis. Older adult PA interventions delivered in controlled settings showed promising results. However, to achieve population level health impact, programs must be effectively scaled-up, and few interventions have achieved this. To effectively scale-up it is essential to identify contextual factors that facilitate or impede implementation at scale. Our aim is to describe factors that influence implementation at scale of a health promotion intervention for older adults (Choose to Move). This implementation evaluation complements our previously published study that assessed the impact of Choose to Move on older adult health indicators.

Methods

To describe factors that influenced implementation our evaluation targeted five distinct levels across a socioecological continuum. Four members of our project team conducted semi-structured interviews by telephone with 1) leaders of delivery partner organizations (n = 13) 2) recreation managers (n = 6), recreation coordinators (n = 27), activity coaches (n = 36) and participants (n = 42) [August 2015 – April 2017]. Interviews were audio-recorded and professionally transcribed and data were analyzed using framework analysis.

Results

Partners agreed on the timeliness and need for scaled-up evidence-based health promotion programs for older adults. Choose to Move aligned with organizational priorities, visions and strategic directions and was deemed easy to deliver, flexible and adaptable. Partners also noted the critical role played by our project team as the support unit. However, partners noted availability of financial resources as a potential barrier to sustainability.

Conclusions

Even relatively simple evidence-based interventions can be challenging to scale-up and sustain. To ensure successful implementation it is essential to align with multilevel socioecological perspectives and assess the vast array of contextual factors that are at the core of better understanding successful implementation.