Effective strategies for scaling up evidence-based practices in primary care: a systematic review

Factors influencing the implementation of the CombiConsultation in Dutch clinical practice: a mixed-methods study

OBJECTIVE

The CombiConsultation is an innovative concise clinical pharmacy service by the community pharmacist for patients with a chronic condition. We aimed to identify relevant factors influencing the implementation of the CombiConsultation in Dutch clinical practice.

METHODS

A mixed-methods study involving interviews and a questionnaire. Content analysis topics within TDF domains were derived from the interview data and were related to the COM-B-model (capability-opportunity-motivation-Behaviour). The relevance of the resulting topics was explored using a questionnaire with 19 statements administered to all 27 pharmacists who performed CombiConsultations.

KEY FINDINGS

Eighteen topics emerged from the interviews. The questionnaire was completed by 23 of the 27 pharmacists. In the domain 'capability', a small number of participants indicated that they need more expertise in pharmacotherapy (13%) and training in consultation skills (35%). In the domain 'opportunity', all participants indicated that an existing good collaboration with the general practitioner/practice nurse and access to all relevant medical data were necessary to implement the CombiConsultation. In terms of motivation, job satisfaction was most important to all participants, followed by adequate reimbursement (83%) and improving collaboration with other healthcare providers and the relationship with patients (78%).

CONCLUSIONS

Capability, opportunity, and motivation were all considered relevant for the implementation of the CombiConsultation. There were crucial factors on the level of the individual pharmacist, on the level of the local collaboration and organization, and on the health system level.

V. Mochcovitch D, Abdoulaye Samri M, Akpo TG, Gogovor A, Blanchette V, Gomes Souza L, Kastner K, M. Achim A, McLean RKD, Milat A, Légaré F. Strategies for involving patients and the public in scaling initiatives in health and social services: A scoping review

BACKGROUND

Scaling in health and social services (HSS) aims to increase the intended impact of proven effective interventions. Patient and public involvement (PPI) is critical for ensuring that scaling beneficiaries' interests are served. We aimed to identify PPI strategies and their characteristics in the science and practice of scaling in HSS.

METHODS

In this scoping review, we included any scaling initiative in HSS that used PPI strategies and reported PPI methods and outcomes. We searched electronic databases (e.g., Medline) from inception to 5 February 2024, and grey literature (e.g., Google). Paired reviewers independently selected and extracted eligible reports. A narrative synthesis was performed and we used the PRISMA for Scoping Reviews and the Guidance for Reporting Involvement of Patients and the Public (GRIPP2).

FINDINGS

We included 110 unique reports out of 24,579 records. In the past 5 years, the evidence on PPI in scaling has increased faster than in any previous period. We found 236 mutually nonexclusive PPI strategies among 120 scaling initiatives. Twenty-four initiatives did not target a specific country; but most of those that did so (n = 96) occurred in higher-income countries (n = 51). Community-based primary health care was the most frequent level of care (n = 103). Mostly, patients and the public were involved throughout all scaling phases (n = 46) and throughout the continuum of collaboration (n = 45); the most frequently reported ethical lens regarding the rationale for PPI was consequentialist-utilitarian (n = 96). Few papers reported PPI recruitment processes (n = 31) or incentives used (n = 18). PPI strategies occurred mostly in direct care (n = 88). Patient and public education was the PPI strategy most reported (n = 31), followed by population consultations (n = 30).

CONCLUSIONS

PPI in scaling is increasing in HSS. Further investigation is needed to better document the PPI experience in scaling and ensure that it occurs in a meaningful and equitable way.

PATIENT AND PUBLIC CONTRIBUTION

Two patients were involved in this review. They shared decisions on review questions, data collection instruments, protocol design, and findings dissemination.

REVIEW REGISTRATION

Open Science Framework on 19 August 2020 (https://osf.io/zqpx7/).

Effects of a medical admission unit on in-hospital patient flow and clinical outcomes

BACKGROUND

the burden of acute complex patients, increasingly older and poli-pathological, accessing to Emergency Departments (ED) leads up hospital overcrowding and the outlying phenomenon. These issues highlight the need for new adequate patients' management strategies. The aim of this study is to analyse the effects on in-hospital patient flow and clinical outcomes of a high-technology and time-limited Medical Admission Unit (MAU) run by internists.

METHODS

all consecutive patients admitted to MAU from Dec-2017 to Nov-2019 were included in the study. The admissions number from ED and hospitalization rate, the overall in-hospital mortality rate in medical department, the total days of hospitalization and the overall outliers bed days were compared to those from the previous two years.

RESULTS

2162 patients were admitted in MAU, 2085(95.6%) from ED, 476(22.0%) were directly discharged, 88(4.1%) died and 1598(73.9%) were transferred to other wards, with a median in-MAU time of stay of 64.5 [0.2-344.2] hours. Comparing the 24 months before, despite the increase in admissions/year from ED in medical department (3842 ± 106 in Dec2015-Nov2017 vs 4062 ± 100 in Dec2017-Nov2019, p<0.001), the number of the outlier bed days has been reduced, especially in surgical department (11.46 ± 6.25% in Dec2015-Nov2017 vs 6.39 ± 3.08% in Dec2017-Nov2019, p=0.001), and mortality in medical area has dropped from 8.74 ± 0.37% to 7.29 ± 0.57%, p<0.001.

CONCLUSIONS

over two years, a patient-centred and problem-oriented approach in a medical admission buffer unit run by internists has ensured a constant flow of acute patients with positive effects on clinical risk and quality of care reducing medical outliers and in-hospital mortality.

A National Approach to Promoting Health Equity in Cardiovascular Disease Prevention: Implementation Science Strengths, Opportunities, and a Changing Chronic Disease Context

In the USA, structural racism contributes to higher rates of cardiovascular disease (CVD) including hypertension, heart disease, and stroke among African American persons. Evidence-based interventions (EBIs), which include programs, policies, and practices, can help mitigate health inequities, but have historically been underutilized or misapplied among communities experiencing discrimination and exclusion. This commentary on the special issue of Prevention Science, "Advancing the Adaptability of Chronic Disease Prevention and Management Through Implementation Science," describes the Centers for Disease Control and Prevention, Division for Heart Disease and Stroke Prevention's (DHDSP's) efforts to support implementation practice and highlights several studies in the issue that align with DHDSP's methods and mission. This work includes EBI identification, scale, and spread as well as health services and policy research. We conclude that implementation practice to enhance CVD health equity will require greater coordination with diverse implementation science partners as well as continued innovation and capacity building to ensure meaningful community engagement throughout EBI development, translation, dissemination, and implementation.

Informing the development of the SUCCEED reporting guideline for studies on the scaling of health interventions: A systematic review

BACKGROUND

Quality reporting contributes to effective translation of health research in practice and policy. As an initial step in the development of a reporting guideline for scaling, the Standards for reporting stUdies of sCaling evidenCEd-informED interventions (SUCCEED), we performed a systematic review to identify relevant guidelines and compile a list of potential items.

METHODS

We conducted a systematic review according to Cochrane method guidelines. We searched the following databases: MEDLINE, Embase, PsycINFO, Cochrane Library, CINAHL, Web of Science, from their respective inceptions. We also searched websites of relevant organizations and Google. We included any document that provided instructions or recommendations, e.g., reporting guideline, checklist, guidance, framework, standard; could inform the design or reporting of scaling interventions; and related to the health sector. We extracted characteristics of the included guidelines and assessed their methodological quality using a 3-item internal validity assessment tool. We extracted all items from the guidelines and classified them according to the main sections of reporting guidelines (title, abstract, introduction, methods, results, discussion and other information). We performed a narrative synthesis based on descriptive statistics.

RESULTS

Of 7704 records screened (published between 1999 and 2019), we included 39 guidelines, from which data were extracted from 57 reports. Of the 39 guidelines, 17 were for designing scaling interventions and 22 for reporting implementation interventions. At least one female author was listed in 31 guidelines, and 21 first authors were female. None of the authors belonged to the patient stakeholder group. Only one guideline clearly identified a patient as having participated in the consensus process. More than half the guidelines (56%) had been developed using an evidence-based process. In total, 750 items were extracted from the 39 guidelines and distributed into the 7 main sections.

CONCLUSION

Relevant items identified could inform the development of a reporting guideline for scaling studies of evidence-based health interventions. This and our assessment of guidelines could contribute to better reporting in the science and practice of scaling.

Mobilizing pilot-based evidence for the spread and sustainability of innovations in healthcare: The role of innovation intermediaries

An endemic challenge facing healthcare systems around the world is how to spread innovation more widely and sustainably. A common response to this challenge involves conducting pilot implementation studies to generate evidence of the innovation's benefits. However, despite the key role that such studies play in the local adoption of innovation, their contribution to the wider spread and sustainability of innovation is relatively under-researched and under-theorized. In this paper we examine this contribution through an empirical examination of the experiences of an innovation intermediary organization in the English NHS (National Health Service). We find that their work in mobilizing pilot-based evidence involves three main strands; configuring to context; transitioning evidence; and managing the transition. Through this analysis we contribute to theory by showing how the agency afforded by intermediary roles can support the effective transitioning of pilot-based evidence across different phases in the innovation journey, and across different occupational groups, and can thus help to create a positive feedback loop from localized early implementers of an innovation to later more widespread adoption and sustainability. Based on these findings, we develop insights on the reasons for the unnecessary repetition of pilots - so-called 'pilotitis'- and offer policy recommendations on how to enhance the role of pilots in the wider spread and sustainability of innovation.

Adapting and implementing breast cancer follow-up in primary care: protocol for a mixed methods hybrid type 1 effectiveness-implementation cluster randomized study

BACKGROUND

Advances in detection and treatment for breast cancer have led to an increase in the number of individuals managing significant late and long-term treatment effects. Primary care has a role in caring for patients with a history of cancer, yet there is little guidance on how to effectively implement survivorship care evidence into primary care delivery.

METHODS

This protocol describes a multi-phase, mixed methods, stakeholder-driven research process that prioritizes actionable, evidence-based primary care improvements to enhance breast cancer survivorship care by integrating implementation and primary care transformation frameworks: the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework and the Practice Change Model (PCM). Informed by depth interviews and a four round Delphi panel with diverse stakeholders from primary care and oncology, we will implement and evaluate an iterative clinical intervention in a hybrid type 1 effectiveness-implementation cluster randomized design in twenty-six primary care practices. Multi-component implementation strategies will include facilitation, audit and feedback, and learning collaboratives. Ongoing data collection and analysis will be performed to optimize adoption of the intervention. The primary clinical outcome to test effectiveness is comprehensive breast cancer follow-up care. Implementation will be assessed using mixed methods to explore how organizational and contextual variables affect adoption, implementation, and early sustainability for provision of follow-up care, symptom, and risk management activities at six- and 12-months post implementation.

DISCUSSION

Study findings are poised to inform development of scalable, high impact intervention processes to enhance long-term follow-up care for patients with a history of breast cancer in primary care. If successful, next steps would include working with a national primary care practice-based research network to implement a national dissemination study. Actionable activities and processes identified could also be applied to development of organizational and care delivery interventions for follow-up care for other cancer sites.

TRIAL REGISTRATION

Registered with ClinicalTrials.gov on June 2, 2022: NCT05400941.

Optimization of Care Pathways Through Technological, Clinical, Organizational and Social Innovations: A Qualitative Study

Numerous calls at national and international level are leading some countries to seek to redesign the provision of healthcare and services. Care pathways have the potential to improve outcomes by providing a mechanism to coordinate care and reduce fragmentation and ultimately costs. However, their implementation still shows variable results, resulting in them being considered as complex interventions in complex systems. By mobilizing an emerging approach combining action research and grounded theory methodology, we conducted a pilot project on care pathways. We used a strongly inductive process, to mobilize comparison and continuous theoretical sampling to produce theories. Forty-two interviews were conducted, and participant observations were made throughout the project, including 60 participant observations at meetings, workshops and field observations. The investigators kept logbooks and recorded field notes. Thematic analysis was used with an inductive approach. The present model explains the factors that positively or negatively influence the implementation of innovations in care pathways. The model represents interactions between facilitating factors, favourable conditions for the emergence of innovation adoption, implementation process enablers and challenges or barriers including those related specifically to the local context. What seems to be totally new is the embodiment of the mobilizing shared objective of active patient-partner participation in decision-making, data collection and analysis and solution building. This allows, in our opinion, to transcend professional perspectives for the benefit of patient-oriented results. Finally, the pilot project has created expectations in terms of spread and scaling. Future research on care pathway implementation should go further in the evaluation of the multifactorial impacts and develop a methodological framework of care pathway implementation, as the only existing proposition seems limited. Furthermore, from a social science perspective, it would be interesting to analyse the modes of social valuation of the different actors to understand what allows the transformation of collective action.

Strategies used throughout the scaling-up process of eConsult - Multiple case study of four Canadian Provinces

BACKGROUND

eConsult is a model of asynchronous communication connecting primary care providers to specialists to discuss patient care. This study aims to analyze the scaling-up process and identify strategies used to support scaling-up efforts in four provinces in Canada.

METHODS

We conducted a multiple case study with four cases (ON, QC, MB, NL). Data collection methods included document review (n = 93), meeting observations (n = 65) and semi-structured interviews (n = 40). Each case was analyzed based on Milat's framework.

RESULTS

The first scaling-up phase was marked by the rigorous evaluation of eConsult pilot projects and the publication of over 90 scientific papers. In the second phase, provinces implemented provincial multi-stakeholder committees, institutionalized the evaluation, and produced documents detailing the scaling-up plan. During the third phase, efforts were made to lead proofs of concept, obtain the endorsement of national and provincial organizations, and mobilize alternate sources of funding. The last phase was mainly observed in Ontario, where the creation of a provincial governance structure and strategies were put in place to monitor the service and manage changes.

CONCLUSIONS

Various strategies need to be used throughout the scaling-up process. The process remains challenging and lengthy because health systems lack clear processes to support innovation scaling-up.

Scaling-Up eConsult: Promising Strategies to Address Enabling Factors in Four Jurisdictions in Canada

BACKGROUND

Effective healthcare innovations are often not scaled up beyond their initial local context. Lack of practical knowledge on how to move from local innovations to large-system improvement hinders innovation and learning capacity in health systems. Studying scale-up processes can lead to a better understanding of how to facilitate the scale-up of interventions. eConsult is a digital health innovation that aims to connect primary care professionals with specialists through an asynchronous electronic consultation. The recent implementation of eConsult in the public health systems of four Canadian jurisdictions provides a unique opportunity to identify different enabling strategies and related factors that promote the scaling up of eConsult across jurisdictions.

METHODS

We conducted a narrative case study in four Canadian provinces, Quebec, Ontario, Manitoba, and Newfoundland & Labrador, over a 3-year period (2018-2021). We observed provincial eConsult committee meetings (n=65) and national eConsult forums (n=3), and we reviewed internal documents (n=93). We conducted semi-structured interviews with key actors in each jurisdiction (eg, researchers, primary care professionals, specialists, policy-makers, and patient partners) (n=40). We conducted thematic analysis guided by the literature on factors and strategies used to scale up innovations.

RESULTS

We identified a total of 31 strategies related to six key enabling factors to scaling up eConsult, including: (1) multi-actor engagement; (2) relative advantage; (3) knowledge transfer; (4) strong evidence base; (5) physician leadership; and (6) resource acquisition (eg, human, material, and financial resources). More commonly used strategies, such as leveraging research infrastructure and bringing together various actors, were used to address multiple enabling factors.

CONCLUSION

Actors used various strategies to scale up eConsult within their respective contexts, and these helped address six key factors that seemed to be essential to the scale-up of eConsult.

Implementation strategies, facilitators, and barriers to scaling up and sustaining post pregnancy family planning, a mixed-methods systematic review

BACKGROUND

Post pregnancy family planning includes both postpartum and post-abortion periods. Post pregnancy women remain one of the most vulnerable groups with high unmet need for family planning. This review aimed to describe and assess the quality of the evidence on implementation strategies, facilitators, and barriers to scaling up and sustaining post pregnancy family planning.

METHODS

Electronic bibliographic databases (MEDLINE, PubMed, Scopus, the Cochrane Library, and Global Index Medicus) were searched from inception to October 2022 for primary quantitative, qualitative, and mixed method reports on scaling up post pregnancy family planning. Abstracts, titles, and full-text papers were assessed according to the inclusion criteria to select studies regardless of country, language, publication status, or methodological limitations. Data were extracted and methodological quality assessed using the Mixed Methods Appraisal Tool. The convergent integrated approach and a deductive thematic synthesis were used to identify themes and sub-themes of strategies to scale up post pregnancy family planning. The health system building blocks were used to summarize barriers and facilitators. GRADE-CERQual was used to assess our confidence in the findings.

RESULTS

Twenty-nine reports (published 2005-2022) were included: 19 quantitative, 7 qualitative, and 3 mixed methods. Seven were from high-income countries, and twenty-two from LMIC settings. Sixty percent of studies had an unclear risk of bias. The included reports used either separate or bundled strategies for scaling-up post pregnancy family planning. These included strategies for healthcare infrastructure, policy and regulation, financing, human resource, and people at the point of care. Strategies that target the point of care (women and / or their partners) contributed to 89.66% (26/29) of the reports either independently or as part of a bundle. Point of care strategies increase adoption and coverage of post pregnancy contraceptive methods.

CONCLUSION

Post pregnancy family planning scaling up strategies, representing a range of styles and settings, were associated with improved post pregnancy contraceptive use. Factors that influence the success of implementing these strategies include issues related to counselling, integration in postnatal or post-abortion care, and religious and social norms.

TRIAL REGISTRATION

Center for Open Science, OSF.IO/EDAKM.

Development and Application of the Scale-Up Reflection Guide (SRG)

Scaling up effective interventions in public health is complex and comprehensive, and published accounts of the scale-up process are scarce. Key aspects of the scale-up experience need to be more comprehensively captured. This study describes the development of a guide for reflecting on and documenting the scale-up of public health interventions, to increase the depth of practice-based information of scaling up. Reviews of relevant scale-up frameworks along with expert input informed the development of the guide. We evaluated its acceptability with potential end-users and applied it to two real-world case studies. The Scale-up Reflection Guide (SRG) provides a structure and process for reflecting on and documenting key aspects of the scale-up process of public health interventions. The SRG is comprised of eight sections: context of completion; intervention delivery, history/background; intervention components; costs/funding strategies and partnership arrangements; the scale-up setting and delivery; scale-up process; and evidence of effectiveness and long-term outcomes. Utilization of the SRG may improve the consistency and reporting for the scale-up of public health interventions and facilitate knowledge sharing. The SRG can be used by a variety of stakeholders including researchers, policymakers or practitioners to more comprehensively reflect on and document scale-up experiences and inform future practice.

Scale-up of a chronic care model-based programme for type 2 diabetes in Belgium: a mixed-methods study

BACKGROUND

Type 2 diabetes (T2D) is an increasingly dominant disease. Interventions are more effective when carried out by a prepared and proactive team within an organised system - the integrated care (IC) model. The Chronic Care Model (CCM) provides guidance for its implementation, but scale-up of IC is challenging, and this hampers outcomes for T2D care. In this paper, we used the CCM to investigate the current implementation of IC in primary care in Flanders (Belgium) and its variability in different practice types.

METHODS

Belgium contains three different primary-care practice types: monodisciplinary fee-for-service practices, multidisciplinary fee-for-service practices and multidisciplinary capitation-based practices. Disproportional sampling was used to select a maximum of 10 practices for each type in three Flemish regions, leading to a total of 66 practices. The study employed a mixed methods design whereby the Assessment of Chronic Illness Care (ACIC) was complemented with interviews with general practitioners, nurses and dieticians linked to the 66 practices.

RESULTS

The ACIC scores of the fee-for-service practices - containing 97% of Belgian patients - only corresponded to basic support for chronic illness care for T2D. Multidisciplinary and capitation-based practices scored considerably higher than traditional monodisciplinary fee-for-service practices. The region had no significant impact on the ACIC scores. Having a nurse, being a capitation practice and having a secretary had a significant effect in the regression analysis, which explained 75% of the variance in ACIC scores. Better-performing practices were successful due to clear role-defining, task delegation to the nurse, coordination, structured use of the electronic medical record, planning of consultations and integration of self-management support, and behaviour-change intervention (internally or using community initiatives). The longer nurses work in primary care practices, the higher the chance that they perform more advanced tasks.

CONCLUSIONS

Besides the presence of a nurse or secretary, also working multidisciplinary under one roof and a capitation-based financing system are important features of a system wherein IC for T2D can be scaled-up successfully. Belgian policymakers should rethink the role of paramedics in primary care and make the financing system more integrated. As the scale-up of the IC varied highly in different contexts, uniform roll-out across a health system containing multiple types of practices may not be successful.

Scaling-up Child and Youth Mental Health Services: Assessing Coverage of a County-Wide Prevention and Early Intervention Initiative During One Fiscal Year

PURPOSE

In the U.S., the percentage of youth in need of evidence-based mental health practices (EBPs) who receive them (i.e., coverage rate) is low. We know little about what influences coverage rates. In 2010, the Los Angeles County Department of Mental Health (LACDMH) launched a reimbursement-driven implementation of multiple EBPs in youth mental health care. This study examines two questions: (1) What was the coverage rate of EBPs delivered three years following initial implementation? (2) What factors are associated with the coverage rates?

METHODS

To assess coverage rates of publicly insured youth, we used LACDMH administrative claims data from July 1, 2013 to June 30, 2014 and estimates of the size of the targeted eligible youth population from the 2014 American Community Survey (ACS). The unit of analysis was clinic service areas (n = 254). We used Geographic Information Systems and an OLS regression to assess community and clinic characteristics related to coverage.

RESULTS

The county coverage rate was estimated at 17%, much higher than national estimates. The proportion of ethnic minorities, individuals who are foreign-born, adults with a college degree within a geographic area were negatively associated with clinic service area coverage rates. Having more therapists who speak a language other than English, providing care outside of clinics, and higher proportion of households without a car were associated with higher coverage rates.

CONCLUSION

Heterogeneity in municipal mental health record type and availability makes it difficult to compare the LACDMH coverage rate with other efforts. However, the LACDMH initiative has higher coverage than published national rates. Having bilingual therapists and providing services outside the clinic was associated with higher coverage. Even with higher coverage, inequities persisted.

Sustaining and scaling a clinic-based approach to address health-related social needs

Objective

Scaling evidence-based interventions (EBIs) from pilot phase remains a pressing challenge in efforts to address health-related social needs (HRSN) and improve population health. This study describes an innovative approach to sustaining and further spreading DULCE (Developmental Understanding and Legal Collaboration for Everyone), a universal EBI that supports pediatric clinics to implement the American Academy of Pediatrics' Bright Futures™ guidelines for infants' well-child visits (WCVs) and introduces a new quality measure of families' HRSN resource use.

Methods

Between August 2018 and December 2019, seven teams in four communities in three states implemented DULCE: four teams that had been implementing DULCE since 2016 and three new teams. Teams received monthly data reports and individualized continuous quality improvement (CQI) coaching for six months, followed by lighter-touch support via quarterly group calls (peer-to-peer learning and coaching). Run charts were used to study outcome (percent of infants that received all WCVs on time) and process measures (percent of families screened for HRSN and connected to resources).

Results

Integrating three new sites was associated with an initial regression of outcome: 41% of infants received all WCVs on time, followed by improvement to 48%. Process performance was sustained or improved: among 989 participating families, 84% (831) received 1-month WCVs on time; 96% (946) were screened for seven HRSN, 54% (508) had HRSN, and 87% (444) used HRSN resources.

Conclusion

An innovative, lighter-touch CQI approach to a second phase of scale-up resulted in sustainment or improvements in most processes and outcomes. Outcomes-oriented CQI measures (family receipt of resources) are an important addition to more traditional process-oriented indicators.

Predictors and outcomes in primary depression care (POKAL) - a research training group develops an innovative approach to collaborative care

BACKGROUND

The interdisciplinary research training group (POKAL) aims to improve care for patients with depression and multimorbidity in primary care. POKAL includes nine projects within the framework of the Chronic Care Model (CCM). In addition, POKAL will train young (mental) health professionals in research competences within primary care settings. POKAL will address specific challenges in diagnosis (reliability of diagnosis, ignoring suicidal risks), in treatment (insufficient patient involvement, highly fragmented care and inappropriate long-time anti-depressive medication) and in implementation of innovations (insufficient guideline adherence, use of irrelevant patient outcomes, ignoring relevant context factors) in primary depression care.

METHODS

In 2021 POKAL started with a first group of 16 trainees in general practice (GPs), pharmacy, psychology, public health, informatics, etc. The program is scheduled for at least 6 years, so a second group of trainees starting in 2024 will also have three years of research-time. Experienced principal investigators (PIs) supervise all trainees in their specific projects. All projects refer to the CCM and focus on the diagnostic, therapeutic, and implementation challenges.

RESULTS

The first cohort of the POKAL research training group will develop and test new depression-specific diagnostics (hermeneutical strategies, predicting models, screening for suicidal ideation), treatment (primary-care based psycho-education, modulating factors in depression monitoring, strategies of de-prescribing) and implementation in primary care (guideline implementation, use of patient-assessed data, identification of relevant context factors). Based on those results the second cohort of trainees and their PIs will run two major trials to proof innovations in primary care-based a) diagnostics and b) treatment for depression.

CONCLUSION

The research and training programme POKAL aims to provide appropriate approaches for depression diagnosis and treatment in primary care.

Vaillancourt V, Poirier MD, Gauthier G, Hudon C, Delli-Colli N, Gagnon D, Careau E, Duhoux A, Gaboury I, Charif AB, Ashcroft R, Lukewich J, Ramond-Roquin A, Massé S. Co-design, implementation, and evaluation of an expanded train-the-trainer strategy to support the sustainability of evidence-based practice guides for registered nurses and social workers in primary care clinics: a developmental evaluation protocol

Background

The implementation of evidence-based innovations is incentivized as part of primary care reform in Canada. In the Province of Québec, it generated the creation of interprofessional care models involving registered nurses and social workers as members of primary care clinics. However, the scope of practice for these professionals remains variable and suboptimal. In 2019, expert committees co-designed and published two evidence-based practice guides, but no clear strategy has been identified to support their assimilation. This project’s goal is to support the implementation and deployment of practice guides for both social workers and registered nurses using a train-the-trainer educational intervention.

Methods/design

This three-phase project is a developmental evaluation using a multiple case study design across 17 primary care clinics. It will involve trainers in healthcare centers, patients, registered nurses and social workers. The development and implementation of an expanded train-the-trainer strategy will be informed by a patient-oriented research approach, the Kirkpatrick learning model, and evidence-based practice guides. For each case and phase, the qualitative and quantitative data will be analyzed using a convergent design method and will be integrated through assimilation.

Discussion

This educational intervention model will allow us to better understand the complex context of primary care clinics, involving different settings and services offered. This study protocol, based on reflective practice, patient-centered research and focused on the needs of the community in collaboration with partners and patients, may serve as an evidence based educational intervention model for further study in primary care.

Tailoring implementation strategies for scale-up: Preparing to take the Med-South Lifestyle program to scale statewide

Background

Tailoring implementation strategies for scale-up involves engaging stakeholders, identifying implementation determinants, and designing implementation strategies to target those determinants. The purpose of this paper is to describe the multiphase process used to engage stakeholders in tailoring strategies to scale-up the Med-South Lifestyle Program, a research-supported lifestyle behavior change intervention that translates the Mediterranean dietary pattern for the southeastern US.

Methods

Guided by Barker et al. framework, we tailored scale-up strategies over four-phases. In Phase 1, we engaged stakeholders from delivery systems that implement lifestyle interventions and from support systems that provide training and other support for statewide scale-up. In Phase 2, we partnered with delivery systems (community health centers and health departments) to design and pilot test implementation strategies (2014-2019). In Phase 3, we partnered with both delivery and support systems to tailor Phase 2 strategies for scale-up (2019-2021) and are now testing those tailored strategies in a type 3 hybrid study (2021-2023). This paper reports on the Phase 3 methods used to tailor implementation strategies for scale-up. To identify determinants of scale-up, we surveyed North Carolina delivery systems (n = 114 community health centers and health departments) and elicited input from delivery and support system stakeholders. We tailored strategies to address identified determinants by adapting the form of Phase 2 strategies while retaining their functions. We pilot tested strategies in three sites and collected data on intermediate, implementation, and effectiveness outcomes.

Findings

Determinants of scale-up included limited staffing, competing priorities, and safety concerns during COVID-19, among others. Tailoring yielded two levels of implementation strategies. At the level of the delivery system, strategies included implementation teams, an implementation blueprint, and cyclical small tests of change. At the level of the support system, strategies included training, educational materials, quality monitoring, and technical assistance. Findings from the pilot study provide evidence for the implementation strategies' reach, acceptability, and feasibility, with mixed findings on fidelity. Strategies were only moderately successful at building delivery system capacity to implement Med-South.

Conclusions

This paper describes the multiphase approach used to plan for Med-South scale-up, including the methods used to tailor two-levels of implementation strategies by identifying and targeting multilevel determinants.

Co-designing person-centred quality indicator implementation for primary care in Alberta: a consensus study

BACKGROUND

We aimed to contribute to developing practical guidance for implementing person-centred quality indicators (PC-QIs) for primary care in Alberta, Canada. As a first step in this process, we conducted stakeholder-guided prioritization of PC-QIs and implementation strategies. Stakeholder engagement is necessary to ensure PC-QI implementation is adapted to the context and local needs.

METHODS

We used an adapted nominal group technique (NGT) consensus process. Panelists were presented with 26 PC-QIs, and implementation strategies. Both PC-QIs and strategies were identified from our extensive previous engagement of patients, caregivers, healthcare providers, and quality improvement leaders. The NGT objectives were to: 1. Prioritize PC-QIs and implementation strategies; and 2. Facilitate the participation of diverse primary care stakeholders in Alberta, including patients, healthcare providers, and quality improvement staff. Panelists participated in three rounds of activities. In the first, panelists individually ranked and commented on the PC-QIs and strategies. The summarized results were discussed in the second-round face-to-face group meeting. For the last round, panelists provided their final individual rankings, informed by the group discussion. Finally, we conducted an evaluation of the consensus process from the panelists' perspectives.

RESULTS

Eleven primary care providers, patient partners, and quality improvement staff from across Alberta participated. The panelists prioritized the following PC-QIs: 'Patient and caregiver involvement in decisions about their care and treatment'; 'Trusting relationship with healthcare provider'; 'Health information technology to support person-centred care'; 'Co-designing care in partnership with communities'; and 'Overall experience'. Implementation strategies prioritized included: 'Develop partnerships'; 'Obtain quality improvement resources'; 'Needs assessment (stakeholders are engaged about their needs/priorities for person-centred measurement)'; 'Align measurement efforts'; and 'Engage champions'. Our evaluation suggests that panelists felt that the process was valuable for planning the implementation and obtaining feedback, that their input was valued, and that most would continue to collaborate with other stakeholders to implement the PC-QIs.

CONCLUSIONS

Our study demonstrates the value of co-design and participatory approaches for engaging stakeholders in adapting PC-QI implementation for the primary care context in Alberta, Canada. Collaboration with stakeholders can promote buy-in for ongoing engagement and ensure implementation will lead to meaningful improvements that matter to patients and providers.

Identifying core strategies and mechanisms for spreading a national medicines optimisation programme across England-a mixed-method study applying qualitative thematic analysis and Qualitative Comparative Analysis

Background

Achieving widespread adoption of innovations across health systems remains a challenge. Past efforts have focused on identifying and classifying strategies to actively support innovation spread (replicating an innovation across sites), but we lack an understanding about the mechanisms which such strategies draw on to deliver successful spread outcomes. There is also no established methodology to identify core strategies or mechanisms which could be replicated with fidelity in new contexts when spreading innovations. We aimed to understand which strategies and mechanisms are connected with successful spread using the case of a national medicines optimisation programme in England.

Methods

The study applied a comparative mixed-method case study approach. We compared spread activity in 15 Academic Health Science Networks (AHSN) in England, applied to one innovation case, Transfers of Care Around Medicines (TCAM). We followed two methodological steps: (1) qualitative thematic analysis of primary data collected from 18 interviews with AHSN staff members to identify the strategies and mechanisms and related contextual determinants and (2) Qualitative Comparative Analysis (QCA) combining secondary quantitative data on spread outcome and qualitative themes from step 1 to identify the core strategies and mechanisms.

Results

We identified six common spread strategy-mechanism constructs that AHSNs applied to spread the TCAM national spread programme: (1) the unique intermediary position of the AHSN as “honest broker” and local networking organisation, (2) the right capacity and position of the spread facilitator, (3) an intersectoral and integrated stakeholder engagement approach, (4) the dynamic marriage of the innovation with local health and care system needs and characteristics, (5) the generation of local evidence, and (6) the timing of TCAM. The QCA resulted in the core strategy/mechanism of a timely start into the national spread programme in combination with the employment of a local, senior pharmacist as an AHSN spread facilitator.

Conclusions

By qualitatively comparing experiences of spreading one innovation across different contexts, we identified common strategies, causal mechanisms, and contextual determinants. The QCA identified one core combination of two strategies/mechanisms. The identification of core strategies/mechanisms and common pre-conditional and mediating contextual determinants of a specific innovation offers spread facilitators and implementers a priority list for tailoring spread activities.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00364-5.

Assessing descriptions of scalability for hypertension control interventions implemented in low-and middle-income countries: A systematic review

Background

The prevalence of hypertension continues to rise in low- and middle-income- countries (LMICs) where scalable, evidence-based interventions (EBIs) that are designed to reduce morbidity and mortality attributed to hypertension have yet to be fully adopted or disseminated. We sought to evaluate evidence from published randomized controlled trials using EBIs for hypertension control implemented in LMICs, and identify the WHO/ExpandNet scale-up components that are relevant for consideration during “scale-up” implementation planning.

Methods

Systematic review of RCTs reporting EBIs for hypertension control implemented in LMICs that stated “scale-up” or a variation of scale-up; using the following data sources PubMed/Medline, Web of Science Biosis Citation Index (BCI), CINAHL, EMBASE, Global Health, Google Scholar, PsycINFO; the grey literature and clinicaltrials.gov from inception through June 2021 without any restrictions on publication date. Two reviewers independently assessed studies for inclusion, conducted data extraction using the WHO/ExpandNet Scale-up components as a guide and assessed the risk of bias using the Cochrane risk-of-bias tool. We provide intervention characteristics for each EBI, BP results, and other relevant scale-up descriptions.

Main results

Thirty-one RCTs were identified and reviewed. Studies reported clinically significant differences in BP, with 23 studies reporting statistically significant mean differences in BP (p < .05) following implementation. Only six studies provided descriptions that captured all of the nine WHO/ExpandNet components. Multi-component interventions, including drug therapy and health education, provided the most benefit to participants. The studies were yet to be scaled and we observed limited reporting on translation of the interventions into existing institutional policy (n = 11), cost-effectiveness analyses (n = 2), and sustainability measurements (n = 3).

Conclusion

This study highlights the limited data on intervention scalability for hypertension control in LMICs and demonstrates the need for better scale-up metrics and processes for this setting.

Trial registration

Registration PROSPERO (CRD42019117750).

Scaling-up citizen workshops in public libraries to disseminate and discuss primary care research results: a quasi-experimental study

Background

Little is known about engaging patients and stakeholders in the process of scaling up effective knowledge translation interventions targeting the public.

Objective

Using an integrated knowledge translation approach, we aimed to scale up and evaluate an effective pilot program to disseminate research results in public libraries.

Methods

We conducted a scaling-up study targeting the public. On the basis of our successful pilot project, we codeveloped and implemented a large-scale program of free citizen workshops in public libraries, in a close research partnership with stakeholders and patient representatives. Citizen workshops, each facilitated by 1 participating physician and 1 science communicator, consisted of a 45-minute computer-assisted presentation and a 45-minute open exchange. The intervention outcome was knowledge gained. The scale-up outcomes were satisfaction, appropriateness, coverage, and costs. An evaluation questionnaire was used to collect data of interest. Both quantitative and qualitative analyses were performed.

Results

The workshop theme chosen by the patient and stakeholder representatives was the high prevalence of medication overuse among people aged ≥65 years. From April to May 2019, 26 workshops were conducted in 25 public libraries reaching 362 people. The mean age of participants was 64.8 (SD 12.5) years. In total, 18 participating physicians and 6 science communicators facilitated the workshops. Participants reported significant knowledge gain (mean difference 2.1, 95% CI 2.0-2.2; P<.001). The median score for overall public satisfaction was 9 out of 10 (IQR 8-10). The public participants globally rated the workshops as having a high level of appropriateness. Coverage was 92% (25/27) of the total number of public libraries targeted. Costs were CAD $6051.84 (US $4519.69) for workshop design and CAD $22,935.41 (US $17,128.85) for scaling them up.

Conclusions

This project successfully established a large-scale and successful implementation science or knowledge translation bridge among researchers, clinicians, and citizens via public libraries. This study provides a model for a dissemination practice that benefits the public by both engaging them in the dissemination process and targeting them directly.

Scaling up tobacco cessation within TB programmes: findings from a multi-country, mixed-methods implementation study

BACKGROUND

Brief behavioural support can effectively help tuberculosis (TB) patients quit smoking and improve their outcomes. In collaboration with TB programmes in Bangladesh, Nepal and Pakistan, we evaluated the implementation and scale-up of cessation support using four strategies: (1) brief tobacco cessation intervention, (2) integration of tobacco cessation within routine training, (3) inclusion of tobacco indicators in routine records and (4) embedding research within TB programmes.

METHODS

We used mixed methods of observation, interviews, questionnaires and routine data. We aimed to understand the extent and facilitators of vertical scale-up (institutionalization) within 59 health facility learning sites in Pakistan, 18 in Nepal and 15 in Bangladesh, and horizontal scale-up (increased coverage beyond learning sites). We observed training and surveyed all 169 TB health workers who were trained, in order to measure changes in their confidence in delivering cessation support. Routine TB data from the learning sites were analysed to assess intervention delivery and use of TB forms revised to report smoking status and cessation support provided. A purposive sample of TB health workers, managers and policy-makers were interviewed (Bangladesh n = 12; Nepal n = 13; Pakistan n = 19). Costs of scale-up were estimated using activity-based cost analysis.

RESULTS

Routine data indicated that health workers in learning sites asked all TB patients about tobacco use and offered them cessation support. Qualitative data showed use of intervention materials, often with adaptation and partial implementation in busy clinics. Short (1-2 hours) training integrated within existing programmes increased mean confidence in delivering cessation support by 17% (95% CI: 14-20%). A focus on health system changes (reporting, training, supervision) facilitated vertical scale-up. Dissemination of materials beyond learning sites and changes to national reporting forms and training indicated a degree of horizontal scale-up. Embedding research within TB health systems was crucial for horizontal scale-up and required the dynamic use of tactics including alliance-building, engagement in the wider policy process, use of insider researchers and a deep understanding of health system actors and processes.

CONCLUSIONS

System-level changes within TB programmes may facilitate routine delivery of cessation support to TB patients. These strategies are inexpensive, and with concerted efforts from TB programmes and donors, tobacco cessation can be institutionalized at scale.

Tools for assessing the scalability of innovations in health: a systematic review

BACKGROUND

The last decade has seen growing interest in scaling up of innovations to strengthen healthcare systems. However, the lack of appropriate methods for determining their potential for scale-up is an unfortunate global handicap. Thus, we aimed to review tools proposed for assessing the scalability of innovations in health.

METHODS

We conducted a systematic review following the COSMIN methodology. We included any empirical research which aimed to investigate the creation, validation or interpretability of a scalability assessment tool in health. We searched Embase, MEDLINE, CINAHL, Web of Science, PsycINFO, Cochrane Library and ERIC from their inception to 20 March 2019. We also searched relevant websites, screened the reference lists of relevant reports and consulted experts in the field. Two reviewers independently selected and extracted eligible reports and assessed the methodological quality of tools. We summarized data using a narrative approach involving thematic syntheses and descriptive statistics.

RESULTS

We identified 31 reports describing 21 tools. Types of tools included criteria (47.6%), scales (33.3%) and checklists (19.0%). Most tools were published from 2010 onwards (90.5%), in open-access sources (85.7%) and funded by governmental or nongovernmental organizations (76.2%). All tools were in English; four were translated into French or Spanish (19.0%). Tool creation involved single (23.8%) or multiple (19.0%) types of stakeholders, or stakeholder involvement was not reported (57.1%). No studies reported involving patients or the public, or reported the sex of tool creators. Tools were created for use in high-income countries (28.6%), low- or middle-income countries (19.0%), or both (9.5%), or for transferring innovations from low- or middle-income countries to high-income countries (4.8%). Healthcare levels included public or population health (47.6%), primary healthcare (33.3%) and home care (4.8%). Most tools provided limited information on content validity (85.7%), and none reported on other measurement properties. The methodological quality of tools was deemed inadequate (61.9%) or doubtful (38.1%).

CONCLUSIONS

We inventoried tools for assessing the scalability of innovations in health. Existing tools are as yet of limited utility for assessing scalability in health. More work needs to be done to establish key psychometric properties of these tools. Trial registration We registered this review with PROSPERO (identifier: CRD42019107095).

Economic evaluation of severe malaria in children under 14 years in Zambia

Introduction

Malaria exerts a significant economic burden on health care providers and households and our study attempts to make claims on the cost effectiveness of artesunate against quinine in patients under 14 years of age in Zambia. Also, to find the average total costs involved in the treatment of severe malaria in children and their impact on household expenditure.

Methods

Cost-effectiveness analysis of severe malaria treatment was conducted from a healthcare provider perspective using a Markov model. Standard costing was performed for the identification, measurement and assessment phases with data from quantification reports for anti-malaria commodities as these documents provides drug procurement costs from suppliers and freight costs. Average and incremental cost-effectiveness ratio were estimated and uncertainties were assessed through probabilistic sensitivity analysis.

Results

In Zambia severe malaria in children has been shown to account for over 45% of the total monthly curative healthcare costs incurred by households compared to the mean per capita monthly income. The cost of treating severe malaria depleted 7.67% of the monthly average household income. According, to the cost effectiveness analysis the of artesunate with quinine the ICER was $105 per death averted.

Conclusion

The use of artesunate over quinine in the treatment of severe malaria in children under 14 years is a highly cost-effective strategy for the healthcare provider in Zambia.

Factors influencing sustainability and scale-up of rural primary healthcare memory clinics: perspectives of clinic team members

Background

The aging of rural populations contributes to growing numbers of people with dementia in rural areas. Despite the key role of primary healthcare in rural settings there is limited research on effective models for dementia care, or evidence on sustaining and scaling them. The purpose of this study was to identify factors influencing sustainability and scale-up of rural primary care based memory clinics from the perspective of healthcare providers involved in their design and delivery.

Methods

Participants were members of four interdisciplinary rural memory clinic teams in the Canadian province of Saskatchewan. A qualitative cross-sectional and retrospective study design was conducted. Data were collected via 6 focus groups (n = 40) and 16 workgroup meetings held with teams over 1 year post-implementation (n = 100). An inductive thematic analysis was used to identify themes.

Results

Eleven themes were identified (five that influenced both sustainability and scale-up, three related to sustainability, and three related to scale-up), encompassing team, organizational, and intervention-based factors. Factors that influenced both sustainability and scale-up were positive outcomes for patients and families, access to well-developed clinic processes and tools, a confident clinic leader-champion, facilitation by local facilitators and the researchers, and organizational and leadership support. Study findings revealed the importance of particular factors in the rural context, including facilitation to support team activities, a proven ready-to-use model, continuity of team members, and mentoring.

Conclusions

Interdisciplinary models of dementia care are feasible in rural settings if the right conditions and supports are maintained. Team-based factors were key to sustaining and scaling the innovation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07550-0.

The Aging, Community and Health Research Unit Community Partnership Program (ACHRU-CPP) for older adults with diabetes and multiple chronic conditions: study protocol for a randomized controlled trial

BACKGROUND

Older adults (≥65 years) with diabetes and multiple chronic conditions (MCC) (> 2 chronic conditions) experience reduced function and quality of life, increased health service use, and high mortality. Many community-based self-management interventions have been developed for this group, however the evidence for their effectiveness is limited. This paper presents the protocol for a randomized controlled trial (RCT) comparing the effectiveness and implementation of the Aging, Community and Health Research Unit-Community Partnership Program (ACHRU-CPP) to usual care in older adults with diabetes and MCC and their caregivers.

METHODS

We will conduct a cross-jurisdictional, multi-site implementation-effectiveness type II hybrid RCT. Eligibility criteria are: ≥65 years, diabetes diagnosis (Type 1 or 2) and at least one other chronic condition, and enrolled in a primary care or diabetes education program. Participants will be randomly assigned to the intervention (ACHRU-CPP) or control arm (1:1 ratio). The intervention arm consists of home/telephone visits, monthly group wellness sessions, multidisciplinary case conferences, and system navigation support. It will be delivered by registered nurses and registered dietitians/nutritionists from participating primary care or diabetes education programs and program coordinators from community-based organizations. The control arm consists of usual care provided by the primary care setting or diabetes education program. The primary outcome is the change from baseline to 6 months in mental functioning. Secondary outcomes will include, for example, the change from baseline to 6 months in physical functioning, diabetes self-management, depressive symptoms, and cost of use of healthcare services. Analysis of covariance (ANCOVA) models will be used to analyze all outcomes, with intention-to-treat analysis using multiple imputation to address missing data. Descriptive and qualitative data from older adults, caregivers and intervention teams will be used to examine intervention implementation, site-specific adaptations, and scalability potential.

DISCUSSION

An interprofessional intervention supporting self-management may be effective in improving health outcomes and client/caregiver experience and reducing service use and costs in this complex population. This pragmatic trial includes a scalability assessment which considers a range of effectiveness and implementation criteria to inform the future scale-up of the ACHRU-CPP.

TRIAL REGISTRATION

Clinical Trials.gov Identifier NCT03664583 . Registration date: September 10, 2018.

Implementability of healthcare interventions: an overview of reviews and development of a conceptual framework

Background

Implementation research may play an important role in reducing research waste by identifying strategies that support translation of evidence into practice. Implementation of healthcare interventions is influenced by multiple factors including the organisational context, implementation strategies and features of the intervention as perceived by people delivering and receiving the intervention. Recently, concepts relating to perceived features of interventions have been gaining traction in published literature, namely, acceptability, fidelity, feasibility, scalability and sustainability. These concepts may influence uptake of healthcare interventions, yet there seems to be little consensus about their nature and impact. The aim of this paper is to develop a testable conceptual framework of implementability of healthcare interventions that includes these five concepts.

Methods

A multifaceted approach was used to develop and refine a conceptual framework of implementability of healthcare interventions. An overview of reviews identified reviews published between January 2000 and March 2021 that focused on at least one of the five concepts in relation to a healthcare intervention. These findings informed the development of a preliminary framework of implementability of healthcare interventions which was presented to a panel of experts. A nominal group process was used to critique, refine and agree on a final framework.

Results

A total of 252 publications were included in the overview of reviews. Of these, 32% were found to be feasible, 4% reported sustainable changes in practice and 9% were scaled up to other populations and/or settings. The expert panel proposed that scalability and sustainability of a healthcare intervention are dependent on its acceptability, fidelity and feasibility. Furthermore, acceptability, fidelity and feasibility require re-evaluation over time and as the intervention is developed and then implemented in different settings or with different populations. The final agreed framework of implementability provides the basis for a chronological, iterative approach to planning for wide-scale, long-term implementation of healthcare interventions.

Conclusions

We recommend that researchers consider the factors acceptability, fidelity and feasibility (proposed to influence sustainability and scalability) during the preliminary phases of intervention development, evaluation and implementation, and iteratively check these factors in different settings and over time.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01171-7.

Assessing the scalability of an integrated falls prevention service for community-dwelling older people: a mixed methods study

Background

There is growing acknowledgement of the need for a phased approach to scaling up health interventions, beginning with an assessment of ‘scalability’, that is, the capacity of an individual intervention to be scaled up. This study aims to assess the scalability of a multi-component integrated falls prevention service for community-dwelling older people and to examine the applicability of the Intervention Scalability Assessment Tool (ISAT). The ISAT consists of 10 domains for consideration when determining the scalability of an intervention, and each domain comprises a series of questions aimed at examining readiness for scale-up.

Methods

Multiple methods were used sequentially as recommended by the ISAT: a review of policy documents, results from a service evaluation and falls-related literature; one-to-one interviews (n = 11) with key stakeholders involved in management and oversight of the service; and a follow-up online questionnaire (n = 10) with stakeholders to rate scalability and provide further feedback on reasons for their scores.

Results

Three of the ISAT domains were rated highly by the participants. Analysis of the qualitative feedback and documents indicated that the issue of falls prevention among older people was of sufficient priority to warrant scale-up of the service and that the service aligned with national health policy priorities. Some participants also noted that benefits of the service could potentially outweigh costs through reduced hospital admissions and serious injuries such as hip fracture. The remaining domains received a moderate score from participants, however, indicating considerable barriers to scale-up. In the qualitative feedback, barriers identified included the perceived need for more healthcare staff to deliver components of the service, for additional infrastructure such as adequate room space, and for an integrated electronic patient management system linking primary and secondary care and to prevent duplication of services.

Conclusions

Plans to scale up the service are currently under review given the practical barriers that need to be addressed. The ISAT provides a systematic and structured framework for examining the scalability of this multi-component falls prevention intervention, although the iterative nature of the process and detailed and technical nature of its questions require considerable time and knowledge of the service to complete.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12877-021-02717-6.

Evaluation of a Dragons' Den-inspired symposium to spread primary health care innovations in Quebec, Canada: a mixed-methods study using quality-improvement e-surveys

BACKGROUND

On May 24, 2017, the Quebec College of Family Physicians held an innovation symposium inspired by the television show Dragons' Den, at which innovators pitched their innovations to Dragon-Facilitators (i.e., decision-makers) and academic family medicine clinical leads. We evaluated the effects of the symposium on the spread of primary health care innovations.

METHODS

We conducted a mixed-methods evaluation of the symposium. We collected data related to Rogers' innovation-decision process using 3 quality-improvement e-surveys (distributed between May 2017 and February 2018). The first survey evaluated spread outputs (innovation discovery, intention to spread, improvements) and was sent to all participants immediately after the symposium. The second evaluated short-term spread outcomes (follow-ups, successes, barriers) and was sent to innovators 3 months after the symposium. The third evaluated medium-term spread outcomes (spread, perceived impact) and was sent to innovators and clinical leads 9 months after the symposium. We analyzed the data using descriptive statistics, content analysis and joint display.

RESULTS

Fifty-one innovators, 66 clinical leads (representing 42 clinics) and 37 Dragon-Facilitators attended the symposium. The response rates for the surveys were 61% (82/134) for the immediate post-symposium survey of all participants; 68% (21/31) for the 3-month survey of innovators; and 49% (48/97) for the 9-month survey of clinical leads and innovators. Immediately after the symposium, clinical leads and Dragon-Facilitators reported a high likelihood of adopting an innovation (mean ± standard deviation 8.02 ± 1.63 on a 10-point Likert scale) and 87% (53/61) agreed that they had discovered innovations at the symposium. Nearly all innovators (95%, 20/21) intended to follow up with potential adopters. After 3 months, 62% (13/21) of innovators had followed up in some way. After 9 months, 72% of clinical leads (18/25) had implemented at least 1 innovation, and 52% of innovators (12/23) had spread or were in the process of spreading innovations.

INTERPRETATION

The innovation symposium supported participants in achieving the early stages of spreading primary health care innovations. Replicating such symposia may help spread other health care innovations.

Strategies to implement SARS-CoV-2 point-of-care testing into primary care settings: a qualitative secondary analysis guided by the Behaviour Change Wheel

BACKGROUND

The purpose of this study is to develop a theory-driven understanding of the barriers and facilitators underpinning physicians' attitudes and capabilities to implementing SARS-CoV-2 point-of-care (POC) testing into primary care practices.

METHODS

We used a secondary qualitative analysis approach to re-analyse data from a qualitative, interview study of 22 primary care physicians from 21 primary care practices across three regions in England. We followed the three-step method based on the Behaviour Change Wheel to identify the barriers to implementing SARS-CoV-2 POC testing and identified strategies to address these challenges.

RESULTS

Several factors underpinned primary care physicians' attitudes and capabilities to implement SARS-CoV-2 POC testing into practice. First, limited knowledge of the SARS-CoV-2 POC testing landscape and a demanding workload affected physicians' willingness to use the tests. Second, there was scepticism about the insufficient evidence pertaining to the clinical efficacy and utility of POC tests, which affected physicians' confidence in the accuracy of tests. Third, physicians would adopt POC tests if they were prescribed and recommended by authorities. Fourth, physicians required professional education and training to increase their confidence in using POC tests but also suggested that healthcare assistants should administer the tests. Fifth, physicians expressed concerns about their limited workload capacity and that extra resources are needed to accommodate any anticipated changes. Sixth, information sharing across practices shaped perceptions of POC tests and the quality of information influenced physician perceptions. Seventh, financial incentives could motivate physicians and were also needed to cover the associated costs of testing. Eighth, physicians were worried that society will view primary care as an alternative to community testing centres, which would change perceptions around their professional identity. Ninth, physicians' perception of assurance/risk influenced their willingness to use POC testing if it could help identify infectious individuals, but they were also concerned about the risk of occupational exposure and potentially losing staff members who would need to self-isolate.

CONCLUSIONS

Improving primary care physicians' knowledgebase of SARS-CoV-2 POC tests, introducing policies to embed testing into practice, and providing resources to meet the anticipated demands of testing are critical to implementing testing into practice.

A systematic review of adaptations and effectiveness of scaled-up nutrition interventions

Context

Public health nutrition interventions shown to be effective under optimal research conditions need to be scaled up and implemented in real-world settings.

Objectives

The primary aim for this review was to assess the effectiveness of scaled-up public health nutrition interventions with proven efficacy, as examined in a randomized controlled trial. Secondary objectives were to: 1) determine if the effect size of scaled-up interventions were comparable to the prescale effect, and; 2) identify any adaptations made during the scale-up process.

Data sources

Six electronic databases were searched and field experts contacted.

Study selection

An intervention was considered scaled up if it was delivered on a larger scale than a preceding randomized controlled trial (“prescale”) in which a significant intervention effect (P ≤ 0.05) was reported on a measure of nutrition.

Data extraction

Two reviewers independently performed screening and data extraction. Effect size differences between prescale and scaled-up interventions were quantified. Adaptations to scale-up studies were coded according to the Adaptome model.

Results

Ten scaled-up nutrition interventions were identified. The effect size difference between prescale trials and scaled-up studies ranged from –32.2% to 222% (median, 50%). All studies made adaptations between prescale to scaled-up interventions.

Conclusion

The effects of nutrition interventions implemented at scale typically were half that achieved in prior efficacy trials. Identifying effective scale-up strategies and methods to support retainment of the original prescale effect size is urgently needed to inform public health policy.

Systematic Review Registration

PROSPERO registration no.CRD42020149267.

Adoption of an Evidence-Based Intervention for Mammography Screening Adherence in Safety Net Clinics

Through an academic-community partnership, an evidence-based intervention to reduce mammography appointment no-show rates in underserved women was expanded to safety net clinics. The partnership implemented four strategies to improve the adoption and scale-up of evidence-based interventions with Federally Qualified Health Centers and charity care clinics: (1) an outreach email blast targeting the community partner member clinics to increase program awareness, (2) an adoption video encouraging enrollment in the program, (3) an outreach webinar educating the community partner member clinics about the program, encouraging enrollment and outlining adoption steps, and (4) an adoption survey adapted from Consolidated Framework for Implementation Research constructs from the Cancer Prevention and Control Research Network for cancer control interventions with Federally Qualified Health Centers. The development of academic-community partnerships can lead to successful adoption of evidence-based interventions particularly in safety net clinics.

Scaling Up Public Health Interventions: Engaging Partners Across Multiple Levels

Advancing the science of intervention scale-up is essential to increasing the impact of effective interventions at the regional and national levels. In contrast with work in high-income countries (HICs), where scale-up research has been limited, researchers in low- and middle-income countries (LMICs) have conducted numerous studies on the regional and national scale-up of interventions. In this article, we review the state of the science on intervention scale-up in both HICs and LMICs. We provide an introduction to the elements of scale-up followed by a description of the scale-up process, with an illustrative case study from our own research. We then present findings from a scoping review comparing scale-up studies in LMIC and HIC settings. We conclude with lessons learned and recommendations for improving scale-up research. Expected final online publication date for the Annual Review of Public Health, Volume 43 is April 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

PROMPT Wales project: national scaling of an evidence-based intervention to improve safety and training in maternity

BACKGROUND

In healthcare, there is increasing recognition of the importance of developing and testing strategies to scale effective interventions. The NHS long-term plan (2019) acknowledges that often a gold standard approach to a problem already exists somewhere within the NHS, however, it has not been replicated widely across the system.

METHODS

We describe the approach and process measures for national scaling of PROMPT (Practical Obstetric Multi-Professional Training) across 12 obstetric-led maternity units in Wales. PROMPT is an evidence-based training package for local maternity staff, previously associated with improvements in maternal and neonatal outcomes, reduction in litigation related to preventable harm and improved safety culture. PROMPT has previously been disseminated internationally using a train-the-trainer model. However, this has been associated with variations in uptake, fidelity and impact. In Wales, the project was supported by Welsh Government, and a structured scaling plan was developed, encompassing ongoing implementation support from a multi-professional team.

RESULTS

PROMPT was successfully implemented in all obstetric led units in Wales, with 326 local PROMPT facilitators trained, and 82.5%-100% of maternity staff attended a local PROMPT course in the first 15 months of the project (January 2019-March 2020). All training courses included evidence-based authentic elements, and 93% of courses in the first year (100/107) were supported by a national implementation team, providing coaching, implementation support and quality assurance.

CONCLUSIONS

Authentically scaling up complex interventions is a significant challenge. To replicate the improved outcomes demonstrated by PROMPT, intervention reach and fidelity must first be demonstrated.In this national scaling project, our scaling methodology led to the successful implementation of PROMPT across all health boards in Wales. Additionally, we demonstrated reduced variation in adoption, reach, timescale and intervention fidelity between maternity units with varying readiness for change, which had been difficult in two previous large-scale PROMPT implementation projects.

Evidence on scaling in health and social care: protocol for a living umbrella review

BACKGROUND

There is a growing interest in scaling effective health innovations to promote equitable access to high-quality health services worldwide. However, multiple challenges persist in scaling innovations. In this study, we aim to summarize the scaling evidence in the health and social care literature and identify current knowledge gaps.

METHODS

We will conduct a living umbrella review according to the Joanna Briggs Institute Reviewers' Manual. We will consider all knowledge syntheses addressing scaling in health or social care (e.g., any setting, any clinical area) and conducted in a systematic way. We will search the following electronic databases: MEDLINE (Ovid), Embase, PsychINFO (Ovid), CINAHL (EBSCO), Web of Science, The Cochrane Library, Sociological Abstract (Proquest), Academic Search Premier (EBSCO), and Proquest Dissertations & Theses Global, from inception. Furthermore, we will conduct searches of the grey literature. No restriction regarding date or language will be applied. Each phase of the review will be processed by two independent reviewers. We will develop a data extraction form on Covidence. We will assess the methodological quality of the included reviews using AMSTAR2 and the risk of bias using ROBIS. Results will be presented in tabular form and accompanied by a narrative synthesis covering the traditional themes of scaling science that emerge from the analysis, such as coverage, range, and sustainability, as well as themes less covered in the literature, including reporting guidance, models, tools, barriers, and/or facilitators to scaling innovations, evidence regarding application in high-income or low-income countries, and end-user engagement. We will disseminate the findings via publications and through relevant networks.

DISCUSSION

The findings of the umbrella review will facilitate access to scaling evidence in the literature and help strengthen the science of scaling for researchers, policy makers, and program managers. Finally, this work will highlight important knowledge gaps and help prioritize future research questions.

SYSTEMATIC REVIEW REGISTRATION

This protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on November 11, 2020 (registration number: CRD42020183774 ).

Economic evaluations of scaling up strategies of evidence-based health interventions: a systematic review protocol

INTRODUCTION

Scaling science aims to help roll out evidence-based research results on a wide scale to benefit more individuals. Yet, little is known on how to evaluate economic aspects of scaling up strategies of evidence-based health interventions.

METHODS AND ANALYSIS

Using the Joanna Briggs Institute guidance on systematic reviews, we will conduct a systematic review of characteristics and methods applied in economic evaluations in scaling up strategies. To be eligible for inclusion, studies must include a scaling up strategy of an evidence-based health intervention delivered and received by any individual or organisation in any country and setting. They must report costs and cost-effectiveness outcomes. We will consider full or partial economic evaluations, modelling and methodological studies. We searched peer-reviewed publications in Medline, Web of Science, Embase, Cochrane Library Database, PEDE, EconLIT, INHATA from their inception onwards. We will search grey literature from international organisations, bilateral agencies, non-governmental organisations, consultancy firms websites and region-specific databases. Two independent reviewers will screen the records against the eligibility criteria and extract data using a pretested extraction form. We will extract data on study characteristics, scaling up strategies, economic evaluation methods and their components. We will appraise the methodological quality of included studies using the BMJ Checklist. We will narratively summarise the studies' descriptive characteristics, methodological strengths/weaknesses and the main drivers of cost-effectiveness outcomes. This study will help identify what are the trade-offs of scaling up evidence-based interventions to allocate resources efficiently.

ETHICS AND DISSEMINATION

No ethics approval is required as no primary data will be collected. The results will be published in a peer-reviewed, international journal and presented at national and international conferences.

The Building Blocks of Implementation Frameworks and Models in Primary Care: A Narrative Review

Background: Our aim is to identify the core building blocks of existing implementation frameworks and models, which can be used as a basis to further develop a framework for the implementation of complex interventions within primary care practices. Within the field of implementation science, various frameworks, and models exist to support the uptake of research findings and evidence-based practices. However, these frameworks and models often are not sufficiently actionable or targeted for use by intervention designers. The objective of this research is to map the similarities and differences of various frameworks and models, in order to find key constructs that form the foundation of an implementation framework or model that is to be developed.

Methods: A narrative review was conducted, searching for papers that describe a framework or model for implementation by means of various search terms, and a snowball approach. The core phases, components, or other elements of each framework or model are extracted and listed. We analyze the similarities and differences between the frameworks and models and elaborate on their core building blocks. These core building blocks form the basis of an overarching model that we will develop based upon this review and put into practice.

Results: A total of 28 implementation frameworks and models are included in our analysis. Throughout 15 process models, a total of 67 phases, steps or requirements are extracted and throughout 17 determinant frameworks a total of 90 components, constructs, or elements are extracted and listed into an Excel file. They are bundled and categorized using NVivo 12© and synthesized into three core phases and three core components of an implementation process as common elements of most implementation frameworks or models. The core phases are a development phase, a translation phase, and a sustainment phase. The core components are the intended change, the context, and implementation strategies.

Discussion: We have identified the core building blocks of an implementation framework or model, which can be synthesized in three core phases and three core components. These will be the foundation for further research that aims to develop a new model that will guide and support intervention designers to develop and implement complex interventions, while taking account contextual factors.

Domains and Methods Used to Assess Home Telemonitoring Scalability: Systematic Review

BACKGROUND

The COVID-19 pandemic catalyzed the adoption of home telemonitoring to cope with social distancing challenges. Recent research on home telemonitoring demonstrated benefits concerning the capacity, patient empowerment, and treatment commitment of health care systems. Moreover, for some diseases, it revealed significant improvement in clinical outcomes. Nevertheless, when policy makers and practitioners decide whether to scale-up a technology-based health intervention from a research study to mainstream care delivery, it is essential to assess other relevant domains, such as its feasibility to be expanded under real-world conditions. Therefore, scalability assessment is critical, and it encompasses multiple domains to ensure population-wide access to the benefits of the growing technological potential for home telemonitoring services in health care.

OBJECTIVE

This systematic review aims to identify the domains and methods used in peer-reviewed research studies that assess the scalability of home telemonitoring-based interventions under real-world conditions.

METHODS

The authors followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines and used multiple databases (PubMed, Scopus, Web of Science, and EconLit). An integrative synthesis of the eligible studies was conducted to better explore each intervention and summarize relevant information concerning the target audience, intervention duration and setting, and type of technology. Each study design was classified based on the strength of its evidence. Lastly, the authors conducted narrative and thematic analyses to identify the domains, and qualitative and quantitative methods used to support scalability assessment.

RESULTS

This review evaluated 13 articles focusing on the potential of scaling up a home telemonitoring intervention. Most of the studies considered the following domains relevant for scalability assessment: problem (13), intervention (12), effectiveness (13), and costs and benefits (10). Although cost-effectiveness was the most common evaluation method, the authors identified seven additional cost analysis methods to evaluate the costs. Other domains were less considered, such as the sociopolitical context (2), workforce (4), and technological infrastructure (3). Researchers used different methodological approaches to assess the effectiveness, costs and benefits, fidelity, and acceptability.

CONCLUSIONS

This systematic review suggests that when assessing scalability, researchers select the domains specifically related to the intervention while ignoring others related to the contextual, technological, and environmental factors, which are also relevant. Additionally, studies report using different methods to evaluate the same domain, which makes comparison difficult. Future work should address research on the minimum required domains to assess the scalability of remote telemonitoring services and suggest methods that allow comparison among studies to provide better support to decision makers during large-scale implementation.

Modified scoping review of the enablers and barriers to implementing primary health care in the COVID-19 context

Since the Alma Ata Declaration of 1978, countries have varied in their progress towards establishing and sustaining comprehensive primary health care (PHC) and realizing its associated vision of 'Health for All'. International health emergencies such as the coronavirus-19 (COVID-19) pandemic underscore the importance of PHC in underpinning health equity, including via access to routine essential services and emergency responsiveness. This review synthesizes the current state of knowledge about PHC impacts, implementation enablers and barriers, and knowledge gaps across the three main PHC components as conceptualized in the 2018 Astana Framework. A scoping review design was adopted to summarize evidence from a diverse body of literature with a modification to accommodate four discrete phases of searching, screening and eligibility assessment: a database search in PubMed for PHC-related literature reviews and multi-country analyses (Phase 1); a website search for key global PHC synthesis reports (Phase 2); targeted searches for peer-reviewed literature relating to specific components of PHC (Phase 3) and searches for emerging insights relating to PHC in the COVID-19 context (Phase 4). Evidence from 96 included papers were analysed across deductive themes corresponding to the three main components of PHC. Findings affirm that investments in PHC improve equity and access, healthcare performance, accountability of health systems and health outcomes. Key enablers of PHC implementation include equity-informed financing models, health system and governance frameworks that differentiate multi-sectoral PHC from more discrete service-focussed primary care, and governance mechanisms that strengthen linkages between policymakers, civil society, non-governmental organizations, community-based organizations and private sector entities. Although knowledge about, and experience in, PHC implementation continues to grow, critical knowledge gaps are evident, particularly relating to country-level, context-specific governance, financing, workforce, accountability and service coordination mechanisms. An agenda to guide future country-specific PHC research is outlined.

Scaling up public health interventions: case study of the polio immunization program in Indonesia

BACKGROUND

The scaling up of public health interventions has received greater attention in recent years; however, there remains paucity of systematic investigations of the scaling up processes. We aim to investigate the overall process, actors and contexts of polio immunization scaling up in Indonesia from 1988 until 2018.

METHODS

A mixed method study with sequential explanatory design was conducted. We carried out a quantitative survey of 323 actors involved in the polio program at national and sub-national levels, followed by Key Informant Interviews (KII)s. Document review was also carried out to construct a timeline of the polio eradication program with milestones. We carried out descriptive statistical analysis of quantitative data and thematic analysis of qualitative data.

RESULTS

The scaling up of polio immunization in Indonesia started as a vertical expansion approach led by the Ministry of Health within a centralized health system. The coverage of immunization increased dramatically from 5% in the earlier 80s to 67.5% in 1987; incremental increases followed until achieving Universal Child Immunization (UCI) in 1990 and subsequently 95% coverage in 1995. Engagement of stakeholders and funding made the scaling up of polio immunization a priority. There was also substantial multisector involvement, including institutions and communities. Local area monitoring (LAM) and integrated health posts (Posyandu) were key to the polio immunization implementation strategy. Challenges for scaling up during this centralized period included cold chain infrastructure and limited experience in carrying out mass campaigns. Scaling up during the decentralized era was slower due to expansion in the number of provinces and districts. Moreover, there were challenges such as the negative perception of immunization side-effects, staff turnover, and the unsmooth transition of centralization towards decentralization.

CONCLUSION

Vertical scaling up of polio immunization program intervention was successful during the centralized era, with involvement of the president as a role model and the engine of multi sector actors. Posyandu (integrated health posts) played an important role, yet its revitalization after the reform-decentralization era has not been optimum.

Strategies for involving patients and the public in scaling-up initiatives in health and social services: protocol for a scoping review and Delphi survey

BACKGROUND

The scale-up of evidence-based innovations is required to reduce waste and inequities in health and social services (HSS). However, it often tends to be a top-down process initiated by policy makers, and the values of the intended beneficiaries are forgotten. Involving multiple stakeholders including patients and the public in the scaling-up process is thus essential but highly complex. We propose to identify relevant strategies for meaningfully and equitably involving patients and the public in the science and practice of scaling up in HSS.

METHODS

We will adapt our overall method from the RAND/UCLA Appropriateness Method. Following this, we will perform a two-prong study design (knowledge synthesis and Delphi study) grounded in an integrated knowledge translation approach. This approach involves extensive participation of a network of stakeholders interested in patient and public involvement (PPI) in scaling up and a multidisciplinary steering committee. We will conduct a systematic scoping review following the methodology recommended in the Joanna Briggs Institute Reviewers Manual. We will use the following eligibility criteria: (1) participants-any stakeholder involved in creating or testing a strategy for PPI; (2) intervention-any PPI strategy proposed for scaling-up initiatives; (3) comparator-no restriction; (4) outcomes: any process or outcome metrics related to PPI; and (5) setting-HSS. We will search electronic databases (e.g., Medline, Web of Science, Sociological Abstract) from inception onwards, hand search relevant websites, screen the reference lists of included records, and consult experts in the field. Two reviewers will independently select and extract eligible studies. We will summarize data quantitatively and qualitatively and report results using the PRISMA extension for Scoping Reviews (PRISMA-ScR) checklist. We will conduct an online Delphi survey to achieve consensus on the relevant strategies for PPI in scaling-up initiatives in HSS. Participants will include stakeholders from low-, middle-, and high-income countries. We anticipate that three rounds will allow an acceptable degree of agreement on research priorities.

DISCUSSION

Our findings will advance understanding of how to meaningfully and equitably involve patients and the public in scaling-up initiatives for sustainable HSS.

SYSTEMATIC REVIEW REGISTRATION

We registered this protocol with the Open Science Framework on August 19, 2020 ( https://osf.io/zqpx7/ ).

Spread, Scale-up, and Sustainability of Video Consulting in Health Care: Systematic Review and Synthesis Guided by the NASSS Framework

BACKGROUND

COVID-19 has thrust video consulting into the limelight, as health care practitioners worldwide shift to delivering care remotely. Evidence suggests that video consulting is acceptable, safe, and effective in selected conditions and settings. However, research to date has mostly focused on initial adoption, with limited consideration of how video consulting can be mainstreamed and sustained.

OBJECTIVE

This study sought to do the following: (1) review and synthesize reported opportunities, challenges, and lessons learned in the scale-up, spread, and sustainability of video consultations, and (2) identify transferable insights that can inform policy and practice.

METHODS

We identified papers through systematic searches in PubMed, CINAHL, and Web of Science. Included articles reported on synchronous, video-based consultations that had spread to more than one setting beyond an initial pilot or feasibility stage, and were published since 2010. We used the Nonadoption, Abandonment, and challenges to the Scale-up, Spread, and Sustainability (NASSS) framework to synthesize findings relating to 7 domains: an understanding of the health condition(s) for which video consultations were being used, the material properties of the technological platform and relevant peripherals, the value proposition for patients and developers, the role of the adopter system, organizational factors, wider macro-level considerations, and emergence over time.

RESULTS

We identified 13 papers describing 10 different video consultation services in 6 regions, covering the following: (1) video-to-home services, connecting providers directly to the patient; (2) hub-and-spoke models, connecting a provider at a central hub to a patient at a rural center; and (3) large-scale top-down evaluations scaled up or spread across a national health administration. Services covered rehabilitation, geriatrics, cancer surgery, diabetes, and mental health, as well as general specialist care and primary care. Potential enablers of spread and scale-up included embedded leadership and the presence of a telehealth champion, appropriate reimbursement mechanisms, user-friendly technology, pre-existing staff relationships, and adaptation (of technology and services) over time. Challenges tended to be related to service development, such as the absence of a long-term strategic plan, resistance to change, cost and reimbursement issues, and the technical experience of staff. There was limited articulation of the challenges to scale-up and spread of video consultations. This was combined with a lack of theorization, with papers tending to view spread and scale-up as the sum of multiple technical implementations, rather than theorizing the distinct processes required to achieve widespread adoption.

CONCLUSIONS

There remains a significant lack of evidence that can support the spread and scale-up of video consulting. Given the recent pace of change due to COVID-19, a more definitive evidence base is urgently needed to support global efforts and match enthusiasm for extending use.

How effective are physical activity interventions when they are scaled-up: a systematic review

Background

The ‘scale-up’ of effective physical activity interventions is required if they are to yield improvements in population health. The purpose of this study was to systematically review the effectiveness of community-based physical activity interventions that have been scaled-up. We also sought to explore differences in the effect size of these interventions compared with prior evaluations of their efficacy in more controlled contexts, and describe adaptations that were made to interventions as part of the scale-up process.

Methods

We performed a search of empirical research using six electronic databases, hand searched reference lists and contacted field experts. An intervention was considered ‘scaled-up’ if it had been intentionally delivered on a larger scale (to a greater number of participants, new populations, and/or by means of different delivery systems) than a preceding randomised control trial (‘pre-scale’) in which a significant intervention effect (p < 0.05) was reported on any measure of physical activity. Effect size differences between pre-scale and scaled up interventions were quantified ([the effect size reported in the scaled-up study / the effect size reported in the pre-scale-up efficacy trial] × 100) to explore any scale-up ‘penalties’ in intervention effects.

Results

We identified 10 eligible studies. Six scaled-up interventions appeared to achieve significant improvement on at least one measure of physical activity. Six studies included measures of physical activity that were common between pre-scale and scaled-up trials enabling the calculation of an effect size difference (and potential scale-up penalty). Differences in effect size ranged from 132 to 25% (median = 58.8%), suggesting that most scaled-up interventions typically achieve less than 60% of their pre-scale effect size. A variety of adaptations were made for scale-up – the most common being mode of delivery.

Conclusion

The majority of interventions remained effective when delivered at-scale however their effects were markedly lower than reported in pre-scale trials. Adaptations of interventions were common and may have impacted on the effectiveness of interventions delivered at scale. These outcomes provide valuable insight for researchers and public health practitioners interested in the design and scale-up of physical activity interventions, and contribute to the growing evidence base for delivering health promotion interventions at-scale.

Trial registration

PROSPERO CRD42020144842.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-021-01080-4.

Scaling up Business Plans in Tajikistan: a qualitative study of the history, barriers, facilitators and lessons learnt

BACKGROUND

To improve health planning at primary health care (PHC) level, Business Plans were introduced in Tajikistan by the Enhancing Primary Health Care (EPHC) Services Project.

OBJECTIVE

To describe the history and process of implementation of Business Plans and to identify barriers, facilitators and lessons learnt from scaling up Business Plans.

METHODS

Set in a qualitative research design, we conducted a desk review of project and official documents and seventeen semi-structured interviews with key stakeholders at national and sub-national levels between May and July 2020. We used an interview guide informed by the ExpandNet/WHO framework and analyzed the data following a content analysis approach facilitated by MAXQDA.

RESULTS

With the participation of various user organizations and resource teams and through a variety of strategic scale-up choices, Business Plans have been scaled up from a vertical pilot project to institutionalized health management tools covering 45% of Tajikistan's PHC facilities. The most prominent facilitators for scaling up Business Plans were the institutionalization and integration of the tool into the Tajik health system, the close collaboration with Community Health Teams (CHTs), the high acceptance of the tool among the users, the advocacy through champions and policy-makers and the large dissemination network. The most outstanding barriers to scaling up Business Plans were insufficient financial or human resources, general weaknesses in health governance, the lack of a strategic scale-up plan and strategic decisions, the lack of motivation or overall vision to implement Business Plans at a large scale and difficulties in donor coordination.

CONCLUSION

To ensure the continuity of scaling up Business Plans, developing a scale-up strategy, strengthening cross-sectoral collaboration and participation during scaling up, and capacitating the user organizations of Business Plans are important next steps to ensure the sustainability and effectiveness of Business Plans in the future.

Using Health Systems Engineering Approaches to Prepare for Tailoring of Implementation Interventions

BACKGROUND

Implementation of evidence-based practices often requires tailoring implementation strategies to local contextual factors, including available resources, expertise, and cultural norms. Using an exemplar case, we describe how health systems engineering methods can be used to understand system-level variation that must be accounted for prior to broad implementation.

METHODS

Within the context of a single-center quality improvement activity, a multi-disciplinary stakeholder team used health systems engineering methods to describe how pre-endoscopy antithrombotic management was executed, and implemented a redesigned process to improve clinical care. The research team then conducted multiple stakeholder focus groups at four different health-care systems to describe and compare current processes for pre-endoscopy antithrombotic medication management. Detailed work flow maps for each health-care system were developed, analyzed, and integrated to develop an overarching current work flow map, identify key process steps, and describe areas of process variation.

RESULTS

Five key process steps were identified across the four health systems: (1) place an endoscopy order, (2) screen for antithrombotic use, (3) coordinate medication management, (4) instruct the patient, and (5) confirm appropriate medication management before procedure. Across health systems, we found a high degree of variation in each step (e.g., who performed, use of technology, systematic vs. ad hoc process). This variation was influenced by two key system-level contextual factors: (1) degree of health system integration and (2) role and training level of available staff. These key steps, areas of variation, and contextual factors were integrated into an assessment tool designed to facilitate tailoring of a future implementation and dissemination strategy.

CONCLUSIONS

Tools from health systems engineering can be used to identify key work flow process steps, variations in how those steps are executed, and influential contextual factors. This process and the associated assessment tool may facilitate broader implementation tailoring.

Seeking consent for organ donation: Process evaluation of implementing a new Specialist Requester nursing role

AIM

To explain the differences in organ donation consent outcomes of a new nursing role (Specialist Requesters) derived from the United States (US) compared with the existing nursing role (Specialist Nurses in Organ Donation).

DESIGN

Thirty-month observational qualitative process evaluation: Implementation theory-informed analysis.

METHODS

Qualitative content analysis of free text describing challenges, processes and practice from 996 bespoke routinely collected potential organ donor 'approach forms' from two regions: one where there was no difference, and one with an observed difference in consent outcomes.

RESULTS

Region A consent rate: Specialist Requester 75.8%, Specialist Nurse in Organ Donation71.8%. Region B consent rate: Specialist Requester 71.4%, Specialist Nurse in Organ Donation 82%. Region A Specialist Requesters turned the family position from no or uncertain to support organ donation in 73% of cases, compared with 27.4% in Region B. Two Specialist Requesters in Region A were highly effective. Region B experienced problems with intervention fidelity and implementation.

CONCLUSIONS

The benefits of the Specialist Requester role remain unclear. Positive differences in consent rates achieved by Specialist Requesters in the originator region reduced over time and have yet to be successfully replicated in other regions.

IMPACT

The impact of Specialist Requesters on consent outcomes varied across regions and it was not known why. Specialist Requesters in Region A were better at getting family member(s) to support organ donation. In Region B, Specialist Nurse in Organ Donation consent rates were higher and problems with intervention fidelity were identified (recruitment, staffing, less experience). Policy makers need to understand it is not just a matter of waiting for the Specialist Requester intervention to work. Ongoing training and recruiting the right people with the right skills need to be addressed and consistently reviewed.

Development and validation of the NCGG-FAT Chinese version for community-dwelling older Taiwanese

AIM

To evaluate the reliability and validity of the National Center for Geriatrics and Gerontology functional assessment tool (NCGG-FAT) Chinese version among community-dwelling older Taiwanese.

METHOD

In total, 40 community-living older adults aged ≥65 years with intact global cognitive function (Mini-Mental State Examination ≥24) were enrolled and received a neuropsychological assessment twice using the computerized NCGG-FAT Chinese version, with an interval of 30 days to examine test-retest reliability. Conventional neurocognitive assessments were performed for all study participants within a week after the first administration of the NCGG-FAT Chinese version to determine validity. Intraclass correlation coefficients (ICC) were employed to assess test-retest reliability, and the Pearson correlation coefficient evaluated the validity.

RESULTS

In total, 40 participants aged 69.8 ± 3.9 years with a mean education of 11.1 ± 4.2 years and MMSE of 28.5 ± 1.8 were enrolled. The Pearson correlation coefficient showed moderate-to-high validity between the conventional neurocognitive assessments and the NCGG-FAT Chinese version components (r = 0.509-0.606, P < 0.01 for all components). High reliability was also identified in the word recognition (immediate) score (ICC = 0.833, P < 0.001), Trail Making Tests part B (ICC = 0.709, P < 0.001) and Symbol Digit Substitution Task score (ICC = 0.850, P < 0.001), whereas word recall (delayed) score and Trail Making Tests part A showed moderate test-retest reliability.

CONCLUSIONS

The NCGG-FAT Chinese version is a valid and reliable instrument to assess multiple dimensions of neurocognitive function of community-living Taiwanese, which may facilitate better community-based screening and intervention programs, particularly for international comparisons. Geriatr Gerontol Int 2020; 20: 1171-1176.

Scaling up population health interventions from decision to sustainability - a window of opportunity? A qualitative view from policy-makers

Background

While known efficacious preventive health interventions exist, the current capacity to scale up these interventions is limited. In recent years, much attention has focussed on developing frameworks and methods for scale-up yet, in practice, the pathway for scale-up is seldom linear and may be highly dependent on contextual circumstances. Few studies have examined the process of scaling up from decision to implementation nor examined the sustainability of scaled-up interventions. This study explores decision-makers’ perceptions from real-world scaled-up case studies to examine how scale-up decisions were made and describe enablers of successful scale-up and sustainability.

Methods

This qualitative study included 29 interviews conducted with purposively sampled key Australian policy-makers, practitioners and researchers experienced in scale-up. Semi-structured interview questions obtained information regarding case studies of scaled-up interventions. The Framework Analysis method was used as the primary method of analysis of the interview data to inductively generate common and divergent themes within qualitative data across cases.

Results

A total of 31 case studies of public health interventions were described by interview respondents based on their experiences. According to the interviewees’ perceptions, decisions to scale up commonly occurred either opportunistically, when funding became available, or when a deliberate decision was made and funding allocated. The latter scenario was more common when the intervention aligned with specific political or strategic goals. Decisions to scale up were driven by a variety of key actors such as politicians, senior policy-makers and practitioners in the health system. Drivers of a successful scale-up process included good governance, clear leadership, and adequate resourcing and expertise. Establishing accountability structures and appropriate engagement mechanisms to encourage the uptake of interventions were also key enablers. Sustainability was influenced by evidence of impact as well as good acceptability among the general or target population.

Conclusions

Much like Kingdon’s Multiple Streams Theory of ‘policy windows’, there is a conceptually similar ‘window for scale-up’, driven by a complex interplay of factors such as political need, strategic context, funding and key actors. Researchers and policy-makers need to consider scalability from the outset and prepare for when the window for scale-up opens. Decision-makers need to provide longer term funding for scale-up to facilitate longer term sustainability and build on the resources already invested for the scale-up process.

Readiness and Implementation of Quality Improvement Strategies Among Small- and Medium-Sized Primary Care Practices: an Observational Study

BACKGROUND

Little is known about what determines strategy implementation around quality improvement (QI) in small- and medium-sized practices. Key questions are whether QI strategies are associated with practice readiness and practice characteristics.

OBJECTIVE

Grounded in organizational readiness theory, we examined how readiness and practice characteristics affect QI strategy implementation. The study was a component of a larger practice-level intervention, Heart of Virginia Healthcare, which sought to transform primary care while improving cardiovascular care.

DESIGN

This observational study analyzed practice correlates of QI strategy implementation in primary care at 3 and 12 months. Data were derived from surveys completed by clinicians and staff and from assessments by practice coaches.

PARTICIPANTS

A total of 175 small- and medium-sized primary care practices were included.

MAIN MEASURES

Outcome was QI strategy implementation in three domains: (1) aspirin, blood pressure, cholesterol, and smoking cessation (ABCS); (2) care coordination; and (3) organizational-level improvement. Coaches assessed implementation at 3 and 12 months. Readiness was measured by baseline member surveys, 1831 responses from 175 practices, a response rate of 73%. Practice survey assessed practice characteristics, a response rate of 93%. We used multivariate regression.

KEY RESULTS

QI strategy implementation increased from 3 to 12 months: the mean for ABCS from 1.20 to 1.59, care coordination from 2.15 to 2.75, organizational improvement from 1.37 to 1.78 (95% CI). There was no statistically significant association between readiness and QI strategy implementation across domains. Independent practice implementation was statistically significantly higher than hospital-owned practices at 3 months for ABCS (95% CI, P = 0.01) and care coordination (95% CI, P = 0.03), and at 12 months for care coordination (95% CI, P = 0.04).

CONCLUSION

QI strategy implementation varies by practice ownership. Independent practices focus on patient care-related activities. FQHCs may need additional time to adopt and implement QI activities. Practice readiness may require more structural and organizational changes before starting a QI effort.