Evidence on Scaling in Health and Social Care: An Umbrella Review

V. Mochcovitch D, Abdoulaye Samri M, Akpo TG, Gogovor A, Blanchette V, Gomes Souza L, Kastner K, M. Achim A, McLean RKD, Milat A, Légaré F. Strategies for involving patients and the public in scaling initiatives in health and social services: A scoping review

BACKGROUND

Scaling in health and social services (HSS) aims to increase the intended impact of proven effective interventions. Patient and public involvement (PPI) is critical for ensuring that scaling beneficiaries' interests are served. We aimed to identify PPI strategies and their characteristics in the science and practice of scaling in HSS.

METHODS

In this scoping review, we included any scaling initiative in HSS that used PPI strategies and reported PPI methods and outcomes. We searched electronic databases (e.g., Medline) from inception to 5 February 2024, and grey literature (e.g., Google). Paired reviewers independently selected and extracted eligible reports. A narrative synthesis was performed and we used the PRISMA for Scoping Reviews and the Guidance for Reporting Involvement of Patients and the Public (GRIPP2).

FINDINGS

We included 110 unique reports out of 24,579 records. In the past 5 years, the evidence on PPI in scaling has increased faster than in any previous period. We found 236 mutually nonexclusive PPI strategies among 120 scaling initiatives. Twenty-four initiatives did not target a specific country; but most of those that did so (n = 96) occurred in higher-income countries (n = 51). Community-based primary health care was the most frequent level of care (n = 103). Mostly, patients and the public were involved throughout all scaling phases (n = 46) and throughout the continuum of collaboration (n = 45); the most frequently reported ethical lens regarding the rationale for PPI was consequentialist-utilitarian (n = 96). Few papers reported PPI recruitment processes (n = 31) or incentives used (n = 18). PPI strategies occurred mostly in direct care (n = 88). Patient and public education was the PPI strategy most reported (n = 31), followed by population consultations (n = 30).

CONCLUSIONS

PPI in scaling is increasing in HSS. Further investigation is needed to better document the PPI experience in scaling and ensure that it occurs in a meaningful and equitable way.

PATIENT AND PUBLIC CONTRIBUTION

Two patients were involved in this review. They shared decisions on review questions, data collection instruments, protocol design, and findings dissemination.

REVIEW REGISTRATION

Open Science Framework on 19 August 2020 (https://osf.io/zqpx7/).

Informing the development of the SUCCEED reporting guideline for studies on the scaling of health interventions: A systematic review

BACKGROUND

Quality reporting contributes to effective translation of health research in practice and policy. As an initial step in the development of a reporting guideline for scaling, the Standards for reporting stUdies of sCaling evidenCEd-informED interventions (SUCCEED), we performed a systematic review to identify relevant guidelines and compile a list of potential items.

METHODS

We conducted a systematic review according to Cochrane method guidelines. We searched the following databases: MEDLINE, Embase, PsycINFO, Cochrane Library, CINAHL, Web of Science, from their respective inceptions. We also searched websites of relevant organizations and Google. We included any document that provided instructions or recommendations, e.g., reporting guideline, checklist, guidance, framework, standard; could inform the design or reporting of scaling interventions; and related to the health sector. We extracted characteristics of the included guidelines and assessed their methodological quality using a 3-item internal validity assessment tool. We extracted all items from the guidelines and classified them according to the main sections of reporting guidelines (title, abstract, introduction, methods, results, discussion and other information). We performed a narrative synthesis based on descriptive statistics.

RESULTS

Of 7704 records screened (published between 1999 and 2019), we included 39 guidelines, from which data were extracted from 57 reports. Of the 39 guidelines, 17 were for designing scaling interventions and 22 for reporting implementation interventions. At least one female author was listed in 31 guidelines, and 21 first authors were female. None of the authors belonged to the patient stakeholder group. Only one guideline clearly identified a patient as having participated in the consensus process. More than half the guidelines (56%) had been developed using an evidence-based process. In total, 750 items were extracted from the 39 guidelines and distributed into the 7 main sections.

CONCLUSION

Relevant items identified could inform the development of a reporting guideline for scaling studies of evidence-based health interventions. This and our assessment of guidelines could contribute to better reporting in the science and practice of scaling.

The Impact of Advance Care Planning on Healthcare Professionals' Well-being: A Systematic Review

CONTEXT

Advance care planning (ACP) improves care for patients with chronic illnesses and reduces family stress. However, the impact of ACP interventions on healthcare professionals' well-being remains unknown.

OBJECTIVE

To systematically review the literature evaluating the impact of ACP interventions on healthcare professionals' well-being.

METHODS

We followed the Joanna Briggs Institute methodology for systematic reviews and registered the protocol in PROSPERO (CRD42022346354). We included primary studies in all languages that assessed the well-being of healthcare professionals in ACP interventions. We excluded any studies on ACP in psychiatric care and in palliative care that did not address goals of care. Searches were conducted on April 4, 2022, and March 6, 2023 in Embase, CINAHL, Web of Science, and PubMed. We used the Mixed Methods Appraisal Tool for quality analysis. We present results as a narrative synthesis because of their heterogeneity.

RESULTS

We included 21 articles published in English between 1997 and 2021 with 17 published after 2019. All were conducted in high-income countries, and they involved a total of 1278 participants. Three reported an interprofessional intervention and two included patient partners. Studies had significant methodological flaws but most reported that ACP had a possible positive impact on healthcare professionals' well-being.

CONCLUSION

This review is the first to explore the impact of ACP interventions on healthcare professionals' well-being. ACP interventions appear to have a positive impact, but high-quality studies are scarce. Further research is needed, particularly using more rigorous and systematic methods to implement interventions and report results.

Methods for scaling up an outreach intervention to increase colorectal cancer screening rates in rural areas

BACKGROUND

Mailed fecal immunochemical test (FIT) outreach and patient navigation are evidence-based practices shown to improve rates of colorectal cancer (CRC) and follow-up in various settings, yet these programs have not been broadly adopted by health systems and organizations that serve diverse populations. Reasons for low adoption rates are multifactorial, and little research explores approaches for scaling up a complex, multi-level CRC screening outreach intervention to advance equity in rural settings.

METHODS

SMARTER CRC, a National Cancer Institute Cancer Moonshot project, is a cluster-randomized controlled trial of a mailed FIT and patient navigation program involving 3 Medicaid health plans and 28 rural primary care practices in Oregon and Idaho followed by a national scale-up trial. The SMARTER CRC intervention combines mailed FIT outreach supported by clinics, health plans, and vendors and patient navigation for colonoscopy following an abnormal FIT result. We applied the framework from Perez and colleagues to identify the intervention's components (including functions and forms) and scale-up dissemination strategies and worked with a national advisory board to support scale-up to additional organizations. The team is recruiting health plans, primary care clinics, and regional and national organizations in the USA that serve a rural population. To teach organizations about the intervention, activities include Extension for Community Healthcare Outcomes (ECHO) tele-mentoring learning collaboratives, a facilitation guide and other materials, a patient navigation workshop, webinars, and individualized technical assistance. Our primary outcome is program adoption (by component), measured 6 months after participation in an ECHO learning collaborative. We also assess engagement and adaptations (implemented and desired) to learn how the multicomponent intervention might be modified to best support broad scale-up.

DISCUSSION

Findings may inform approaches for adapting and scaling evidence-based approaches to promote CRC screening participation in underserved populations and settings.

TRIAL REGISTRATION

Registered at ClinicalTrials.gov (NCT04890054) and at the NCI's Clinical Trials Reporting Program (CTRP no.: NCI-2021-01032) on May 11, 2021.

Spontaneous Scaling of a Primary Care Innovation in Real-Life Conditions: Protocol for a Case Study

BACKGROUND

Scaling effective primary care innovations to benefit more people is of interest to decision makers. However, we know little about how promising innovations are being scaled "spontaneously," that is, without deliberate guidance.

OBJECTIVE

We aim to observe, document, and analyze how, in real-life conditions, 1 primary care innovation spontaneously scales up across Quebec, Canada.

METHODS

We will conduct a participative study using a descriptive single-case study. It will be guided by the McLean and Gargani principles for scaling and reported according to the COREQ (Consolidated Criteria for Reporting Qualitative Research) guidelines. Informed by an integrated knowledge translation approach, our steering committee will include patient users throughout the project. Inspired by the Quebec College of Family Physician's "Dragons' Den" primary care program, we will identify a promising primary care innovation that is being or will be scaled spontaneously. We will interview the innovation team about their scaling experiences every month for 1 year. We will conduct interviews and focus groups with decision makers, health care providers, and end users in the innovation team and the target site about their experience of both scaling and receiving the scaled innovation and document meetings as nonparticipant observers. Interview transcripts and documentary data will be analyzed to (1) compare the spontaneous scaling plan and implementation with the McLean and Gargani principles for scaling and (2) determine how it was consistent with or diverged from the 4 McLean and Gargani guiding principles: justification, optimal scale, coordination, and dynamic evaluation.

RESULTS

This study was funded in March 2020 by the Canadian Institutes of Health Research. Recruitment began in November 2023 and data collection began in December 2023. Results are expected to be published in the first quarter of 2024.

CONCLUSIONS

Our study will advance the science of scaling by providing practical evidence-based material about scaling health and social care innovations in real-world settings using the 4 guiding principles of McLean and Gargani.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/54855.

Essential content for teaching implementation practice in healthcare: a mixed-methods study of teams offering capacity-building initiatives

BACKGROUND

Applying the knowledge gained through implementation science can support the uptake of research evidence into practice; however, those doing and supporting implementation (implementation practitioners) may face barriers to applying implementation science in their work. One strategy to enhance individuals' and teams' ability to apply implementation science in practice is through training and professional development opportunities (capacity-building initiatives). Although there is an increasing demand for and offerings of implementation practice capacity-building initiatives, there is no universal agreement on what content should be included. In this study we aimed to explore what capacity-building developers and deliverers identify as essential training content for teaching implementation practice.

METHODS

We conducted a convergent mixed-methods study with participants who had developed and/or delivered a capacity-building initiative focused on teaching implementation practice. Participants completed an online questionnaire to provide details on their capacity-building initiatives; took part in an interview or focus group to explore their questionnaire responses in depth; and offered course materials for review. We analyzed a subset of data that focused on the capacity-building initiatives' content and curriculum. We used descriptive statistics for quantitative data and conventional content analysis for qualitative data, with the data sets merged during the analytic phase. We presented frequency counts for each category to highlight commonalities and differences across capacity-building initiatives.

RESULTS

Thirty-three individuals representing 20 capacity-building initiatives participated. Study participants identified several core content areas included in their capacity-building initiatives: (1) taking a process approach to implementation; (2) identifying and applying implementation theories, models, frameworks, and approaches; (3) learning implementation steps and skills; (4) developing relational skills. In addition, study participants described offering applied and pragmatic content (e.g., tools and resources), and tailoring and evolving the capacity-building initiative content to address emerging trends in implementation science. Study participants highlighted some challenges learners face when acquiring and applying implementation practice knowledge and skills.

CONCLUSIONS

This study synthesized what experienced capacity-building initiative developers and deliverers identify as essential content for teaching implementation practice. These findings can inform the development, refinement, and delivery of capacity-building initiatives, as well as future research directions, to enhance the translation of implementation science into practice.

Scaling-Up eConsult: Promising Strategies to Address Enabling Factors in Four Jurisdictions in Canada

BACKGROUND

Effective healthcare innovations are often not scaled up beyond their initial local context. Lack of practical knowledge on how to move from local innovations to large-system improvement hinders innovation and learning capacity in health systems. Studying scale-up processes can lead to a better understanding of how to facilitate the scale-up of interventions. eConsult is a digital health innovation that aims to connect primary care professionals with specialists through an asynchronous electronic consultation. The recent implementation of eConsult in the public health systems of four Canadian jurisdictions provides a unique opportunity to identify different enabling strategies and related factors that promote the scaling up of eConsult across jurisdictions.

METHODS

We conducted a narrative case study in four Canadian provinces, Quebec, Ontario, Manitoba, and Newfoundland & Labrador, over a 3-year period (2018-2021). We observed provincial eConsult committee meetings (n=65) and national eConsult forums (n=3), and we reviewed internal documents (n=93). We conducted semi-structured interviews with key actors in each jurisdiction (eg, researchers, primary care professionals, specialists, policy-makers, and patient partners) (n=40). We conducted thematic analysis guided by the literature on factors and strategies used to scale up innovations.

RESULTS

We identified a total of 31 strategies related to six key enabling factors to scaling up eConsult, including: (1) multi-actor engagement; (2) relative advantage; (3) knowledge transfer; (4) strong evidence base; (5) physician leadership; and (6) resource acquisition (eg, human, material, and financial resources). More commonly used strategies, such as leveraging research infrastructure and bringing together various actors, were used to address multiple enabling factors.

CONCLUSION

Actors used various strategies to scale up eConsult within their respective contexts, and these helped address six key factors that seemed to be essential to the scale-up of eConsult.