T-CaST: an implementation theory comparison and selection tool

A Guide to Implementation Science for Phase 3 Clinical Trialists: Designing Trials for Evidence Uptake

The delayed and modest uptake of evidence-based treatments following cardiovascular clinical trials highlights the need for greater attention to implementation early in the development and testing of treatments. However, implementation science is not well understood and is often an afterthought following phase 3 trials. In this review, we describe the goals, frameworks, and methods of implementation science, along with common multilevel barriers and facilitators of implementation. We propose that some of the approaches used for implementation well after a trial has ended can be incorporated into the design of phase 3 trials to foster early post-trial implementation. Approaches include, but are not limited to, engaging broad stakeholders including patients, clinicians, and decision-makers in trial advisory boards; using less restrictive eligibility criteria that ensure both internal validity and generalizability; having trial protocols reviewed by regulators; integrating trial execution with the health care system; evaluating and addressing barriers and facilitators to deployment of the intervention; and undertaking cost-effectiveness and cost utility analyses across jurisdictions. We provide case examples to highlight concepts and to guide end-of-trial implementation.

Process mapping with failure mode and effects analysis to identify determinants of implementation in healthcare settings: a guide

BACKGROUND

Generating and analyzing process maps can help identify and prioritize barriers to the implementation of evidence-based practices in healthcare settings. Guidance on how to systematically apply and report these methods in implementation research is scant. We describe a method combining a qualitative approach to developing process maps with a quantitative evaluation of maps drawn from the quality improvement literature called failure mode and effects analysis (FMEA).

METHODS

We provide an outline and guidance for how investigators can use process mapping with FMEA to identify and prioritize barriers when implementing evidence-based clinical interventions. Suggestions for methods and reporting were generated based on established procedures for process mapping with FMEA and through review of original research papers which apply both methods in healthcare settings. We provide case examples to illustrate how this approach can be operationalized in implementation research.

RESULTS

The methodology of process mapping with FMEA can be divided into four broad phases: 1) formulating a plan, 2) generating process maps to identify and organize barriers over time, 3) prioritizing barriers through FMEA, and 4) devising an implementation strategy to address priority barriers. We identified 14 steps across the four phases. Two illustrative examples are provided. Case 1 describes the implementation of referrals to chiropractic care for adults with low back pain in primary care clinics. Case 2 describes the implementation of a family navigation intervention for children with autism spectrum disorder seeking care in pediatric clinics. For provisional guidance for reporting, we propose the REporting Process mapping and Analysis for Implementation Research (REPAIR) checklist.

CONCLUSIONS

Process mapping with FMEA can elucidate barriers and facilitators to successful implementation of evidence-based clinical interventions. This paper provides initial guidance for more systematic applications of this methodology in implementation research. Future research should use a consensus-building approach, such as a multidisciplinary Delphi panel, to further delineate the reporting standards for studies that use process mapping with FMEA.

Implementation Strategies for Quality Improvement in Palliative Care: A Scoping Review

BACKGROUND

Quality improvement (QI) programs based on person-centred outcome measures (PCOMs) play an important role in promoting optimal palliative care. However, routine use of PCOMs has been slow and difficult to implement, including within QI programs.

OBJECTIVE

This study aimed to identify implementation strategies that support the implementation of PCOMs as routine practice in hospital-based palliative care, as well as the implementation theories, models and frameworks (TMFs) guiding the design of these implementation strategies.

METHODS

A scoping review was conducted in accordance with the Joanna Briggs Institute (JBI) Scoping Review framework. Four databases (Medline, CINAHL, Scopus and PubMed) were systematically searched for literature published between 1 January 1990 and 8 March 2024.

RESULTS

One hundred and fifteen unique implementation strategies, identified from 11 included studies, were mapped onto the 73 Expert Recommendations for Implementing Change (ERIC) discrete implementation strategies, covering 52% of the ERIC strategies. The most commonly used categories were train and educate stakeholders, and support clinicians, followed by develop stakeholder interrelationships and use evaluation and iterative strategies. Three key themes emerged: what to do; how to do it; and who to do it with. Only four studies employed TMFs to guide the design of the implementation strategies in this review.

CONCLUSIONS

To promote the implementation of PCOM-based QI programs, strategies should be developed based on identified/potential barriers and facilitators by using rigorous TMFs. The components of the implementation strategies must be reported transparently and consistently to enable replication and measurement in future research and practice.

PATIENT AND PUBLIC CONTRIBUTION

This scoping review does not directly involve patients or the general public in its design or execution. However, it is part of an implementation study aimed at integrating the Palliative Care Outcome Collaboration (PCOC) model into routine clinical practice at a cancer hospital in China. Before the formal implementation, palliative care professionals from this hospital highlighted the need for a comprehensive analysis of existing evidence to support the effective adoption of the PCOC model in their specific clinical setting.

Development and usability testing of an online support tool to identify models and frameworks to inform implementation

BACKGROUND

Theories, models and frameworks (TMFs) are useful when implementing, evaluating and sustaining healthcare evidence-based interventions. Yet it can be challenging to identify an appropriate TMF for an implementation project. We developed and tested the usability of an online tool to help individuals who are doing or supporting implementation practice activities to identify appropriate models and/or frameworks to inform their work.

METHODS

We used methods guided by models and evidence on implementation science and user-centered design. Phases of tool development included applying findings from a scoping review of TMFs and interviews with 24 researchers/implementers on barriers and facilitators to identifying and selecting TMFs. Based on interview findings, we categorized the TMFs by aim, stage of implementation, and target level of change to inform the tool's algorithm. We then conducted interviews with 10 end-users to test the usability of the prototype tool and administered the System Usability Scale (SUS). Usability issues were addressed and incorporated into the tool.

RESULTS

We developed Find TMF, an online tool consisting of 3-4 questions about the user's implementation project. The tool's algorithm matches key characteristics of the user's project (aim, stage, target change level) with characteristics of different TMFs and presents a list of candidate models/frameworks. Ten individuals from Canada or Australia participated in usability testing (mean SUS score 84.5, standard deviation 11.4). Overall, participants found the tool to be simple, easy to use and visually appealing with a useful output of candidate models/frameworks to consider for an implementation project. Users wanted additional instruction and guidance on what to expect from the tool and how to use the information in the output table. Tool improvements included incorporating an overview figure outlining the tool steps and output, displaying the tool questions on a single page, and clarifying the available functions of the results page, including adding direct links to the glossary and to complementary tools.

CONCLUSIONS

Find TMF is an easy-to-use online tool that may benefit individuals who support implementation practice activities by making the vast number of models and frameworks more accessible, while also supporting a consistent approach to identifying and selecting relevant TMFs.

Using theory knitting to conceptualize social phenomena in the design and evaluation of dance programs for people living with Parkinson's disease

Dance programs for people living with Parkinson's disease (PwPD) offer participants an opportunity to exercise, engage in artistic self-expression, and form new relationships. While it is understood that the social dimension of dance programs for PwPD contributes to dancer satisfaction and program sustainability, the social mechanisms instrumental to program success are under-examined. Engaging with theory from wider disciplines, or "theory knitting" can help program designers and evaluators examine the mechanisms and contextual factors that make classes socially meaningful with greater detail and specificity. This study identified and examined three theoretical frameworks that program planners and evaluators could use to conceptualize social engagement in dance for PwPD contexts and inform practice. Each theory was assessed for fit using the T-CaST theory comparison and selection tool developed by Birken et al. (2018). As an example, we used anthropologist Victor Turner's (1970; 1977) theory of liminality and communitas to identify five key areas for fostering a sense of social connection in dance for PwPD contexts: (1) selecting a meaningful dance space (2) creating a joyous atmosphere (3) marking entrance into the liminal time and space with rituals (4) embodying liminality and anti-structure and (5) inverting power relations and embracing fluid roles.

IMplementation of the Preterm Birth Surveillance PAthway: a RealisT evaluation (The IMPART Study)

BACKGROUND

In the UK, 7.6% of babies are born preterm, which the Department of Health aims to decrease to 6% by 2025. To advance this, NHS England released Saving Babies Lives Care Bundle Version 2 Element 5, recommending the Preterm Birth Pathway for women at risk of preterm birth. The success of this new pathway depends on its implementation. The IMPART (IMplementation of the Preterm Birth Surveillance PAthway: a RealisT evaluation) study aimed to research how, why, for whom, to what extent and in what contexts the prediction and prevention aspects of Preterm Birth Surveillance Pathway is implemented through a realist evaluation. Realist implementation studies are growing in popularity.

METHODS

Initial programme theories were developed through a realist informed literature scope, interviews with developers of the NHS England guidance, and a national questionnaire of current practice. Implementation theory was utilised in developing the programme theories. Data (interviews and observations with staff and women) were undertaken in 3 case sites in England to 'test' the programme theories. Substantive theory was utilised during data analysis to interpret and refine the theories on how implementation could be improved.

RESULTS

Three explanatory areas were developed: risk assessing and referral; the preterm birth surveillance clinic; and women centred care. Explanatory area 1 dealt with the problems in correct risk assessment and referral to a preterm clinic. Explanatory area 2 focused on how once a correct referral has been made to a preterm clinic, knowledgeable and supported clinicians can deliver a well-functioning clinic. Explanatory area 3 concentrated on how the pathway delivers appropriate care to women.

CONCLUSIONS

The IMPART study provides several areas where implementation could be improved. These include educating clinicians on knowledge of risk factors and the purpose of the preterm clinic, having a multidisciplinary preterm team (including a preterm midwife) with specialist preterm knowledge and skills (including transvaginal cervical scanning skills), and sites actively working with their local network. This multidisciplinary preterm team are placed to deliver continuity of care for women at high-risk of preterm birth, being attentive to their history but also ensuring they are not defined by their risk status.

TRIAL REGISTRATION

ISRCTN57127874.

Using the consolidated framework for implementation research to identify challenges and opportunities for implementing a reproductive health education program into sickle cell disease care

BACKGROUND

As survival rates for individuals with sickle cell disease (SCD) increase, calls have been made to improve their reproductive healthcare and outcomes. The research team created a web-based program entitled Fertility edUcaTion to Understand ReproductivE health in Sickle cell disease (FUTURES). The study aim was to use the Consolidated Framework for Implementation Research (CFIR) during pre-implementation to identify challenges and opportunities from the individual to systems level of implementation to ultimately optimize the integration of FUTURES into clinical practice.

METHODS

Semi-structured interviews were conducted with clinicians, research team members, and adolescent and young adult (AYA) males with SCD and their caregivers who participated in pilot testing. Interviews (N = 31) were coded inductively and then mapped onto CFIR domains (i.e., outer setting, inner setting, characteristics of individuals, and intervention characteristics).

RESULTS

Research team interviews indicated the lack of universal guidelines for reproductive care in this population and gaps in reproductive health knowledge as key reasons for developing FUTURES, also highlighting the importance of collaboration with community members during development. Clinicians reported intraorganizational communication as essential to implementing FUTURES and discussed challenges in addressing reproductive health due to competing priorities. Clinicians, AYAs, and caregivers reported positive views of FUTURES regarding length, engagement, accessibility, and content. Suggestions for the best setting and timing for implementation varied.

CONCLUSIONS

Using CFIR during the pre-implementation phase highlighted challenges and opportunities regarding integrating this program into SCD care. These findings will inform adaptation and further testing of FUTURES to ensure effective implementation of this novel education program.

What is context in knowledge translation? Results of a systematic scoping review

Knowledge Translation (KT) aims to convey novel ideas to relevant stakeholders, motivating their response or action to improve people's health. Initially, the KT literature focused on evidence-based medicine, applying findings from laboratory and clinical research to disease diagnosis and treatment. Since the early 2000s, the scope of KT has expanded to include decision-making with health policy implications.This systematic scoping review aims to assess the evolving knowledge-to-policy concepts, that is, macro-level KT theories, models and frameworks (KT TMFs). While significant attention has been devoted to transferring knowledge to healthcare settings (i.e. implementing health policies, programmes or measures at the meso-level), the definition of 'context' in the realm of health policymaking at the macro-level remains underexplored in the KT literature. This study aims to close the gap.A total of 32 macro-level KT TMFs were identified, with only a limited subset of them offering detailed insights into contextual factors that matter in health policymaking. Notably, the majority of these studies prompt policy changes in low- and middle-income countries and received support from international organisations, the European Union, development agencies or philanthropic entities.

The use of implementation science theories, models, and frameworks in implementation research for medicinal products: A scoping review

BACKGROUND

The uptake, adoption and integration of new medicines and treatment regimens within healthcare delivery can take a decade or more. Increasingly, implementation science (IS) research is being used to bridge this gap between the availability of new therapeutic evidence and its actual application in clinical practice. Little is known, however, about the quality of IS research in this area, including the degree to which theories, models and frameworks (TMFs) are being used. The objective of this study was to conduct a scoping review of the use of TMFs in implementation research involving medicinal products.

METHODS

A search was conducted for English language abstracts and manuscripts describing the application of TMFs in IS studies for medicinal products. Eligible publications were those published between 1 January 1974 and 12 December 2022. All records were screened at the title and abstract stage; included full-text papers were abstracted using data extraction tables designed for the study. Study quality was appraised using the Implementation Research Development Tool.

RESULTS

The initial scoping search identified 2697 publications, of which 9 were ultimately eligible for inclusion in the review. Most studies were published after 2020 and varied in their objectives, design and therapeutic area. Most studies had sample sizes of fewer than 50 participants, and all focused on the post-marketing phase of drug development. The TMF most frequently used was the Consolidated Framework for Implementation Research (CFIR). Although most studies applied all TMF domains, TMF use was limited to instrument development and/or qualitative analysis. Quality appraisals indicated the need for engaging patients and other stakeholders in the implementation research, reporting on the cost of implementation strategies, and evaluating the unintended consequences of implementation efforts.

CONCLUSIONS

We found that few IS studies involving medicinal products reported using TMFs. Those that did encompassed a wide variety of therapeutic indications and medicinal products; all were in the post-marketing phase and involved limited application of the TMFs. Researchers should consider conducting IS in earlier phases of drug development and integrating the TMFs throughout the research process. More consistent and in-depth use of TMFs may help advance research in this area.

A scoping review of theories, models and frameworks used or proposed to evaluate knowledge mobilization strategies

BACKGROUND

Evaluating knowledge mobilization strategies (KMb) presents challenges for organizations seeking to understand their impact to improve KMb effectiveness. Moreover, the large number of theories, models, and frameworks (TMFs) available can be confusing for users. Therefore, the purpose of this scoping review was to identify and describe the characteristics of TMFs that have been used or proposed in the literature to evaluate KMb strategies.

METHODS

A scoping review methodology was used. Articles were identified through searches in electronic databases, previous reviews and reference lists of included articles. Titles, abstracts and full texts were screened in duplicate. Data were charted using a piloted data charting form. Data extracted included study characteristics, KMb characteristics, and TMFs used or proposed for KMb evaluation. An adapted version of Nilsen (Implement Sci 10:53, 2015) taxonomy and the Expert Recommendations for Implementing Change (ERIC) taxonomy (Powell et al. in Implement Sci 10:21, 2015) guided data synthesis.

RESULTS

Of the 4763 search results, 505 were retrieved, and 88 articles were eligible for review. These consisted of 40 theoretical articles (45.5%), 44 empirical studies (50.0%) and four protocols (4.5%). The majority were published after 2010 (n = 70, 79.5%) and were health related (n = 71, 80.7%). Half of the studied KMb strategies were implemented in only four countries: Canada, Australia, the United States and the United Kingdom (n = 42, 47.7%). One-third used existing TMFs (n = 28, 31.8%). According to the adapted Nilsen taxonomy, process models (n = 34, 38.6%) and evaluation frameworks (n = 28, 31.8%) were the two most frequent types of TMFs used or proposed to evaluate KMb. According to the ERIC taxonomy, activities to "train and educate stakeholders" (n = 46, 52.3%) were the most common, followed by activities to "develop stakeholder interrelationships" (n = 23, 26.1%). Analysis of the TMFs identified revealed relevant factors of interest for the evaluation of KMb strategies, classified into four dimensions: context, process, effects and impacts.

CONCLUSIONS

This scoping review provides an overview of the many KMb TMFs used or proposed. The results provide insight into potential dimensions and components to be considered when assessing KMb strategies.

A scoping review reveals candidate quality indicators of knowledge translation and implementation science practice tools

OBJECTIVES

To identify candidate quality indicators from existing tools that provide guidance on how to practice knowledge translation and implemenation science (KT practice tools) across KT domains (dissemination, implementation, sustainability, and scalability).

STUDY DESIGN AND SETTING

We conducted a scoping review using the Joanna Briggs Institute Manual for Evidence Synthesis. We systematically searched multiple electronic databases and the gray literature. Documents were independently screened, selected, and extracted by pairs of reviewers. Data about the included articles, KT practice tools, and candidate quality indicators were analyzed, categorized, and summarized descriptively.

RESULTS

Of 43,060 titles and abstracts that were screened from electronic databases and gray literature, 850 potentially relevant full-text articles were identified, and 253 articles were included in the scoping review. Of these, we identified 232 unique KT practice tools from which 27 unique candidate quality indicators were generated. The identified candidate quality indicators were categorized according to the development (n = 17), evaluation (n = 5) and adaptation (n = 3) of the tools, and engagement of knowledge users (n = 2). No tools were identified that appraised the quality of KT practice tools.

CONCLUSIONS

The development of a quality appraisal instrument of KT practice tools is needed. The results will be further refined and finalized in order to develop a quality appraisal instrument for KT practice tools.

Hurdles and potentials when implementing internet-delivered Acceptance and commitment therapy for chronic pain: a retrospective appraisal using the Quality implementation framework

OBJECTIVES

Internet-delivered psychological interventions can be regarded as evidence-based practices and have been implemented in psychiatric and somatic care at primary and specialist levels. However, challenges as low adherence and poor routinization, have arisen during attempts to implement internet-delivered interventions in chronic pain settings. Internet-delivered Acceptance and Commitment Therapy (IACT) has been found to be helpful for chronic pain patients and might aid in developing pain rehabilitation services. However, the integration of IACT into standard health care has not yet been described from an implementation science perspective. The aim of this hybrid 1 effectiveness-implementation study was to evaluate the process of implementing IACT in a pain rehabilitation setting, to guide future implementation initiatives.

METHODS

In this retrospective study we described actions taken during an implementation initiative, in which IACT was delivered as part of an interdisciplinary pain rehabilitation program (IPRP) at a specialist level clinic. All documents relevant to the study were reviewed and coded using the Quality Improvement Framework (QIF), focusing on adoption, appropriateness and sustainability.

RESULTS

The QIF-analysis of implementation actions resulted in two categories: facilitators and challenges for implementation. Sustainability may be facilitated by sensitivity to the changing needs of a clinical setting and challenged by unfitting capacity building. Appropriateness might be challenged by an insufficient needs assessment and facilitated by aligning routines for communication with the clinic's existing infrastructure. Adoption may be facilitated by staff key champions and an ability to adapt to occurring hurdles. Possible influential factors, hypotheses and key process challenges are presented in a logic model to guide future initiatives.

CONCLUSIONS

Sustainable implementation may depend on both the continuity of facilitating implementation actions and flexibility to the changing needs and interests of patients, caregivers and organization. We conclude that the use of theories, models and frameworks (TMF) as well as a logic model may ease design, planning and evaluation of an implementation process. Lastly, we suggest that IACT may be appropriate for IPRP when given before or after IPRP, focusing on psychiatric comorbidities.

Implementation of Remote Activity Sensing to Support a Rehabilitation Aftercare Program: Observational Mixed Methods Study With Patients and Health Care Professionals

BACKGROUND

Physical activity is central to maintaining the quality of life for patients with complex chronic conditions and is thus at the core of neurorehabilitation. However, maintaining activity improvements in daily life is challenging. The novel Stay With It program aims to promote physical activity after neurorehabilitation by cultivating self-monitoring skills and habits.

OBJECTIVE

We examined the implementation of the Stay With It program at the Valens Rehabilitation Centre in Switzerland using the normalization process theory framework, focusing on 3 research aims. We aimed to examine the challenges and facilitators of program implementation from the perspectives of patients and health care professionals. We aimed to evaluate the potential of activity sensors to support program implementation and patient acceptance. Finally, we aimed to evaluate patients' engagement in physical activity after rehabilitation, patients' self-reported achievement of home activity goals, and factors influencing physical activity.

METHODS

Patients were enrolled if they had a disease that was either chronic or at risk for chronicity and participated in the Stay With It program. Patients were assessed at baseline, the end of rehabilitation, and a 3-month follow-up. The health care professionals designated to deliver the program were surveyed before and after program implementation. We used a mixed methods approach combining standardized questionnaires, activity-sensing data (patients only), and free-text questions.

RESULTS

This study included 23 patients and 13 health care professionals. The diverse needs of patients and organizational hurdles were major challenges to program implementation. Patients' intrinsic motivation and health care professionals' commitment to refining the program emerged as key facilitators. Both groups recognized the value of activity sensors in supporting program implementation and sustainability. Although patients appreciated the sensor's ability to monitor, motivate, and quantify activity, health care professionals saw the sensor as a motivational tool but expressed concerns about technical difficulties and potential inaccuracies. Physical activity levels after patients returned home varied considerably, both within and between individuals. The self-reported achievement of activity goals at home also varied, in part because of vague definitions. Common barriers to maintaining activity at home were declining health and fatigue often resulting from heat and pain. At the 3-month follow-up, 35% (8/23) of the patients withdrew from the study, with most citing deteriorating physical health as the reason and that monitoring and discussing their low activity would negatively affect their mental health.

CONCLUSIONS

Integrating aftercare programs like Stay With It into routine care is vital for maintaining physical activity postrehabilitation. Although activity trackers show promise in promoting motivation through monitoring, they may lead to frustration during health declines. Their acceptability may also be influenced by an individual's health status, habits, and technical skills. Our study highlights the importance of considering health care professionals' perspectives when integrating new interventions into routine care.

Unlocking the restraint-Development of a behaviour change intervention to increase the provision of modified constraint-induced movement therapy in stroke rehabilitation

BACKGROUND

Strong evidence supports the provision of modified constraint-induced movement therapy (mCIMT) to improve upper limb function after stroke. A service audit identified that very few patients received mCIMT in a large subacute, early-supported discharge rehabilitation service. A behaviour change intervention was developed to increase the provision of mCIMT following an unsuccessful 'education only' attempt. This paper aims to systematically document the steps undertaken and to provide practical guidance to clinicians and rehabilitation services to implement this complex, yet effective, rehabilitation intervention.

METHODS

This clinician behaviour change intervention was developed over five stages and led by a working group of neurological experts (n = 3). Data collection methods included informal discussions with clinicians and an online survey (n = 35). The staged process included reflection on why the first attempt did not improve the provision of mCIMT (stage 1), mapping barriers and enablers to the Theoretical Domains Framework (TDF) and behaviour change wheel (BCW) to guide the behaviour change techniques (stages 2 and 3), developing a suitable mCIMT protocol (stage 4), and delivering the behaviour change intervention (stage 5).

RESULTS

Reflection among the working group identified the need for upskilling in mCIMT delivery and the use of a behaviour change framework to guide the implementation program. Key determinants of behaviour change operated within the TDF domains of knowledge, skills, environmental context and resources, social role and identity, and social influences. Following the development of a context-specific mCIMT protocol, the BCW guided the behaviour change intervention, which included education, training, persuasion, environmental restructuring, and modelling.

CONCLUSION

This paper provides an example of using the TDF and BCW to support the implementation of mCIMT in a large early-supported discharge service. It outlines the suite of behaviour change techniques used to influence clinician behaviour. The success of this behaviour change intervention will be explored in future research.

Essential content for teaching implementation practice in healthcare: a mixed-methods study of teams offering capacity-building initiatives

BACKGROUND

Applying the knowledge gained through implementation science can support the uptake of research evidence into practice; however, those doing and supporting implementation (implementation practitioners) may face barriers to applying implementation science in their work. One strategy to enhance individuals' and teams' ability to apply implementation science in practice is through training and professional development opportunities (capacity-building initiatives). Although there is an increasing demand for and offerings of implementation practice capacity-building initiatives, there is no universal agreement on what content should be included. In this study we aimed to explore what capacity-building developers and deliverers identify as essential training content for teaching implementation practice.

METHODS

We conducted a convergent mixed-methods study with participants who had developed and/or delivered a capacity-building initiative focused on teaching implementation practice. Participants completed an online questionnaire to provide details on their capacity-building initiatives; took part in an interview or focus group to explore their questionnaire responses in depth; and offered course materials for review. We analyzed a subset of data that focused on the capacity-building initiatives' content and curriculum. We used descriptive statistics for quantitative data and conventional content analysis for qualitative data, with the data sets merged during the analytic phase. We presented frequency counts for each category to highlight commonalities and differences across capacity-building initiatives.

RESULTS

Thirty-three individuals representing 20 capacity-building initiatives participated. Study participants identified several core content areas included in their capacity-building initiatives: (1) taking a process approach to implementation; (2) identifying and applying implementation theories, models, frameworks, and approaches; (3) learning implementation steps and skills; (4) developing relational skills. In addition, study participants described offering applied and pragmatic content (e.g., tools and resources), and tailoring and evolving the capacity-building initiative content to address emerging trends in implementation science. Study participants highlighted some challenges learners face when acquiring and applying implementation practice knowledge and skills.

CONCLUSIONS

This study synthesized what experienced capacity-building initiative developers and deliverers identify as essential content for teaching implementation practice. These findings can inform the development, refinement, and delivery of capacity-building initiatives, as well as future research directions, to enhance the translation of implementation science into practice.

IMP2ART: development of a multi-level programme theory integrating the COM-B model and the iPARIHS framework, to enhance implementation of supported self-management of asthma in primary care

BACKGROUND

Supported asthma self-management, incorporating an asthma action plan and annual clinical review, has been recommended by UK/global guidelines for over three decades. However, implementation remains poor, as only around a third of individuals receive basic asthma care, according to the UKs leading respiratory charity Asthma and Lung UK. A systematic review of implementation studies recommended that a whole systems approach targeting patients, healthcare professional education, and organisations is needed to improve implementation of supported asthma self-management in primary care. The IMPlementing IMProved Asthma self-management as RouTine (IMP2ART) is a national Hybrid-II implementation cluster randomised controlled trial that aims to evaluate such an approach. This paper describes the development of the implementation strategy for IMP2ART with particular focus on the integration of multiple level theories.

METHODS

The Medical Research Council design and evaluation of complex interventions framework and the Person-Based Approach to intervention development were used as guidance for stages of strategy development. Specifically, we (i) set up a multidisciplinary team (including practicing and academic clinicians, health psychologists, public health and patient colleagues), (ii) reviewed and integrated evidence and theory, (iii) developed guiding principles, (iv) developed prototype materials, and (v) conducted a pre-pilot study before final refinement.

RESULTS

The implementation strategy included resources for patients, team-based and individual healthcare professional education, practice audit and feedback, and an asthma review template, as well as a facilitator role accessible to primary care practices for 12 months. The synthesis of the integrated Promoting Action on Research Implementation in Health Services (iPARIHS) and Capability, Opportunity, Motivation and Behaviour (COM-B) frameworks led to an evolved framework bringing together important implementation and behaviour change elements which will be used as a basis for the study process evaluation.

CONCLUSIONS

A description of rigorous implementation strategy development for the IMP2ART study is provided along with newly theorised integration of implementation and behaviour change science which may be of benefit to others targeting implementation in primary care.

TRIAL REGISTRATION

ISRCTN15448074. Registered on 2nd December 2019.

Developing the intersectionality supplemented Consolidated Framework for Implementation Research (CFIR) and tools for intersectionality considerations

BACKGROUND

The concept of intersectionality proposes that demographic and social constructs intersect with larger social structures of oppression and privilege to shape experiences. While intersectionality is a widely accepted concept in feminist and gender studies, there has been little attempt to use this lens in implementation science. We aimed to supplement the Consolidated Framework for Implementation Research (CFIR), a commonly used framework in implementation science, to support the incorporation of intersectionality in implementation science projects by (1) integrating an intersectional lens to the CFIR; and (2) developing a tool for researchers to be used alongside the updated framework.

METHODS

Using a nominal group technique, an interdisciplinary framework committee (n = 17) prioritized the CFIR as one of three implementation science models, theories, and frameworks to supplement with intersectionality considerations; the modification of the other two frameworks are described in other papers. The CFIR subgroup (n = 7) reviewed the five domains and 26 constructs in the CFIR and prioritized domains and constructs for supplementation with intersectional considerations. The subgroup then iteratively developed recommendations and prompts for incorporating an intersectional approach within the prioritized domains and constructs. We developed recommendations and prompts to help researchers consider how personal identities and power structures may affect the facilitators and inhibitors of behavior change and the implementation of subsequent interventions.

RESULTS

We achieved consensus on how to apply an intersectional lens to CFIR after six rounds of meetings. The final intersectionality supplemented CFIR includes the five original domains, and 28 constructs; the outer systems and structures and the outer cultures constructs were added to the outer setting domain. Intersectionality prompts were added to 13 of the 28 constructs.

CONCLUSION

Through an expert-consensus approach, we modified the CFIR to include intersectionality considerations and developed a tool with prompts to help implementation users apply an intersectional lens using the updated framework.

Enhancing the appropriateness of eyecare delivery: the iCaretrack approach

Optometrists play an integral role in primary eyecare services, including prevention, diagnosis, and management of acute and chronic eye conditions. Therefore, it remains essential that the care they provide be timely and appropriate to ensure the best patient outcomes and optimal utilisation of resources. However, optometrists continuously face many challenges that can affect their ability to provide appropriate care (i.e., the care in line with evidence-based clinical practice guidelines). To address any resulting evidence-to-practice gaps, programs are needed that support and enable optometrists to adopt and utilise the best evidence in clinical practice. Implementation science is a field of research that can be applied to improving the adoption and maintenance of evidence-based practices in routine care, through systematic development and application of strategies or interventions to address barriers to evidence-based practice. This paper demonstrates an approach using implementation science to enhance optometric eyecare delivery. A brief overview of the methods used to identify existing gaps in appropriate eyecare delivery is presented. An outline of the process used to understand the behavioural barriers responsible for such gaps follows, involving theoretical models and frameworks. The resulting development of an online program for optometrists to enhance their capability, motivation, and opportunity to provide evidence-based eyecare is described, using the Behaviour Change Model and co-design methods. The importance of and methods used in evaluating such programs are also discussed. Finally, reflections on the experience and key learnings from the project are shared. While the paper focuses on experiences in improving glaucoma and diabetic eyecare in the Australian optometry context, this approach can be adapted to other conditions and contexts.

A scoping review of implementation science theories, models, and frameworks - an appraisal of purpose, characteristics, usability, applicability, and testability

BACKGROUND

A proliferation of theories, models, and frameworks (TMFs) have been developed in the implementation science field to facilitate the implementation process. The basic features of these TMFs have been identified by several reviews. However, systematic appraisals on the quality of these TMFs are inadequate. To fill this gap, this study aimed to assess the usability, applicability, and testability of the current TMFs in a structured way.

METHODS

A scoping review method was employed. Electronic databases were searched to locate English and Chinese articles published between January 2000 and April 2022. Search terms were specific to implementation science. Additionally, hand searches were administered to identify articles from related reviews. Purpose and characteristics such as the type of TMF, analytical level, and observation unit were extracted. Structured appraisal criteria were adapted from Birken et al.'s Theory Comparison and Selection Tool (T-CaST) to conduct an in-depth analysis of the TMFs' usability, applicability, and testability.

RESULTS

A total of 143 TMFs were included in this analysis. Among them, the most common purpose was to identify barriers and facilitators. Most TMFs applied the descriptive method to summarize the included constructs or the prescriptive method to propose courses of implementation actions. TMFs were mainly mid-range theories built on existing conceptual frameworks or demonstrated grand theories. The usability of the TMFs needs to be improved in terms of the provision of conceptually matched strategies to barriers and facilitators and instructions on the TMFs usage. Regarding the applicability, little attention was paid to the constructs of macro-level context, stages of scale-up and sustainability, and implementation outcomes like feasibility, cost, and penetration. Also, fewer TMFs could propose recommended research and measurement methods to apply the TMFs. Lastly, explicit hypotheses or propositions were lacking in most of the TMFs, and empirical evidence was lacking to support the claimed mechanisms between framework elements in testability.

CONCLUSIONS

Common limitations were found in the usability, application, and testability of the current TMFs. The findings of this review could provide insights for developers of TMFs for future theoretical advancements.

Remote Technologies to Enhance Service Delivery for Adults: Clinical Research Perspectives

There are many examples of remote technologies that are clinically effective and provide numerous benefits to adults with hearing loss. Despite this, the uptake of remote technologies for hearing healthcare has been both low and slow until the onset of the COVID-19 pandemic, which has been a key driver for change globally. The time is now right to take advantage of the many benefits that remote technologies offer, through clinical, consumer, or hybrid services and channels. These include greater access and choice, better interactivity and engagement, and tailoring of technologies to individual needs, leading to clients who are better informed, enabled, and empowered to self-manage their hearing loss. This article provides an overview of the clinical research evidence-base across a range of remote technologies along the hearing health journey. This includes qualitative, as well as quantitative, methods to ensure the end-users' voice is at the core of the research, thereby promoting person-centered principles. Most of these remote technologies are available and some are already in use, albeit not widespread. Finally, whenever new technologies or processes are implemented into services, be they clinical, hybrid, or consumer, careful consideration needs to be given to the required behavior change of the key people (e.g., clients and service providers) to facilitate and optimize implementation.

Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

Introduction

Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation.

Methods

Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized.

Results

Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%).

Conclusion

TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science's translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the "AI chasm" continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice.

Good practice recommendations on implementation evaluation for policies targeting diet, physical activity, and sedentary behaviour

Health policies aim to achieve specific health goals through system-level changes, unlike common health interventions that focus on promoting specific health behaviors on individual level. However, reliable data on the feasibility and implementation of policy actions across Europe are lacking. Moreover, no practice-oriented guidance exists for policy makers and implementers on how to evaluate policy implementation.As part of the Policy Evaluation Network, we aimed to synthesise knowledge on how to evaluate the implementation of policies promoting healthy diets, physical activity, and reducing sedentary behaviours. The multidisciplinary working group comprised 16 researchers and conducted two scoping reviews, three systematic reviews, two meta-reviews, two qualitative case studies and one quantitative case study over three years. The target populations included the general population, those at risk for obesity, and school children. Based on these reviews and case studies, this article summarises and presents the findings and lessons learned regarding the implementation evaluation of policies in nine case reports.Drawing on these experiences, three critical requirements for policy implementation evaluation were set: 1) conduct a comprehensive policy implementation evaluation from a multi-level perspective, 2) use implementation frameworks to address processes, determinants, and outcomes, and 3) engage relevant stakeholders in policy implementation evaluation. Finally, the consensus process resulted in 10 steps for the implementation evaluation of policies to promote physical activity and a healthy diet and to reduce sedentary behaviours, which adhere to the requirements and resources of the targeted policy.The findings of an implementation evaluation can lead to a better understanding of why policies work or not and can serve as a basis for developing solutions. This practice-oriented guidance outlines factors that should be considered in policy implementation evaluation to address its complexity. In this way, involved researchers and practitioners are empowered to engage in the evaluation process to close the knowledge gap regarding policy implementation.

A 4D Theoretical Framework for Measuring Topic-Specific Influence on Twitter: Development and Usability Study on Dietary Sodium Tweets

BACKGROUND

Social media has emerged as a prominent approach for health education and promotion. However, it is challenging to understand how to best promote health-related information on social media platforms such as Twitter. Despite commercial tools and prior studies attempting to analyze influence, there is a gap to fill in developing a publicly accessible and consolidated framework to measure influence and analyze dissemination strategies.

OBJECTIVE

We aimed to develop a theoretical framework to measure topic-specific user influence on Twitter and to examine its usability by analyzing dietary sodium tweets to support public health agencies in improving their dissemination strategies.

METHODS

We designed a consolidated framework for measuring influence that can capture topic-specific tweeting behaviors. The core of the framework is a summary indicator of influence decomposable into 4 dimensions: activity, priority, originality, and popularity. These measures can be easily visualized and efficiently computed for any Twitter account without the need for private access. We demonstrated the proposed methods by using a case study on dietary sodium tweets with sampled stakeholders and then compared the framework with a traditional measure of influence.

RESULTS

More than half a million dietary sodium tweets from 2006 to 2022 were retrieved for 16 US domestic and international stakeholders in 4 categories, that is, public agencies, academic institutions, professional associations, and experts. We discovered that World Health Organization, American Heart Association, Food and Agriculture Organization of the United Nations (UN-FAO), and World Action on Salt (WASH) were the top 4 sodium influencers in the sample. Each had different strengths and weaknesses in their dissemination strategies, and 2 stakeholders with similar overall influence, that is, UN-FAO and WASH, could have significantly different tweeting patterns. In addition, we identified exemplars in each dimension of influence. Regarding tweeting activity, a dedicated expert published more sodium tweets than any organization in the sample in the past 16 years. In terms of priority, WASH had more than half of its tweets dedicated to sodium. UN-FAO had both the highest proportion of original sodium tweets and posted the most popular sodium tweets among all sampled stakeholders. Regardless of excellence in 1 dimension, the 4 most influential stakeholders excelled in at least 2 out of 4 dimensions of influence.

CONCLUSIONS

Our findings demonstrate that our method not only aligned with a traditional measure of influence but also advanced influence analysis by analyzing the 4 dimensions that contribute to topic-specific influence. This consolidated framework provides quantifiable measures for public health entities to understand their bottleneck of influence and refine their social media campaign strategies. Our framework can be applied to improve the dissemination of other health topics as well as assist policy makers and public campaign experts to maximize population impact.

Clinical guidelines for the use of lifestyle-based mental health care in major depressive disorder: World Federation of Societies for Biological Psychiatry (WFSBP) and Australasian Society of Lifestyle Medicine (ASLM) taskforce

OBJECTIVES

The primary objectives of these international guidelines were to provide a global audience of clinicians with (a) a series of evidence-based recommendations for the provision of lifestyle-based mental health care in clinical practice for adults with Major Depressive Disorder (MDD) and (b) a series of implementation considerations that may be applicable across a range of settings.

METHODS

Recommendations and associated evidence-based gradings were based on a series of systematic literature searches of published research as well as the clinical expertise of taskforce members. The focus of the guidelines was eight lifestyle domains: physical activity and exercise, smoking cessation, work-directed interventions, mindfulness-based and stress management therapies, diet, sleep, loneliness and social support, and green space interaction. The following electronic bibliographic databases were searched for articles published prior to June 2020: PubMed, EMBASE, The Cochrane Library (Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Methodology Register), CINAHL, PsycINFO. Evidence grading was based on the level of evidence specific to MDD and risk of bias, in accordance with the World Federation of Societies for Biological Psychiatry criteria.

RESULTS

Nine recommendations were formed. The recommendations with the highest ratings to improve MDD were the use of physical activity and exercise, relaxation techniques, work-directed interventions, sleep, and mindfulness-based therapies (Grade 2). Interventions related to diet and green space were recommended, but with a lower strength of evidence (Grade 3). Recommendations regarding smoking cessation and loneliness and social support were based on expert opinion. Key implementation considerations included the need for input from allied health professionals and support networks to implement this type of approach, the importance of partnering such recommendations with behaviour change support, and the need to deliver interventions using a biopsychosocial-cultural framework.

CONCLUSIONS

Lifestyle-based interventions are recommended as a foundational component of mental health care in clinical practice for adults with Major Depressive Disorder, where other evidence-based therapies can be added or used in combination. The findings and recommendations of these guidelines support the need for further research to address existing gaps in efficacy and implementation research, especially for emerging lifestyle-based approaches (e.g. green space, loneliness and social support interventions) where data are limited. Further work is also needed to develop innovative approaches for delivery and models of care, and to support the training of health professionals regarding lifestyle-based mental health care.

Value of implementation science and hybrid implementation research designs for nursing education research: A discussion paper

INTRODUCTION

Nursing education research is complex and contextualized. The evaluation and impact of educational innovations on students, educators, and educational outcomes are influenced by the complexity of environments. Most interventional research in nursing is designed and implemented without considering the behavioral and contextual issues affecting educational innovations, uptake and change processes, and outcomes. Implementation science has emerged as a valuable methodology for designing and conducting interventional research that has the potential to translate evidence and innovations quickly into practice.

PURPOSE

This paper aims to explore the value of implementation science theories, models, and frameworks and hybrid designs for interventional nursing education research and illustrate how these can be used in nursing education research.

METHODS

A brief overview of implementation science, the various types of theories, models and frameworks and Hybrid designs are provided. Illustrative examples demonstrating the incorporation of these methodologies in interventional nursing education research are provided.

RESULTS

A brief overview of implementation and its key concepts namely context, implementation strategies, fidelity, outcomes, adaptation, and sustainability is provided. Three types of hybrid designs are discussed with examples in nursing education research.

DISCUSSION

The implications of implementation science for nursing education research are: a) Accelerating uptake of innovations to improve educational outcomes, b) targeting systematic change in individual and organizational behaviour and c) ensuring the sustainability of teaching and learning innovations.

CONCLUSION

Incorporating implementation science in nursing education research can optimize the uptake of educational innovations in practice in a sustainable manner. Nurse educators should equip themselves with implementation science skills and develop competencies to enhance the delivery of effective and quality nursing education.

Researching Compassionate Communities: Identifying theoretical frameworks to evaluate the complex processes behind public health palliative care initiatives

BACKGROUND

Compassionate Communities have been put forward as a new model for community-based palliative care to positively impact the health and wellbeing of those experiencing challenges of serious illness, death, dying, and loss. Despite the growing international movement to develop these public health initiatives to end-of-life care, only a handful of initiatives have undergone some form of evaluation.

AIM

To provide guidance on designing evaluation research by identifying theoretical frameworks to understand the development, implementation, and underlying mechanisms of Compassionate Communities.

METHODS

To identify suitable theoretical frameworks for the study of Compassionate Communities, we applied two steps. The first step examined the characteristics of Compassionate Communities and translated them into assessment criteria for the selection of theoretical frameworks. The second step consisted of applying the identified assessment criteria to a list of widely used and highly cited theoretical frameworks.

RESULTS

Three well-established theoretical frameworks were identified as being most suitable to study the development, implementation, and underlying mechanisms of Compassionate Communities: The Consolidated Framework for Implementation Research (CFIR), the integrated-Promoting Action on Research Implementation in Health Services framework (i-PARIHS), and the Extended Normalization Process Theory (ENPT).

CONCLUSIONS

The article supports and encourages the use of theoretical frameworks to evaluate the complex processes behind public health palliative care initiatives. The complementary use of two determinant frameworks and an implementation theory provides theoretical grounding to gain rich insights into the emergent and shifting interplays between agency, social processes, and contextual factors that shape the development and implementation of Compassionate Communities.

Strategies for implementing the interRAI home care frailty scale with home-delivered meal clients

Introduction

Frailty is a complex condition that is highly associated with health decline and the loss of independence. Home-delivered meal programs are designed to provide older adults with health and nutritional support that can attenuate the risk of frailty. However, home-delivered meal agencies do not routinely assess frailty using standardized instruments, leading to uncertainty over the longitudinal impact of home-delivered meals on frailty levels. Considering this knowledge gap, this study aimed to facilitate home-delivered meal staff's implementation of a standardized frailty instrument with meal clients as part of routine programming. This article (a) describes the use of Implementation Mapping principles to develop strategies supporting frailty instrument implementation in one home-delivered meal agency and (b) examines the degree to which a combination of strategies influenced the feasibility of frailty instrument use by home-delivered meal staff at multiple time points.

Methods and materials

This retrospective observational study evaluated staff's implementation of the interRAI Home Care Frailty Scale (HCFS) with newly enrolled home-delivered meal clients at baseline-, 3-months, and 6-months. The process of implementing the HCFS was supported by five implementation strategies that were developed based on tenets of Implementation Mapping. Rates of implementation and reasons clients were lost to 3- and 6-month follow-up were evaluated using univariate analyses. Client-level data were also examined to identify demographic factors associated with attrition at both follow-up time points.

Results

Staff implemented the HCFS with 94.8% (n = 561) of eligible home-delivered meal clients at baseline. Of those clients with baseline HCFS data, staff implemented the follow-up HCFS with 43% of clients (n = 241) at 3-months and 18.0% of clients (n = 101) at 6-months. Insufficient client tracking and documentation procedures complicated staff's ability to complete the HCFS at follow-up time points.

Discussion

While the HCFS assesses important frailty domains that are relevant to home-delivered meal clients, its longitudinal implementation was complicated by several agency- and client-level factors that limited the extent to which the HCFS could be feasibly implemented over multiple time points. Future empirical studies are needed to design and test theoretically derived implementation strategies to support frailty instrument use in the home- and community-based service setting.

Developing a knowledge translation program for health practitioners: Allied Health Translating Research into Practice

Background

Front-line health practitioners lack confidence in knowledge translation, yet they are often required to undertake projects to bridge the knowledge-practice gap. There are few initiatives focused on building the capacity of the health practitioner workforce to undertake knowledge translation, with most programs focusing on developing the skills of researchers. This paper reports the development and evaluation of a knowledge translation capacity building program for allied health practitioners located over geographically dispersed locations in Queensland, Australia.

Methods

Allied Health Translating Research into Practice (AH-TRIP) was developed over five years with consideration of theory, research evidence and local needs assessment. AH-TRIP includes five components: training and education; support and networks (including champions and mentoring); showcase and recognition; TRIP projects and implementation; evaluation. The RE-AIM framework (Reach, Effectiveness, Adoption, Implementation Maintenance) guided the evaluation plan, with this paper reporting on the reach (number, discipline, geographical location), adoption by health services, and participant satisfaction between 2019 and 2021.

Results

A total of 986 allied health practitioners participated in at least one component of AH-TRIP, with a quarter of participants located in regional areas of Queensland. Online training materials received an average of 944 unique page views each month. A total of 148 allied health practitioners have received mentoring to undertake their project, including a range of allied health disciplines and clinical areas. Very high satisfaction was reported by those receiving mentoring and attending the annual showcase event. Nine of sixteen public hospital and health service districts have adopted AH-TRIP.

Conclusion

AH-TRIP is a low-cost knowledge translation capacity building initiative which can be delivered at scale to support allied health practitioners across geographically dispersed locations. Higher adoption in metropolitan areas suggests that further investment and targeted strategies are needed to reach health practitioners working in regional areas. Future evaluation should focus on exploring the impact on individual participants and the health service.

Development and psychometric evaluation of the Implementation Science Research Project Appraisal Criteria (ImpResPAC) tool: a study protocol

INTRODUCTION

The need for quantitative criteria to appraise the quality of implementation research has recently been highlighted to improve methodological rigour. The Implementation Science Research development (ImpRes) tool and supplementary guide provide methodological guidance and recommendations on how to design high-quality implementation research. This protocol reports on the development of the Implementation Science Research Project Appraisal Criteria (ImpResPAC) tool, a quantitative appraisal tool, developed based on the structure and content of the ImpRes tool and supplementary guide, to evaluate the conceptual and methodological quality of implementation research.

METHODS AND ANALYSIS

This study employs a three-stage sequential mixed-methods design. During stage 1, the research team will map core domains of the ImpRes tool, guidance and recommendations contained in the supplementary guide and within the literature, to ImpResPAC. In stage 2, an international multidisciplinary expert group, recruited through purposive sampling, will inform the refinement of ImpResPAC, including content, scoring system and user instructions. In stage 3, an extensive psychometric evaluation of ImpResPAC, that was created in stage 1 and refined in stage 2, will be conducted. The scaling assumptions (inter-item and item-total correlations), reliability (internal consistency, inter-rater) and validity (construct and convergent validity) will be investigated by applying ImpResPAC to 50 protocols published in Implementation Science. We envisage developing ImpResPAC in this way will provide implementation research stakeholders, primarily grant reviewers and educators, a comprehensive, transparent and fair appraisal of the conceptual and methodological quality of implementation research, increasing the likelihood of funding research that will generate knowledge and contribute to the advancement of the field.

ETHICS AND DISSEMINATION

This study will involve human participants. This study has been registered and minimal risk ethical clearance granted by The Research Ethics Office, King's College London (reference number MRA-20/21-20807). Participants will receive written information on the study via email and will provide e-consent if they wish to participate. We will use traditional academic modalities of dissemination (eg, conferences and publications).

Increasing Societal Benefit From Cardiovascular Drugs

During the past few years, several innovative treatments for noncommunicable chronic disease have become available, including SGLT2i (sodium-glucose cotransporter-2 inhibitors), GLP-1a (glucagon-like-peptide 1 agonists), ARNI (angiotensin receptor-neprilysin inhibitors), and finerenone, a selective nonsteroidal mineralocorticoid receptor antagonist. Each of these medications improves clinically relevant outcomes when added to existing therapies, and the indications for their use are rapidly expanding. Because existing drug regimens are already complex and costly, ensuring that society derives the maximal benefit from these new agents represents a major challenge. This Primer discusses how society can meet this challenge, which we address in terms of 5 principles: maximizing benefit, minimizing harm, optimizing uptake, increasing value for money, and ensuring equitable access. The Primer is most relevant for stakeholders in high-income countries, but the principles are broadly applicable to stakeholders in other settings, including low- and middle-income countries. We have focused the discussion on SGLT-2i, but the 5 principles herein could be used with reference to ARNI, finerenone, or any other health product.

Adapting a tobacco cessation treatment intervention and implementation strategies to enhance implementation effectiveness and clinical outcomes in the context of HIV care in Vietnam: a case study

BACKGROUND

Smoking rates remain high in Vietnam, particularly among people living with HIV/AIDS (PLWH), but tobacco cessation services are not available in outpatient HIV clinics (OPCs). The research team is conducting a type II hybrid randomized controlled trial (RCT) comparing the cost-effectiveness of three tobacco cessation interventions among PLWH receiving care in HIV clinics in Vietnam. The study is simultaneously evaluating the implementation processes and outcomes of strategies aimed at increasing the implementation of tobacco dependence treatment (TDT) in the context of HIV care. This paper describes the systematic, theory-driven process of adapting intervention components and implementation strategies with demonstrated effectiveness in high-income countries, and more recently in Vietnam, to a new population (i.e., PLWH) and new clinical setting, prior to launching the trial.

METHODS

Data collection and analyses were guided by two implementation science frameworks and the socio-ecological model. Qualitative interviews were conducted with 13 health care providers and 24 patients in three OPCs. Workflow analyses were conducted in each OPC. Qualitative data were analyzed using rapid qualitative analysis procedures. Based on findings, components of the intervention and implementation strategies were adapted, followed by a 3-month pilot study in one OPC with 16 patients randomized to one of two intervention arms.

RESULTS

The primary adaptations included modifying the TDT intervention counseling content to address barriers to quitting among PLWH and Vietnamese sociocultural norms that support smoking cessation. Implementation strategies (i.e., training and system changes) were adapted to respond to provider- and clinic-level determinants of implementation effectiveness (e.g., knowledge gaps, OPC resource constraints, staffing structure, compatibility).

CONCLUSIONS

Adaptations were facilitated through a mixed method, stakeholder (patient and health care provider, district health leader)-engaged evaluation of context-specific influences on intervention and implementation effectiveness. This data-driven approach to refining and adapting components aimed to optimize intervention effectiveness and implementation in the context of HIV care. Balancing pragmatism with rigor through the use of rapid analysis procedures and multiple methods increased the feasibility of the adaptation process.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05162911 . Registered on December 16, 2021.

Unraveling implementation context: the Basel Approach for coNtextual ANAlysis (BANANA) in implementation science and its application in the SMILe project

BACKGROUND

Designing intervention and implementation strategies with careful consideration of context is essential for successful implementation science projects. Although the importance of context has been emphasized and methodology for its analysis is emerging, researchers have little guidance on how to plan, perform, and report contextual analysis. Therefore, our aim was to describe the Basel Approach for coNtextual ANAlysis (BANANA) and to demonstrate its application on an ongoing multi-site, multiphase implementation science project to develop/adapt, implement, and evaluate an integrated care model in allogeneic SteM cell transplantatIon facILitated by eHealth (the SMILe project).

METHODS

BANANA builds on guidance for assessing context by Stange and Glasgow (Contextual factors: the importance of considering and reporting on context in research on the patient-centered medical home, 2013). Based on a literature review, BANANA was developed in ten discussion sessions with implementation science experts and a medical anthropologist to guide the SMILe project's contextual analysis. BANANA's theoretical basis is the Context and Implementation of Complex Interventions (CICI) framework. Working from an ecological perspective, CICI acknowledges contextual dynamics and distinguishes between context and setting (the implementation's physical location).

RESULTS

BANANA entails six components: (1) choose a theory, model, or framework (TMF) to guide the contextual analysis; (2) use empirical evidence derived from primary and/or secondary data to identify relevant contextual factors; (3) involve stakeholders throughout contextual analysis; (4) choose a study design to assess context; (5) determine contextual factors' relevance to implementation strategies/outcomes and intervention co-design; and (6) report findings of contextual analysis following appropriate reporting guidelines. Partly run simultaneously, the first three components form a basis both for the identification of relevant contextual factors and for the next components of the BANANA approach.

DISCUSSION

Understanding of context is indispensable for a successful implementation science project. BANANA provides much-needed methodological guidance for contextual analysis. In subsequent phases, it helps researchers apply the results to intervention development/adaption and choices of contextually tailored implementation strategies. For future implementation science projects, BANANA's principles will guide researchers first to gather relevant information on their target context, then to inform all subsequent phases of their implementation science project to strengthen every part of their work and fulfill their implementation goals.

A citation analysis and scoping systematic review of the operationalization of the Practical, Robust Implementation and Sustainability Model (PRISM)

BACKGROUND

The Practical, Robust Implementation and Sustainability Model (PRISM) was developed in 2008 as a contextually expanded version of the broadly used Reach, Adoption, Effectiveness, Implementation, and Maintenance (RE-AIM) framework. PRISM provides researchers a pragmatic and intuitive model to improve translation of research interventions into clinical and community practice. Since 2008, the use of PRISM increased across diverse topics, populations, and settings. This citation analysis and scoping systematic review aimed to assess the use of the PRISM framework and to make recommendations for future research.

METHODS

A literature search was conducted using three databases (PubMed, Web of Science, Scopus) for the period of 2008 and September 2020. After exclusion, reverse citation searches and invitations to experts in the field were used to identify and obtain recommendations for additional articles not identified in the original search. Studies that integrated PRISM into their study design were selected for full abstraction. Unique research studies were abstracted for information on study characteristics (e.g., setting/population, design), PRISM contextual domains, and RE-AIM outcomes.

RESULTS

A total of 180 articles were identified to include PRISM to some degree. Thirty-two articles representing 23 unique studies integrated PRISM within their study design. Study characteristics varied widely and included studies conducted in diverse contexts, but predominately in high-income countries and in clinical out-patient settings. With regards to use, 19 used PRISM for evaluation, 10 for planning/development, 10 for implementation, four for sustainment, and one for dissemination. There was substantial variation across studies in how and to what degree PRISM contextual domains and RE-AIM outcomes were operationalized and connected. Only two studies directly connected individual PRISM context domains with RE-AIM outcomes, and another four included RE-AIM outcomes without direct connection to PRISM domains.

CONCLUSIONS

This is the first systematic review of the use of PRISM in various contexts. While there were low levels of 'integrated' use of PRISM and few reports on linkage to RE-AIM outcomes, most studies included important context domains of implementation and sustainability infrastructure and external environment. Recommendations are provided for more consistent and comprehensive use of and reporting on PRISM to inform both research and practice on contextual factors in implementation.

Desirable attributes of theories, models, and frameworks for implementation strategy design in healthcare: a scoping review protocol

Background: Implementation strategies can facilitate the adoption of evidence-based practices and policies. A wide range of theoretical approaches-theories, models, and frameworks-can be used to inform implementation strategy design in different ways (e.g., guiding barrier and enabler assessment to implementing evidence-based interventions). While selection criteria and attributes of theoretical approaches for use in implementation strategy design have been studied, they have never been synthesized. Furthermore, theoretical approaches have never been classified according to desirable criteria and attributes for use in implementation strategy design. This scoping review aims to a) identify the literature reporting on the selection of theoretical approaches for informing implementation strategy design in healthcare and b) understand the suggested use of these approaches in implementation strategy design. Methods: The Joanna Briggs Institute methodological guidelines will be used to conduct this scoping review. A search of three bibliographical databases (MEDLINE, Embase, CINAHL) will be conducted for peer-reviewed discussion, methods, protocol, or review papers. Data will be managed using the Covidence software. Two review team members will independently perform screening, full text review and data extraction. Results: Results will include a list of selection criteria and attributes of theoretical approaches for use in research on implementation strategy design. Descriptive data regarding selection criteria and attributes will be synthesized graphically and in table format. Data regarding the suggested use of theoretical approaches in implementation strategy design will be presented narratively. Conclusions: Results will be used to classify existing theoretical approaches according to the attributes and selection criteria identified in this scoping review. Envisioned next steps include an online tool that will be created to assist researchers in selecting theories, models, and frameworks for implementation strategy design.

Comparing and using prominent social accountability frameworks in medical education: moving from theory to implementation in Northern Ontario, Canada

BACKGROUND

Social accountability in medical education is conceptualized as a responsibility to respond to the needs of local populations and demonstrate impact of these activities. The objective of this study was to rigorously examine and compare social accountability theories, models, and frameworks to identify a theory-informed structure to understand and evaluate the impacts of medical education in Northern Ontario.

METHODS

Using a narrative review methodology, prominent social accountability theories, models, and frameworks were identified. The research team extracted important constructs and relationships from the selected frameworks. The Theory Comparison and Selection Tool was used to compare the frameworks for fit and relevance.

RESULTS

Eleven theories, models, and frameworks were identified for in-depth analysis and comparison. Two realist frameworks that considered community relationships in medical education and social accountability in health services received the highest scores. Frameworks focused on learning health systems, evaluating institutional social accountability, and implementing evidence-based practices also scored highly.

CONCLUSION

We used a systematic theory selection process to describe and compare social accountability constructs and frameworks to inform the development of a social accountability impact framework for the Northern Ontario School of Medicine. The research team examined important constructs, relationships, and outcomes, to select a framework that fits the aims of a specific project. Additional engagement will help determine how to combine, adapt, and implement framework components to use in a Northern Ontario framework.

A scoping review of frameworks in empirical studies and a review of dissemination frameworks

BACKGROUND

The field of dissemination and implementation (D&I) research has grown immensely in recent years. However, the field of dissemination research has not coalesced to the same degree as the field of implementation research. To advance the field of dissemination research, this review aimed to (1) identify the extent to which dissemination frameworks are used in dissemination empirical studies, (2) examine how scholars define dissemination, and (3) identify key constructs from dissemination frameworks.

METHODS

To achieve aims 1 and 2, we conducted a scoping review of dissemination studies published in D&I science journals. The search strategy included manuscripts published from 1985 to 2020. Articles were included if they were empirical quantitative or mixed methods studies about the dissemination of information to a professional audience. Studies were excluded if they were systematic reviews, commentaries or conceptual papers, scale-up or scale-out studies, qualitative or case studies, or descriptions of programs. To achieve aim 1, we compiled the frameworks identified in the empirical studies. To achieve aim 2, we compiled the definitions from dissemination from frameworks identified in aim 1 and from dissemination frameworks identified in a 2021 review (Tabak RG, Am J Prev Med 43:337-350, 2012). To achieve aim 3, we compile the constructs and their definitions from the frameworks.

FINDINGS

Out of 6017 studies, 89 studies were included for full-text extraction. Of these, 45 (51%) used a framework to guide the study. Across the 45 studies, 34 distinct frameworks were identified, out of which 13 (38%) defined dissemination. There is a lack of consensus on the definition of dissemination. Altogether, we identified 48 constructs, divided into 4 categories: process, determinants, strategies, and outcomes. Constructs in the frameworks are not well defined.

IMPLICATION FOR D&I RESEARCH

This study provides a critical step in the dissemination research literature by offering suggestions on how to define dissemination research and by cataloging and defining dissemination constructs. Strengthening these definitions and distinctions between D&I research could enhance scientific reproducibility and advance the field of dissemination research.

Selecting implementation models, theories, and frameworks in which to integrate intersectional approaches

Background

Models, theories, and frameworks (MTFs) provide the foundation for a cumulative science of implementation, reflecting a shared, evolving understanding of various facets of implementation. One under-represented aspect in implementation MTFs is how intersecting social factors and systems of power and oppression can shape implementation. There is value in enhancing how MTFs in implementation research and practice account for these intersecting factors. Given the large number of MTFs, we sought to identify exemplar MTFs that represent key implementation phases within which to embed an intersectional perspective.

Methods

We used a five-step process to prioritize MTFs for enhancement with an intersectional lens. We mapped 160 MTFs to three previously prioritized phases of the Knowledge-to-Action (KTA) framework. Next, 17 implementation researchers/practitioners, MTF experts, and intersectionality experts agreed on criteria for prioritizing MTFs within each KTA phase. The experts used a modified Delphi process to agree on an exemplar MTF for each of the three prioritized KTA framework phases. Finally, we reached consensus on the final MTFs and contacted the original MTF developers to confirm MTF versions and explore additional insights.

Results

We agreed on three criteria when prioritizing MTFs: acceptability (mean = 3.20, SD = 0.75), applicability (mean = 3.82, SD = 0.72), and usability (median = 4.00, mean = 3.89, SD = 0.31) of the MTF. The top-rated MTFs were the Iowa Model of Evidence-Based Practice to Promote Quality Care for the ‘Identify the problem’ phase (mean = 4.57, SD = 2.31), the Consolidated Framework for Implementation Research for the ‘Assess barriers/facilitators to knowledge use’ phase (mean = 5.79, SD = 1.12), and the Behaviour Change Wheel for the ‘Select, tailor, implement interventions’ phase (mean = 6.36, SD = 1.08).

Conclusions

Our interdisciplinary team engaged in a rigorous process to reach consensus on MTFs reflecting specific phases of the implementation process and prioritized each to serve as an exemplar in which to embed intersectional approaches. The resulting MTFs correspond with specific phases of the KTA framework, which itself may be useful for those seeking particular MTFs for particular KTA phases. This approach also provides a template for how other implementation MTFs could be similarly considered in the future.

Trial registration

Open Science Framework Registration: osf.io/qgh64.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01682-x.

Five Common Myths Limiting Engagement in HIV-Related Implementation Research

ABSTRACT

HIV-related implementation research holds great promise in achieving the potential of efficacious prevention and treatment tools in reducing the incidence of HIV and improving HIV treatment outcomes among people living with HIV. From the perspectives of HIV-related implementation research training and academia and through consultations with funders and investigators new to implementation research, we identified 5 myths that act as barriers to engagement in implementation research among new investigators. Prevailing myths broadly include (1) one must rigidly apply all aspects of an implementation framework for it to be valid, (2) implementation research limits the type of designs available to researchers, (3) implementation strategies cannot be patient-level or client-level approaches, (4) only studies prioritizing implementation outcomes are "true" implementation research, and (5) if not explicitly labeled implementation research, it may have limited impact on implementation. We offer pragmatic approaches to negotiate these myths with the goal of encouraging dialog, ensuring high-quality research, and fostering a more inclusive and dynamic field of implementation research. Ultimately, the goal of dispelling these myths was to lower the perceived bar to engagement in HIV-related implementation research while still ensuring quality in the methods and measures used.

Development and usability testing of tools to facilitate incorporating intersectionality in knowledge translation

Background

The field of knowledge translation (KT) has been criticized for neglecting contextual and social considerations that influence health equity. Intersectionality, a concept introduced by Black feminist scholars, emphasizes how human experience is shaped by combinations of social factors (e.g., ethnicity, gender) embedded in systemic power structures. Its use has the potential to advance equity considerations in KT. Our objective was to develop and conduct usability testing of tools to support integrating intersectionality in KT through three key phases of KT: identifying the gap; assessing barriers to knowledge use; and selecting, tailoring, and implementing interventions.

Methods

We used an integrated KT approach and assembled an interdisciplinary development committee who drafted tools. We used a mixed methods approach for usability testing with KT intervention developers that included semi-structured interviews and the System Usability Scale (SUS). We calculated an average SUS score for each tool. We coded interview data using the framework method focusing on actionable feedback. The development committee used the feedback to revise tools, which were formatted by a graphic designer.

Results

Nine people working in Canada joined the development committee. They drafted an intersectionality primer and one tool that included recommendations, activities, reflection prompts, and resources for each of the three implementation phases. Thirty-one KT intervention developers from three countries participated in usability testing. They suggested the tools to be shorter, contain more visualizations, and use less jargon. Average SUS scores of the draft tools ranged between 60 and 78/100. The development committee revised and shortened all tools, and added two, one-page summary documents. The final toolkit included six documents.

Conclusions

We developed and evaluated tools to help embed intersectionality considerations in KT. These tools go beyond recommending the use of intersectionality to providing practical guidance on how to do this. Future work should develop guidance for enhancing social justice in intersectionality-enhanced KT.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08181-1.

Collaboration Leading to Addiction Treatment and Recovery from Other Stresses (CLARO): process of adapting collaborative care for co-occurring opioid use and mental disorders

Background

Opioid use disorders (OUD), co-occurring with either depression and/or PTSD, are prevalent, burdensome, and often receive little or low-quality care. Collaborative care is a service delivery intervention that uses a team-based model to improve treatment access, quality, and outcomes in primary care patients, but has not been evaluated for co-occurring OUD and mental health disorders. To address this treatment and quality gap, we adapted collaborative care for co-occurring OUD and mental health disorders.

Methods

Our adapted model is called Collaboration Leading to Addiction Treatment and Recovery from Other Stresses (CLARO). We used the five-step Map of Adaptation Process (McKleroy in AIDS Educ Prev 18:59–73, 2006) to develop the model. For each step, our stakeholder team of research and clinical experts, primary care partners, and patients provided input into adaptation processes (e.g., adaptation team meetings, clinic partner feedback, patient interviews and beta-testing). To document each adaptation and our decision-making process, we used the Framework for Reporting Adaptations and Modifications-Enhanced (Wiltsey Stirman in Implement Sci 14:1–10, 2019).

Results

We documented 12 planned fidelity-consistent adaptations to collaborative care, including a mix of content, context, and training/evaluation modifications intended to improve fit with the patient population (co-occurring disorders) or the New Mexico setting (low-resource clinics in health professional shortage areas). Examples of documented adaptations include use of community health workers as care coordinators; an expanded consultant team to support task-shifting to community health workers; modified training protocols for Problem-Solving Therapy and Written Exposure Therapy to incorporate examples of treating patients for depression or PTSD with co-occurring OUD; and having care coordinators screen for patients’ social needs.

Conclusions

We completed the first three steps of the Map of Adaptation Process, resulting in a variety of adaptations that we believe will make collaborative care more acceptable and feasible in treating co-occurring OUD and mental health disorders. Future steps include evaluating the effectiveness of CLARO and documenting reactive and/or planned adaptations to the model that occur during its implementation and delivery.

Trial registration NCT04559893, NCT04634279. Registered 08 September 2020, https://clinicaltrials.gov/ct2/show/NCT04559893

Protocol for the IMPART study: IMplementation of the preterm birth surveillance PAthway - a RealisT evaluation

INTRODUCTION

New guidance, from NHS England (Saving Babies Lives Care Bundle Version 2 Element 5 (SBLCBv2)) has recommended a best practice pathway for women at risk of preterm birth (the Preterm Birth Pathway). This is to help meet the Department of Health's aim to reduce preterm birth from 8% to 6% by 2025. Considering most hospitals do not currently have a preterm prevention clinic, implementing this pathway will require significant coordination.

METHODS AND ANALYSIS

The study will aim to investigate key features of contexts, mechanisms and outcomes, and their interactions in the implementation of the asymptomatic prediction and prevention components of the SBLCBv2 Preterm Birth Surveillance Pathway. This will be through a theory driven realist evaluation, utilising mixed methods (interviews with staff and women, observational analysis and analysing routinely collected hospital and admin data) in three case sites in England. The study has a Project Advisory Group composed of five women who have recently given birth.

ETHICS AND DISSEMINATION

The study has ethical approval (King's College London REC approval number: MRSP-20/21-20955, and, IRAS:289144). A dissemination plan will be fully created with the Project Advisory Group, and we anticipate this will include presenting at conferences, publications, webinars, alongside dissemination to the wider population through parent and baby groups, the media and charities.

TRIAL REGISTRATION NUMBER

ISRCTN57127874.

Supporting researchers in knowledge translation and dissemination of their research to increase usability and impact

PURPOSE

One of the key areas of delivery of the 'Action Plan for Health Research 2019-2029', for the Health Service Executive (HSE) in Ireland, is adding value and using data and knowledge, including health-related quality of life (HRQoL), for improved health care, service delivery and better population health and wellbeing. The development of governance, management and support framework and mechanisms will provide a structure for ensuring research is relevant to the organisation's service plan, well designed, has a clear plan for dissemination and translation of knowledge, and minimises research waste. Developing a process for the translation, dissemination and impact of research is part of the approach to improving translation of research into practice and aligning it with knowledge gaps. A project was undertaken to develop a clear, unified, universally applicable approach for the translation, dissemination, and impact of research undertaken by HSE staff and commissioned, sponsored, or hosted by the organisation. This included the development of guidance, training, and information for researchers.

METHODS

Through an iterative process, an interdisciplinary working group of experts in knowledge translation (KT), implementation science, quality improvement and research management, identified KT frameworks and tools to form a KT, dissemination, and impact process for the HSE. This involved a literature review, screening of 247 KT theories, models, and frameworks (TMFs), review of 18 TMFs selected as usable and applicable to the HSE, selection of 11 for further review, and final review of 6 TMFs in a consensus workshop. An anonymous online survey of HSE researchers, consisting of a mixture of multiple choice and free text questions, was undertaken to inform the development of the guidance and training.

RESULTS

A pilot of the KT process and guidance, involving HSE researchers testing its use at various stages of their research, demonstrated the need to guide researchers through planning, stakeholder engagement, and disseminating research knowledge, and provide information that could easily be understood by novice as well as more experienced researchers. A survey of all active researchers across the organisation identified their support and knowledge requirements and led to the development of accompanying guidance to support researchers in the use of the process. Researchers of all levels reported that they struggled to engage with stakeholders, including evidence users and policy makers, to optimise the impact of their research. They wanted tools that would support better engagement and maximise the value of KT. As a result of the project a range of information, guidance, and training resources have been developed.

CONCLUSION

KT is a complex area and researchers need support to ensure they maximise the value of their research. The KT process outlined enables the distilling of a clear message, provides a process to engage with stakeholders, create a plan to incorporate local and political context, and can show a means to evaluate how much the findings are applied in practice. This is a beneficial application of KT in the field of patient reported outcomes. In implementing this work, we have reinforced the message that stakeholder engagement is crucial from the start of the research study and increases engagement in, and ownership of, the research knowledge.

Understanding implementation context and social processes through integrating Normalization Process Theory (NPT) and the Consolidated Framework for Implementation Research (CFIR)

BACKGROUND

For successful implementation of an innovation within a complex adaptive system, we need to understand the ways that implementation processes and their contexts shape each other. To do this, we need to explore the work people do to make sense of an innovation and integrate it into their workflow and the contextual elements that impact implementation. Combining Normalization Process Theory (NPT) with the Consolidated Framework for Implementation Research (CFIR) offers an approach to achieve this. NPT is an implementation process theory that explains how changes in the way people think about and use an innovation occurs, while CFIR is a framework that categorizes and describes contextual determinants across five domains that influence implementation. We demonstrate through a case example from our prior research how we integrated NPT and CFIR to inform the development of the interview guide, coding manual, and analysis of the findings.

METHODS

In collaboration with our stakeholders, we selected NPT and CFIR to study the implementation process and co-developed an interview guide to elicit responses that would illuminate concepts from both. We conducted, audio-recorded, and transcribed 28 interviews with various professionals involved with the implementation. Based on independent coding of select transcripts and team discussion comparing, clarifying, and crystallizing codes, we developed a coding manual integrating CFIR and NPT constructs. We applied the integrated codes to all interview transcripts.

RESULTS

Our findings highlight how integrating CFIR domains with NPT mechanisms adds explanatory strength to the analysis of implementation processes, with particular implications for practical strategies to facilitate implementation. Multiple coding across both theoretical frames captured the entanglement of process and context. Integrating NPT and CFIR enriched understandings of how interactions between implementation processes and contextual determinants shaped each other during implementation.

CONCLUSION

The integration of NPT and CFIR provides guidance to identify and explore complex entangled interactions between agents, processes, and contextual conditions within and beyond organizations to embed innovations into routine practices. Nuanced understandings gained through this approach moves understandings beyond descriptions of determinants to explain how change occurs or not during implementation. Mechanism-based explanations illuminate concrete practical strategies to support implementation.

Evaluating the Application of the RE-AIM Planning and Evaluation Framework: An Updated Systematic Review and Exploration of Pragmatic Application

Background

RE-AIM is one of the most widely applied frameworks to plan and evaluate the implementation of public health and health behavior change interventions. The objective of this review is to provide an updated synthesis of use of the RE-AIM (Reach Effectiveness Adoption Implementation and Maintenance) planning and evaluation framework and explore pragmatic use (i.e., partial application of the framework) and how this is reported.

Methods

Systematic review. MEDLINE (R) and PsycINFO were searched, via the Ovid interface, between January 2011 and December 2017. Studies that applied RE-AIM as a planning and/or evaluation framework were included.

Results

One hundred fifty-seven articles met inclusion criteria. One hundred forty-nine reported using RE-AIM for evaluation, three for planning and five for planning and evaluation. Reach was the most frequently reported dimension (92.9%), followed by implementation (90.3%), adoption (89.7%), effectiveness (84.5%), and maintenance (77.4%). One hundred forty-seven/one hundred fifty-seven articles originated from high-income economy countries. Within a sub-set analysis (10% of included articles), 9/15 articles evaluated all dimensions. Of the 6/15 articles that did not evaluate all dimensions, five provided no justification for pragmatic application.

Conclusions

RE-AIM has gained increased use in recent years and there is evidence that it is being applied pragmatically. However, the rationale for pragmatic use is often not reported.

Systematic Review Registration

PROSPERO (CRD42017054616).

Meta-review of implementation determinants for policies promoting healthy diet and physically active lifestyle: application of the Consolidated Framework for Implementation Research

BACKGROUND

Although multiple systematic reviews indicate that various determinants (barriers and facilitators) occur in the implementation processes of policies promoting healthy diet, physical activity (PA), and sedentary behavior (SB) reduction, the overarching synthesis of such reviews is missing. Applying the Consolidated Framework for Implementation Research (CFIR), this meta-review aims to (1) identify determinants that were systematically indicated as occurring during the implementation processes and (2) identify differences in the presence of determinants across reviews versus stakeholder documents on healthy diet/PA/SB policies, reviews/stakeholder documents addressing healthy diet policies versus PA/SB policies targeting any population/setting, and healthy diet/PA/SB policies focusing on school settings.

METHODS

A meta-review of published systematic scoping or realist reviews (k = 25) and stakeholder documents (k = 17) was conducted. Data from nine bibliographic databases and documentation of nine major stakeholders were systematically searched. Included reviews (72%) and stakeholder documents (100%) provided qualitative synthesis of original research on implementation determinants of policies promoting healthy diet or PA or SB reduction, and 28% of reviews provided some quantitative synthesis. Determinants were considered strongly supported if they were indicated by ≥ 60.0% of included reviews/stakeholder documents.

RESULTS

Across the 26 CFIR-based implementation determinants, seven were supported by 66.7-76.2% of reviews/stakeholder documents. These determinants were cost, networking with other organizations/communities, external policies, structural characteristics of the setting, implementation climate, readiness for implementation, and knowledge/beliefs of involved individuals. Most frequently, published reviews provided support for inner setting and individual determinants, whereas stakeholder documents supported outer and inner setting implementation determinants. Comparisons between policies promoting healthy diet with PA/SB policies revealed shared support for only three implementation determinants: cost, implementation climate, and knowledge/beliefs. In the case of healthy diet/PA/SB policies targeting school settings, 14 out of 26 implementation determinants were strongly supported.

CONCLUSIONS

The strongly supported (i.e., systematically indicated) determinants may guide policymakers and researchers who need to prioritize potential implementation determinants when planning and monitoring the implementation of respective policies. Future research should quantitatively assess the importance or role of determinants and test investigate associations between determinants and progress of implementation processes.

TRIAL REGISTRATION

PROSPERO, # CRD42019133341.

Implementation strategies and outcomes for occupational therapy in adult stroke rehabilitation: a scoping review

BACKGROUND

Stroke survivors often encounter occupational therapy practitioners in rehabilitation practice settings. Occupational therapy researchers have recently begun to examine the implementation strategies that promote the use of evidence-based occupational therapy practices in stroke rehabilitation; however, the heterogeneity in how occupational therapy research is reported has led to confusion about the types of implementation strategies used in occupational therapy and their association with implementation outcomes. This review presents these strategies and corresponding outcomes using uniform language and identifies the extent to which strategy selection has been guided by theories, models, and frameworks (TMFs).

METHODS

A scoping review protocol was developed to assess the breadth and depth of occupational therapy literature examining implementation strategies, outcomes, and TMFs in the stroke rehabilitation field. Five electronic databases and two peer-reviewed implementation science journals were searched to identify studies meeting the inclusion criteria. Two reviewers applied the inclusion parameters and consulted with a third reviewer to achieve consensus. The 73-item Expert Recommendations for Implementing Change (ERIC) implementation strategy taxonomy guided the synthesis of implementation strategies. The Implementation Outcomes Framework guided the analysis of measured outcomes.

RESULTS

The initial search yielded 1219 studies, and 26 were included in the final review. A total of 48 out of 73 discrete implementation strategies were described in the included studies. The most used implementation strategies were "distribute educational materials" (n = 11), "assess for readiness and identify barriers and facilitators" (n = 11), and "conduct educational outreach visits" (n = 10). "Adoption" was the most frequently measured implementation outcome, while "cost" was not measured in any included studies. Eleven studies reported findings supporting the effectiveness of their implementation strategy or strategies; eleven reported inconclusive findings, and four found that their strategies did not lead to improved implementation outcomes. In twelve studies, at least partially beneficial outcomes were reported, corresponding with researchers using TMFs to guide implementation strategies.

CONCLUSIONS

This scoping review synthesized implementation strategies and outcomes that have been examined in occupational therapy and stroke rehabilitation. With the growth of the stroke survivor population, the occupational therapy profession must identify effective strategies that promote the use of evidence-based practices in routine stroke care and describe those strategies, as well as associated outcomes, using uniform nomenclature. Doing so could advance the occupational therapy field's ability to draw conclusions about effective implementation strategies across diverse practice settings.

How well do critical care audit and feedback interventions adhere to best practice? Development and application of the REFLECT-52 evaluation tool

BACKGROUND

Healthcare Audit and Feedback (A&F) interventions have been shown to be an effective means of changing healthcare professional behavior, but work is required to optimize them, as evidence suggests that A&F interventions are not improving over time. Recent published guidance has suggested an initial set of best practices that may help to increase intervention effectiveness, which focus on the "Nature of the desired action," "Nature of the data available for feedback," "Feedback display," and "Delivering the feedback intervention." We aimed to develop a generalizable evaluation tool that can be used to assess whether A&F interventions conform to these suggestions for best practice and conducted initial testing of the tool through application to a sample of critical care A&F interventions.

METHODS

We used a consensus-based approach to develop an evaluation tool from published guidance and subsequently applied the tool to conduct a secondary analysis of A&F interventions. To start, the 15 suggestions for improved feedback interventions published by Brehaut et al. were deconstructed into rateable items. Items were developed through iterative consensus meetings among researchers. These items were then piloted on 12 A&F studies (two reviewers met for consensus each time after independently applying the tool to four A&F intervention studies). After each consensus meeting, items were modified to improve clarity and specificity, and to help increase the reliability between coders. We then assessed the conformity to best practices of 17 critical care A&F interventions, sourced from a systematic review of A&F interventions on provider ordering of laboratory tests and transfusions in the critical care setting. Data for each criteria item was extracted by one coder and confirmed by a second; results were then aggregated and presented graphically or in a table and described narratively.

RESULTS

In total, 52 criteria items were developed (38 ratable items and 14 descriptive items). Eight studies targeted lab test ordering behaviors, and 10 studies targeted blood transfusion ordering. Items focused on specifying the "Nature of the Desired Action" were adhered to most commonly-feedback was often presented in the context of an external priority (13/17), showed or described a discrepancy in performance (14/17), and in all cases it was reasonable for the recipients to be responsible for the change in behavior (17/17). Items focused on the "Nature of the Data Available for Feedback" were adhered to less often-only some interventions provided individual (5/17) or patient-level data (5/17), and few included aspirational comparators (2/17), or justifications for specificity of feedback (4/17), choice of comparator (0/9) or the interval between reports (3/13). Items focused on the "Nature of the Feedback Display" were reported poorly-just under half of interventions reported providing feedback in more than one way (8/17) and interventions rarely included pilot-testing of the feedback (1/17 unclear) or presentation of a visual display and summary message in close proximity of each other (1/13). Items focused on "Delivering the Feedback Intervention" were also poorly reported-feedback rarely reported use of barrier/enabler assessments (0/17), involved target members in the development of the feedback (0/17), or involved explicit design to be received and discussed in a social context (3/17); however, most interventions clearly indicated who was providing the feedback (11/17), involved a facilitator (8/12) or involved engaging in self-assessment around the target behavior prior to receipt of feedback (12/17).

CONCLUSIONS

Many of the theory-informed best practice items were not consistently applied in critical care and can suggest clear ways to improve interventions. Standardized reporting of detailed intervention descriptions and feedback templates may also help to further advance research in this field. The 52-item tool can serve as a basis for reliably assessing concordance with best practice guidance in existing A&F interventions trialed in other healthcare settings, and could be used to inform future A&F intervention development.

TRIAL REGISTRATION

Not applicable.

Leveraging knowledge translation and implementation science in the pursuit of evidence informed health professions education

Evidence informed approaches to health professions education can ensure accountability to learners and society in providing meaningful and effective education and helping resource strained systems via streamlined and cost-efficient practices. Knowledge translation and implementation science are two areas of study originally developed in clinical medicine in response to concerns that health care practices were incongruent with the scientific evidence. Two decades of research have led to important advances in our understanding of the nature and magnitude of research-practice gaps, the factors that support or impede adoption of evidence in clinical decision-making, and in the design and evaluation of theory driven interventions to reduce gaps. This paper borrows concepts from knowledge translation and implementation science to further our thinking about how health professions education can 'truly' be evidence informed. The article is organised in four sections: a discussion of the impetus for the evidence informed health professions education movement; a description of the origins of knowledge translation and implementation science; a discussion on how knowledge translation and implementation science can be leveraged to advance the evidence informed health professions education agenda; and suggestions for future discussion and research. An example is used to illustrate the application of the underpinning principles of knowledge translation and implementation science. The authors suggest a theory driven, staged and systematic approach that integrates knowledge translation principles and processes and involves key stakeholders interested in promoting the application of educational research of evidence.