Enabling the implementation of evidence based practice: a conceptual framework

Too much theory and not enough practice? The challenge of implementation science application in healthcare practice

BACKGROUND

Implementation science (IS) should contribute to maintaining high standards of care across healthcare systems and enhancing care practices. However, despite the evident need for greater and more rapid uptake and integration of evidence in practice, IS design and methodology fall short of the needs of effective translation.

AIM

In this paper we examine what it is about IS that makes it so appealing for effective uptake of interventions in routine practice, and yet so difficult to achieve. We propose a number of ways that implementation scientists could build mutual relationships with healthcare practitioners and other stakeholders including public members to ensure greater shared care practices, and highlight the value of IS training, collaborative educational events, and co-designed research.

DISCUSSION

More consideration should be given to IS applications in healthcare contexts. Implementation scientists can make a valuable contribution by mobilizing theory and improving practice. However, goals for an evidence-based system may be more appropriately achieved through greater outreach and collaboration, with methods that are flexible to support rapid implementation in complex adaptive systems. Collective learning and mutual trust can be cultivated by embedding researchers into healthcare services while offering greater opportunities for practitioners to learn about, and engage in, implementation research.

CONCLUSION

To bridge the worlds of healthcare practice and IS, researchers could be more consistent in the relationships they build with professionals and the public, communicating through a shared language and co-joining practical approaches to effective implementation. This will build capacity for improved collaboration and foster respectful, interdisciplinary relationships.

Reporting unit context data to stakeholders in long-term care: a practical approach

Background

The importance of reporting research evidence to stakeholders in ways that balance complexity and usability is well-documented. However, guidance for how to accomplish this is less clear. We describe a method of developing and visualising dimension-specific scores for organisational context (context rank method). We explore perspectives of leaders in long-term care nursing homes (NHs) on two methods for reporting organisational context data: context rank method and our traditionally presented binary method—more/less favourable context.

Methods

We used a multimethod design. First, we used survey data from 4065 healthcare aides on 290 care units from 91 NHs to calculate quartiles for each of the 10 Alberta Context Tool (ACT) dimension scores, aggregated at the care unit level based on the overall sample distribution of these scores. This ordinal variable was then summed across ACT scores. Context rank scores were assessed for associations with outcomes for NH staff and for quality of care (healthcare aides’ instrumental and conceptual research use, job satisfaction, rushed care, care left undone) using regression analyses. Second, we used a qualitative descriptive approach to elicit NH leaders’ perspectives on whether the methods were understandable, meaningful, relevant, and useful. With 16 leaders, we conducted focus groups between December 2017 and June 2018: one in Nova Scotia, one in Prince Edward Island, and one in Ontario, Canada. Data were analysed using content analysis.

Results

Composite scores generated using the context rank method had positive associations with healthcare aides’ instrumental research use (p < .0067) and conceptual research use and job satisfaction (p < .0001). Associations were negative between context rank summary scores and rushed care and care left undone (p < .0001). Overall, leaders indicated that data presented by both methods had value. They liked the binary method as a starting point but appreciated the greater level of detail in the context rank method.

Conclusions

We recommend careful selection of either the binary or context rank method based on purpose and audience. If a simple, high-level overview is the goal, the binary method has value. If improvement is the goal, the context rank method will give leaders more actionable details.

Implementing a complex hospital innovation: conceptual underpinnings, program design and implementation of a complex innovation in an international multi-site hospital trial

Background

Designing implementation programs that effectively integrate complex healthcare innovations into complex settings is a fundamental aspect of knowledge translation. We describe the development of a conceptually grounded implementation program for a complex healthcare innovation and its subsequent application in pediatric hospital settings.

Methods

We conducted multiple case observations of the application of the Phased Reciprocal Implementation Synergy Model (PRISM) framework in the design and operationalization of an implementation program for a complex hospital wide innovation in pediatric hospital settings.

Results

PRISM informed the design and delivery of 10 international hospital wide implementations of the complex innovation, BedsidePEWS. Implementation and innovation specific goals, overarching implementation program design principles, and a phased-based, customizable, and context responsive implementation program including innovation specific tools and evaluation plans emerged from the experience.

Conclusion

Theoretically grounded implementation approaches customized for organizational contexts are feasible for the adoption and integration of this complex hospital-wide innovation. Attention to the fitting of the innovation to local practices, setting, organizational culture and end-user preferences can be achieved while maintaining the integrity of the innovation.

The clinical value and cost-effectiveness of treatments for patients with coronary artery disease

BACKGROUND

The clinical value and cost-effectiveness of invasive treatments for patients with coronary artery disease is unclear. Invasive treatments such as coronary artery bypass grafting and percutaneous coronary intervention are frequently used as a starting treatment, yet they are much more costly than optimal medical therapy. While patients may transition into other treatments over time, the choices of starting treatments are likely important determinants of costs and health outcomes. The aim is to predict by how much costs and health outcomes will change from a decision to use different starting treatments for patients with coronary artery disease in an Asian setting.

METHODS

A cost-effectiveness study using a Markov model informed by data from Singapore General Hospital was done. All patients with initial presentations of stable coronary disease and no acute coronary syndromes who received medical treatments and interventional therapies were included. We compare existing practice, where the starting treatment can be medical therapy or stent percutaneous coronary interventions or coronary artery bypass grafting, with alternate starting treatment strategies.

RESULTS

When compared to 'existing practice' a policy of starting 14% of patients with coronary artery bypass grafting and 86% with optimal medical therapy showed savings of $1,743 per patient and 0.23 additional quality adjusted life years. A change to policy nationwide would save $10 million and generate 1,380 quality adjusted life years.

CONCLUSIONS

Increasing coronary artery bypass grafting and use of medical therapy in the setting of coronary artery disease is likely to saves costs and improve health outcomes. A definitive study to address the question we investigate would be very difficult to undertake and so using existing data to model the expected outcomes is a useful tool. There are likely to be large and complex barriers to the implementation of any policy change based on the findings of this study.

Exploring ways to enhance pain management for older people with dementia in acute care settings using a Participatory Action Research approach

BACKGROUND

Dementia is a progressive condition that leads to reduced cognition, deteriorating communication and is a risk factor for other acute and chronic health problems. The rise in the prevalence of dementia means untreated pain is becoming increasingly common with healthcare staff being challenged to provide optimal pain management. This negatively impacts the person living with dementia and their carers. There is minimal evidence that explores the pain management experience of patients as they move through acute care settings.

OBJECTIVE

To understand the complexities of managing the pain of older people with dementia as they progress through acute care settings, with the view of assisting staff to improve practice.

METHOD

A Participatory Action Research approach, guided by the Promoting Action Research in Health Services framework, was used. Three Action Cycles were completed comprising of an exploratory audit and two case studies (Action Cycle One), three focus groups with a total of 14 participants (Action Cycle Two) and the development and implementation of immediate and long-term actions (Action Cycle Three).

RESULTS

Thematic analysis identified four themes that affected pain management practices. These were not knowing the patient; balancing competing priorities; knowledge and understanding of pain and dementia and not assimilating available information.

CONCLUSION

Pain management practices for patient living with dementia, across acute care settings, was influenced by shared ways of thinking and working. Not knowing the patient, fragmentation of information and having insufficient knowledge of the subtleties of dementia led participants to deliver task-focused, target and policy-driven care that was not person-centred in its approach. Facilitated reflection enabled acute care teams to actively participate in identifying problems and finding solutions to enhance practice.

Prioritising Responses Of Nurses To deteriorating patient Observations (PRONTO): a pragmatic cluster randomised controlled trial evaluating the effectiveness of a facilitation intervention on recognition and response to clinical deterioration

BACKGROUND

Most hospitals use physiological signs to trigger an urgent clinical review. We investigated whether facilitation could improve nurses' vital sign measurement, interpretation, treatment and escalation of care for deteriorating patients.

METHODS

In a pragmatic cluster randomised controlled trial, we randomised 36 inpatient wards at four acute hospitals to receive standard clinical practice guideline (CPG) dissemination to ward staff (n=18) or facilitated implementation for 6 months following standard dissemination (n=18). Expert, hospital and ward facilitators tailored facilitation techniques to promote nurses' CPG adherence. Patient records were audited pre-intervention, 6 and 12 months post-intervention on randomly selected days. Escalation of care as per hospital policy was the primary outcome at 6 and 12 months after implementation. Patients, nurses and assessors were blinded to group assignment. Analysis was by intention-to-treat.

RESULTS

From 10 383 audits, improved escalation as per hospital policy was evident in the intervention group at 6 months (OR 1.47, 95% CI (1.06 to 2.04)) with a complete set of vital sign measurements sustained at 12 months (OR 1.22, 95% CI (1.02 to 1.47)). There were no significant differences in escalation of care as per hospital policy between study groups at 6 or 12 months post-intervention. After adjusting for patient and hospital characteristics, a significant change from T0 in mean length of stay between groups at 12 months favoured the intervention group (-2.18 days, 95% CI (-3.53 to -0.82)).

CONCLUSION

Multi-level facilitation significantly improved escalation as per hospital policy at 6 months in the intervention group that was not sustained at 12 months. The intervention group had increased vital sign measurement by nurses, as well as shorter lengths of stay for patients at 12 months. Further research is required to understand the dose of facilitation required to impact clinical practice behaviours and patient outcomes.

TRIAL REGISTRATION NUMBER

ACTRN12616000544471p.

Optimising the Conceptualisation of Context Comment on "Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-country Analysis"

Context matters. Therefore, efforts to develop greater conceptual clarity are important for science and practice. In this commentary, we outline some key issues that were prompted by Squire's et al.'s contribution. Specifically, we reinforce context as an interactive concept and therefore something that is hard to 'pin down', the problematic nature of conceptualising context in implementation and de-implementation, and a requirement for the development of culturally sensitive understandings. Finally, we suggest it is vital that continued investment into providing a more comprehensive list of determinants needs to be accompanied by an equal effort in developing practical methods and tools to support use and application.

Implementation of recommendations in rheumatic and musculoskeletal diseases: considerations for development and uptake

A clinical guideline is a document with the aim of guiding decisions based on evidence regarding diagnosis, management and treatment in specific areas of healthcare. Specific to rheumatic and musculoskeletal diseases (RMDs), adherence to clinical guidelines recommendations impacts the outcomes of people with these diseases. However, currently, the implementation of recommendations is less than optimal in rheumatology.The WHO has described the implementation of evidence-based recommendations as one of the greatest challenges facing the global health community and has identified the importance of scaling up these recommendations. But closing the evidence-to-practice gap is often complex, time-consuming and difficult. In this context, the implementation science offers a framework to overcome this scenario.This article describes the principles of implementation science to facilitate and optimise the implementation of clinical recommendations in RMDs. Embedding implementation science methods and techniques into recommendation development and daily practice can help maximise the likelihood that implementation is successful in improving the quality of healthcare and healthcare services.

Improving the Physical Health of Psychiatric Hospital Residents: An Evaluation of an Obesity Education Program for Mental Health Professionals

Background: People living with mental health disorders are at increased risk for developing obesity due to poor diet, physical inactivity, and antipsychotic medications. In the United States, the obesity rate is 36% in the general population and more than 50% for people living with mental health disorders. Although mental health clinicians concentrate on managing psychiatric disorders, they seldom recognize the gradual increase in body mass index of their patients. The result is a disconnection between the clinical management of psychiatric disorders and the medical management of obesity. Purpose: This study assessed the effectiveness of an evidence-based education program for improving the obesity management practices of mental health clinicians caring for residents at a state psychiatric hospital. Methods: This was a quasi-experimental study design with a pretest and posttest evaluation. Convenience sampling was used to recruit mental health professionals, or clinicians, at a large psychiatric hospital in the Southern region of the United States. Data was collected with the Advising and Treating Overweight and Obese Patient questionnaire (17 items). Data analysis included descriptive and inferential statistics. The findings were reported in accordance with the TREND and GREET guidelines. Results: The education program was completed by 50 MHCs. The pretest indicated that 76% of MHCs were not involved in helping obese residents manage their weight, but the posttest indicated 90% were involved. There was a significant increase in MHC knowledge about obesity management and reported actions 90-days after the program. MHCs were unable to arrange follow-up visits for residents, a task not directly within their control. Conclusions: Mental health clinicians reported increased knowledge and improved clinical practice after an education program. Because the outcomes were reported at 90-days after the program, further research needs to evaluate the longitudinal impact of this type of program, where the reported behaviors are correlated to process and clinical outcome measures for obesity.

The Influence of Context on Implementation and Improvement: Protocol for a Mixed Methods, Secondary Analyses Study

Background

Caring for the well-being of older adults is one of the greatest challenges in modern societies. Improving the quality of care and life for older adults and the work lives of their care providers calls for effective knowledge translation of evidence-based best practices.

Objective

This study’s purpose is to contribute to knowledge translation by better understanding the roles of organizational context (workplace environment) and facilitation (process or role) in implementation and improvement success. Our study has 2 goals: (1) to advance knowledge translation science by further developing and testing the Promoting Action on Research Implementation in Health Services framework (which outlines how implementation relies on the interplay of context, facilitation, and evidence) and (2) to advance research by optimizing implementation success via tailoring of modifiable elements of organizational context and facilitation.

Methods

This is secondary analyses of 15 years of longitudinal data from the Translating Research in Elder Care (TREC) program’s multiple data sources. This research is ongoing in long-term care (LTC) homes in western Canada. TREC data include the following: 5 waves of survey collection, 2 clinical trials, and regular ongoing outcome data for LTC residents. We will use a sequential exploratory and confirmatory mixed methods design. We will analyze qualitative and quantitative data holdings in an iterative process: (1) comprehensive reanalysis of qualitative data to derive hypotheses, (2) quantitative modeling to test hypotheses, and (3) action cycles to further refine and integrate qualitative and quantitative analyses. The research team includes 4 stakeholder panels: (1) system decision- and policy makers, (2) care home managers, (3) direct care staff, and (4) a citizen engagement group of people living with dementia and family members of LTC residents. A fifth group is our panel of external scientific advisors. Each panel will engage periodically, providing their perspectives on project direction and findings.

Results

This study is funded by the Canadian Institutes of Health Research. Ethics approval was obtained from the University of Alberta (Pro00096541). The results of the secondary analyses are expected by the end of 2023.

Conclusions

The project will advance knowledge translation science by deepening our understanding of the roles of context, the interactions between context and facilitation, and their influence on resident and staff quality outcomes. Importantly, findings will inform understanding of the mechanisms by which context and facilitation affect the success of implementation and offer insights into factors that influence the implementation success of interventions in nursing homes.

International Registered Report Identifier (IRRID)

DERR1-10.2196/40611

Development of a qualitative data analysis codebook informed by the i-PARIHS framework

Background

The Integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework and its predecessor, PARIHS, have been widely utilized in implementation studies. Although i-PARIHS developers have focused on creating tools to guide facilitators in its application in practice, tools are also needed for evaluation and research. Codebooks with clear and meaningful code labels and definitions are an important component of qualitative data analysis and have been developed for other widely used frameworks. There is no such codebook for i-PARIHS. Additionally, sub-constructs for the Innovation, Recipients, and Context constructs lack definitions, and there is no sub-classification of facilitation activities for the Facilitation construct. The lack of a standardized codebook hinders our ability to synthesize research findings across studies, explore and test the range of activities that are utilized in facilitation efforts, and potentially validate and further refine i-PARIHS. This paper describes a rigorous process of developing a detailed qualitative codebook informed by the i-PARIHS framework.

Methods

A workgroup of qualitative researchers conducted a rigorous four-phase process to develop a codebook informed by i-PARIHS. In phase 1, workgroup members reviewed and discussed literature, consulted an organizational scientist, and drafted and refined subcodes and definitions for i-PARIHS constructs. In phase 2, they obtained feedback from an expert panel and further refined subcodes and definitions. In phase 3, they obtained feedback from i-PARIHS developers/experts and incorporated it into the codebook. Finally, two studies piloted the application of the codebook which informed the final version.

Results

The resulting i-PARIHS-informed codebook includes definitions for the four main constructs of the framework: Innovation, Recipients, Context, and Facilitation; subcodes and definitions for characteristics of each of these constructs; and instructions for the suggested application of individual codes and use of the codebook generally.

Conclusions

The standardized codes and definitions in the codebook can facilitate data exploration, pattern identification, and insight development informed by the i-PARIHS framework. Qualitative analysts can also use them to explore interactions between i-PARIHS constructs, maximize the potential for comparing findings across studies, and support the refinement of the i-PARIHS framework using empirical findings from multiple studies.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00344-9.

Implementing surgical mentorship in a resource-constrained context: a mixed methods assessment of the experiences of mentees, mentors, and leaders, and lessons learned

BACKGROUND

A well-qualified workforce is critical to effective functioning of health systems and populations; however, skill gaps present a challenge in low-resource settings. While an emerging body of evidence suggests that mentorship can improve quality, access, and systems in African health settings by building the capacity of health providers, less is known about its implementation in surgery. We studied a novel surgical mentorship intervention as part of a safe surgery intervention (Safe Surgery 2020) in five rural Ethiopian facilities to understand factors affecting implementation of surgical mentorship in resource-constrained settings.

METHODS

We designed a convergent mixed-methods study to understand the experiences of mentees, mentors, hospital leaders, and external stakeholders with the mentorship intervention. Quantitative data was collected through a survey (n = 25) and qualitative data through in-depth interviews (n = 26) in 2018 to gather information on (1) intervention characteristics including areas of mentorship, mentee-mentor relationships, and mentor characteristics, (2) organizational context including facilitators and barriers to implementation, (3) perceived impact, and (4) respondent characteristics. We analyzed the quantitative and qualitative data using frequency analysis and the constant comparison method, respectively; we integrated findings to identify themes.

RESULTS

All mentees (100%) experienced the intervention as positive. Participants perceived impact as: safer and more frequent surgical procedures, collegial bonds between mentees and mentors, empowerment among mentees, and a culture of continuous learning. Over 70% of all mentees reported their confidence and job satisfaction increased. Supportive intervention characteristics included a systems focus, psychologically safe mentee-mentor relationships, and mentor characteristics including generosity with time and knowledge, understanding of local context, and interpersonal skills. Supportive organizational context included a receptive implementation climate. Intervention challenges included insufficient clinical training, inadequate mentor support, and inadequate dose. Organizational context challenges included resource constraints and a lack of common understanding of the intervention.

CONCLUSION

We offer lessons for intervention designers, policy makers, and practitioners about optimizing surgical mentorship interventions in resource-constrained settings. We attribute the intervention's success to its holistic approach, a receptive climate, and effective mentee-mentor relationships. These qualities, along with policy support and adapting the intervention through user feedback are important for successful implementation.

Role of Local Evidence in Transferring Evidence-Based Interventions to Low- and Middle-Income Country Settings: Application to Global Cancer Prevention and Control

PURPOSE

Although the global burden of cancer falls increasingly on low- and middle-income countries (LMICs), much of the evidence for cancer prevention and control comes from high-income countries and may not be directly applicable to LMIC settings. In this paper, we focus on the following question: When the majority of the evidence supporting an evidence-based intervention or implementation strategy comes from high-income countries, what local, contextual evidence is needed when transferring and adapting an intervention or strategy to a specific LMIC setting?

METHODS

We draw on an existing framework (the Population, Intervention, Environment, Transfer-T process model) for assessing transferability of interventions between distinct settings and apply the model to two case studies as learning examples involving implementation of tobacco use treatment guidelines and self sampling for human papillomavirus DNA in cervical cancer screening.

RESULTS

These two case studies illustrate how researchers, policymakers, practitioners, and consumers may approach the need for local evidence from different perspectives and with different priorities. As uses and expectations around local evidence may be different for different groups, aligning these priorities through multistakeholder engagement in which all parties participate in defining the questions and cocreating the solutions is critical, along with promoting standardized reporting of contextual factors.

CONCLUSION

Local, contextual evidence can be important for both researchers and practitioners, and its absence may hinder translation of research and implementation efforts across different settings. However, it is essential for researchers, practitioners, and other stakeholders to be able to clearly articulate the type of data needed and why it is important. In particular, where resources are limited, evidence generation should be prioritized to address real needs and gaps in knowledge.

Facilitation as a component of evidence implementation: a multinational perspective

BACKGROUND

Facilitation is a key component of JBI's approach to evidence implementation along with context analysis and evaluation of process and outcomes. Although the role of facilitation is recognized as a critical component of evidence implementation, what constitutes effective facilitation is poorly understood.

AIM

This article presents a descriptive exploration of facilitation as it occurs in evidence implementation initiatives conducted in various healthcare and geographical contexts. All projects used the JBI approach to evidence implementation.

METHODS

To provide a multinational perspective on how facilitation was operationalized to promote positive changes in clinical practice and health outcomes, five case studies of evidence implementation projects are presented.

RESULTS

The cases highlighted that facilitation is a multifaceted process that can be met through a variety of roles that address aspects of education and capacity building, partnerships, action planning, problem solving and evaluation. Facilitation in all cases appeared to be collaborative, with multiple 'players' within and outside of the health organization being involved in the process. Although there are similarities in activities, facilitation involved some level of local contextualization where there were unique or additional activities performed to accommodate the local needs and requirements of the health organization involved in each case. Numerous contextual factors influenced the success of the implementation initiative.

CONCLUSION

The cases emphasized the complex nature of facilitation as a strategy for evidence implementation, indicating that contextual attributes and features define the range of knowledge, skills, and activities that should take place in order for facilitation to be effective. Although there appears to be some core components, tailoring and adaptation of the facilitation process (or roles) is required.

Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-Country Analysis

BACKGROUND

Context is recognized as important to successful knowledge translation (KT) in health settings. What is meant by context, however, is poorly understood. The purpose of the current study was to elicit tacit knowledge about what is perceived to constitute context by conducting interviews with a variety of health system stakeholders internationally so as to compile a comprehensive list of contextual attributes and their features relevant to KT in healthcare.

METHODS

A descriptive qualitative study design was used. Semi-structured interviews were conducted with health system stakeholders (change agents/KT specialists and KT researchers) in four countries: Australia, Canada, the United Kingdom, and the United States. Interview transcripts were analyzed using inductive thematic content analysis in four steps: (1) selection of utterances describing context, (2) coding of features of context, (3) categorizing of features into attributes of context, (4) comparison of attributes and features by: country, KT experience, and role.

RESULTS

A total of 39 interviews were conducted. We identified 66 unique features of context, categorized into 16 attributes. One attribute, Facility Characteristics, was not represented in previously published KT frameworks. We found instances of all 16 attributes in the interviews irrespective of country, level of experience with KT, and primary role (change agent/KT specialist vs. KT researcher), revealing robustness and transferability of the attributes identified. We also identified 30 new context features (across 13 of the 16 attributes).

CONCLUSION

The findings from this study represent an important advancement in the KT field; we provide much needed conceptual clarity in context, which is essential to the development of common assessment tools to measure context to determine which context attributes and features are more or less important in different contexts for improving KT success.

How and Why Context Matters: A Personal Reflection Comment on "Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-Country Analysis"

This commentary acknowledges that the evidence-based practice (EBP) movement did not automatically or initially understand the impact of context on successful implementation (SI). The subsequent work of research teams, such as the PARIHS (Promoting Action on Research in Health Services) team, and the Ottawa team led by Squires, have contributed to the ongoing refinement of the concept. However, still under discussion is whether having a more comprehensive set of contextual attributes will necessarily lead to more implementation success. Just as the strength of the evidence does not automatically lead to implementation success, so having a comprehensive understanding of contextual factors will not necessarily improve implementation uptake.

The Extent Hospital Organizational Factors Influence Inpatient Care Delivery: A Case Study Looking at Knee and Hip Replacement Surgery

There is a body of Implementation and Dissemination research describing the importance of “context”—the characteristics describing the setting where a process or innovation occurs—when evaluating delivery, outcomes and cost of health services. These contextual factors, which can occur at the system, organization, or provider level, may either facilitate or erect barriers to the utilization of evidence-based practices and the outcomes achieved. This paper examines the influence of organizational structure and operating environment characteristics of where inpatient health care is delivered, controlling for patient and provider characteristics, on health services delivery and outcomes achieved. We used inpatient cost-of-care to represent the bundle of services provided to patients receiving primary knee and hip replacement procedures. Data includes patient level data from discharge records for 62 140 knee replacements and 42 392 hip replacements from the 2015 AHRQ Healthcare Cost and Utilization Project State Inpatient Discharge database and hospital characteristics from the 2015 American Hospital Association survey. Multi-level linear estimation models controlling for patient and payer characteristics were employed to assess the impact of specific organizational and operating environment factors. We found that although patient and payer characteristics significantly impacted the inpatient cost of care, there is significant variation between hospitals and among physicians within a hospital beyond what can be explained by patient, payer and local price effect characteristics. Organizational and physician characteristics that had the most significant impact on cost of care included the volume of services provided, urban location, and for-profit ownership. These factors can inform future policy and program design and evaluation.

Challenges to implementing artificial intelligence in healthcare: a qualitative interview study with healthcare leaders in Sweden

BACKGROUND

Artificial intelligence (AI) for healthcare presents potential solutions to some of the challenges faced by health systems around the world. However, it is well established in implementation and innovation research that novel technologies are often resisted by healthcare leaders, which contributes to their slow and variable uptake. Although research on various stakeholders' perspectives on AI implementation has been undertaken, very few studies have investigated leaders' perspectives on the issue of AI implementation in healthcare. It is essential to understand the perspectives of healthcare leaders, because they have a key role in the implementation process of new technologies in healthcare. The aim of this study was to explore challenges perceived by leaders in a regional Swedish healthcare setting concerning the implementation of AI in healthcare.

METHODS

The study takes an explorative qualitative approach. Individual, semi-structured interviews were conducted from October 2020 to May 2021 with 26 healthcare leaders. The analysis was performed using qualitative content analysis, with an inductive approach.

RESULTS

The analysis yielded three categories, representing three types of challenge perceived to be linked with the implementation of AI in healthcare: 1) Conditions external to the healthcare system; 2) Capacity for strategic change management; 3) Transformation of healthcare professions and healthcare practice.

CONCLUSIONS

In conclusion, healthcare leaders highlighted several implementation challenges in relation to AI within and beyond the healthcare system in general and their organisations in particular. The challenges comprised conditions external to the healthcare system, internal capacity for strategic change management, along with transformation of healthcare professions and healthcare practice. The results point to the need to develop implementation strategies across healthcare organisations to address challenges to AI-specific capacity building. Laws and policies are needed to regulate the design and execution of effective AI implementation strategies. There is a need to invest time and resources in implementation processes, with collaboration across healthcare, county councils, and industry partnerships.

The Role of Informatics in Implementing Guidelines for Chronic Opioid Therapy Risk Assessment in Primary Care: A Narrative Review Informed by the Socio-Technical Model

Approximately 2 million Americans live with opioid use disorder (OUD), most of whom also have chronic pain. The economic burden of chronic pain and prescription opioid misuse runs into billions of dollars. Patients on prescription opioids for chronic non-cancer pain (CNCP) are at increased risk for OUD and overdose. By adhering to the Center for Disease Control and Prevention (CDC) opioid prescribing guidelines, primary care providers (PCPs) have the potential to improve patient outcomes. But numerous provider, patient, and practice-specific factors challenge adherence to guidelines in primary care. Many of the barriers may be mediated by informatics interventions, but gaps in knowledge and unmet needs exist. This narrative review examines the risk assessment and harm reduction process in a socio-technical context to highlight the gaps in knowledge and unmet needs that can be mediated through informatics intervention.

Factors That Influence the Clinical Implementation of Aerobic Exercise in Stroke Rehabilitation: A Theory-Informed Qualitative Study

OBJECTIVE

Best practice guidelines recommend that aerobic exercise (AEx) be implemented as early as possible poststroke, yet the prescription of AEx remains limited in stroke rehabilitation settings. This study used theoretical frameworks to obtain an in-depth understanding of barriers and enablers to AEx implementation in the stroke rehabilitation setting.

METHODS

A qualitative, descriptive study was conducted. Participants were recruited from 4 stroke rehabilitation settings in Ontario, Canada, that have participated in an implementation study to provide structured AEx programming as part of standard care. Six clinician focus groups (with 19 physical therapists and 5 rehabilitation assistants) and one-to-one interviews with 7 managers and 1 physician were conducted to explore barriers and enablers to AEx implementation. The Theoretical Domains Framework and Consolidated Framework for Implementation Research informed content analysis for clinician and manager perspectives, respectively.

RESULTS

Barriers specific to resource constraints and health care system pressures, combined with patient goals, led to interventions to improve function being prioritized over AEx. Successful implementation was enabled through an interprofessional approach and team engagement in the planning and implementation process. Health care providers described concerns about patient safety, but confidence and capability for implementing AEx were enabled by education, skill development, use of exercise tests, and consultation with individuals with content expertise. Participants described the development of supportive processes that enabled AEx implementation within team workflows and shared resources.

CONCLUSION

Strategies to support implementation of AEx in stroke rehabilitation should incorporate knowledge and skills, the provision of clinical decision-making tools, access to expert consultation, the roles and social influence of the interprofessional team and formal and informal leaders, and supportive processes adapted to the local context.

IMPACT

Results from this study will inform the development of a clinical implementation toolkit to support clinical uptake of AEx in the stroke rehabilitation setting.

Understanding Variation in Adoption of Video Telehealth and Implications for Health Care Systems

BACKGROUND

Telehealth has rapidly expanded since COVID-19. Veterans Health Administration (VHA), the largest integrated health care system in the United States, was well-positioned to incorporate telehealth across specialties due to existing policies and infrastructure.

OBJECTIVES

The objective of this study is to investigate predictors of occupational therapy (OT) practitioners' adoption of video telehealth.

METHODS

This study presents data from a convenience sample of VHA occupational therapy (OT) practitioners administered pre-pandemic, in fall 2019. Survey development was guided by the Promoting Action on Research Implementation in Health Services framework, and gathered clinician attitudes, experiences, and perspectives about video telehealth to deliver OT services. Items included telehealth usage, perceived effectiveness of specific OT interventions, and perceptions about evidence. Our outcome variable denoted practitioners' level of adoption of video telehealth: telehealth users (adopters), non-users who want to use telehealth (potential adopters and reference group), and non-users who do not want to use telehealth (non-adopters). In multiple multinomial logistic regressions, we tested whether level of adoption was associated with years of VHA work experience and perceived strength of evidence.

RESULTS

Of approximately 1455 eligible practitioners, 305 VHA occupational therapy practitioners participated in the survey (21% response rate). One hundred and twenty-five (41%) reported using video telehealth, whereas 180 (59%) reported not using video telehealth. Among non-users, 107 (59%) indicated willingness to adopt telehealth whereas 73 (41%) were not willing. More VHA work experience predicted higher odds of being an adopter than a potential adopter; perceptions of stronger evidence regarding video telehealth predicted higher odds of being a potential adopter than a non-adopter.

CONCLUSION

Clinician beliefs and years of experience exerted an influence on clinicians' use or willingness to use video telehealth. Efforts to enhance adoption of video telehealth should address clinicians' beliefs regarding the innovative nature of and organizational resources necessary to foster utilization.

Implementation Science Research in Communication Sciences and Disorders: A Scoping Review

PURPOSE

The purpose of this study was to complete a scoping review of implementation science (IS) research in communication sciences and disorders (CSD) over time and to determine characteristics of IS research in CSD.

METHOD

A scoping review was conducted of PubMed and Education Resources Information Center for sources published in English that (a) included CSD practitioners, (b) addressed IS research, and (c) identified a specific evidence-based practice. Resulting sources were systematically examined for study aim, patient populations, implementation framework utilized, setting of the study, implementation strategy examined, and implementation outcome measured.

RESULTS

The majority of the 82 studies that underwent a full-text review (80.5%) were published in 2014 or later. One fourth of the studies were concept papers, and another one fourth focused on context assessment (25.6% of studies, each), 11% focused on designing implementation strategies, and 36.6% focused on testing implementation strategies. The patient population most frequently represented aphasia (21.3%), and most studies (34.4%) were conducted in inpatient medical settings. Nearly half (42.6%) of the nonconcept studies lacked an IS framework. Among implementation strategies identified, approximately one third of studies focused on education and/or training plus another strategy and one fourth focused on education and/or training alone. Implementation outcomes measured typically represented early stages of implementation.

CONCLUSIONS

This scoping review of IS research in CSD described the landscape of IS studies in CSD. IS is intersecting with CSD at a rapid rate, especially since 2014. Future IS research in CSD should adopt an implementation framework a priori and consider the broad range of implementation strategies and outcomes to support the uptake of research into typical practice settings.

Understanding how and why quality circles improve standards of practice, enhance professional development and increase psychological well-being of general practitioners: a realist synthesis

OBJECTIVES

To understand how and why participation in quality circles (QCs) improves general practitioners' (GPs) psychological well-being and the quality of their clinical practice. To provide evidence-informed and practical guidance to maintain QCs at local and policy levels.

DESIGN

A theory-driven mixed method.

SETTING

Primary healthcare.

METHOD

We collected data in four stages to develop and refine the programme theory of QCs: (1) coinquiry with Swiss and European expert stakeholders to develop a preliminary programme theory; (2) realist review with systematic searches in MEDLINE, Embase, PsycINFO and CINHAL (1980-2020) to inform the preliminary programme theory; (3) programme refinement through interviews with participants, facilitators, tutors and managers of QCs and (4) consolidation of theory through interviews with QC experts across Europe and examining existing theories.

SOURCES OF DATA

The coinquiry comprised 4 interviews and 3 focus groups with 50 European experts. From the literature search, we included 108 papers to develop the literature-based programme theory. In stage 3, we used data from 40 participants gathered in 6 interviews and 2 focus groups to refine the programme theory. In stage 4, five interviewees from different healthcare systems consolidated our programme theory.

RESULT

Requirements for successful QCs are governmental trust in GPs' abilities to deliver quality improvement, training, access to educational material and performance data, protected time and financial resources. Group dynamics strongly influence success; facilitators should ensure participants exchange knowledge and generate new concepts in a safe environment. Peer interaction promotes professional development and psychological well-being. With repetition, participants gain confidence to put their new concepts into practice.

CONCLUSION

With expert facilitation, clinical review and practice opportunities, QCs can improve the quality of standard practice, enhance professional development and increase psychological well-being in the context of adequate professional and administrative support.

PROSPERO REGISTRATION NUMBER

CRD42013004826.

Strengthening capacity in hospitals to reduce perinatal morbidity and mortality through a codesigned intervention package: protocol for a realist evaluation as part of a stepped-wedge trial of the Action Leveraging Evidence to Reduce perinatal morTality and morbidity (ALERT) in sub-Saharan Africa project

INTRODUCTION

Despite a strong evidence base for developing interventions to reduce child mortality and morbidity related to pregnancy and delivery, major knowledge-implementation gaps remain. The Action Leveraging Evidence to Reduce perinatal morTality and morbidity (ALERT) in sub-Saharan Africa project aims to overcome these gaps through strengthening the capacity of multidisciplinary teams that provide maternity care. The intervention includes competency-based midwife training, community engagement for study design, mentoring and quality improvement cycles. The realist process evaluation of ALERT aims at identifying and testing the causal pathway through which the intervention achieves its impact.

METHODS AND ANALYSIS

This realist process evaluation complements the effectiveness evaluation and the economic evaluation of the ALERT intervention. Following the realist evaluation cycle, we will first elicit the initial programme theory on the basis of the ALERT theory of change, a review of the evidence on adoption and diffusion of innovations and the perspectives of the stakeholders. Second, we will use a multiple embedded case study design to empirically test the initial programme theory in two hospitals in each of the four intervention countries. Qualitative and quantitative data will be collected, using in-depth interviews with hospital staff and mothers, observations, patient exit interviews and (hospital) document reviews. Analysis will be guided by the Intervention-Actors-Context-Mechanism-Outcome configuration heuristic. We will use thematic coding to analyse the qualitative data. The quantitative data will be analysed descriptively and integrated in the analysis using a retroductive approach. Each case study will end with a refined programme theory (in-case analysis). Third, we will carry out a cross-case comparison within and between the four countries. Comparison between study countries should enable identifying relevant context factors that influence effectiveness and implementation, leading to a mid-range theory that may inform the scaling up the intervention.

ETHICS AND DISSEMINATION

In developing this protocol, we paid specific attention to cultural sensitivity, the do no harm principle, confidentiality and non-attribution. We received ethical approval from the local and national institutional review boards in Tanzania, Uganda, Malawi, Benin, Sweden and Belgium. Written or verbal consent of respondents will be secured after explaining the purpose, potential benefits and potential harms of the study using an information sheet. The results will be disseminated through workshops with the hospital staff and national policymakers, and scientific publications and conferences.

TRIAL REGISTRATION NUMBER

PACTR202006793783148.

Acceptability, appropriateness and feasibility of the Latin American and Caribbean Code against Cancer: perceptions of decision-makers and health professionals in Argentina

Background

Cancer is an important public health problem. In Latin America and the Caribbean, there were approximately 1,500,000 new cases of cancer and 700,000 deaths due to cancer in 2020. These figures will increase by 78% by 2040 to more than 2.5 million people diagnosed with cancer each year, who will require medical attention, care and support. However, it is estimated that at least 40% of cancers could be prevented by adopting a healthier lifestyle, reducing risky behaviours and implementing recommended health interventions.

Objective

To evaluate the perceptions of health decision-makers and professionals regarding the Latin American and Caribbean Code against Cancer (CLCC) as a support tool for designing and implementing public policies for cancer prevention and control (acceptability, appropriateness and feasibility) in Argentina.

Methods

A qualitative study was conducted using individual, semi-structured interviews with health decision-makers and professionals (n = 30). The questions and thematic analysis of the information gathered have been guided by the principles of the Consolidated Framework for Implementation Research: intervention characteristics, outer setting, inner setting and characteristics of individuals.

Results

Health professionals and health decision-makers broadly accepted the proposal of the CLCC as a tool for supporting the design and implementation of public policies for cancer prevention and control, and considered it to be appropriate. Additionally, from the interviewees' perspective, factors should be ensured to guarantee the implementation of the CLCC as a viable public health policy. They also felt it was right to take the CECC as a model and to adapt its content to the specific characteristics of the Latin American population, customs, lifestyle habits, epidemiological characteristics and, in particular, the Argentinian socio-economic context. Interviewees perceived the CLCC as a health intervention whose complexity varied depending on the recommendation, although most of them were feasible. The broad consensus among the interviewees was that the development of the CLCC could yield numerous advantages in improving cancer prevention and control policy, and responding to the needs of the population. It was also considered to be an opportunity to introduce fundamental changes. With regard to the implementation of the CLCC, interviewees reported a favourable institutional climate, since they perceived that it would receive a priority equal to or greater than the ongoing prevention measures, and that it would have the commitment of the health authorities. They also felt that the implementation of the CLCC in their work environment would not be very complicated, and that the decision-makers and professionals had the necessary capacity to implement it. Finally, they felt that the implementation would be facilitated by the participation and consensus of health decision-makers at the primary care level, and negotiation with industrial and environmental sectors.

Conclusions

Our study shows that health professionals and decision-makers consider the CLCC to be highly acceptable, appropriate and feasible. This would facilitate its implementation as a tool that could enhance current cancer prevention and control policies in Argentina. The results of the study indicate the necessity for the CLCC to be adapted to the socio-economic context of Argentina, and highlight that population adherence to the CLCC recommendations will depend on complex and diverse factors, especially those involving changing unhealthy behaviours linked to cancer risk.

Translation of the geriatric emergency department intervention into other emergency departments: a post implementation evaluation of outcomes for older adults

Background

Increasing numbers of older adults with complex health deficits presenting to emergency departments has prompted the development of innovative models of care. One such model designed to reduce poor outcomes associated with acute healthcare, is the Geriatric Emergency Department Intervention. This intervention is a nurse-led, physician-championed, Emergency Department intervention that improves the health outcomes for frail older adults in the emergency department.

Methods

This quantitative cohort study aimed to evaluate the healthcare outcomes and costs associated with the implementation of the Geriatric Emergency Department Intervention (GEDI) for adults aged 70 years and over at two hospital sites that implemented the model using the integrated-Promoting Action on Research Implementation in Health Services (i-PARHIS) framework. Hospital A was large teaching hospital located in the tropical north of Australia. Hospital B was a medium sized teaching hospital near Brisbane, Queensland Australia.

The effect of the intervention was examined in two ways. Outcomes were compared between: 1) all patients in the pre- and post- implementation periods, and 2) patients seen or not seen by the Geriatric Emergency Department Intervention team in the post-implementation period. The outcomes measured were disposition (discharged home, admitted); emergency department length of stay; hospital length of stay; all cause in-hospital mortality within 28 days; time to re-presentation up to 28 days post-discharge; emergency department and in-hospital costs.

Survival analyses were used for the primary and secondary outcome variables and a Cox survival model was used to estimate the associations between variables and outcomes. Multiple regression models were used to examine other secondary outcomes whilst controlling for a range of confounders.

Results

The Geriatric Emergency Department Intervention was successfully translated into two different emergency departments. Both demonstrated an increased likelihood of discharge, decreased emergency department length of stay, decreased hospital costs for those who were admitted, with an associated reduction in risk of mortality, for adults aged 70 years and over.

Conclusions

The Geriatric Emergency Department Intervention was successfully translated into new sites that adapted the model design. Improvement in healthcare outcomes for older adults presenting to the emergency department was demonstrated, although this was more subtle than in the original model setting.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12877-022-02999-4.

Time–motion analysis of external facilitation for implementing the Collaborative Chronic Care Model in general mental health clinics: Use of an interval-based data collection approach

Background: Facilitation is an effective strategy to implement evidence-based practices, often involving external facilitators (EFs) bringing content expertise to implementation sites. Estimating time spent on multifaceted EF activities is complex. Furthermore, collecting continuous time–motion data for facilitation tasks is challenging. However, organizations need this information to allocate implementation resources to sites. Thus, our objectives were to conduct a time–motion analysis of external facilitation, and compare continuous versus noncontinuous approaches to collecting time–motion data. Methods: We analyzed EF time–motion data from six VA mental health clinics implementing the evidence-based Collaborative Chronic Care Model (CCM). We documented EF activities during pre-implementation (4–6 weeks) and implementation (12 months) phases. We collected continuous data during the pre-implementation phase, followed by data collection over a 2-week period (henceforth, “a two-week interval”) at each of three time points (beginning/middle/end) during the implementation phase. As a validity check, we assessed how closely interval data represented continuous data collected throughout implementation for two of the sites. Results: EFs spent 21.8 ± 4.5 h/site during pre-implementation off-site, then 27.5 ± 4.6 h/site site-visiting to initiate implementation. Based on the 2-week interval data, EFs spent 2.5 ± 0.8, 1.4 ± 0.6, and 1.2 ± 0.6 h/week toward the implementation’s beginning, middle, and end, respectively. Prevalent activities were preparation/planning, process monitoring, program adaptation, problem identification, and problem-solving. Across all activities, 73.6% of EF time involved email, phone, or video communication. For the two continuous data sites, computed weekly time averages toward the implementation’s beginning, middle, and end differed from the interval data’s averages by 1.0, 0.1, and 0.2 h, respectively. Activities inconsistently captured in the interval data included irregular assessment, stakeholder engagement, and network development. Conclusions: Time–motion analysis of CCM implementation showed initial higher-intensity EF involvement that tapered. The 2-week interval data collection approach, if accounting for its potential underestimation of irregular activities, may be promising/efficient for implementation studies collecting time–motion data.

Characterizing healthcare incidents in Sweden related to health information technology affecting care management of multiple patients

This study aimed to examine health information technology-related incidents and identify risks associated with multiple patients' management. Sources of information comprised interviews with healthcare professionals and three small sets of local voluntary incident reports using two sampling strategies, purposive and snowball sampling. Incident reports, in the form of free-text narratives, were aggregated for analysis using the Health Information Technology Classification System and thematic analysis. Of 95 incidents, 176 issues were identified, comprising 77% (n = 136) technical issues, and 23% (n = 40) use or human-related issues. Human issues were over two times more likely to harm patients (OR 2.25, 95% CI 1.01 - 4.98) than technical issues. Incidents that affected multiple patients' care accounted for 70% (n = 66) of the total sample, and large-scale events comprised 39% (n = 26) of the incidents that affected multiple patients' care. Systematically identifying and characterizing such incidents should be prioritized for health information technology implementations.

Clinician perspectives on implementing a team-based metacognitive strategy training approach to stroke rehabilitation

INTRODUCTION

The objective of this research study was to explore site and clinician specific experiences, successes and challenges in implementing a complex intervention (cognitive orientation to daily occupational performance approach) to enhance stroke team's ability to address cognitive impairments as part of comprehensive stroke rehabilitation.

METHODS

A focus group was held with clinicians from five study sites, all rehabilitation stroke hospitals in a large urban setting, to discuss implementation experiences. Participants were clinicians (site champions) from each of the five participating stroke program study sites and included four occupational therapists, three physiotherapists and one speech-language pathologist. Thematic analysis was used to identify themes that represented clinicians' perspectives.

RESULTS

Implementing this complex team-based intervention was influenced by three themes-organizational support, experiential evidence, and clinicians' perspectives. Continued implementation of the intervention following the withdrawal of study support was represented on a continuum that ranged from not using the approach at all to implementing it with all patients. Sites where managers encouraged and supported use of the intervention within teams (organization support), continued to use it after the study support period as did clinicians who were willing to try new interventions (clinicians' perspectives). Development of iterative conclusions through implementation or attempts to implement the intervention had both positive and negative effects on continued implementation (experiential evidence).

CONCLUSIONS

Strategies that reinforce development of positive experiential evidence and building organizational support for innovative practice were found to be useful adjuncts in facilitating implementation of complex interprofessional interventions.

Growing pains: Lessons learned from a failed mobile mindfulness clinical trial for patients with complex care needs

This paper discusses lessons learned from a failed clinical trial investigating the use of a mobile application (app) to deliver a mindfulness intervention to middle-aged and older adults receiving services at a rehabilitation hospital in Ontario, Canada. A randomized controlled trial with 82 participants was planned, with the experimental group receiving access to a mindfulness app and a wait-list control group receiving access to the app after 4 weeks; however, the study could not be completed due to low recruitment rates. This implementation failure was considered from the perspective of the PARIHS framework. More specifically, Three key recruitment challenges were identified, and recommendations for future research provided. Firstly, the increasingly complex care needs of the study population appeared to influence eligibility; it would be beneficial for future research to consider adopting strategies to better understand the needs of the target population. Secondly, participants’ stage of care and readiness of change likely negatively influenced compliance and retention in this study, and should be assessed in future research. Finally, a lack of clinician integration into the research team negatively impacted recruitment in this study; future studies should consider integrating direct service providers into the research team as this may increase buy-in and referral rates. The challenges and recommendations outlined can inform design and implementation of future studies in this area.

Building effective engagement for implementation with i-PARIHS: a collaborative enquiry into paediatric pain care in the emergency department

BACKGROUND

Pain is a central and distressing experience for children in the emergency department (ED). Despite the harmful effects of pain, ED care often falls short of providing timely and effective pain relief. Knowledge translation research targeting systems of care holds potential to transform paediatric pain care. This article reports on the first stages of an implementation project aimed at embedding effective and sustainable practice change in an Australian children's hospital ED.

METHODS

The integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework underpinned a cooperative process of engagement to establish a practitioner-led, interprofessional research collaborative. The Kids Pain Collaborative (KPC) aimed to co-design innovation in paediatric ED pain care, facilitating an extensive reconnaissance of research evidence, clinician and family experiences, and local evaluation data. This critical appraisal of the context and culture of pain management generated foci for innovation and facilitation of implementation action cycles.

RESULTS

Engaging in a complex process of facilitated critical reflection, the KPC unpacked deeply embedded assumptions and organisational practices for pain care that worked against what they wanted to achieve as a team. A culture of rules-based pain management and command and control leadership produced self-defeating practices and ultimately breakdowns in pain care. By raising a critical awareness of context, and building consensus on the evidence for change, the KPC has established a whole of ED shared vision for prioritising pain care.

CONCLUSIONS

In-depth key stakeholder collaboration and appraisal of context is the first step in innovation of practice change. The KPC provided a space for collaborative enquiry where ED clinicians and researchers could develop context-specific innovation and implementation strategy. We provide an example of the prospective application of i-PARIHS in transforming ED pain care, using a collaborative and participatory approach that has successfully enabled high levels of departmental engagement, motivation and ownership of KPC implementation as the facilitation journey unfolds.

The Consolidated Framework for Implementation Research: a reflection on researchers' experiences of its benefits and challenges and the lessons learnt from using it

BACKGROUND

In healthcare implementation research, there is little discussion of researchers' experiences of using frameworks, including the Consolidated Framework for Implementation Research (CFIR).

AIM

To identify and discuss the benefits and challenges encountered and the lessons learnt from researchers' experiences of using the CFIR in different contexts and phases of research.

DISCUSSION

This article synthesises the reflections of nursing and public health researchers on their experiences of using the CFIR across four separate healthcare-associated infection prevention and control implementation studies. The CFIR's benefits and challenges, the resolutions to these challenges and the lessons learnt from the application of the framework were discussed.

CONCLUSIONS

Identified benefits included the framework's adaptability and flexibility, and its provision of structure and shared language for research. Translation to another language and differentiating between domains and constructs were challenges.

IMPLICATIONS FOR PRACTICE

Nurse researchers may find this article useful when considering use of the CFIR, or to anticipate and prepare to overcome the challenges highlighted when using the framework.

It takes a village: Influencing policy and practice to prevent alcohol use in pregnancy and promote better outcomes for individuals living with Fetal Alcohol Spectrum Disorder

Fetal Alcohol Spectrum Disorder (FASD) is a neurodevelopmental disorder caused by exposure to alcohol in utero. It has pervasive, lifelong impacts and is recognised as a major public health concern in many countries where alcohol is used. The FASD Research Australia Centre of Research Excellence (CRE) was funded by the National Health and Medical Research Council to generate and translate evidence to address prevention, diagnosis, and management of FASD in Australia. The current paper describes the approach to policy and practice impact taken by our CRE, including our stakeholder engagement processes and the key principles that underlie our approach. We provide examples of policy and practice influence in FASD prevention, diagnosis and management that have been achieved over the past five years and discuss challenges that are routinely faced in the translation of our work.

Individual-Level Factors are Significantly More Predictive of Employee Innovativeness Than Job-Specific or Organization-Level Factors: Results From a Quantitative Study of Health Professionals

Individual innovativeness is particularly indispensable among health professionals. The healthcare environment is complex and its knowledge workers must continually adapt to change and be comfortable with ambiguity. The objective of this study was to determine the relative importance of individual, job-specific, and organizational factors on innovative output of health professionals. Employed Canadian Registered Dietitians (n = 237) completed an online survey incorporating relevant validated tools, including the 10-item Big Five Inventory and the Alberta Context Tool. Factors were classified by level and introduced in blocks to a multivariate linear regression model, with the outcome of self-reported innovative output. Factors included in the model explained 44% of variation in self-reported innovative output. Although all blocks contributed significantly to the model, minimal variation was explained by factors at the job-specific (4%) and organizational levels (4%). Factors at the individual level most predictive of innovative output were role innovation, the personality trait of conscientiousness and voluntary membership in a professional association. To encourage employee innovativeness, health administrators, and managers of health professionals should consider how best to incorporate screens for individual-level indicators of innovative output (eg, personality tests) in their institutional hiring and selection processes.

Context in Implementation Science

Changing health care delivery systems and processes of care to improve health care quality is complex. What is done (intervention) is equally important as how it is done (implementation) and where it is done (context). Furthermore, it has been consistently observed that among groups participating in multisite quality improvement (QI) efforts and implementation studies, significant heterogeneity in the improvements is seen. Our objective is to provide a step-by-step guide to assist both researchers and groups practicing QI on the frontlines in addressing context in planning, implementing, and disseminating their QI and implementation interventions. We discuss in depth a sample of the >60 available dissemination and implementation frameworks that consider context. We then provide an approach to addressing context in QI and implementation initiatives and discuss an application of this approach, using a published study as an example. Finally, we discuss next steps for the field of context and implementation science. Data from networks of health systems working together on QI are needed on both network-wide rates of process and outcome measures. Also needed are segmented/stratified data that inform our understanding of the influence of context on successful implementation in subgroups. Finally, multisite prospective studies are needed to develop an in-depth understanding of how specific context and implementation factors affect the successful spread of proven interventions.

Contemporary Challenges of Nursing CPD: Time to change the model to meet citizens' needs

The purpose of this paper is to present the evidence shared with a citizen Consensus panel detailing key issues associated with how nursing CPD can best influence the quality of health and social care experienced by citizens and communities. It presents a summary of contemporary theory, research and evidence of the effectiveness of nursing CPD and outlines four key challenges: (i) how to strengthen the focus on patient experience as the starting point for CPD; (ii) the lack of evidence of CPD effectiveness and accountability in its transfer to practice; (iii) evaluation of CPD effectiveness; and (iv) involving citizens in targeting CPD where it is most needed. It briefly describes the methods used to facilitate public consultation through a citizen Consensus panel as part of a collaborative project with the RCN Strategic Research Alliance in 2020 and outlines 7 themes identified as important by the public for future development. The main challenge for nursing is capitalizing on the workplace as a learning resource that can integrate learning with development, improvement, knowledge translation, inquiry and innovation. This requires skilled facilitators, particularly at meso- levels, and systems leaders with the full skillset to develop system-wide cultures of learning that enable everyone to flourish and create good places to work. The paper concludes that the development of CPD process measures would indicate how CPD investment contributes to person-centred, safe and effective care and system transformation and enable commissioners and education providers to optimize CPD's full potential.

Approaches for Implementing Healthy Food Interventions in Settings With Limited Resources: A Case Study of Sodium Reduction Interventions in Emergency Food Programs Addressing Food Insecurity

PURPOSE

This study describes how recipients of the Centers for Disease Control and Prevention funded Sodium Reduction in Communities Program (SRCP) worked with emergency food programs to improve access to healthy food to address chronic conditions.

DESIGN

SRCP recipients partnered with emergency food programs to implement sodium reduction strategies including nutrition standards, procurement practices, environmental strategies, and behavioral economics approaches.

SETTING

SRCP recipients and emergency food programs in Washington County and Benton County, Arkansas and King County, Washington.

SUBJECTS

SRCP recipient staff, emergency food program staff, and key stakeholders.

MEASURES

We conducted semi-structured interviews with key stakeholders and systematic review of program documents.

ANALYSIS

Data were analyzed using effects matrices for each recipient. Matrices were organized using select implementation science constructs and compared in a cross-case analysis.

RESULTS

Despite limited resources, emergency food programs can implement sodium reduction interventions which may provide greater access to healthy foods and lead to reductions in health disparities. Emergency food programs successfully implemented sodium reduction interventions by building on the external and internal settings; selecting strategies that align with existing processes; implementing change incrementally and engaging staff, volunteers, and clients; and sustaining changes.

CONCLUSION

Findings contribute to understanding the ways in which emergency food programs and other organizations with limited resources have implemented public health nutrition interventions addressing food insecurity and improving access to healthy foods. These strategies may be transferable to other settings with limited resources.

Effectiveness of Quality Improvement Coaching on Process Outcomes in Health Care Settings: A Systematic Review

BACKGROUND

A culture of improvement is an important feature of high-quality health care systems. However, health care teams often need support to translate quality improvement (QI) activities into practice. One method of support is consultation from a QI coach. The literature suggests that coaching interventions have a positive impact on clinical outcomes. However, the impact of coaching on specific process outcomes, like adoption of clinical care activities, is unknown. Identifying the process outcomes for which QI coaching is most effective could provide specific guidance on when to employ this strategy.

METHODS

We searched multiple databases from inception through July 2021. Studies that addressed the effects of QI coaching on process of care outcomes were included. Two reviewers independently extracted study characteristics and assessed risk of bias. Certainty of evidence was assessed using GRADE.

RESULTS

We identified 1983 articles, of which 23 cluster-randomized trials met eligibility criteria. All but two took place in a primary care setting. Overall, interventions typically targeted multiple simultaneous processes of care activities. We found that coaching probably has a beneficial effect on composite process of care outcomes (n = 9) and ordering of labs and vital signs (n = 6), and possibly has a beneficial effect on changes in organizational process of care (n = 5), appropriate documentation (n = 5), and delivery of appropriate counseling (n = 3). We did not perform meta-analyses because of conceptual heterogeneity around intervention design and outcomes; rather, we synthesized the data narratively. Due to imprecision, inconsistency, and high risk of bias of the included studies, we judged the certainty of these results as low or very low.

CONCLUSION

QI coaching interventions may affect certain processes of care activities such as ordering of labs and vital signs. Future research that advances the identification of when QI coaching is most beneficial for health care teams seeking to implement improvement processes in pursuit of high-quality care will support efficient use of QI resources.

PROTOCOL REGISTRATION

This study was registered and followed a published protocol (PROSPERO: CRD42020165069).

Staff perspectives on the feasibility of a clinical pathway for anxiety and depression in cancer care, and mid-implementation adaptations

BACKGROUND

Clinical pathways (CPs) are intended to standardise and improve care but do not always produce positive outcomes, possibly because they were not adapted to suit the specific context in which they were enacted. This qualitative study aimed to explore staff perspectives of implementation of a CP for routine screening, assessment, referral and management of anxiety and depression (the ADAPT CP) for patients with cancer, focussing on perceived feasibility of the CP and negotiated adaptations made during the implementation phase.

METHODS

The ADAPT CP was implemented in 12 urban and regional oncology services in Australia. Services were randomised to receive core versus enhanced implementation strategies. Core sites received support until implementation commencement and could access progress reports. Enhanced sites received proactive, ongoing support during the 12-month implementation. Purposively selected staff were interviewed prior to implementation (n = 88) and 6 months later, half-way through the implementation period (n = 89). Monthly meetings with lead multi-disciplinary teams at the eight enhanced sites were recorded. Data were thematically analysed.

RESULTS

Six overarching themes were identified: ADAPT is of high value; timing for introducing the CP and screening is difficult; online screening is challenging; a burden too much; no-one to refer patients to; and micro-logistics are key. While early screening was deemed desirable, diverse barriers meant this was complex, with adaptations made to time and screening location. Online screening prompted by email, seen as time-saving and efficient, also proved unsuccessful in some services, with adaptations made to in-clinic or phone screening, or repeated email reminders. Staff negative attitudes to ADAPT, time constraints, and perceived poor fit of ADAPT to work roles and flows, all impacted implementation, with key tasks often devolving to a few key individuals. Nevertheless, services remained committed to the ADAPT CP, and worked hard to create, review and adapt strategies to address challenges to optimise success.

CONCLUSIONS

This study demonstrates the interactive nature of health service change, with staff actively engaging with, forming views on, and problem-solving adaptations of the ADAPT CP to overcome barriers. Obtaining staff feedback is critical to ensure health service change is sustainable, meaningful and achieves its promise of improving patient outcomes.

TRIAL REGISTRATION

The study was registered prospectively with the ANZCTR on 22/3/2017. Trial ID ACTRN12617000411347.

Frameworks for implementation of policies promoting healthy nutrition and physically active lifestyle: systematic review

Background

Policy frameworks focusing on policy implementation may vary in terms of their scope, included constructs, relationships between the constructs, and context factors. Although multiple policy implementation frameworks exist, the overarching synthesis characterizing differences between the frameworks is missing. This study investigated frameworks guiding implementation of policies aiming at healthy nutrition, physical activity promotion, and a reduction of sedentary behavior. In particular, we aimed at examining the scope of the frameworks and the content of included constructs (e.g., referring to implementation processes, determinants, or implementation evaluation), the level at which these constructs operate (e.g., the individual level, the organizational/community level), relationships between the constructs, and the inclusion of equity factors.

Methods

A systematic review (the PROSPERO registration no. CRD42019133251) was conducted using 9 databases and 8 stakeholder websites. The content of 38 policy implementation frameworks was coded and analyzed.

Results

Across the frameworks, 47.4% (18 in 38) addressed three aims: description of the process, determinants, and the evaluation of implementation. The majority of frameworks (65.8%; 25 in 38) accounted for constructs from three levels: individual, organizational/community, and the system level. System-level constructs were included less often (76.3%; 29 in 38) than individual-level or organizational/community-level constructs (86.8% [33 in 38 frameworks] and 94.7% [36 in 38 frameworks] respectively). The majority of frameworks (84.2%, 32 in 38) included at least some sections that were solely of descriptive character (a list of unassociated constructs); 50.0% (19 in 38) included sections of prescriptive character (general steps of implementation); 60.5% (23 in 38) accounted for explanatory sections (assuming bi- or uni-directorial associations). The complex system approach was accounted for only in 21.1% (8 in 38) of frameworks. More than half (55.3%; 21 in 38) of frameworks did not account for any equity constructs (e.g., socioeconomic status, culture).

Conclusions

The majority of policy implementation frameworks have two or three aims (combining processes, determinants and/or the evaluation of implementation), include multi-level constructs (although the system-level determinants are less frequently included than those from the individual- or organizational/community-level), combine sections of purely descriptive character with sections accounting for prescriptive and/or explanatory associations, and are likely to include a little or no equity constructs.

Registration

PROSPERO, #CRD42019133251.

Is a novel diagnostic pathway for cardiology outpatient clinics in Singapore lower cost than existing practice: a cost modelling study

OBJECTIVE

To evaluate the potential for change to costs from a decision to adopt a novel diagnostic pathway for referrals to cardiology outpatients with symptoms of chest pain.

DESIGN

Costs modelling study using existing observational data, with a cost year of 2018.

SETTING

Specialist Heart Centre in Singapore.

PARTICIPANTS

All new referrals (n=10 622) to the outpatient clinics for investigation between January 2017 and December 2017.

INTERVENTIONS

Two competing testing regimes are compared in a decision tree model. Current practice includes classification of patients by their risk and the use of treadmill tests, calcium scores, functional testing and CT angiogram. New practice offers a fundamental difference in use of diagnostics for patients, with some offered angiogram directly and for low-risk patients a calcium score is used to refine risk stratification.

OUTCOME MEASURES

The expected cost difference between testing alternatives.

RESULTS

The expected cost saving from 'New Practice' as compared with 'Current Practice' is $S764 per patient. There is a 50% probability the savings per patient range between $S764 and $S824 and a 90% probability they are between $S616 and $S912. The expected savings to Singapore national health services are $S26.8 million annually, with a range of $S16.2 to $S41.1 million.

CONCLUSIONS

We find some evidence that using a coronary calcium score, which can be performed with a fraction of the time and cost of a CT coronary angiogram, saves costs to health services.

Evaluating factors that influenced the successful implementation of an evidence-based neonatal care intervention in Chinese hospitals using the PARIHS framework

Background

Evidence based interventions (EBIs) can improve patient care and outcomes. Understanding the process for successfully introducing and implementing EBIs can inform effective roll-out and scale up. The Promoting Action on Research Implementation in Health Services (PARIHS) framework can be used to evaluate and guide the introduction and implementation of EBIs. In this study, we used kangaroo mother care (KMC) as an example of an evidence-based neonatal intervention recently introduced in selected Chinese hospitals, to identify the factors that influenced its successful implementation. We also explored the utility of the PARIHS framework in China and investigated how important each of its constructs (evidence, context and facilitation) and sub-elements were perceived to be to successful implementation of EBIs in a Chinese setting.

Method

We conducted clinical observations and semi-structured interviews with 10 physicians and 18 nurses in five tertiary hospitals implementing KMC. Interview questions were organized around issues including knowledge and beliefs, resources, culture, implementation readiness and climate. We used directed content analysis to analyze the interview transcript, amending the PARIHS framework to incorporate emerging sub-themes. We also rated the constructs and sub-elements on a continuum from “low (weak)”, “moderate” or “high (strong)” highlighting the ones considered most influential for hospital level implementation by study participants.

Results

Using KMC as an example, our finding suggest that clinical experience, culture, leadership, evaluation, and facilitation are highly influential elements for EBI implementation in China. External evidence had a moderate impact, especially in the initial awareness raising stages of implementation and resources were also considered to be of moderate importance, although this may change as implementation progresses. Patient experience was not seen as a driver for implementation at hospital level.

Conclusion

Based on our findings examining KMC implementation as a case example, the PARIHS framework can be a useful tool for planning and evaluating EBI implementation in China. However, it’s sub-elements should be assessed and adapted to the implementation setting.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07493-6.

"Keep It Simple"-Co-Creation of a Tailored Newborn Resuscitation Course for Midwifery Students

PURPOSE

To develop a tailored newborn resuscitation course for midwifery students.

PATIENTS AND METHODS

A qualitative study using an explorative, abductive approach was applied. Co-creation through workshops was facilitated to develop a tailored newborn resuscitation course for midwifery students. Four workshops with midwifery students and midwives were conducted from May to October 2020. Twenty participants attended one workshop of their choice. Five out of Norway's six midwifery education programmes participated, and included midwives from across Norway. All workshops were held digitally via the Zoom platform. A seven-step framework analysis method was applied to analyse the workshop data.

RESULTS

We identified four themes: 1) practice guidance, 2) technical skills 3) non-technical skills 4) innovative methods.

CONCLUSION

Findings emphasize the importance of practice guidance, technical skills, non-technical skills and innovative methods to facilitate the learning process. However, these skills cannot be acquired without the context to facilitate them, and thus a supportive culture is essential to sustain newborn resuscitation expertise as a midwife/midwifery student. We found that midwives expressed the same need to learn, train and prepare themselves for newborn resuscitation as midwifery students. The importance of facilitating the learning of newborn resuscitation with low-dose, high-frequency training in a supportive culture thus matters to both midwifery students and expert midwives.

Analysis of the implementation of an innovative IT solution to improve waiting times, communication with primary care and efficiency in Rheumatology

OBJECTIVE

To describe in detail an innovative program based on telemedicine for semi-automated prioritization of referrals from Primary Care (PC) to Rheumatology, for reproducibility purposes, and to present the results of the implementation study.

METHODS

The context and situation were carefully analyzed, paying attention to all processes in place, referral numbers, waiting times, and number of complementary tests prior to discharge from Rheumatology. The composition of the team, aims, users, scope, and implementation phases were defined. Eight process indicators were established and measured before and 32 months after the program implementation.

RESULTS

The program, which includes IT circuits, algorithms based on response to specific guideline-based checklists, e-consultation, and appointments based on priority, was fully implemented in our health area after a pilot study in two PC centers. After implementation, 6185 rheumatology referrals showed an e-consultation response delay of 8.95 days, and to first face-to-face visit (after e-consultation) of 12.6 (previous delay before program implementation was 83.1 days). Resolution by e-consultation reached 20% (1195 patients did not need seeing the rheumatologist to have the problem solved), and 1369 patients (32%) were discharged after the first visit. The overall resolution rate was 44.0% (2564 discharges/5830 e-consultations). From a random sample of 100 visits, only 10% of patients needed additional complementary tests to make a diagnosis and decision by Rheumatology (20.9% decrease from previous period).

CONCLUSION

A careful analysis of the situation and processes, with implementation of simple IT circuits, allows for the improvement of the efficiency and resolution of problems in Rheumatology.

What Does a Systems Approach to Quality Improvement Look Like in Practice?

Universally improving healthcare systems is difficult to achieve in practice with organisations implementing a range of quality improvement (QI) approaches, in varying and changing contexts, and efforts ranging from project-based improvements to whole system change. This study aimed to identify how organisations overcome the challenges to improving the quality of the services they deliver. Drawing on the eight challenges from the ‘Quality and Safety in Europe by Research (QUASER) hospital guide, we assessed eight cases reported by the UK-based regulator Care Quality Commission as improving their performance. A thematic analysis of these secondary data established that all eight challenges had been addressed or considered in varying degrees. Education and physical and technological challenges seemed less prominent than developments made to address other challenges such as developing leadership, structure, and culture to support improving quality. This paper relies on the analysis of secondary case data and one framework to assess improvement efforts. Further research is required to consider other models and frameworks and to collate longitudinal data to capture the dynamics and increasing the maturity of improving healthcare systems in practice.

Physicians' cognitive approach to prognostication after cardiac arrest

OBJECTIVE

Elucidate how physicians formulate a neurological prognosis after cardiac arrest and compare differences between experts and general providers.

METHODS

We performed semi-structured interviews with experts in post-arrest care and general physicians. We created an initial model and interview guide based on professional society guidelines. Two authors independently coded interviews based on this initial model, then identified new topics not included in it. To describe individual physicians' cognitive approach to prognostication, we created a graphical representation. We summarized these individual "mental models" into a single overall model, as well as two models stratified by expertise.

RESULTS

We performed 36 interviews (17 experts and 19 generalists), most of whom practice in Europe (23) or North America (12). Participants described their approach to prognosis formulation as complex and iterative, with sequential and repeated data acquisition, interpretation, and prognosis formulation. Eventually, this cycle results in a final prognosis and treatment recommendation. Commonly mentioned factors were diagnostic test performance, time from arrest, patient characteristics. Participants also discussed factors rarely discussed in prognostication research including physician and hospital characteristics. We found no substantial differences between experts and general physicians.

CONCLUSION

Physicians' cognitive approach to neurologic prognostication is complex and influenced by many factors, including some rarely considered in current research. Understanding these processes better could inform interventions designed to aid physicians in prognostication.

'Trying to fly the plane while we were building it'. Applying a learning health systems approach to evaluate early-stage barriers and facilitators to implementing primary care transformation: a qualitative study

OBJECTIVE

A learning health system (LHS) uses data to generate evidence and answer questions required to continually improve system performance and patient care. Given the complexities of practice transformation, an area where LHS is particularly important is the study of primary care transformation (PCT) as PCT generates several practice-level questions that require study where the findings can be readily implemented. In May 2019, a large integrated health delivery system in Minnesota began implementation of a population management PCT in two of its 40 primary care clinics. In this model of care, patients are grouped into one of five service bundles based on their complexity of care; patient appointment lengths and services provided are then tailored to each service bundle. The objective of this study was to examine the use of a LHS in PCT by utilising the Consolidated Framework for Implementation Research (CFIR) to categorise implementation lessons from the initial two PCT clinics to inform further implementation of the PCT within the health system.

DESIGN

This was a formative evaluation in which semistructured qualitative interviews were carried out. Observational field notes were also taken. Inductive coding of the data was performed and resultant codes were mapped to the CFIR.

SETTING

Two suburban primary care clinics in the Twin Cities, Minnesota.

PARTICIPANTS

Twenty-two care team members from the first two clinics to adopt the PCT.

RESULTS

Seventeen codes emerged to describe care team members' perceived implementation influences. Codes occurred in each of the five CFIR domains (intervention characteristics, outer setting, inner setting, characteristics of individuals and process), with most codes occurring in the 'inner setting' domain.

CONCLUSIONS

Using an LHS approach to determine early-stage implementation influences is key to guiding further PCT implementation, understanding modifications that need to be made and additional research that needs to occur.

Australian oncology health professionals' knowledge, perceptions, and clinical practice related to cancer-related cognitive impairment and utility of a factsheet

PURPOSE

Cancer-related cognitive impairment (CRCI) can have debilitating effects on cancer survivors' quality of life. Despite this, patients often report a lack of information provided by health professionals (HPs) to assist with understanding and managing cognitive changes. This study aimed to explore Australian oncology HPs' understanding of and clinical practice related to CRCI including the use of a Cancer Council Australia CRCI factsheet.

METHODS

Australian oncology HPs (medical oncologists, cancer nurses, and clinical psychologists) completed a questionnaire that assessed CRCI knowledge, prior to receiving the factsheet. Semi-structured interviews were conducted to explore their perceptions of CRCI and the factsheet. Interviews were recorded, transcribed, and analyzed using framework analysis to identify key themes.

RESULTS

Questionnaires were completed by twenty-nine HPs. Most HPs had moderate to high knowledge of CRCI, yet low knowledge of the relationship between CRCI and cancer. Twenty-six (response rate 90%) HPs; medical oncologists (n = 7), cancer nurses (n = 12), and clinical psychologists (n = 7), consented to be interviewed. Three main themes were identified: (1) Is CRCI impact real or over-rated?; (2) If it is important, they will tell me: identifying and responding to CRCI in clinical practice; and (3) Using a factsheet in clinical practice.

CONCLUSION

This study's multi-disciplinary exploration of Australian oncology HPs' perceptions of CRCI highlighted that health professional perceptions drive CRCI discussions with patients. Further education to support clinicians to discuss CRCI is required. Consideration of the barriers and facilitators within healthcare settings is important for successful integration of the factsheet into routine care.