Measuring organizational readiness for knowledge translation in chronic care

Development of a Multidisciplinary Care Pathway for Fracture Prevention in Men with Prostate Cancer at Initiation of Androgen Deprivation Therapy

Fracture risk is increased in men with prostate cancer (PCa) receiving Androgen Deprivation Therapy (ADT). However, routine assessment of fracture risk is often not systematically applied. We aimed to establish a comprehensive care pathway for fracture prevention in men with PCa starting ADT. Therefore, a multidisciplinary working group designed and implemented a care pathway using the 'Knowledge to Action' framework, based on current Dutch guidelines for PCa, osteoporosis and fracture prevention, and an extensive literature review of other guidelines. The pathway was developed according to a five-step clinical approach including case finding, fracture risk assessment based on risk factors, bone mineral density test, vertebral fracture assessment, differential diagnosis, treatment, and annual follow-up. Our fracture prevention care pathway for patients with PCa at the time of ADT initiation was designed to promote a patient-centered, multidisciplinary approach to facilitate the implementation of early fracture prevention measures.

Planning and implementing practice changes in Ontario maternal-newborn hospital units: a secondary qualitative analysis

BACKGROUND

Moving evidence into practice is complex, and pregnant and birthing people and their infants do not always receive care that aligns with the best available evidence. Implementation science can inform how to effectively move evidence into practice. While there are a growing number of examples of implementation science being studied in maternal-newborn care settings, it remains unknown how real-world teams of healthcare providers and leaders approach the overall implementation process when making practice changes. The purpose of this study was to describe maternal-newborn hospital teams' approaches to implementing practice changes. We aimed to identify what implementation steps teams take (or not) and identify strengths and potential areas for improvement based on best practices in implementation science.

METHODS

We conducted a supplementary qualitative secondary analysis of 22 interviews completed in 2014-2015 with maternal-newborn nursing leaders in Ontario, Canada. We used directed content analysis to code the data to seven steps in an implementation framework (Implementation Roadmap): identify the problem and potential best practice; assemble local evidence; select and customize best practice; discover barriers and drivers; tailor implementation strategies; field-test, plan evaluation, prepare to launch; launch, evaluate, and sustain. Frequency counts are presented for each step.

RESULTS

Participants reported completing a median of 4.5 of 7 Implementation Roadmap steps (range = 3-7), with the most common being identifying a practice problem. Other steps were described less frequently (e.g., selecting and adapting evidence, field-testing, outcome evaluation) or discussed frequently but not optimally (e.g., barriers assessment). Participants provided examples of how they engaged point-of-care staff throughout the implementation process, but provided fewer examples of engaging pregnant and birthing people and their families. Some participants stated they used a formal framework or process to guide their implementation process, with the most common being quality improvement approaches and tools.

CONCLUSIONS

We identified variability across the 22 hospitals in the implementation steps taken. While we observed many strengths, we also identified areas where further support may be needed. Future work is needed to create opportunities and resources to support maternal-newborn healthcare providers and leaders to apply principles and tools from implementation science to their practice change initiatives.

A realist review of the effective implementation of the ICU Liberation Bundle in the paediatric intensive care unit setting

OBJECTIVE

The objective of this study was to produce an evidence base of what works, for whom, and in what context when implementing the ICU Liberation Bundle into the paediatric intensive care unit (PICU).

REVIEW METHOD USED

This is a realist review (a review that considers what works, for whom, and in what context) of contemporary international literature.

DATA SOURCES

Data were collected via electronic searches of CINAHL, PubMed, EMBASE and MEDLINE, Google Scholar, and Web of Science for articles published before October 2020.

REVIEW METHOD

An initial scoping search identified the underpinning theory of the implementation of the ICU Liberation Bundle (a multifactor intervention aimed at improving patient outcomes) which was mapped onto the Consolidated Framework for Implementation Research (CFIR). We identified 547 unique citations; 12 full-text papers were included that reported eight studies. Data were extracted and mapped to the CFIR domains.

RESULTS

Data mapped to all CFIR domains. Characteristics of individuals included involvement of key stakeholders, champions, and parents and understanding of staff attitudes and perceptions of the intervention, and all bedside staff members were involved and given training. Within the inner setting, understanding of unit culture, ensuring effective support systems in place, knowledge of the baseline, and leadership support, and buy-in were important. Culture of family-centred care and alignment of the intervention to national guidelines related to the outer setting. Intervention characteristics included the number and timings of interventions, de-escalation rounding checklists, the use of age-appropriate and validated assessment tools, and local policies for the bundle. The process included set training program, senior unit/hospital team consultation on all processes, continual audit adherence to the bundle and feedback, and celebration of successes.

CONCLUSIONS

This novel realist review of the literature identified that successful implementation of the ICU Liberation Bundle into PICU settings involves the following: (i) a thorough understanding of the PICU context, including baseline metrics, resources, and staff attitudes; (ii) using contextual information to adapt the intervention elements to ensure fit; and (iii) both clinical effectiveness and implementation outcomes must be measured. Registration of review: PROSPERO 2020 CRD42020211944.

An Exploration of Organizational Characteristics and Training Adoption in Irish Community Drug Treatment Services

BACKGROUND

Changes in patterns of drug use and population needs necessitate the adoption of new technologies. Despite high failure rates in adopting new technologies acquired in training, little is known about the process that can support successful change. This study explores the impact that staff and service characteristics have on the process of training adoption in Irish opiate substitution therapy services, with a specific focus on the concept of organizational readiness to change.

METHODS

A cross-sectional survey was conducted on a convenience sample of 132 staff members across 12 services in Ireland. The relationship between staff demographics, their perceptions of organizational readiness to change, burnout, and a four-stage process of training adoption were considered.

RESULTS

Discipline, job tenure, and educational levels are important predictors of engagement in the adoption process. Staff in services with higher institutional needs, greater pressures for change, and poorer resources were less likely to be exposed to, or adopt, training. Having lower levels of stress and more influence with peers was associated with better adoption of training.

CONCLUSIONS

Planners and service managers need to carefully consider the composition or dynamics of services when initiating change. Organizational readiness to change and staff characteristics as measured by instruments used in this study are important determinants of the process of innovation or training adoption and provide a good basis for developing further understanding of how treatment services work. This article expands on results from previous studies conducted in the United States to a European context.

Factors that support readiness to implement integrated evidence-based practice to increase cancer screening

BACKGROUND

In 2015, the Centers for Disease Control and Prevention (CDC) funded the Colorectal Cancer Control Program (CRCCP), which partners with health care systems and primary care clinics to increase colorectal cancer (CRC) screening uptake. We interviewed CRCCP stakeholders to explore the factors that support readiness for integrated implementation of evidence-based interventions (EBIs) and supporting activities to promote CRC screening with other screening and chronic disease management activities in primary care clinics.

METHODS

Using the Consolidated Framework for Implementation Research (CFIR), we conducted a literature review and identified constructs to guide data collection and analysis. We purposively selected four CRCCP awardees that demonstrated ongoing engagement with clinic partner sites, willingness to collaborate with CDC and other stakeholders, and availability of high-quality data. We gathered background information on the selected program sites and conducted primary data collection interviews with program site staff and partners. We used NVivo QSR 11.0 to systematically pilot-code interview data, achieving a kappa coefficient of 0.8 or higher, then implemented a step-wise process to identify site-specific and cross-cutting emergent themes. We also included screening outcome data in our analysis to examine the impact of integrated cancer screening efforts on screening uptake.

RESULTS

We identified four overarching factors that contribute to clinic readiness to implement integrated EBIs and supporting activities: the funding environment, clinic governance structure, information sharing within clinics, and clinic leadership support. Sites reported supporting clinic partners' readiness for integrated implementation by providing coordinated funding application processes and braided funding streams and by funding partner organizations to provide technical assistance to support efficient incorporation of EBIs and supporting activities into existing clinic workflows. These actions, in turn, support clinic readiness to integrate the implementation of EBIs and supporting activities that promote CRC screening along with other screening and chronic disease management activities.

DISCUSSION

The selected CRCCP program sites supported clinics' readiness to integrate CRC EBIs and supporting activities with other screening and chronic disease management activities increasing uptake of CRC screening and improving coordination of patient care.

CONCLUSIONS

We identified the factors that support clinic readiness to implement integrated EBIs and supporting activities including flexible funding mechanisms, effective data sharing systems, coordination across clinical staff, and supportive leadership. The findings provide insights into how public health programs and their clinic partners can collectively support integrated implementation to promote efficient, coordinated patient-centered care.

Feasibility of Good Governance at Health Facilities: A Proposed Framework and its Application Using Empirical Insights From Kenya

BACKGROUND

Governance is a social phenomenon which permeates throughout systemic, organisational and individual levels. Studies of health systems governance traditionally assessed performance of systems or organisations against principles of good governance. However, understanding key pre-conditions to embed good governance required for healthcare organisations is limited. We explore the feasibility of embedding good governance at healthcare facilities in Kenya.

METHODS

Our conceptualisation of organisational readiness for embedding good governance stems from a theory of institutional analysis and frameworks for understanding organisational readiness for change. Four inter-related constructs underpin to embed good governance: (i) individual motivations, determined by (ii) mechanisms for encouraging adherence to good governance through (iii) organisation's institutional arrangements, all within (iv) a wider context. We propose a framework, validated through qualitative methods and collected through 39 semi-structured interviews with healthcare providers, county and national-level policy-makers in Kenya. Data was analysed using framework approach, guided by the four constructs of the theoretical framework. We explored each construct in relation to three key principles of good governance: accountability, participation and transparency of information.

RESULTS

Embedding good governance in healthcare organisations in Kenya is influenced by political and socio-cultural contexts. Individual motivations were a critical element of self-enforcement to embed principles of good governance by healthcare providers within their facilities. Healthcare providers possess strong moral incentives to self-enforce accountability to local populations, but their participation in decision-making was limited. Health facilities lacked effective mechanisms for enforcing good governance such as combating corruption, which led to a proliferation of informal institutional arrangements.

CONCLUSION

Organisational readiness for good governance is context-specific so future work should recognise different interpretations of acceptable degrees of transparency, accountability and participation. While good governance involves collective social action, organisational readiness relies on individual choices and decisions within the context of organisational rules and cultural and historical environments.

Factors influencing the integration of evidence-based task-strengthening strategies for hypertension control within HIV clinics in Nigeria

Background

Evidence-based task-strengthening strategies for hypertension (HTN) control (TASSH) are not readily available for patients living with HIV in sub-Saharan Africa where the dual burden of HTN and HIV remains high. We are conducting a cluster randomized controlled trial comparing the effectiveness of practice facilitation versus a self-directed control (i.e., receipt of TASSH with no practice facilitation) in reducing blood pressure and increasing the adoption of task-strengthening strategies for HTN control within HIV clinics in Nigeria. Prior to implementing the trial, we conducted formative research to identify factors that may influence the integration of TASSH within HIV clinics in Nigeria.

Methods

This mixed-methods study was conducted with purposively selected healthcare providers at 29 HIV clinics, followed by a 1-day stakeholder meeting with 19 representatives of HIV clinics. We collected quantitative practice assessment data using two instruments: (a) an adapted Service Availability and Readiness Assessment (SARA) tool to assess the capacity of the clinic to manage NCDs and (b) Implementation Climate Scale to assess the degree to which there is a strategic organizational climate supportive of the evidence-based practice implementation. The quantitative data were analyzed using descriptive statistics and measures of scale reliability. We also used the Consolidated Framework for Implementation Research (CFIR), to thematically analyze qualitative data generated and relevant to the aims of this study.

Results

Across the 29 clinics surveyed, the focus on TASSH (mean=1.77 (SD=0.59)) and educational support (mean=1.32 (SD=0.68)) subscales demonstrated the highest mean score, with good–excellent internal consistency reliability (Cronbach’s alphas ranging from 0.84 to 0.96). Within the five CFIR domains explored, the major facilitators of the intervention included relative advantage of TASSH compared to current practice, compatibility with clinic organizational structures, support of patients’ needs, and intervention alignment with national guidelines. Barriers included the perceived complexity of TASSH, weak referral network and patient tracking mechanism within the clinics, and limited resources and diagnostic equipment for HTN.

Conclusion

Optimizing healthcare workers’ implementation of evidence-based TASSH within HIV clinics requires attention to both the implementation climate and contextual factors likely to influence adoption and long-term sustainability. These findings have implications for the development of effective practice facilitation strategies to further improve the delivery and integration of TASSH within HIV clinics in Nigeria.

Trial registration

ClinicalTrials.gov, NCT04704336

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00289-z.

Knowledge Translation and WIC Food Package Regulation Change

OBJECTIVE

Knowledge Translation (KT) is the exchange, synthesis, and ethically-sound application of knowledge. A case study methodology is used to examine KT at the organizational level of the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) program.

METHOD

The study used purposeful sampling to select WIC informants from state WIC agencies to participate in semi-structured interviews about their individual experiences during the 2009 WIC regulation change process. Thematic coding of retrospective semi-structured interviews with key informants from WIC state agencies revealed key components of the state-level WIC regulation implementation process, and key constructs of Organizational Readiness for Knowledge Translation in the WIC program.

RESULTS

WIC informants highlight that decisions made by WIC state agencies regarding how to appraise, synthesize, and adapt evidence or regulation change are constrained by the KT decisions made by federal agencies. WIC state agencies should assess their level of readiness for KT in terms of 1) innovation readiness; 2) personal readiness; and 3) institutional readiness.

CONCLUSIONS

This WIC case study can help decision-makers to understand the KT process of implementing evidence-informed regulation changes, identify factors that could influence states' ability to be prepared for implementing changes, and gauge "practicality" of future WIC regulation changes.

Context, complexity and process in the implementation of evidence-based innovation: a realist informed review

Background

This review of scholarly work in health care knowledge translation advances understanding of implementation components that support the complete and timely integration of new knowledge. We adopt a realist approach to investigate what is known from the current literature about the impact of, and the potential relationships between, context, complexity and implementation process.

Methods

Informed by two distinct pathways, knowledge utilization and knowledge translation, we utilize Rogers’ Diffusion of Innovations theory (DOI) and Harvey and Kitson’s integrated- Promoting Action on Research Implementation in Health Service framework (PARIHS) to ground this review. Articles from 5 databases; Medline, Scopus, PsycInfo, Web of Science, and Google Scholar and a search of authors were retrieved. Themes and patterns related to these implementation components were extracted. Literature was selected for inclusion by consensus. Data extraction was iterative and was moderated by the authors.

Results

A total of 67 articles were included in the review. Context was a central component to implementation. It was not clear how and to what extent context impacted implementation. Complexity was found to be a characteristic of context, implementation process, innovations and a product of the relationship between these three elements. Social processes in particular were reported as influential however; descriptions of how these social process impact were limited. Multiple theoretical and operational models were found to ground implementation processes. We offer an emerging conceptual model to illustrate the key discoveries.

Conclusions

The review findings indicate there are dynamic relationship between context, complexity and implementation process for enhancing uptake of evidence-based knowledge in hospital settings. These are represented in a conceptual model. Limited empiric evidence was found to explain the nature of the relationships.

Assessing Organizational Readiness for Change Comment on "Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT"

This commentary provides an overview of the organizational readiness for change (ORC) literature over the last decade, with respect to prevailing definitions, theories, and tools to guide assessment of ORC in preparation for implementation. The development of the OR4KT by Gagnon et al is an important contribution to this body of work. This commentary highlights the strengths of the OR4KT including development based on two systematic reviews conducted by the authors to synthesize OR theory and measurement tools, and applicability to a wider range of high-income country healthcare settings through inclusion of input from a diverse group of international experts and transcultural adaptation of the tool, in the context of the literature to date. Limitations and future directions for further development of the tool are also discussed and include application of quantitative psychometric approaches and evaluation of the tool in a broader range of healthcare settings.

Are Healthcare Organizations Ready for Change? Comment on "Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT"

Worldwide most health systems are facing a series of common challenges characterized by the increasing burden of chronic diseases and multimorbidity, and the accelerated pace of biomedical and technological innovations, on the other side. There is a growing recognition that many changes are needed at the macro, meso and micro management levels to tackle these challenges. Therefore, knowing if healthcare organizations are ready for change is a key issue, as high organizational readiness for change (ORC) has been positively related with higher organizational effort and staff motivation for overcoming barriers and setbacks in change endeavours. In practice, readiness for change is not commonly measured and there is a need of adequate metrics for it. In this commentary, a new tool for measuring readiness change is reviewed, the OR4KT. It has been developed based on a solid theoretical background and with the involvement of experts and potential users in the design and it has been tested and validated in three languages and in different organizational settings. Although its generalizability needs to be further tested, it seems to be a promising and useful tool to diagnose if organizations are ready to implement evidence-informed changes. A broader recognition of the key role that the science of implementation can play in the success of much needed transformations in healthcare provides a good opportunity for the dissemination of the OR4KT.

Appraising the quality standard underpinning international clinical practice guidelines for the selection and care of vascular access devices: a systematic review of reviews

OBJECTIVE

Catheter-related bloodstream infections are one of the most important adverse events for patients. Evidence-based practice embraces interventions to prevent and reduce catheter-related bloodstream infections in patients. At present, a growing number of guidelines exist worldwide. The purpose of the study was to assess clinical practice guidelines for peripheral and central venous access device care and prevention of related complications.

DESIGN

Systematic review of clinical practice guidelines: We conducted a search of the literature published from 2005 to 2018 using Medline/PubMed, Embase, CINAHL, Ovid, ScienceDirect, Scopus and Web of Science. We also evaluated grey literature sources and websites of organisations that compiled or produced guidelines. Guideline quality was assessed with the Appraisal of Guidelines for Research and Evaluation, Second Edition tool by three independent reviewers. Cohen's kappa coefficient was used to evaluate the concordance between reviewers.

RESULTS

We included seven guidelines in the evaluation. The concordance between observers was substantial, K=0.6364 (95% CI 0.0247 to 1.2259). We identified seven international guidelines, which scored poorly on crucial domains such as applicability (medium 39%), stakeholder involvement (medium 65%) and methodological rigour (medium 67%). Guidelines by Spanish Health Ministry and UK National Institute for Health and Care Excellence presented the highest quality.

CONCLUSIONS

It is crucial to critically evaluate the validity and reliability of clinical practice guidelines so the best, most context-specific document is selected. Such choice is a necessary prior step to encourage and support health organisations to transfer research results to clinical practice. The gaps identified in our study may explain the suboptimal clinical impact of guidelines. Such low adoption may be mitigated with the use of implementation guides accompanying clinical documents.

Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT

Background: Implementing effective interventions in healthcare requires organizations to be ready to support change. This study aimed to develop, adapt transculturally, and assess the content and face validity of the Organizational Readiness for Knowledge Translation (OR4KT) tool. The OR4KT was designed to measure the readiness of healthcare organizations to implement evidence-informed change across a variety of services.

Methods: Based on systematic reviews of the literature, a Delphi exercise, and expert consultation, we first generated an initial pool of items. Second, we developed and assessed content validity of the pilot OR4KT questionnaire in English. Third, we created French and Spanish versions using a sequential forward and backward translation approach, and transcultural adaptation by a consensus process. Finally, we conducted pilot studies in three contexts – the Basque country region (Spain), and the provinces of Québec and Ontario (Canada) – where 30 experts assessed the face validity of the three versions of OR4KT.

Results: We selected 59 items, grouped in 6 dimensions (organizational climate, context, change content, leadership, organizational support, and motivation) for the final English version of OR4KT. Translation and transcultural adaptation did not identify any content or language problems. Our findings indicate that the English, French and Spanish versions of OR4KT are linguistically equivalents and have high face validity. Only minor revisions to the wording of some items were recommended.

Conclusion: The OR4KT holds promise as a measure of readiness for knowledge translation (KT) in healthcare organizations. The validity and reliability of the three versions of the OR4KT will be assessed in real-life contexts of implementation of evidence-based changes in healthcare

Frameworks for self-management support for chronic disease: a cross-country comparative document analysis

BACKGROUND

In a number of countries, frameworks have been developed to improve self-management support (SMS) in order to reduce the impact of chronic disease. The frameworks potentially provide direction for system-wide change in the provision of SMS by healthcare systems. Although policy formulation sets a foundation for health service reform, little is currently known about the processes which underpin SMS framework development as well as the respective implementation and evaluation plans.

METHODS

The aim of this study was to conduct a cross-country comparative document analysis of frameworks on SMS for chronic diseases in member countries of the Organisation for Economic Cooperation and Development. SMS frameworks were sourced through a systematic grey literature search and compared through document analysis using the Health Policy Triangle framework focusing on policy context, contents, actors involved and processes of development, implementation and evaluation.

RESULTS

Eight framework documents published from 2008 to 2017 were included for analysis from: Scotland, Wales, Ireland, Manitoba, Queensland, Western Australia, Tasmania and the Northern Territory. The number of chronic diseases identified for SMS varied across the frameworks. A notable gap was a lack of focus on multimorbidity. Common courses of action across countries included the provision of self-management programmes for individuals with chronic disease and education to health professionals, though different approaches were proposed. The 'actors' involved in policy formulation were inconsistent across countries and it was only clear from two frameworks that individuals with chronic disease were directly involved. Half of the frameworks had SMS implementation plans with timelines. Although all frameworks referred to the need for evaluation of SMS implementation, few provided a detailed plan.

CONCLUSIONS

Differences across frameworks may have implications for their success including: the extent to which people with chronic disease are involved in policy making; the courses of action taken to enhance SMS; and planned implementation processes including governance and infrastructure. Further research is needed to examine how differences in frameworks have affected implementation and to identify the critical success factors in SMS policy implementation.

Evaluation of the "Foundations in Knowledge Translation" training initiative: preparing end users to practice KT

BACKGROUND

Current knowledge translation (KT) training initiatives are primarily focused on preparing researchers to conduct KT research rather than on teaching KT practice to end users. Furthermore, training initiatives that focus on KT practice have not been rigorously evaluated and have focused on assessing short-term outcomes and participant satisfaction only. Thus, there is a need for longitudinal training evaluations that assess the sustainability of training outcomes and contextual factors that may influence outcomes.

METHODS

We evaluated the KT training initiative "Foundations in KT" using a mixed-methods longitudinal design. "Foundations in KT" provided training in KT practice and included three tailored in-person workshops, coaching, and an online platform for training materials and knowledge exchange. Two cohorts were included in the study (62 participants, including 46 "Foundations in KT" participants from 16 project teams and 16 decision-maker partners). Participants completed self-report questionnaires, focus groups, and interviews at baseline and at 6, 12, 18, and 24 months after the first workshop.

RESULTS

Participant-level outcomes include survey results which indicated that participants' self-efficacy in evidence-based practice (F(1,8.9) = 23.7, p = 0.001, n = 45), KT activities (F(1,23.9) = 43.2, p < 0.001, n = 45), and using evidence to inform practice increased over time (F(1,11.0) = 6.0, p = 0.03, n = 45). Interviews and focus groups illustrated that participants' understanding of and confidence in using KT increased from baseline to 24 months after the workshop. Interviews and focus groups suggested that the training initiative helped participants achieve their KT project objectives, plan their projects, and solve problems over time. Contextual factors include teams with high self-reported organizational capacity and commitment to implement at the start of their project had buy-in from upper management that resulted in secured funding and resources for their project. Training initiative outcomes include participants who applied the KT knowledge and skills they learned to other projects by sharing their knowledge informally with coworkers. Sustained spread of KT practice was observed with five teams at 24 months.

CONCLUSIONS

We completed a longitudinal evaluation of a KT training initiative. Positive participant outcomes were sustained until 24 months after the initial workshop. Given the emphasis on implementing evidence and the need to train implementers, these findings are promising for future KT training.

Validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire

BACKGROUND

Organizational readiness to change healthcare practice is a major determinant of successful implementation of evidence-based interventions. However, we lack of comprehensive, valid, and reliable instruments to measure it. We assessed the validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire in the context of the implementation of the Prescribe Vida Saludable III project, which seeks to strengthen health promotion and chronic disease prevention in primary healthcare organizations of the Osakidetza (Basque Health Service, Spain).

METHODS

A cross-sectional study was conducted including 127 professionals from 20 primary care centers within Osakidetza. They filled in the OR4KT questionnaire twice in a 15- to 30-day period to test repeatability. In addition, we used the Survey of Organizational Attributes for Primary Care (SOAPC) and we documented the number of healthcare professionals who formally engaged in the Prescribe Vida Saludable III project within each participating center to assess concurrent validity.

RESULTS

Cronbach's alpha for the overall OR4KT was .95, and the overall repeatability coefficient was 6.95%, both excellent results. Confirmatory factor analysis supported the underlying theoretical structure of 6 dimensions and 23 sub-dimensions. There were positive moderate-to-high internal correlations between these six dimensions, and there was evidence of good concurrent validity (correlation coefficient of .76 with SOAPC, and .80 with the proportion of professionals engaged by center). A score higher than 64 (out of 100) would be indicative of an organization with high level of readiness to implement the intervention (sensitivity = .75, specificity = 1).

CONCLUSIONS

The Spanish version of the OR4KT exhibits very strong reliability and good validity, although it needs to be validated in a larger sample and in different implementation contexts.

Supporting the Evaluation and Implementation of Musculoskeletal Models of Care: A Globally Informed Framework for Judging Readiness and Success

OBJECTIVE

To develop a globally informed framework to evaluate readiness for implementation and success after implementation of musculoskeletal models of care (MOCs).

METHODS

Three phases were undertaken: 1) a qualitative study with 27 Australian subject matter experts (SMEs) to develop a draft framework; 2) an eDelphi study with an international panel of 93 SMEs across 30 nations to evaluate face validity, and refine and establish consensus on the framework components; and 3) translation of the framework into a user-focused resource and evaluation of its acceptability with the eDelphi panel.

RESULTS

A comprehensive evaluation framework was developed for judging the readiness and success of musculoskeletal MOCs. The framework consists of 9 domains, with each domain containing a number of themes underpinned by detailed elements. In the first Delphi round, scores of "partly agree" or "completely agree" with the draft framework ranged 96.7%-100%. In the second round, "essential" scores ranged 58.6%-98.9%, resulting in 14 of 34 themes being classified as essential. SMEs strongly agreed or agreed that the final framework was useful (98.8%), usable (95.1%), credible (100%) and appealing (93.9%). Overall, 96.3% strongly supported or supported the final structure of the framework as it was presented, while 100%, 96.3%, and 100% strongly supported or supported the content within the readiness, initiating implementation, and success streams, respectively.

CONCLUSION

An empirically derived framework to evaluate the readiness and success of musculoskeletal MOCs was strongly supported by an international panel of SMEs. The framework provides an important internationally applicable benchmark for the development, implementation, and evaluation of musculoskeletal MOCs.

The FORGE AHEAD clinical readiness consultation tool: a validated tool to assess clinical readiness for chronic disease care mobilization in Canada's First Nations

BACKGROUND

Given the astounding rates of diabetes and related complications, and the barriers to providing care present in Indigenous communities in Canada, intervention strategies that take into account contextual factors such as readiness to mobilize are needed to maximize improvements and increase the likelihood of success and sustainment. As part of the national FORGE AHEAD Program, we sought to develop, test and validate a clinical readiness consultation tool aimed at assessing the readiness of clinical teams working on-reserve in First Nations communities to participate in quality improvement (QI) to enhance diabetes care in Canada.

METHODS

A literature review was conducted to identify existing readiness tools. The ABCD - SAT was adapted using a consensus approach that emphasized a community-based participatory approach and prioritized the knowledge and wisdom held by community members. The tool was piloted with a group of 16 people from 7 provinces and 11 partnering communities to assess language use, clarity, relevance, format, and ease of completion using examples. Internal reliability analysis and convergence validity were conducted with data from 53 clinical team members from 11 First Nations communities (3-5 per community) who have participated in the FORGE AHEAD program.

RESULTS

The 27-page Clinical Readiness Consultation Tool (CRCT) consists of five main components, 21 sub-components, and 74 items that are aligned with the Expanded Chronic Care Model. Five-point Likert scale feedback from the pilot ranged from 3.25 to 4.5. Length of the tool was reported as a drawback but respondents noted that all the items were needed to provide a comprehensive picture of the healthcare system. Results for internal consistency showed that all sub-components except for two were within acceptable ranges (0.77-0.93). The Team Structure and Function sub-component scale had a moderately significant positive correlation with the validated Team Climate Inventory, r = 0.45, p < 0.05.

CONCLUSIONS

The testing and validation of the FORGE AHEAD CRCT demonstrated that the tool is acceptable, valid and reliable. The CRCT has been successfully used to support the implementation of the FORGE AHEAD Program and the health services changes that partnering First Nations communities have designed and undertaken to improve diabetes care.

TRIAL REGISTRATION NUMBER

Current ClinicalTrial.gov protocol ID NCT02234973 . Date of Registration: July 30, 2014.

Factor Structure, Reliability and Measurement Invariance of the Alberta Context Tool and the Conceptual Research Utilization Scale, for German Residential Long Term Care

We translated the Canadian residential long term care versions of the Alberta Context Tool (ACT) and the Conceptual Research Utilization (CRU) Scale into German, to study the association between organizational context factors and research utilization in German nursing homes. The rigorous translation process was based on best practice guidelines for tool translation, and we previously published methods and results of this process in two papers. Both instruments are self-report questionnaires used with care providers working in nursing homes. The aim of this study was to assess the factor structure, reliability, and measurement invariance (MI) between care provider groups responding to these instruments. In a stratified random sample of 38 nursing homes in one German region (Metropolregion Rhein-Neckar), we collected questionnaires from 273 care aides, 196 regulated nurses, 152 allied health providers, 6 quality improvement specialists, 129 clinical leaders, and 65 nursing students. The factor structure was assessed using confirmatory factor models. The first model included all 10 ACT concepts. We also decided a priori to run two separate models for the scale-based and the count-based ACT concepts as suggested by the instrument developers. The fourth model included the five CRU Scale items. Reliability scores were calculated based on the parameters of the best-fitting factor models. Multiple-group confirmatory factor models were used to assess MI between provider groups. Rather than the hypothesized ten-factor structure of the ACT, confirmatory factor models suggested 13 factors. The one-factor solution of the CRU Scale was confirmed. The reliability was acceptable (>0.7 in the entire sample and in all provider groups) for 10 of 13 ACT concepts, and high (0.90-0.96) for the CRU Scale. We could demonstrate partial strong MI for both ACT models and partial strict MI for the CRU Scale. Our results suggest that the scores of the German ACT and the CRU Scale for nursing homes are acceptably reliable and valid. However, as the ACT lacked strict MI, observed variables (or scale scores based on them) cannot be compared between provider groups. Rather, group comparisons should be based on latent variable models, which consider the different residual variances of each group.

Development and Initial Validation of a New Practice Context Assessment Tool for Ambulatory Practices Engaged in Quality Improvement

Variable success with quality improvement (QI) efforts in ambulatory care is often attributed to differences in local contexts. Identifying and addressing patient-, practice-, or community-level contextual factors might improve implementation of QI projects. The authors developed and validated a framework for a Practice Context Assessment (PCA), and then created the PCA instrument to glean insights from staff on contextual factors and distributed it at 10 ambulatory practice sites. The PCA framework showed acceptable expert-assessed content validity, with content validity index scores ranging from 0.74 (community engagement) to 0.97 (leadership). The PCA instrument comprised several scales grouped into 7 domains with Cronbach α scores from 0.83 (leadership) to 0.95 (patient and family engagement). The PCA framework provides a valid construct to help ambulatory practices understand contextual issues that might influence QI projects. A revised version of the PCA instrument is now ready for further testing.

Adapting collaborative depression care for public community long-term care: using research-practice partnerships

This manuscript details potential benefits for using a research-practice partnership to adapt collaborative depression care for public community long-term care agencies serving older adults. We used sequential, multi-phase, and mixed methods approaches for documenting the process of adaptation within a case study. Systematic adaptation strategies are described, such as leveraging long-term research-practice collaborations, consulting with multiple stakeholders across all levels and disciplines, and balancing demands to monitor treatment fidelity, clinical outcomes, and implementation results. These examples demonstrate that researchers interested in implementation science need skills to negotiate the competing demands that arise from both the research and practice settings.

A mixed methods evaluation of the maternal-newborn dashboard in Ontario: dashboard attributes, contextual factors, and facilitators and barriers to use: a study protocol

Background

There are wide variations in maternal-newborn care practices and outcomes across Ontario. To help institutions and care providers learn about their own performance, the Better Outcomes Registry & Network (BORN) Ontario has implemented an audit and feedback system, the Maternal-Newborn Dashboard (MND), for all hospitals providing maternal-newborn care. The dashboard provides (1) near real-time feedback, with site-specific and peer comparison data about six key performance indicators; (2) a visual display of evidence-practice gaps related to the indicators; and (3) benchmarks to provide direction for practice change. This study aims to evaluate the effects of the dashboard, dashboard attributes, contextual factors, and facilitation/support needs that influence the use of this audit and feedback system to improve performance. The objectives of this study are to (1) evaluate the effect of implementing the dashboard across Ontario; (2) explore factors that potentially explain differences in the use of the MND among hospitals; (3) measure factors potentially associated with differential effectiveness of the MND; and (4) identify factors that predict differences in hospital performance.

Methods/design

A mixed methods design includes (1) an interrupted time series analysis to evaluate the effect of the intervention on six indicators, (2) key informant interviews with a purposeful sample of directors/managers from up to 20 maternal-newborn care hospitals to explore factors that influence the use of the dashboard, (3) a provincial survey of obstetrical directors/managers from all maternal-newborn hospitals in the province to measure factors that influence the use of the dashboard, and (4) a multivariable generalized linear mixed effects regression analysis of the indicators at each hospital to quantitatively evaluate the change in practice following implementation of the dashboard and to identify factors most predictive of use.

Discussion

Study results will provide essential data to develop knowledge translation strategies for facilitating practice change, which can be further evaluated through a future cluster randomized trial.

The Council of Academic Hospitals of Ontario (CAHO) Adopting Research to Improve Care (ARTIC) Program: Reach, Sustainability, Spread and Lessons Learned from an Implementation Funding Model

Despite evidence on what works in healthcare, there is a significant gap in the time it takes to bring research into practice. The Council of Academic Hospitals of Ontario's Adopting Research to Improve Care program addresses this research-to-practice gap by incorporating the following components into its funding program: strategic selection of evidence for implementation, education and training for implementation, implementation supports, executive champions and governance, and evaluation. Funded projects have been sustained (76% reported full sustainability) and spread to over 200 new sites. Lessons learned include the following: assess readiness, develop tailored implementation materials, consider characteristics of implementation supports, protect champion time and consider evaluation feasibility.

Changing practice to support self-management and recovery in mental illness: application of an implementation model

Health services introducing practice changes need effective implementation methods. Within the setting of a community mental health service offering recovery-oriented psychosocial support for people with mental illness, we aimed to: (i) identify a well-founded implementation model; and (ii) assess its practical usefulness in introducing a new programme for recovery-oriented self-management support. We reviewed the literature to identify implementation models applicable to community mental health organisations, and that also had corresponding measurement tools. We used one of these models to inform organisational change strategies. The literature review showed few models with corresponding tools. The Promoting Action on Research Implementation in Health Services (PARIHS) model and the related Organisational Readiness to Change Assessment (ORCA) tool were used. The PARIHS proposes prerequisites for health service change and the ORCA measures the extent to which these prerequisites are present. Application of the ORCA at two time points during implementation of the new programme showed strategy-related gains for some prerequisites but not for others, reflecting observed implementation progress. Additional strategies to address target prerequisites could be drawn from the PARIHS model. The PARIHS model and ORCA tool have potential in designing and monitoring practice change strategies in community mental health organisations. Further practical use and testing of implementation models appears justified in overcoming barriers to change.

Models of care for musculoskeletal health: a cross-sectional qualitative study of Australian stakeholders' perspectives on relevance and standardised evaluation

BACKGROUND

The prevalence and impact of musculoskeletal conditions are predicted to rapidly escalate in the coming decades. Effective strategies are required to minimise 'evidence-practice', 'burden-policy' and 'burden-service' gaps and optimise health system responsiveness for sustainable, best-practice healthcare. One mechanism by which evidence can be translated into practice and policy is through Models of Care (MoCs), which provide a blueprint for health services planning and delivery. While evidence supports the effectiveness of musculoskeletal MoCs for improving health outcomes and system efficiencies, no standardised national approach to evaluation in terms of their 'readiness' for implementation and 'success' after implementation, is yet available. Further, the value assigned to MoCs by end users is uncertain. This qualitative study aimed to explore end users' views on the relevance of musculoskeletal MoCs to their work and value of a standardised evaluation approach.

METHODS

A cross-sectional qualitative study was undertaken. Subject matter experts (SMEs) with health, policy and administration and consumer backgrounds were drawn from three Australian states. A semi-structured interview schedule was developed and piloted to explore perceptions about musculoskeletal MoCs including: i) aspects important to their work (or life, for consumers) ii) usefulness of standardised evaluation frameworks to judge 'readiness' and 'success' and iii) challenges associated with standardised evaluation. Verbatim transcripts were analysed by two researchers using a grounded theory approach to derive key themes.

RESULTS

Twenty-seven SMEs (n = 19; 70.4 % female) including five (18.5 %) consumers participated in the study. MoCs were perceived as critical for influencing and initiating changes to best-practice healthcare planning and delivery and providing practical guidance on how to implement and evaluate services. A 'readiness' evaluation framework assessing whether critical components across the health system had been considered prior to implementation was strongly supported, while 'success' was perceived as an already familiar evaluation concept. Perceived challenges associated with standardised evaluation included identifying, defining and measuring key 'readiness' and 'success' indicators; impacts of systems and context changes; cost; meaningful stakeholder consultation and developing a widely applicable framework.

CONCLUSIONS

A standardised evaluation framework that includes a strong focus on 'readiness' is important to ensure successful and sustainable implementation of musculoskeletal MoCs.

Characteristics of community health organizations and decision-makers considering the adoption of motivational interviewing

Research related to the adoption of comparative effectiveness research (CER) in mental health practice is limited. This study explores the factors that influence decisions to adopt motivational interviewing (MI)-an evidence-based practice (EBP) grounded in CER-among decision-makers (n = 311) in community health organizations (n = 92). Descriptive analyses focus on organization and decision-maker characteristics and processes that may influence the decision to adopt an EBP, including demographics, structure and operations, readiness, attitudes, barriers, and facilitators. Within-group agreement is examined to determine the degree to which participants within each organization gave similar responses. Results show characteristics differed according to type of organization (community health versus community behavioral health) and position (directors versus staff). Within-group agreement was also influenced by position. These findings indicate different strategies may be needed to best disseminate CER to the two groups.

Predictors of the decision to adopt motivational interviewing in community health settings

The purpose of this study is to concurrently examine the impact of individual and organizational characteristics on the decision to adopt the evidence-based practice (EBP) motivational interviewing (MI) among directors and staff (n = 311) in community health organizations (n = 92). Results from hierarchical linear modeling indicated that, at the individual level, attitudes toward EBPs and race each predicted directors' decisions to adopt, while gender predicted staff's decisionmaking. At the organizational level, organizational climate was inversely associated with both staff's and directors' decisions to adopt MI. Organizational barriers to implementing EBPs and use of reading materials and treatment manuals were related to directors' decision to adopt. Type of organization and staff attributes were associated with staff's decision to adopt. These findings underscore the need to tailor dissemination and implementation strategies to address differences between directors and staff in the adoption of EBPs.

How to study improvement interventions: a brief overview of possible study types

Improvement (defined broadly as purposive efforts to secure positive change) has become an increasingly important activity and field of inquiry within healthcare. This article offers an overview of possible methods for the study of improvement interventions. The choice of available designs is wide, but debates continue about how far improvement efforts can be simultaneously practical (aimed at producing change) and scientific (aimed at producing new knowledge), and whether the distinction between the practical and the scientific is a real and useful one. Quality improvement projects tend to be applied and, in some senses, self-evaluating. They are not necessarily directed at generating new knowledge, but reports of such projects if well conducted and cautious in their inferences may be of considerable value. They can be distinguished heuristically from research studies, which are motivated by and set out explicitly to test a hypothesis, or otherwise generate new knowledge, and from formal evaluations of improvement projects. We discuss variants of trial designs, quasi-experimental designs, systematic reviews, programme evaluations, process evaluations, qualitative studies, and economic evaluations. We note that designs that are better suited to the evaluation of clearly defined and static interventions may be adopted without giving sufficient attention to the challenges associated with the dynamic nature of improvement interventions and their interactions with contextual factors. Reconciling pragmatism and research rigour is highly desirable in the study of improvement. Trade-offs need to be made wisely, taking into account the objectives involved and inferences to be made.

Making sense of implementation theories, models and frameworks

BACKGROUND

Implementation science has progressed towards increased use of theoretical approaches to provide better understanding and explanation of how and why implementation succeeds or fails. The aim of this article is to propose a taxonomy that distinguishes between different categories of theories, models and frameworks in implementation science, to facilitate appropriate selection and application of relevant approaches in implementation research and practice and to foster cross-disciplinary dialogue among implementation researchers.

DISCUSSION

Theoretical approaches used in implementation science have three overarching aims: describing and/or guiding the process of translating research into practice (process models); understanding and/or explaining what influences implementation outcomes (determinant frameworks, classic theories, implementation theories); and evaluating implementation (evaluation frameworks). This article proposes five categories of theoretical approaches to achieve three overarching aims. These categories are not always recognized as separate types of approaches in the literature. While there is overlap between some of the theories, models and frameworks, awareness of the differences is important to facilitate the selection of relevant approaches. Most determinant frameworks provide limited "how-to" support for carrying out implementation endeavours since the determinants usually are too generic to provide sufficient detail for guiding an implementation process. And while the relevance of addressing barriers and enablers to translating research into practice is mentioned in many process models, these models do not identify or systematically structure specific determinants associated with implementation success. Furthermore, process models recognize a temporal sequence of implementation endeavours, whereas determinant frameworks do not explicitly take a process perspective of implementation.

How to study improvement interventions: a brief overview of possible study types

Improvement (defined broadly as purposive efforts to secure positive change) has become an increasingly important activity and field of inquiry within healthcare. This article offers an overview of possible methods for the study of improvement interventions. The choice of available designs is wide, but debates continue about how far improvement efforts can be simultaneously practical (aimed at producing change) and scientific (aimed at producing new knowledge), and whether the distinction between the practical and the scientific is a real and useful one. Quality improvement projects tend to be applied and, in some senses, self-evaluating. They are not necessarily directed at generating new knowledge, but reports of such projects if well conducted and cautious in their inferences may be of considerable value. They can be distinguished heuristically from research studies, which are motivated by and set out explicitly to test a hypothesis, or otherwise generate new knowledge, and from formal evaluations of improvement projects. We discuss variants of trial designs, quasi-experimental designs, systematic reviews, programme evaluations, process evaluations, qualitative studies, and economic evaluations. We note that designs that are better suited to the evaluation of clearly defined and static interventions may be adopted without giving sufficient attention to the challenges associated with the dynamic nature of improvement interventions and their interactions with contextual factors. Reconciling pragmatism and research rigour is highly desirable in the study of improvement. Trade-offs need to be made wisely, taking into account the objectives involved and inferences to be made.

Interventions to increase the use of electronic health information by healthcare practitioners to improve clinical practice and patient outcomes

BACKGROUND

There is a large volume of health information available, and, if applied in clinical practice, may contribute to effective patient care. Despite an abundance of information, sub-optimal care is common. Many factors influence practitioners' use of health information, and format (electronic or other) may be one such factor.

OBJECTIVES

To assess the effects of interventions aimed at improving or increasing healthcare practitioners' use of electronic health information (EHI) on professional practice and patient outcomes.

SEARCH METHODS

We searched The Cochrane Library (Wiley), MEDLINE (Ovid), EMBASE (Ovid), CINAHL (EBSCO), and LISA (EBSCO) up to November 2013. We contacted researchers in the field and scanned reference lists of relevant articles.

SELECTION CRITERIA

We included studies that evaluated the effects of interventions to improve or increase the use of EHI by healthcare practitioners on professional practice and patient outcomes. We defined EHI as information accessed on a computer. We defined 'use' as logging into EHI. We considered any healthcare practitioner involved in patient care. We included randomized, non-randomized, and cluster randomized controlled trials (RCTs, NRCTs, CRCTs), controlled clinical trials (CCTs), interrupted time series (ITS), and controlled before-and-after studies (CBAs).The comparisons were: electronic versus printed health information; EHI on different electronic devices (e.g. desktop, laptop or tablet computers, etc.; cell / mobile phones); EHI via different user interfaces; EHI provided with or without an educational or training component; and EHI compared to no other type or source of information.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data and assessed the risk of bias for each study. We used GRADE to assess the quality of the included studies. We reassessed previously excluded studies following our decision to define logins to EHI as a measure of professional behavior. We reported results in natural units. When possible, we calculated and reported median effect size (odds ratio (OR), interquartile ranges (IQR)). Due to high heterogeneity across studies, meta-analysis was not feasible.

MAIN RESULTS

We included two RCTs and four CRCTs involving 352 physicians, 48 residents, and 135 allied health practitioners. Overall risk of bias was low as was quality of the evidence. One comparison was supported by three studies and three comparisons were supported by single studies, but outcomes across the three studies were highly heterogeneous. We found no studies to support EHI versus no alternative. Given these factors, it was not possible to determine the relative effectiveness of interventions. All studies reported practitioner use of EHI, two reported on compliance with electronic practice guidelines, and none reported on patient outcomes.One trial (139 participants) measured guideline adherence for an electronic versus printed guideline, but reported no difference between groups (median OR 0.85, IQR 0.74 to 1.08). One small cross-over trial (10 participants) reported increased use of clinical guidelines when provided with a mobile versus stationary, desktop computer (mean use per shift: intervention group (IG) 3.6, standard deviation (SD) 1.7 vs. control group (CG) 2.0 (SD 1.9), P value = 0.033). One cross-over trial (203 participants) reported that using a customized versus a generic interface had little impact on practitioners' use of EHI (mean difference in adjusted end-of-study rate: 0.77 logins/month/user, 95% confidence interval (CI) CI 0.43 to 1.11). Three trials included education or training and reported increased use of EHI by practitioners following training.

AUTHORS' CONCLUSIONS

This review provided no evidence that the use of EHI translates into improved clinical practice or patient outcomes, though it does suggest that when practitioners are provided with EHI and education or training, the use of EHI increases. We have defined use as the activity of logging into an EHI resource, but based on our findings use does not automatically translate to the application of EHI in practice. While using EHI may be an important component of evidence-based medicine, alone it is insufficient to improve patient care or clinical practices. For EHI to be applied in patient care, it will be necessary to understand why practitioners' are reluctant to apply EHI when treating people, and to determine the most effective way(s) to reduce this reluctance.

A systematic review of instruments to assess organizational readiness for knowledge translation in health care

BACKGROUND

The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.

METHODS

We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.

FINDINGS

We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments.

CONCLUSION

Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts.

Organizational readiness for knowledge translation in chronic care: a Delphi study

Background

Health-care organizations need to be ready prior to implement evidence-based interventions. In this study, we sought to achieve consensus on a framework to assess the readiness of health-care organizations to implement evidence-based interventions in the context of chronic care.

Methods

We conducted a web-based modified Delphi study between March and May 2013. We contacted 76 potentially eligible international experts working in the fields of organizational readiness (OR), knowledge translation (KT), and chronic care to comment upon the 76 elements resulting from our proposed conceptual map. This conceptual map was based on a systematic review of the existing frameworks of Organizational Readiness for Change (ORC) in health-care. We developed a conceptual map that proposed a set of core concepts and their associated 17 dimensions and 59 sub-dimensions. Experts rated their agreement concerning the applicability and importance of ORC elements on a 5-point Likert scale, where 1 indicates total disagreement and 5 indicates total agreement. Two rounds were needed to get a consensus from the experts. Consensus was a priori defined as strong (≥75%) or moderate (60-74%). Simple descriptive statistics was used.

Results

In total, 14 participants completed the first round and 10 completed the two rounds. Panel members reached consensus on the applicability and importance of 6 out of 17 dimensions and 28 out of 59 sub-dimensions to assess OR for KT in the context of chronic care. A strong level of consensus (≥75%) was attained on the Organizational contextual factors, Leadership/participation, Organizational support, and Motivation dimensions. The Organizational climate for change and Change content dimensions reached a moderate consensus (60-74%). Experts also reached consensus on 28 out of 59 sub-dimensions to assess OR for KT. Twenty-one sub-dimensions reached a strong consensus (≥75%) and seven a moderate consensus (60-74%).

Conclusion

This study results provided the most important and applicable dimensions and sub-dimensions for assessing OR-KT in the context of chronic care. They can be used to guide the design of an assessment tool to improve knowledge translation in the field of chronic care.

The development of an online decision support tool for organizational readiness for change

Background

Much importance has been placed on assessing readiness for change as one of the earliest steps of implementation, but measuring it can be a complex and daunting task. Organizations and individuals struggle with how to reliably and accurately measure readiness for change. Several measures have been developed to help organizations assess readiness, but these are often underused due to the difficulty of selecting the right measure. In response to this challenge, we will develop and test a prototype of a decision support tool that is designed to guide individuals interested in implementation in the selection of an appropriate readiness assessment measure for their setting.

Methods

A multi-phase approach will be used to develop the decision support tool. First, we will identify key measures for assessing organizational readiness for change from a recently completed systematic review. Included measures will be those developed for healthcare settings (e.g., acute care, public health, mental health) and that have been deemed valid and reliable. Second, study investigators and field experts will engage in a mapping exercise to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a stakeholder panel will be recruited and consulted to determine the feasibility and relevance of the selected measures using a modified Delphi process. Fourth, findings from the mapping exercise and stakeholder consultation will inform the development of a decision support tool that will guide users in appropriately selecting change readiness measures. Fifth, the tool will undergo usability testing.

Discussion

Our proposed decision support tool will address current challenges in the field of organizational change readiness by aiding individuals in selecting a valid and reliable assessment measure that is relevant to user needs and practice settings. We anticipate that implementers and researchers who use our tool will be more likely to conduct readiness for change assessments in their settings when planning for implementation. This, in turn, may contribute to more successful implementation outcomes. We will test this tool in a future study to determine its efficacy and impact on implementation processes.

What supports physiotherapists' use of research in clinical practice? A qualitative study in Sweden

Background

Evidence-based practice has increasingly been recognized as a priority by professional physiotherapy organizations and influential researchers and clinicians in the field. Numerous studies in the past decade have documented that physiotherapists hold generally favorable attitudes to evidence-based practice and recognize the importance of using research to guide their clinical practice. Research has predominantly investigated barriers to research use. Less is known about the circumstances that actually support use of research by physiotherapists. This study explores the conditions at different system levels that physiotherapists in Sweden perceive to be supportive of their use of research in clinical practice.

Methods

Patients in Sweden do not need a referral from a physician to consult a physiotherapist and physiotherapists are entitled to choose and perform any assessment and treatment technique they find suitable for each patient. Eleven focus group interviews were conducted with 45 physiotherapists, each lasting between 90 and 110 minutes. An inductive approach was applied, using topics rather than questions to allow the participants to generate their own questions and pursue their own priorities within the framework of the aim. The data were analyzed using qualitative content analysis.

Results

Analysis of the data yielded nine favorable conditions at three system levels supporting the participant’s use of research in clinical practice: two at the individual level (attitudes and motivation concerning research use; research-related knowledge and skills), four at the workplace level (leadership support; organizational culture; research-related resources; knowledge exchange) and three at the extra-organizational level (evidence-based practice guidelines; external meetings, networks, and conferences; academic research and education).

Conclusions

Supportive conditions for physiotherapists’ use of research exist at multiple interdependent levels, including the individual, workplace, and extra-organizational levels. Research use in physiotherapy appears to be an interactive and interpretative social process that involves a great deal of interaction with various people, including colleagues and patients.

Writing implementation research grant proposals: ten key ingredients

BACKGROUND

All investigators seeking funding to conduct implementation research face the challenges of preparing a high-quality proposal and demonstrating their capacity to conduct the proposed study. Applicants need to demonstrate the progressive nature of their research agenda and their ability to build cumulatively upon the literature and their own preliminary studies. Because implementation science is an emerging field involving complex and multilevel processes, many investigators may not feel equipped to write competitive proposals, and this concern is pronounced among early stage implementation researchers.

DISCUSSION

This article addresses the challenges of preparing grant applications that succeed in the emerging field of dissemination and implementation. We summarize ten ingredients that are important in implementation research grants. For each, we provide examples of how preliminary data, background literature, and narrative detail in the application can strengthen the application.

SUMMARY

Every investigator struggles with the challenge of fitting into a page-limited application the research background, methodological detail, and information that can convey the project's feasibility and likelihood of success. While no application can include a high level of detail about every ingredient, addressing the ten ingredients summarized in this article can help assure reviewers of the significance, feasibility, and impact of the proposed research.