What can management theories offer evidence-based practice? A comparative analysis of measurement tools for organisational context

Exploring what influences physiotherapists' capability, opportunity and motivation to integrate new evidence into routine clinical care using the Balance Intensity Scale

PURPOSE

To explore influences on the capability, opportunity and motivation of physiotherapists integrating new evidence into routine care.

MATERIALS AND METHODS

Mixed-methods study utilising the Theoretical Domains Framework and Capability-Opportunity-Motivation-Behaviour model. Metropolitan inpatient rehabilitation physiotherapists participated by integrating the Balance Intensity Scale into routine care for 6 weeks. Evidence integration was supported by a tailored theory-informed approach. Participants completed pre- and post-evidence integration surveys and a post-evidence integration focus group.

RESULTS

Pre- and post-surveys were completed by 24 and 12 participants, respectively. One focus group (n = 7) was conducted. Framework analysis identified themes in Capability (n = 4), Opportunity (n = 4) and Motivation (n = 5) domains influencing behaviour when implementing new evidence. The evidence integration process enhanced participants' Knowledge (p = 0.04), Skills (p = 0.003) and Belief in capabilities (p = 0.03) when prescribing and measuring balance exercises.

CONCLUSIONS

This study identified perceived barriers and enablers to evidence integration of a new outcome measure into routine care. It highlights strategies that may support physiotherapy teams in incorporating new evidence into routine care. These strategies include education on the evidence being implemented, physical resources, change champions to facilitate social support, management endorsement, and recognition of the time and effort required for evidence integration in the short term.

Innovation in healthcare: leadership perceptions about the innovation characteristics of artificial intelligence-a qualitative interview study with healthcare leaders in Sweden

BACKGROUND

Despite the extensive hopes and expectations for value creation resulting from the implementation of artificial intelligence (AI) applications in healthcare, research has predominantly been technology-centric rather than focused on the many changes that are required in clinical practice for the technology to be successfully implemented. The importance of leaders in the successful implementation of innovations in healthcare is well recognised, yet their perspectives on the specific innovation characteristics of AI are still unknown. The aim of this study was therefore to explore the perceptions of leaders in healthcare concerning the innovation characteristics of AI intended to be implemented into their organisation.

METHODS

The study had a deductive qualitative design, using constructs from the innovation domain in the Consolidated Framework for Implementation Research (CFIR). Interviews were conducted with 26 leaders in healthcare.

RESULTS

Participants perceived that AI could provide relative advantages when it came to care management, supporting clinical decisions, and the early detection of disease and risk of disease. The development of AI in the organisation itself was perceived as the main current innovation source. The evidence base behind AI technology was questioned, in relation to its transparency, potential quality improvement, and safety risks. Although the participants acknowledged AI to be superior to human action in terms of effectiveness and precision in some situations, they also expressed uncertainty about the adaptability and trialability of AI. Complexities such as the characteristics of the technology, the lack of conceptual consensus about AI, and the need for a variety of implementation strategies to accomplish transformative change in practice were identified, as were uncertainties about the costs involved in AI implementation.

CONCLUSION

Healthcare leaders not only saw potential in the technology and its use in practice, but also felt that AI's opacity limits its evidence strength and that complexities in relation to AI itself and its implementation influence its current use in healthcare practice. More research is needed based on actual experiences using AI applications in real-world situations and their impact on clinical practice. New theories, models, and frameworks may need to be developed to meet challenges related to the implementation of AI in healthcare.

Absorptive capacity in the adoption of innovations in health: a scoping review

OBJECTIVE

The objective of this scoping review was to explore how absorptive capacity has been conceptualized and measured in studies of innovation adoption in health care organizations.

INTRODUCTION

Current literature highlights the need to incorporate knowledge translation processes at the organizational and system level to enhance the adoption of new knowledge into practice. Absorptive capacity is a set of routines and processes characterized by knowledge acquisition, assimilation, transformation, and application. A key concept in organizational learning theory, absorptive capacity is thought to be critical to the adoption of new knowledge and innovations in organizations. To understand how absorptive capacity was conceptualized and measured in health care organizations, it was appropriate to conduct a scoping review to answer our research question.

INCLUSION CRITERIA

This scoping review included published and unpublished primary studies (ie, experimental, quasi-experimental, observational, and qualitative study designs), as well as reviews that broadly focused on the adoption of innovations at the organizational level in health care, and framed innovation adoption as processes that rely on organizational learning and absorptive or learning capacity.

METHODS

Searches included electronic databases (ie, MEDLINE, Embase, PsycINFO, CINAHL, and Scopus) and gray literature, as well as reference scanning of relevant studies. Study abstracts and full texts were screened for eligibility by two independent reviewers. Data extraction of relevant studies was also done independently by two reviewers. All discrepancies were addressed through discussion or adjudicated by a third reviewer. Synthesis of the extracted data focused on descriptive frequencies and counts of the results. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR).

RESULTS

The search strategies identified a total of 7433 citations. Sixteen papers were identified for inclusion, including a set of two companion papers, and data were extracted from 15 studies. We synthesized the objectives of the included studies and identified that researchers focused on at least one of the following aspects: i) exploring pre-existing capacity that affects improvement and innovation in health care settings; ii) describing factors influencing the spread and sustainability of organizations; iii) identifying measures and testing the knowledge application process; and iv) providing construct clarity. No new definitions were identified within this review; instead existing definitions were refined to suit the local context of the health care organization in which they were used.

CONCLUSIONS

Given the rapidly changing and evolving nature of health care, it is important to understand both current best practices and an organization's ability to acquire, assimilate, transform, and apply these practices to their specific organization. While much research has gone into developing ways to implement knowledge translation, understanding an organization's internal structures and framework for seeking out and implementing new evidence as it relates to absorptive capacity is still a relatively novel concept.

Building learning organizational culture during COVID-19 outbreak: a national study

Background

Hospitals and healthcare institutions should be observant of the ever-changing environment and be adaptive to learning practices. By adopting the steps and other components of organizational learning, healthcare institutions can convert themselves into learning organizations and ultimately strengthen the overall healthcare system of the country. The present study aimed to examine the influence of several organizational learning dimensions on organization culture in healthcare settings during the COVID-19 outbreak.

Methods

During COVID-19 crisis in 2020, an online cross-sectional study was performed. Data were collected via official emails sent to 1500 healthcare professionals working in front line at four sets of hospitals in Saudi Arabia. Basic descriptive analysis was constructed to identify the variation between the four healthcare organizations. A multiple regression was employed to explore how hospitals can adopt learning process during pandemics, incorporating several Dimensions of Learning Organizations Questionnaire (DLOQ) developed by Marsick and Watkins (2003) and Leufvén and others (2015).

Results

Organizational learning including system connections (M = 3.745), embedded systems (M = 3.732), and team work and collaborations (M = 3.724) tended to have major significant relationships with building effective learning organization culture. Staff empowerment, dialogues and inquiry, internal learning culture, and continuous learning had the lowest effect on building health organization culture (M = 3.680, M = 3.3.679, M = 3.673, M = 3.663, respectively). A multiple linear regression was run to predict learning organization based on the several variables. These variables statistically significantly predicted learning organization, F (6, 1124) = 168.730, p < .0005, R² = 0.471, (p < .05).

Discussion

The findings concluded that although intrinsic factors like staff empowerment, dialogues and inquiry, and internal learning culture, revealed central roles, still the most crucial factors toward the development of learning organization culture were extrinsic ones including connections, embed system and collaborations.

Conclusions

Until knowledge-sharing is embedded in health organizational systems; organizations may not maintain a high level of learning during crisis.

What makes a 'successful' collaborative research project between public health practitioners and academics? A mixed-methods review of funding applications submitted to a local intervention evaluation scheme

Background

The national Public Health Practice Evaluation Scheme (PHPES) is a response-mode funded evaluation programme operated by the National Institute for Health Research School for Public Health Research (NIHR SPHR). The scheme enables public health professionals to work in partnership with SPHR researchers to conduct rigorous evaluations of their interventions. Our evaluation reviewed the learning from the first five years of PHPES (2013–2017) and how this was used to implement a revised scheme within the School.

Methods

We conducted a rapid review of applications and reports from 81 PHPES projects and sampled eight projects (including unfunded) to interview one researcher and one practitioner involved in each sampled project (n = 16) in order to identify factors that influence success of applications and effective delivery and dissemination of evaluations. Findings from the review and interviews were tested in an online survey with practitioners (applicants), researchers (principal investigators [PIs]) and PHPES panel members (n = 19) to explore the relative importance of these factors. Findings from the survey were synthesised and discussed for implications at a national workshop with wider stakeholders, including public members (n = 20).

Results

Strengths: PHPES provides much needed resources for evaluation which often are not available locally, and produces useful evidence to understand where a programme is not delivering, which can be used to formatively develop interventions. Weaknesses: Objectives of PHPES were too narrowly focused on (cost-)effectiveness of interventions, while practitioners also valued implementation studies and process evaluations. Opportunities: PHPES provided opportunities for novel/promising but less developed ideas. More funded time to develop a protocol and ensure feasibility of the intervention prior to application could increase intervention delivery success rates. Threats: There can be tensions between researchers and practitioners, for example, on the need to show the 'success’ of the intervention, on the use of existing research evidence, and the importance of generalisability of findings and of generating peer-reviewed publications.

Conclusions

The success of collaborative research projects between public health practitioners (PHP) and researchers can be improved by funders being mindful of tensions related to (1) the scope of collaborations, (2) local versus national impact, and (3) increasing inequalities in access to funding. Our study and comparisons with related funding schemes demonstrate how these tensions can be successfully resolved.

Health Sciences-Evidence Based Practice Questionnaire (HS-EBP): Normative Data and Differential Profiles in Spanish Osteopathic Professionals

The main goal of this study was to obtain normative data of the scores of the Health-Sciences Evidence Based Practice (HS-EBP) questionnaire, and to analyse evidence-based practice (EBP) among potential clusters of osteopathy professionals in Spain. An online descriptive cross-sectional study has been applied. A total number of 443 Spanish practicing osteopaths answered a survey including the 5 dimensions of the HS-EBP questionnaire and sociodemographic, training, and practice variables using the “LimeSurvey” online platform. Results point out that the median scores for each five HS-EBP questionnaire dimensions were 95.00, 86.00, 78.00, 84.00 and 62.00 considering that the range of possible scores in each of the dimensions was: from 12 to 120 in dimensions 1, 4 and 5; from 14–140 in dimension 2; and from 10–100 in dimension 3. A clustering algorithm extracted 6 different profiles across the five HS-EBP latent dimensions: low scores in all dimensions (cluster 1); low scores in all dimensions but with medium scores in dimension 1 (cluster 2); mixed pattern of scores, low in dimensions 2 and 5 and medium in the rest of the dimensions; medium scores in all dimensions (cluster 4); high scores in all dimensions and low scores in dimension 5 (cluster 5); and high scores in all dimensions (cluster 6). Significant relationship was found among the response patterns in the clusters and: academic degree level, EBP training and training level, and work time invested in healthcare activity, research and teaching activity. These results allow a description of the actual level of EBP and differential profiles of Osteopathy care practice in Spain. Knowledge of normative scores of the HS-EBP questionnaire and identification of different predictors of Spanish osteopaths’ EBP, e.g., academic degree, EBP training and training level, work time invested in healthcare activity, research, and teaching activity, and having a working relationship with an accredited educational centre, enable a comprehensive evaluation of the EBP of osteopathic professionals and can also be useful for developing and implementing formative intervention programs for improving EBP practice in osteopathic practice.

Measures of outer setting constructs for implementation research: A systematic review and analysis of psychometric quality

Background

Despite their influence, outer setting barriers (e.g., policies, financing) are an infrequent focus of implementation research. The objective of this systematic review was to identify and assess the psychometric properties of measures of outer setting used in behavioral and mental health research.

Methods

Data collection involved (a) search string generation, (b) title and abstract screening, (c) full-text review, (d) construct mapping, and (e) measure forward searches. Outer setting constructs were defined using the Consolidated Framework for Implementation Research (CFIR). The search strategy included four relevant constructs separately: (a) cosmopolitanism, (b) external policy and incentives, (c) patient needs and resources, and (d) peer pressure. Information was coded using nine psychometric criteria: (a) internal consistency, (b) convergent validity, (c) discriminant validity, (d) known-groups validity, (e) predictive validity, (f) concurrent validity, (g) structural validity, (h) responsiveness, and (i) norms. Frequencies were calculated to summarize the availability of psychometric information. Information quality was rated using a 5-point scale and a final median score was calculated for each measure.

Results

Systematic searches yielded 20 measures: four measures of the general outer setting domain, seven of cosmopolitanism, four of external policy and incentives, four of patient needs and resources, and one measure of peer pressure. Most were subscales within full scales assessing implementation context. Typically, scales or subscales did not have any psychometric information available. Where information was available, the quality was most often rated as "1-minimal" or "2-adequate."

Conclusion

To our knowledge, this is the first systematic review to focus exclusively on measures of outer setting factors used in behavioral and mental health research and comprehensively assess a range of psychometric criteria. The results highlight the limited quantity and quality of measures at this level. Researchers should not assume "one size fits all" when measuring outer setting constructs. Some outer setting constructs may be more appropriately and efficiently assessed using objective indices or administrative data reflective of the system rather than the individual.

Unit Leadership and Climates for Evidence-Based Practice Implementation in Acute Care: A Cross-Sectional Descriptive Study

PURPOSE

The purposes of this study were to (a) describe nurse manager (NM) leadership behaviors for evidence-based practice, NM evidence-based practice competencies, and unit climates for evidence-based practice implementation in acute care, and (b) test for differences in NMs' and staff nurses' (RNs') perceptions.

DESIGN

A multisite cross-sectional design was used to collect data from a sample of 24 NMs and 553 RNs from 24 adult medical-surgical units in seven U.S. community hospitals.

METHODS

Responses were collected using electronic questionnaires, inclusive of the Nurse Manager Evidence-Based Practice Competency Scale (NM only), Implementation Leadership Scale, and Implementation Climate Scale. E-mail reminders and gift card lottery drawings encouraged response. Descriptive statistics described total and subscale scores by role. Differences in perceptions were evaluated using independent t-tests with Bonferroni correction (α = .05).

FINDINGS

23 NMs and 287 RNs responded (95.8% and 51.9% response rates, respectively). NMs reported they were "somewhat competent" in evidence-based practice (M = 1.62 [SD = 0.5]; 0-3 scale). NMs and RNs perceived leadership behaviors (NM: M = 2.73 [SD = 0.46]; RN: M = 2.88 [SD = 0.78]; 0-4 scale) and unit climates for evidence-based practice implementation (NM: M = 2.16 [SD = 0.67]; RN: M = 2.24 [SD = 0.74]; 0-4 scale) as evident to a "moderate extent." RN and NM perceptions differed significantly on the Proactive (p = .01) and Knowledgeable (p < .001) leadership subscales.

CONCLUSIONS

Evidence-based practice competencies and leadership behaviors of NMs, and unit climates for evidence-based practice were modest at best and interventions are needed. To close the research to practice gap, future studies should investigate the interplay between social dynamic context factors and implementation strategies to promote uptake of evidence-based practices.

CLINICAL RELEVANCE

Critical attention is needed to build organizational capacity for evidence-based practices through development of unit leadership and climate for evidence-based practice to accelerate routine use of evidence-based practices for improving care delivery and patient outcomes. The three instruments described herein provide a foundation for nurse leaders to assess these dynamic context factors and design interventions or programs where there is opportunity for improvement.

NHS managers’ use of nursing workforce planning and deployment technologies: a realist synthesis

Background

Policy and reviews of health-care safety and quality emphasise the role of NHS managers in ensuring safe, good-quality patient care through effective staffing. Guidance requires that NHS managers combine professional judgement with evidence-based workforce planning and deployment tools and technologies (WPTs). Evidence has focused on the effectiveness of WPTs, but little is known about supporting their implementation, or the impact of using WPTs across settings.

Objectives

The review answered the following question: ‘NHS managers’ use of workforce planning and deployment technologies and their impacts on nursing staffing and patient care: what works, for whom, how and in what circumstances?’.

Design

A realist synthesis was conducted. A programme theory was formulated and expressed as hypotheses in the form of context, mechanisms and outcomes; this considered how, through using WPTs, particular conditions produced responses to generate outcomes. There were four phases: (1) development of a theoretical territory to understand nurse workforce planning and deployment complexity, resulting in an initial programme theory; (2) retrieval, review and synthesis of evidence, guided by the programme theory; (3) testing and refinement of the programme theory for practical application; and (4) actionable recommendations to support NHS managers in the implementation of WPTs for safe staffing.

Participants

NHS managers, patient and public representatives and policy experts informed the programme theory in phase 1, which was validated in interviews with 10 NHS managers. In phase 3, 11 NHS managers were interviewed to refine the programme theory.

Results

Workforce planning and deployment tools and technologies can be characterised functionally by their ability to summarise and aggregate staffing information, communicate about staffing, allocate staff and facilitate compliance with standards and quality assurance. NHS managers need to combine local knowledge and professional judgement with data from WPTs for effective staffing decisions. WPTs are used in a complex workforce system in which proximal factors (e.g. the workforce satisfaction with staffing) can influence distal factors (e.g. organisational reputation and potential staff recruitment). The system comprises multiple organisational strategies (e.g. professional and financial), which may (or may not) align around effective staffing. The positive impact of WPTs can include ensuring that staff are allocated effectively, promoting the patient safety agenda within an organisation, learning through comparison about ‘what works’ in effective staffing and having greater influence in staffing work. WPTs appear to have a positive impact when they visibly integrate data on needs and resources and when there is technical and leadership support. A collaborative process appears to be best for developing and implementing WPTs, so that they are fit for purpose.

Limitations

The evidence, predominantly from acute care, often lacked detail on how managers applied professional judgement to WPTs for staffing decisions. The evidence lacked specificity about how managers develop skills on communicating staffing decisions to patients and the public.

Conclusions and recommendations

The synthesis produced initial explanations of the use and impact of WPTs for decision-making and what works to support NHS managers to use these effectively. It is suggested that future research should further evaluate the programme theory.

Study registration

This study is registered as PROSPERO CRD42016038132.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

How dislocation and professional anxiety influence readiness for change during the implementation of hospital-based home care for children newly diagnosed with diabetes - an ethnographic analysis of the logic of workplace change

Background

In 2013–14, the evidence based care model Hospital-based Home Care for children newly diagnosed with diabetes was implemented at a large paediatric diabetes care facility in the south of Sweden. The first step of the implementation was to promote readiness for change among the professionals within the diabetes team through regular meetings. The aim was to analyse the implicit facilitators and barriers evident on a cultural micro level in discussions during the course of these meetings. What conceptions, ideals and identities might complicate, or facilitate, implementation?

Methods

A case study was conducted during the implementation process. This article draw on ethnographic observations carried out at team meetings (n = 6) during the introductory element of implementation. From a discourse theoretical perspective, the verbal negotiations during these meetings were analysed.

Results

Three aspects were significant in order to understand the dislocation during this element of implementation: an epistemological disagreement that challenged the function of information within care practice; a paradoxical understanding of the time-knowledge intersection; and expressions of professional anxiety. More concretely, the professionals exhibited an unwillingness to give up the opportunity to provide structured, age-independent information; a resistance against allowing early discharge; and a professional identity formed both by altruistic concern and occupational guardiancy. The findings suggest the necessity of increased awareness of the conceptions and ideals that constitute the basis of a certain professional practice; a deeper understanding of the cultural meaning that influences care practice within a specific logic in order to predict in what way these ideals might be challenged by the implemented evidence.

Conclusions

Our main contribution is the argument that the implemented evidence in itself needs to be examined and problematized from a cultural analytical perspective before initiation in order to be able to actively counter negative connotations and resistance.

Assessing the capacity of ministries of health to use research in decision-making: conceptual framework and tool

Background

The capacity to demand and use research is critical for governments if they are to develop policies that are informed by evidence. Existing tools designed to assess how government officials use evidence in decision-making have significant limitations for low- and middle-income countries (LMICs); they are rarely tested in LMICs and focus only on individual capacity. This paper introduces an instrument that was developed to assess Ministry of Health (MoH) capacity to demand and use research evidence for decision-making, which was tested for reliability and validity in eight LMICs (Bangladesh, Fiji, India, Lebanon, Moldova, Pakistan, South Africa, Zambia).

Methods

Instrument development was based on a new conceptual framework that addresses individual, organisational and systems capacities, and items were drawn from existing instruments and a literature review. After initial item development and pre-testing to address face validity and item phrasing, the instrument was reduced to 54 items for further validation and item reduction. In-country study teams interviewed a systematic sample of 203 MoH officials. Exploratory factor analysis was used in addition to standard reliability and validity measures to further assess the items.

Results

Thirty items divided between two factors representing organisational and individual capacity constructs were identified. South Africa and Zambia demonstrated the highest level of organisational capacity to use research, whereas Pakistan and Bangladesh were the lowest two. In contrast, individual capacity was highest in Pakistan, followed by South Africa, whereas Bangladesh and Lebanon were the lowest.

Conclusion

The framework and related instrument represent a new opportunity for MoHs to identify ways to understand and improve capacities to incorporate research evidence in decision-making, as well as to provide a basis for tracking change.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-017-0227-3) contains supplementary material, which is available to authorized users.

Quality improvement in large healthcare organizations

PURPOSE

The purpose of this paper is to investigate the obstacles and challenges associated with organizational monitoring and follow-up (M & F) processes related to health care quality improvement (QI) and development.

DESIGN/METHODOLOGY/APPROACH

A longitudinal case study of a large health care organization during a system-wide QI intervention. Content analysis was conducted of repeated interviews with key actors and archival data collected over a period of four years.

FINDINGS

The demand for improved M & F strategies, and what and how to monitor were described by the respondents. Obstacles and challenges for achieving M & F strategies that enables system-wide and coherent development were found in three areas: monitoring, processing, and feedback and communication. Also overarching challenges were found.

PRACTICAL IMPLICATIONS

A model of important aspects of M & F systems is presented that can be used for analysis and planning and contribute to shared cognition of such systems. Approaches for systematic analysis and follow-up of identified problems have to be developed and fully incorporated in the organization's measurement systems. A systematic M & F needs analytic and process-oriented competence, and this study highlights the potential in an organizational function with capacity and mandate for such tasks.

ORIGINALITY/VALUE

Most health care systems are flooded with a vast amount of registers, records, and measurements. A key issue is how such data can be processed and refined to reflect the needs and the development process of the health care system and how rich data can be used for improvement purposes. This study presents key organizational actor's view on important factors to consider when building a coherent organizational M & F strategy.

The impact of organisational change and fiscal restraint on organisational culture

Background

Strategies to implement evidence-based practice have highlighted the bidirectional relationship of organisational change on organisational culture. The present study examined changes in perceptions of organisational culture in two community mental health services implementing cognitive therapies into routine psychosis care over 3 years. During the time of the study there were a number of shared planned and unplanned changes that the mental health services had to accommodate. One service, Metro South, had the additional challenge of embarking on a major organisational restructure.

Methods

A survey of organisational culture was administered to clinical staff of each service at yearly intervals over the 3 years.

Results

At baseline assessment there was no significant difference between the two services in organisational culture. At the midpoint assessment, which was conducted at the time the Metro South restructure was operationalized, there were less positive ratings of organisational culture recorded in Metro South compared to the other service. Organisational culture returned to near-baseline levels at endpoint assessment.

Conclusions

These findings are consistent with the literature that organisational culture is relatively robust and resilient. It is also consistent with the literature that, at any one time, a service or organisation may have a finite capacity to absorb change. Consequently this limitation needs to be taken into account in the timing and planning of major service reform where possible. The results also extend the literature, insofar as external factors with a high impact on the operation of an organisation may impact upon organisational culture albeit temporarily.

Improving Nursing Home Care through Feedback On PerfoRMance Data (INFORM): Protocol for a cluster-randomized trial

BACKGROUND

Audit and feedback is effective in improving the quality of care. However, methods and results of international studies are heterogeneous, and studies have been criticized for a lack of systematic use of theory. In TREC (Translating Research in Elder Care), a longitudinal health services research program, we collect comprehensive data from care providers and residents in Canadian nursing homes to improve quality of care and life of residents, and quality of worklife of caregivers. The study aims are to a) systematically feed back TREC research data to nursing home care units, and b) compare the effectiveness of three different theory-based feedback strategies in improving performance within care units.

METHODS

INFORM (Improving Nursing Home Care through Feedback On PerfoRMance Data) is a 3.5-year pragmatic, three-arm, parallel, cluster-randomized trial. We will randomize 67 Western Canadian nursing homes with 203 care units to the three study arms, a standard feedback strategy and two assisted and goal-directed feedback strategies. Interventions will target care unit managerial teams. They are based on theory and evidence related to audit and feedback, goal setting, complex adaptive systems, and empirical work on feeding back research results. The primary outcome is the increased number of formal interactions (e.g., resident rounds or family conferences) involving care aides - non-registered caregivers providing up to 80% of direct care. Secondary outcomes are a) other modifiable features of care unit context (improved feedback, social capital, slack time) b) care aides' quality of worklife (improved psychological empowerment, job satisfaction), c) more use of best practices, and d) resident outcomes based on the Resident Assessment Instrument - Minimum Data Set 2.0. Outcomes will be assessed at baseline, immediately after the 12-month intervention period, and 18 months post intervention.

DISCUSSION

INFORM is the first study to systematically assess the effectiveness of different strategies to feed back research data to nursing home care units in order to improve their performance. Results of this study will enable development of a practical, sustainable, effective, and cost-effective feedback strategy for routine use by managers, policy makers and researchers. The results may also be generalizable to care settings other than nursing homes.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02695836 . Date of registration: 24 February 2016.

Design and validation of a questionnaire to assess organizational culture in French hospital wards

BACKGROUND

Although many organizational culture questionnaires have been developed, there is a lack of any validated multidimensional questionnaire assessing organizational culture at hospital ward level and adapted to health care context. Facing the lack of an appropriate tool, a multidisciplinary team designed and validated a dimensional organizational culture questionnaire for healthcare settings to be administered at ward level.

METHODS

A database of organizational culture items and themes was created after extensive literature review. Items were regrouped into dimensions and subdimensions (classification validated by experts). Pre-test and face validation was conducted with 15 health care professionals. In a stratified cluster random sample of hospitals, the psychometric validation was conducted in three phases on a sample of 859 healthcare professionals from 36 multidisciplinary medicine services: 1) the exploratory phase included a description of responses' saturation levels, factor and correlations analyses and an internal consistency analysis (Cronbach's alpha coefficient); 2) confirmatory phase used the Structural Equation Modeling (SEM); 3) reproducibility was studied by a test-retest.

RESULTS

The overall response rate was 80 %; the completion average was 97 %. The metrological results were: a global Cronbach's alpha coefficient of 0.93, higher than 0.70 for 12 sub-dimensions; all Dillon-Goldstein's rho coefficients higher than 0.70; an excellent quality of external model with a Goodness of Fitness (GoF) criterion of 0.99. Seventy percent of the items had a reproducibility ranging from moderate (Intra-Class Coefficient between 50 and 70 % for 25 items) to good (ICC higher than 70 % for 33 items).

CONCLUSIONS

COMEt (Contexte Organisationnel et Managérial en Etablissement de Santé) questionnaire is a validated multidimensional organizational culture questionnaire made of 6 dimensions, 21 sub-dimensions and 83 items. It is the first dimensional organizational culture questionnaire, specific to healthcare context, for a unit level assessment showing robust psychometric properties (validity and reliability). This tool is suited for research purposes, especially for assessing organizational context in research analysing the effectiveness of hospital quality improvement strategies. Our tool is also suited for an overall assessment of ward culture and could be a powerful trigger to improve management and clinical performance. Its psychometric properties in other health systems need to be tested.

Managers' use of nursing workforce planning and deployment technologies: protocol for a realist synthesis of implementation and impact

INTRODUCTION

Nursing staffing levels in hospitals appear to be associated with improved patient outcomes. National guidance indicates that the triangulation of information from workforce planning and deployment technologies (WPTs; eg, the Safer Nursing Care Tool) and 'local knowledge' is important for managers to achieve appropriate staffing levels for better patient outcomes. Although WPTs provide managers with predictive information about future staffing requirements, ensuring patient safety and quality care also requires the consideration of information from other sources in real time. Yet little attention has been given to how to support managers to implement WPTs in practice. Given this lack of understanding, this evidence synthesis is designed to address the research question: managers' use of WPTs and their impacts on nurse staffing and patient care: what works, for whom, how and in what circumstances?

METHODS AND ANALYSIS

To explain how WPTs may work and in what contexts, we will conduct a realist evidence synthesis through sourcing relevant evidence, and consulting with stakeholders about the impacts of WPTs on health and relevant public service fields. The review will be in 4 phases over 18 months. Phase 1: we will construct an initial theoretical framework that provides plausible explanations of what works about WPTs. Phase 2: evidence retrieval, review and synthesis guided by the theoretical framework; phase 3: testing and refining of programme theories, to determine their relevance; phase 4: formulating actionable recommendations about how WPTs should be implemented in clinical practice.

ETHICS AND DISSEMINATION

Ethical approval has been gained from the study's institutional sponsors. Ethical review from the National Health Service (NHS) is not required; however research and development permissions will be obtained. Findings will be disseminated through stakeholder engagement and knowledge mobilisation activities. The synthesis will develop an explanatory programme theory of the implementation and impact of nursing WPTs, and practical guidance for nurse managers.

TRIAL REGISTRATION NUMBER

CRD42016038132.

Response process and test-retest reliability of the Context Assessment for Community Health tool in Vietnam

BACKGROUND

The recently developed Context Assessment for Community Health (COACH) tool aims to measure aspects of the local healthcare context perceived to influence knowledge translation in low- and middle-income countries. The tool measures eight dimensions (organizational resources, community engagement, monitoring services for action, sources of knowledge, commitment to work, work culture, leadership, and informal payment) through 49 items.

OBJECTIVE

The study aimed to explore the understanding and stability of the COACH tool among health providers in Vietnam.

DESIGNS

To investigate the response process, think-aloud interviews were undertaken with five community health workers, six nurses and midwives, and five physicians. Identified problems were classified according to Conrad and Blair's taxonomy and grouped according to an estimation of the magnitude of the problem's effect on the response data. Further, the stability of the tool was examined using a test-retest survey among 77 respondents. The reliability was analyzed for items (intraclass correlation coefficient (ICC) and percent agreement) and dimensions (ICC and Bland-Altman plots).

RESULTS

In general, the think-aloud interviews revealed that the COACH tool was perceived as clear, well organized, and easy to answer. Most items were understood as intended. However, seven prominent problems in the items were identified and the content of three dimensions was perceived to be of a sensitive nature. In the test-retest survey, two-thirds of the items and seven of eight dimensions were found to have an ICC agreement ranging from moderate to substantial (0.5-0.7), demonstrating that the instrument has an acceptable level of stability.

CONCLUSIONS

This study provides evidence that the Vietnamese translation of the COACH tool is generally perceived to be clear and easy to understand and has acceptable stability. There is, however, a need to rephrase and add generic examples to clarify some items and to further review items with low ICC.

The Many Organisational Factors Relevant to Planning Change in Emergency Care Departments: A Qualitative Study to Inform a Cluster Randomised Controlled Trial Aiming to Improve the Management of Patients with Mild Traumatic Brain Injuries

BACKGROUND

The Neurotrauma Evidence Translation (NET) Trial aims to design and evaluate the effectiveness of a targeted theory-and evidence-informed intervention to increase the uptake of evidence-based recommended practices for the management of patients who present to an emergency department (ED) with mild head injuries. When designing interventions to bring about change in organisational settings such as the ED, it is important to understand the impact of the context to ensure successful implementation of practice change. Few studies explicitly use organisational theory to study which factors are likely to be most important to address when planning change processes in the ED. Yet, this setting may have a unique set of organisational pressures that need to be taken into account when implementing new clinical practices. This paper aims to provide an in depth analysis of the organisational context in which ED management of mild head injuries and implementation of new practices occurs, drawing upon organisational level theory.

METHODS

Semi-structured interviews were conducted with ED staff in Australia. The interviews explored the organisational context in relation to change and organisational factors influencing the management of patients presenting with mild head injuries. Two researchers coded the interview transcripts using thematic content analysis. The "model of diffusion in service organisations" was used to guide analyses and organisation of the results.

RESULTS

Nine directors, 20 doctors and 13 nurses of 13 hospitals were interviewed. With regard to characteristics of the innovation (i.e. the recommended practices) the most important factor was whether they were perceived as being in line with values and needs. Tension for change (the degree to which stakeholders perceive the current situation as intolerable or needing change) was relatively low for managing acute mild head injury symptoms, and mixed for managing longer-term symptoms (higher change commitment, but relatively low change efficacy). Regarding implementation processes, the importance of (visible) senior leadership for all professions involved was identified as a critical factor. An unpredictable and hectic environment brings challenges in creating an environment in which team-based and organisational learning can thrive (system antecedents for innovation). In addition, the position of the ED as the entry-point of the hospital points to the relevance of securing buy-in from other units.

CONCLUSIONS

We identified several organisational factors relevant to realising change in ED management of patients who present with mild head injuries. These factors will inform the intervention design and process evaluation in a trial evaluating the effectiveness of our implementation intervention.

Making sense of implementation theories, models and frameworks

BACKGROUND

Implementation science has progressed towards increased use of theoretical approaches to provide better understanding and explanation of how and why implementation succeeds or fails. The aim of this article is to propose a taxonomy that distinguishes between different categories of theories, models and frameworks in implementation science, to facilitate appropriate selection and application of relevant approaches in implementation research and practice and to foster cross-disciplinary dialogue among implementation researchers.

DISCUSSION

Theoretical approaches used in implementation science have three overarching aims: describing and/or guiding the process of translating research into practice (process models); understanding and/or explaining what influences implementation outcomes (determinant frameworks, classic theories, implementation theories); and evaluating implementation (evaluation frameworks). This article proposes five categories of theoretical approaches to achieve three overarching aims. These categories are not always recognized as separate types of approaches in the literature. While there is overlap between some of the theories, models and frameworks, awareness of the differences is important to facilitate the selection of relevant approaches. Most determinant frameworks provide limited "how-to" support for carrying out implementation endeavours since the determinants usually are too generic to provide sufficient detail for guiding an implementation process. And while the relevance of addressing barriers and enablers to translating research into practice is mentioned in many process models, these models do not identify or systematically structure specific determinants associated with implementation success. Furthermore, process models recognize a temporal sequence of implementation endeavours, whereas determinant frameworks do not explicitly take a process perspective of implementation.

The influence of organizational context on best practice use by care aides in residential long-term care settings

OBJECTIVE

This study assessed individual and organizational context (work environment) factors that influence use of best practices by care aides (nursing assistants) in nursing homes. Little scientific attention has been focused on understanding best practice use in nursing homes and almost none on care aides.

SETTING AND PARTICIPANTS

A total of 1262 care aides in 25 nursing homes in the 3 Canadian prairie provinces. Care aides are unregulated workers who provide 80% of direct care to residents in Canadian nursing homes.

METHOD

We used hierarchical linear modeling to (1) assess the amount of variance in use of best practices, as reported by care aides, that could be attributed to individual or organizational factors, and (2) identify predictors of best practices use by care aides.

RESULTS

At the individual level, statistically significant predictors of instrumental use of best practices included sex, age, shift worked, job efficacy, and belief suspension. At the unit level, significant predictors were social capital, organizational slack (staffing and time), number of informal interactions, and unit type. At the facility level, ownership model and province were significant. Significant predictors of conceptual use of best practices at the individual level included English as a first language, job efficacy, belief suspension, intent to use research, adequate knowledge, and number of information sources used. At the unit level, significant predictors were evaluation (feedback mechanisms), structural resources, and organizational slack (time). At the facility level, province was significant. The R(2) was 18.3% for instrumental use of best practices and 43.4% for conceptual use. Unit level factors added a substantial amount of explained variance whereas facility level factors added relatively little explained variance.

CONCLUSIONS

Our study suggests that context plays an important role in care aides' use of best practices in nursing homes. Individual characteristics played a more prominent role than contextual factors in predicting conceptual use of best practices.

Identifying Continence OptioNs after Stroke (ICONS): an evidence synthesis, case study and exploratory cluster randomised controlled trial of the introduction of a systematic voiding programme for patients with urinary incontinence after stroke in secondary care

Background

Urinary incontinence (UI) following acute stroke is common, affecting between 40% and 60% of people in hospital, but is often poorly managed.

Aim

To develop, implement and evaluate the preliminary effectiveness and potential cost-effectiveness of a systematic voiding programme (SVP), with or without supported implementation, for the management of UI after stroke in secondary care.

Design

Structured in line with the Medical Research Council framework for the evaluation of complex interventions, the programme comprised two phases: Phase I, evidence synthesis of combined approaches to manage UI post stroke, case study of the introduction of the SVP in one stroke service; Phase II, cluster randomised controlled exploratory trial incorporating a process evaluation and testing of health economic data collection methods.

Setting

One English stroke service (case study) and 12 stroke services in England and Wales (randomised trial).

Participants

Case study, 43 patients; randomised trial, 413 patients admitted to hospital with stroke and UI.

Interventions

A SVP comprising assessment, individualised conservative interventions and weekly review. In the supported implementation trial arm, facilitation was used as an implementation strategy to support and enable people to change their practice.

Main outcome measures

Participant incontinence (presence/absence) at 12 weeks post stroke. Secondary outcomes were quality of life, frequency and severity of incontinence, urinary symptoms, activities of daily living and death, at discharge, 6, 12 and 52 weeks post stroke.

Results

There was no suggestion of a beneficial effect on outcome at 12 weeks post stroke [intervention vs. usual care: odds ratio (OR) 1.02, 95% confidence interval (CI) 0.54 to 1.93; supported implementation vs. usual care: OR 1.06, 95% CI 0.54 to 2.09]. There was weak evidence of better outcomes on the Incontinence Impact Questionnaire in supported implementation (OR 1.22, 95% CI 0.72 to 2.08) but the CI is wide and includes both clinically relevant benefit and harm. Both intervention arms had a higher estimated odds of continence for patients with urge incontinence than usual care (intervention: OR 1.58, 95% CI 0.83 to 2.99; supported implementation: OR 1.73, 95% CI 0.88 to 3.43). The process evaluation showed that the SVP increased the visibility of continence management through greater evaluation of patients’ trajectories and outcomes, and closer attention to workload. In-hospital resource use had to be based on estimates provided by staff. The response rates for the postal questionnaires were 73% and 56% of eligible patients at 12 and 52 weeks respectively. Completion of individual data items varied between 67% and 100%.

Conclusions

The trial was exploratory and did not set out to establish effectiveness; however, there are indications the intervention may be effective in patients with urge and stress incontinence. A definitive trial is now warranted.

Study registration

This study is registered as ISRCTN08609907.

Funding details

The National Institute for Health Research Programme Grants for Applied Research programme. Excess treatment costs and research support costs were funded by participating NHS trusts and health boards, Lancashire and Cumbria and East Anglia Comprehensive Local Research Networks and the Welsh National Institute for Social Care and Health Research.

Understanding context in knowledge translation: a concept analysis study protocol

AIM

To conduct a concept analysis of clinical practice contexts (work environments) that facilitate or militate against the uptake of research evidence by healthcare professionals in clinical practice. This will involve developing a clear definition of context by describing its features, domains and defining characteristics.

BACKGROUND

The context where clinical care is delivered influences that care. While research shows that context is important to knowledge translation (implementation), we lack conceptual clarity on what is context, which contextual factors probably modify the effect of knowledge translation interventions (and hence should be considered when designing interventions) and which contextual factors themselves could be targeted as part of a knowledge translation intervention (context modification).

DESIGN

Concept analysis.

METHODS

The Walker and Avant concept analysis method, comprised of eight systematic steps, will be used: (1) concept selection; (2) determination of aims; (3) identification of uses of context; (4) determination of defining attributes of context; (5) identification/construction of a model case of context; (6) identification/construction of additional cases of context; (7) identification/construction of antecedents and consequences of context; and (8) definition of empirical referents of context. This study is funded by the Canadian Institutes of Health Research (January 2014).

DISCUSSION

This study will result in a much needed framework of context for knowledge translation, which identifies specific elements that, if assessed and used to tailor knowledge translation activities, will result in increased research use by nurses and other healthcare professionals in clinical practice, ultimately leading to better patient care.

What if implementation is not the problem? Exploring the missing links between knowledge and action

Given all the available knowledge about effective implementation, why do many organizations continue to have-or appear to have-an implementation problem? Analysis of a 7-year corpus of reports by a Canadian health region's "embedded" research and evaluation unit sought to discover the source of the region's intractable difficulty implementing improvement. Findings suggested that the problem was neither a lack of knowledge (decision-makers displayed sophisticated understanding of fundamental issues) nor an inability to take action (there existed sufficient capacity to implement change). However, managers' high-level knowledge was not made actionable, and micro-level decision-making often produced piecemeal actions inadequately informed by existing knowledge. The problem arose at the stage of "operationalization"-the identification of concrete, executable actions fully informed by knowledge of complex, system-level issues. Yet this crucial phase is a focus of neither the implementation nor knowledge translation (KT) literatures. The organizational decision-making literature reveals how decision-makers initiate operationalization (i.e., by setting the direction for a discovery approach) but not how they can ensure its successful completion. The focus of KT research and practice should expand to explicating and improving decision-making, lest KT become an exercise of infusing content into a broken process. Copyright © 2014 John Wiley & Sons, Ltd.

Social and organizational factors affecting implementation of evidence-informed practice in a public health department in Ontario: a network modelling approach

OBJECTIVE

The objective of this study is to develop a statistical model to assess factors associated with information seeking in a Canadian public health department.

METHODS

Managers and professional consultants of a public health department serving a large urban population named whom they turned to for help, whom they considered experts in evidence-informed practice, and whom they considered friends. Multilevel regression analysis and exponential random graph modeling were used to predict the formation of information seeking and expertise-recognition connections by personal characteristics of the seeker and source, and the structural attributes of the social networks.

RESULTS

The respondents were more likely to recognize the members of the supervisory/administrative division as experts. The extent to which an individual implemented evidence-based practice (EBP) principles in daily practice was a significant predictor of both being an information source and being recognized as expert by peers. Friendship was a significant predictor of both information seeking and expertise-recognition connections.

CONCLUSION

The analysis showed a communication network segregated by organizational divisions. Managers were identified frequently as information sources, even though this is not a part of their formal role. Self-perceived implementation of EBP in practice was a significant predictor of being an information source or an expert, implying a positive atmosphere towards implementation of evidence-informed decision making in this public health organization. Results also implied that the perception of accessibility and trust were significant predictors of expertise recognition.

Evaluating a systematic voiding programme for patients with urinary incontinence after stroke in secondary care using soft systems analysis and Normalisation Process Theory: findings from the ICONS case study phase

BACKGROUND

Urinary incontinence (UI) affects between 40 and 60% of people in hospital after stroke, but is often poorly managed in stroke units.

OBJECTIVES

To inform an exploratory trial by three methods: identifying the organisational context for embedding the SVP; exploring health professionals' views around embedding the SVP and measuring presence/absence of UI and frequency of UI episodes at baseline and six weeks post-stroke.

DESIGN

A mixed methods single case study included analysis of organisational context using interviews with clinical leaders analysed with soft systems methodology, a process evaluation using interviews with staff delivering the intervention and analysed with Normalisation Process Theory, and outcome evaluation using data from patients receiving the SVP and analysed using descriptive statistics.

SETTING

An 18 bed acute stroke unit in a large Foundation Trust (a 'not for profit' privately controlled entity not accountable to the UK Department of Health) serving a population of 370,000.

PARTICIPANTS

Health professionals and clinical leaders with a role in either delivering the SVP or linking with it in any capacity were recruited following informed consent. Patients were recruited meeting the following inclusion criteria: aged 18 or over with a diagnosis of stroke; urinary incontinence (UI) as defined by the International Continence Society; conscious; medically stable as judged by the clinical team and with incontinence classified as stress, urge, mixed or 'functional'. All patients admitted to the unit during the intervention period were screened for eligibility; informed consent to collect baseline and outcome data was sought from all eligible patients.

RESULTS

Organisational context: 18 health professionals took part in four group interviews. Findings suggest an environment not conducive to therapeutic continence management and a focus on containment of UI. Embedding the SVP into practice: 21 nursing staff took part in six group interviews. Initial confusion gave way to embedding of processes facilitated by new routines and procedures. Patient outcome: 43 patients were recruited; 28 of these commenced the SVP. Of these, 6/28 (21%) were continent at six weeks post-stroke or discharge.

CONCLUSION

It was possible to embed the SVP into practice despite an organisational context not conducive to therapeutic continence care. Recommendations are made for introducing the SVP in a trial context.

A KT intervention including the evidence alert system to improve clinician's evidence-based practice behavior--a cluster randomized controlled trial

Background

It is difficult to foster research utilization among allied health professionals (AHPs). Tailored, multifaceted knowledge translation (KT) strategies are now recommended but are resource intensive to implement. Employers need effective KT solutions but little is known about; the impact and viability of multifaceted KT strategies using an online KT tool, their effectiveness with AHPs and their effect on evidence-based practice (EBP) decision-making behavior. The study aim was to measure the effectiveness of a multifaceted KT intervention including a customized KT tool, to change EBP behavior, knowledge, and attitudes of AHPs.

Methods

This is an evaluator-blinded, cluster randomized controlled trial conducted in an Australian community-based cerebral palsy service. 135 AHPs (physiotherapists, occupational therapists, speech pathologists, psychologists and social workers) from four regions were cluster randomized (n = 4), to either the KT intervention group (n = 73 AHPs) or the control group (n = 62 AHPs), using computer-generated random numbers, concealed in opaque envelopes, by an independent officer. The KT intervention included three-day skills training workshop and multifaceted workplace supports to redress barriers (paid EBP time, mentoring, system changes and access to an online research synthesis tool). Primary outcome (self- and peer-rated EBP behavior) was measured using the Goal Attainment Scale (individual level). Secondary outcomes (knowledge and attitudes) were measured using exams and the Evidence Based Practice Attitude Scale.

Results

The intervention group’s primary outcome scores improved relative to the control group, however when clustering was taken into account, the findings were non-significant: self-rated EBP behavior [effect size 4.97 (95% CI -10.47, 20.41) (p = 0.52)]; peer-rated EBP behavior [effect size 5.86 (95% CI -17.77, 29.50) (p = 0.62)]. Statistically significant improvements in EBP knowledge were detected [effect size 2.97 (95% CI 1.97, 3.97 (p < 0.0001)]. Change in EBP attitudes was not statistically significant.

Conclusions

Improvement in EBP behavior was not statistically significant after adjusting for cluster effect, however similar improvements from peer-ratings suggest behaviorally meaningful gains. The large variability in behavior observed between clusters suggests barrier assessments and subsequent KT interventions may need to target subgroups within an organization.

Trial registration

Registered on the Australian New Zealand Clinical Trials Registry (ACTRN12611000529943).

Schools' absorptive capacity to innovate in health promotion

PURPOSE

A comprehensive "health promoting schools" (HPS) approach is advocated by the World Health Organization to foster the health of students. To date, few studies have evaluated schools' capacity to implement it in an optimal way. The purpose of this paper is to present a conceptual framework that identifies core features likely to facilitate the incorporation of innovation, such as HPS, into school functioning.

DESIGN/METHODOLOGY/APPROACH

The framework was built by combining dimensions derived from two major strands of literature, i.e. management and HPS. It has taken root in Zahra and George's model of organisation absorptive capacity (AC) for new knowledge but has been adapted to better explore AC in a school context. The contrasting cases of two secondary schools that adopted a HPS approach in Quebec, Canada, for at least three years were used to illustrate the value of the framework.

FINDINGS

The framework proposed is a multidimensional model that considers components such as modulators, antecedents, integration mechanisms and strategic levers as potential determinants of AC, i.e. acquisition, assimilation, transformation and exploitation. The conceptual framework helped to qualify and compare AC regarding HPS in the two cases and holds promise to appreciate mechanisms having the greatest influence on it.

ORIGINALITY/VALUE

The framework can serve as a conceptual guide to facilitate the absorption of innovation in schools and to design future empirical research to better understand the underlying process by which schools strengthen their capacities to become settings conducive to the health of youth.

Implementing the evidence for language-appropriate health care systems: The Welsh context

Like Canada, Wales, UK is a bilingual nation: the Welsh language is an important part of its national identity and legislative framework. This has implications for the delivery of public sector services, particularly in the context of health and social care, where responding to the language needs of service users is fundamental to quality health care provision. Nevertheless, despite the strengthening policy commitment for a whole-system approach towards enhancing Welsh language services, there is a paucity of evidence to guide best practice in organizational planning in health care settings. This commentary outlines the context and significance of bilingual health care provision in Wales and the implications for building and embedding the evidence base. It calls for further work to translate our knowledge and understanding of language-appropriate practice to provide more effective and sensitive health care services; and to close the implementation gap between evidence and practice. Given the relevance of this challenge for health care providers in Canada who plan and deliver services for French-language minorities, this approach has resonance across our research communities. Thus, in our common pursuit to establish integrated knowledge translation research for language-appropriate health care systems, this commentary offers a focus for reflection, discussion and collaborative action.

What supports physiotherapists' use of research in clinical practice? A qualitative study in Sweden

Background

Evidence-based practice has increasingly been recognized as a priority by professional physiotherapy organizations and influential researchers and clinicians in the field. Numerous studies in the past decade have documented that physiotherapists hold generally favorable attitudes to evidence-based practice and recognize the importance of using research to guide their clinical practice. Research has predominantly investigated barriers to research use. Less is known about the circumstances that actually support use of research by physiotherapists. This study explores the conditions at different system levels that physiotherapists in Sweden perceive to be supportive of their use of research in clinical practice.

Methods

Patients in Sweden do not need a referral from a physician to consult a physiotherapist and physiotherapists are entitled to choose and perform any assessment and treatment technique they find suitable for each patient. Eleven focus group interviews were conducted with 45 physiotherapists, each lasting between 90 and 110 minutes. An inductive approach was applied, using topics rather than questions to allow the participants to generate their own questions and pursue their own priorities within the framework of the aim. The data were analyzed using qualitative content analysis.

Results

Analysis of the data yielded nine favorable conditions at three system levels supporting the participant’s use of research in clinical practice: two at the individual level (attitudes and motivation concerning research use; research-related knowledge and skills), four at the workplace level (leadership support; organizational culture; research-related resources; knowledge exchange) and three at the extra-organizational level (evidence-based practice guidelines; external meetings, networks, and conferences; academic research and education).

Conclusions

Supportive conditions for physiotherapists’ use of research exist at multiple interdependent levels, including the individual, workplace, and extra-organizational levels. Research use in physiotherapy appears to be an interactive and interpretative social process that involves a great deal of interaction with various people, including colleagues and patients.

The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework

Background

The case has been made for more and better theory-informed process evaluations within trials in an effort to facilitate insightful understandings of how interventions work. In this paper, we provide an explanation of implementation processes from one of the first national implementation research randomized controlled trials with embedded process evaluation conducted within acute care, and a proposed extension to the Promoting Action on Research Implementation in Health Services (PARIHS) framework.

Methods

The PARIHS framework was prospectively applied to guide decisions about intervention design, data collection, and analysis processes in a trial focussed on reducing peri-operative fasting times. In order to capture a holistic picture of implementation processes, the same data were collected across 19 participating hospitals irrespective of allocation to intervention. This paper reports on findings from data collected from a purposive sample of 151 staff and patients pre- and post-intervention. Data were analysed using content analysis within, and then across data sets.

Results

A robust and uncontested evidence base was a necessary, but not sufficient condition for practice change, in that individual staff and patient responses such as caution influenced decision making. The implementation context was challenging, in which individuals and teams were bounded by professional issues, communication challenges, power and a lack of clarity for the authority and responsibility for practice change. Progress was made in sites where processes were aligned with existing initiatives. Additionally, facilitators reported engaging in many intervention implementation activities, some of which result in practice changes, but not significant improvements to outcomes.

Conclusions

This study provided an opportunity for reflection on the comprehensiveness of the PARIHS framework. Consistent with the underlying tenant of PARIHS, a multi-faceted and dynamic story of implementation was evident. However, the prominent role that individuals played as part of the interaction between evidence and context is not currently explicit within the framework. We propose that successful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice. This proposal will enhance the potential of the PARIHS framework for explanation, and ensure theoretical development both informs and responds to the evidence base for implementation.

Trial registration

ISRCTN18046709 - Peri-operative Implementation Study Evaluation (PoISE).

Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures

BACKGROUND

Two of the current methodological barriers to implementation science efforts are the lack of agreement regarding constructs hypothesized to affect implementation success and identifiable measures of these constructs. In order to address these gaps, the main goals of this paper were to identify a multi-level framework that captures the predominant factors that impact implementation outcomes, conduct a systematic review of available measures assessing constructs subsumed within these primary factors, and determine the criterion validity of these measures in the search articles.

METHOD

We conducted a systematic literature review to identify articles reporting the use or development of measures designed to assess constructs that predict the implementation of evidence-based health innovations. Articles published through 12 August 2012 were identified through MEDLINE, CINAHL, PsycINFO and the journal Implementation Science. We then utilized a modified five-factor framework in order to code whether each measure contained items that assess constructs representing structural, organizational, provider, patient, and innovation level factors. Further, we coded the criterion validity of each measure within the search articles obtained.

RESULTS

Our review identified 62 measures. Results indicate that organization, provider, and innovation-level constructs have the greatest number of measures available for use, whereas structural and patient-level constructs have the least. Additionally, relatively few measures demonstrated criterion validity, or reliable association with an implementation outcome (e.g., fidelity).

DISCUSSION

In light of these findings, our discussion centers on strategies that researchers can utilize in order to identify, adapt, and improve extant measures for use in their own implementation research. In total, our literature review and resulting measures compendium increases the capacity of researchers to conceptualize and measure implementation-related constructs in their ongoing and future research.

A mixed methods descriptive investigation of readiness to change in rural hospitals participating in a tele-critical care intervention

BACKGROUND

Telemedicine technology can improve care to patients in rural and medically underserved communities yet adoption has been slow. The objective of this study was to study organizational readiness to participate in an academic-community hospital partnership including clinician education and telemedicine outreach focused on sepsis and trauma care in underserved, rural hospitals.

METHODS

This is a multi-method, observational case study. Participants included staff from 4 participating rural South Carolina hospitals. Using a readiness-for-change model, we evaluated 5 general domains and the related factors or topics of organizational context via key informant interviews (n=23) with hospital leadership and staff, compared these to data from hospital staff surveys (n=86) and triangulated data with investigators' observational reports. Survey items were grouped into 4 categories (based on content and fit with conceptual model) and scored, allowing regression analyses for inferential comparisons to assess factors related to receptivity toward the telemedicine innovation.

RESULTS

General agreement existed on the need for the intervention and feasibility of implementation. Previous experience with a telemedicine program appeared pivotal to enthusiasm. Perception of need, task demands and resource need explained nearly 50% of variation in receptivity. Little correlation emerged with hospital or ED leadership culture and support. However qualitative data and investigator observations about communication and differing support among disciplines and between staff and leadership could be important to actual implementation.

CONCLUSIONS

A mixed methods approach proved useful in assessing organizational readiness for change in small organizations. Further research on variable operational definitions, potential influential factors, appropriate and feasible methods and valid instruments for such research are needed.

Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

Background

Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments.

Methods

Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. Study selection: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care.

Results

We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited.

Conclusions

Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice.

State-of-the-art and future directions in multilevel interventions across the cancer control continuum

We conducted literature searches and analyses to describe the current state of multilevel intervention (MLI) research and to identify opportunities to advance cancer control and prevention. We found single-level studies that considered other contextually important levels, and multilevel health-care systems research and community-wide studies. This literature is characterized by limited reporting of theoretical, contextual, temporal, and implementation factors. Most MLIs focus on prevention and screening, rather than diagnosis, treatment, or survivorship. Opportunities relate to 1) dynamic, adaptive emergent interventions and research designs that evolve over time by attending to contextual factors and interactions across levels; 2) analyses that include simulation modeling, or multimethod approaches that integrate quantitative and qualitative methods; and 3) translation and intervention approaches that locally reinvent MLIs in different contexts. MLIs have great potential to reduce cancer burden by using theory and integrating quantitative, qualitative, participatory, and transdisciplinary methods that continually seek alignment across intervention levels, pay attention to context, and adapt over time.

A thematic analysis of the role of the organisation in building allied health research capacity: a senior managers' perspective

BACKGROUND

Evidence-based practice aims to achieve better health outcomes in the community. It relies on high quality research to inform policy and practice; however research in primary health care continues to lag behind that of other medical professions. The literature suggests that research capacity building (RCB) functions across four levels; individual, team, organisation and external environment. Many RCB interventions are aimed at an individual or team level, yet evidence indicates that many barriers to RCB occur at an organisational or external environment level. This study asks senior managers from a large healthcare organisation to identify the barriers and enablers to RCB. The paper then describes strategies for building allied health (AH) research capacity at an organisational level from a senior managers' perspective.

METHODS

This qualitative study is part of a larger collaborative RCB project. Semi-structured in-depth interviews were conducted with nine allied health senior managers. Recorded interviews were transcribed and NVivo was used to analyse findings and emergent themes were defined.

RESULTS

The dominant themes indicate that the organisation plays an integral role in building AH research capacity and is the critical link in creating synergy across the four levels of RCB. The organisation can achieve this by incorporating research into its core business with a whole of organisation approach including its mission, vision and strategic planning. Critical success factors include: developing a co-ordinated and multidisciplinary approach to attain critical mass of research-active AH and enhance learning and development; support from senior managers demonstrated through structures, processes and systems designed to facilitate research; forming partnerships to increase collaboration and sharing of resources and knowledge; and establishing in internal framework to promote recognition for research and career path opportunities.

CONCLUSIONS

This study identifies four key themes: whole of organisation approach; structures, processes and systems; partnerships and collaboration; and dedicated research centres, units and positions. These themes form the foundation of a model which can be applied to assist in achieving synergy across the four levels of RCB, overcome barriers and create an environment that supports and facilitates research development in AH.

A thematic analysis of the role of the organisation in building allied health research capacity: a senior managers' perspective

Background

Evidence-based practice aims to achieve better health outcomes in the community. It relies on high quality research to inform policy and practice; however research in primary health care continues to lag behind that of other medical professions. The literature suggests that research capacity building (RCB) functions across four levels; individual, team, organisation and external environment. Many RCB interventions are aimed at an individual or team level, yet evidence indicates that many barriers to RCB occur at an organisational or external environment level. This study asks senior managers from a large healthcare organisation to identify the barriers and enablers to RCB. The paper then describes strategies for building allied health (AH) research capacity at an organisational level from a senior managers’ perspective.

Methods

This qualitative study is part of a larger collaborative RCB project. Semi-structured in-depth interviews were conducted with nine allied health senior managers. Recorded interviews were transcribed and NVivo was used to analyse findings and emergent themes were defined.

Results

The dominant themes indicate that the organisation plays an integral role in building AH research capacity and is the critical link in creating synergy across the four levels of RCB. The organisation can achieve this by incorporating research into its core business with a whole of organisation approach including its mission, vision and strategic planning. Critical success factors include: developing a co-ordinated and multidisciplinary approach to attain critical mass of research-active AH and enhance learning and development; support from senior managers demonstrated through structures, processes and systems designed to facilitate research; forming partnerships to increase collaboration and sharing of resources and knowledge; and establishing in internal framework to promote recognition for research and career path opportunities.

Conclusions

This study identifies four key themes: whole of organisation approach; structures, processes and systems; partnerships and collaboration; and dedicated research centres, units and positions. These themes form the foundation of a model which can be applied to assist in achieving synergy across the four levels of RCB, overcome barriers and create an environment that supports and facilitates research development in AH.

Mining the management literature for insights into implementing evidence-based change in healthcare

OBJECTIVE

We synthesized the management and health literatures for insights into implementing evidence-based change in healthcare drawn from industry-specific data. Because change principles based on evidence often fail to be translated into organizational practice or policy, we sought studies at the nexus of organizational change and knowledge translation.

METHODS

We reviewed five top management journals to identify an initial pool of 3,091 studies, which yielded a final sample of 100 studies. Data were abstracted, verified by the original authors and revised before entry into a database. We employed a systematic narrative synthesis approach using words and text to distill data and explain relationships. We categorized studies by varying levels of relevance for knowledge translation as (1) primary, direct; (2) intermediate; and (3) secondary, indirect. We also identified recurring categories of change-related organizational factors. The current analysis examines these factors in studies of primary relevance to knowledge translation, which we also coded for intervention readiness to reflect how readily change can be implemented. Preliminary

RESULTS AND CONCLUSIONS

Results centred on five change-related categories: Tailoring the Intervention Message; Institutional Links/Social Networks; Training; Quality of Work Relationships; and Fit to Organization. In particular, networks across institutional and individual levels appeared as prominent pathways for changing healthcare organizations. Power dynamics, positive social relations and team structures also played key roles in implementing change and translating it into practice. We analyzed journals in which first authors of these studies typically publish, and found evidence that management and health sciences remain divided. Bridging these disciplines through research syntheses promises a wealth of evidence and insights, well worth mining in the search for change that works in healthcare transformation.

Assessment of variation in the Alberta Context Tool: the contribution of unit level contextual factors and specialty in Canadian pediatric acute care settings

Background

There are few validated measures of organizational context and none that we located are parsimonious and address modifiable characteristics of context. The Alberta Context Tool (ACT) was developed to meet this need. The instrument assesses 8 dimensions of context, which comprise 10 concepts. The purpose of this paper is to report evidence to further the validity argument for ACT. The specific objectives of this paper are to: (1) examine the extent to which the 10 ACT concepts discriminate between patient care units and (2) identify variables that significantly contribute to between-unit variation for each of the 10 concepts.

Methods

859 professional nurses (844 valid responses) working in medical, surgical and critical care units of 8 Canadian pediatric hospitals completed the ACT. A random intercept, fixed effects hierarchical linear modeling (HLM) strategy was used to quantify and explain variance in the 10 ACT concepts to establish the ACT's ability to discriminate between units. We ran 40 models (a series of 4 models for each of the 10 concepts) in which we systematically assessed the unique contribution (i.e., error variance reduction) of different variables to between-unit variation. First, we constructed a null model in which we quantified the variance overall, in each of the concepts. Then we controlled for the contribution of individual level variables (Model 1). In Model 2, we assessed the contribution of practice specialty (medical, surgical, critical care) to variation since it was central to construction of the sampling frame for the study. Finally, we assessed the contribution of additional unit level variables (Model 3).

Results

The null model (unadjusted baseline HLM model) established that there was significant variation between units in each of the 10 ACT concepts (i.e., discrimination between units). When we controlled for individual characteristics, significant variation in the 10 concepts remained. Assessment of the contribution of specialty to between-unit variation enabled us to explain more variance (1.19% to 16.73%) in 6 of the 10 ACT concepts. Finally, when we assessed the unique contribution of the unit level variables available to us, we were able to explain additional variance (15.91% to 73.25%) in 7 of the 10 ACT concepts.

Conclusion

The findings reported here represent the third published argument for validity of the ACT and adds to the evidence supporting its use to discriminate patient care units by all 10 contextual factors. We found evidence of relationships between a variety of individual and unit-level variables that explained much of this between-unit variation for each of the 10 ACT concepts. Future research will include examination of the relationships between the ACT's contextual factors and research utilization by nurses and ultimately the relationships between context, research utilization, and outcomes for patients.

Study protocol: ICONS: identifying continence options after stroke: a randomised trial

BACKGROUND

Urinary incontinence following acute stroke is common, affecting between 40%-60% of people in hospital after a stroke. Despite the availability of clinical guidelines for urinary incontinence and urinary incontinence after stroke, national audit data suggest incontinence is often poorly managed. Conservative interventions (e.g. bladder training, pelvic floor muscle training and prompted voiding) have been shown to have some effect with participants in Cochrane systematic reviews, but have not had their effectiveness demonstrated with stroke patients.

METHODS/DESIGN

A cluster randomised controlled pilot trial designed to assess the feasibility of a full-scale cluster randomised trial and to provide preliminary evidence of the effectiveness and cost-effectiveness of a systematic voiding programme for the management of continence after stroke. Stroke services will be randomised to receive the systematic voiding programme, the systematic voiding programme plus supported implementation, or usual care. The trial aims to recruit at least 780 participants in 12 stroke services (4 per arm). The primary outcome is presence/absence of incontinence at six weeks post-stroke. Secondary outcomes include frequency and severity of incontinence, quality of life and cost-utility. Outcomes will be measured at six weeks, three months and (for participants recruited in the first three months) twelve months after stroke. Process data will include rates of recruitment and retention and fidelity of intervention delivery. An integrated qualitative evaluation will be conducted in order to describe implementation and assist in explaining the potential mediators and modifiers of the process.

TRIAL REGISTRATION

ISRCTN: ISRCTN08609907

Understanding the conditions for improvement: research to discover which context influences affect improvement success

Context can be defined as all factors that are not part of a quality improvement intervention itself. More research indicates which aspects are 'conditions for improvement', which influence improvement success. However, little is known about which conditions are most important, whether these are different for different quality interventions or whether some become less or more important at different times in carrying out an improvement. Knowing more about these conditions could help speed up and spread improvements and develop the science. This paper proposes ways to build knowledge about the conditions needed for different changes, and to create conditional-attribution explanations to provide qualified generalisations. It describes theory-based, non-experimental research designs. It also suggests that 'practical improvers' can make their changes more effective by reflecting on and revising their own 'assumption-theories' about the conditions which will help and hinder the improvements they aim to implement.