Supporting the implementation of stroke quality-based procedures (QBPs): a mixed methods evaluation to identify knowledge translation activities, knowledge translation interventions, and determinants of implementation across Ontario

Background

In 2013, Health Quality Ontario introduced stroke quality-based procedures (QBPs) to promote use of evidence-based practices for patients with stroke in Ontario hospitals. The study purpose was to: (a) describe the knowledge translation (KT) interventions used to support stroke QBP implementation, (b) assess differences in the planned and reported KT interventions by region, and (c) explore determinants perceived to have affected outcomes.

Methods

A mixed methods approach was used to evaluate: activities, KT interventions, and determinants of stroke QBP implementation. In Phase 1, a document review of regional stroke network work plans was conducted to capture the types of KT activities planned at a regional level; these were mapped to the knowledge to action framework. In Phase 2, we surveyed Ontario hospital staff to identify the KT interventions used to support QBP implementation at an organizational level. Phase 3 involved qualitative interviews with staff to elucidate deeper understanding of survey findings.

Results

Of the 446 activities identified in the document review, the most common were ‘dissemination’ (24.2%; n = 108), ‘implementation’ (22.6%; n = 101), ‘implementation planning’ (15.0%; n = 67), and ‘knowledge tools’ (10.5%; n = 47). Based on survey data (n = 489), commonly reported KT interventions included: staff educational meetings (43.1%; n = 154), champions (41.5%; n = 148), and staff educational materials (40.6%; n = 145). Survey participants perceived stroke QBP implementation to be successful (median = 5/7; interquartile range = 4–6; range = 1–7; n = 335). Forty-four people (e.g., managers, senior leaders, regional stroke network representatives, and frontline staff) participated in interviews/focus groups. Perceived facilitators to QBP implementation included networks and collaborations with external organizations, leadership engagement, and hospital prioritization of stroke QBP. Perceived barriers included lack of funding, size of the hospital (i.e., too small), lack of resources (i.e., staff and time), and simultaneous implementation of other QBPs.

Conclusions

Information on the types of activities and KT interventions used to support stroke QBP implementation and the key determinants influencing uptake of stroke QBPs can be used to inform future activities including the development and evaluation of interventions to address barriers and leverage facilitators.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3220-9) contains supplementary material, which is available to authorized users.

Evaluation of the "Foundations in Knowledge Translation" training initiative: preparing end users to practice KT

BACKGROUND

Current knowledge translation (KT) training initiatives are primarily focused on preparing researchers to conduct KT research rather than on teaching KT practice to end users. Furthermore, training initiatives that focus on KT practice have not been rigorously evaluated and have focused on assessing short-term outcomes and participant satisfaction only. Thus, there is a need for longitudinal training evaluations that assess the sustainability of training outcomes and contextual factors that may influence outcomes.

METHODS

We evaluated the KT training initiative "Foundations in KT" using a mixed-methods longitudinal design. "Foundations in KT" provided training in KT practice and included three tailored in-person workshops, coaching, and an online platform for training materials and knowledge exchange. Two cohorts were included in the study (62 participants, including 46 "Foundations in KT" participants from 16 project teams and 16 decision-maker partners). Participants completed self-report questionnaires, focus groups, and interviews at baseline and at 6, 12, 18, and 24 months after the first workshop.

RESULTS

Participant-level outcomes include survey results which indicated that participants' self-efficacy in evidence-based practice (F(1,8.9) = 23.7, p = 0.001, n = 45), KT activities (F(1,23.9) = 43.2, p < 0.001, n = 45), and using evidence to inform practice increased over time (F(1,11.0) = 6.0, p = 0.03, n = 45). Interviews and focus groups illustrated that participants' understanding of and confidence in using KT increased from baseline to 24 months after the workshop. Interviews and focus groups suggested that the training initiative helped participants achieve their KT project objectives, plan their projects, and solve problems over time. Contextual factors include teams with high self-reported organizational capacity and commitment to implement at the start of their project had buy-in from upper management that resulted in secured funding and resources for their project. Training initiative outcomes include participants who applied the KT knowledge and skills they learned to other projects by sharing their knowledge informally with coworkers. Sustained spread of KT practice was observed with five teams at 24 months.

CONCLUSIONS

We completed a longitudinal evaluation of a KT training initiative. Positive participant outcomes were sustained until 24 months after the initial workshop. Given the emphasis on implementing evidence and the need to train implementers, these findings are promising for future KT training.

Evaluating implementation of the World Health Organization's Strategic Approach to strengthening sexual and reproductive health policies and programs to address unintended pregnancy and unsafe abortion

Background

We conducted a process evaluation to assess how the World Health Organization’s (WHO) Strategic Approach to strengthening sexual and reproductive health policies and programs (“the SA”) was used in 15 countries that requested WHO’s technical support in addressing unintended pregnancy and unsafe abortion. The SA is a three-stage planning, policy, and program implementation process. We used the social ecological model (SEM) to analyze the contextual factors that influenced SA implementation.

Methods

We used a two-phased sequential approach to data collection and analysis. In Phase A, we conducted a document and literature review and synthesized data thematically. In Phase B, we conducted interviews with stakeholders who used the SA in the countries of interest. We used a qualitative method triangulation technique to analyze and combine data from both phases to understand how the SA was implemented in each country.

Results

Data from 145 documents and 19 interviews described the SA process and activities in each country. All 15 countries completed Stage 1 activities. The activities of Stage 1 determined activities in subsequent stages and varied across countries. Following Stage 1, some countries focused on reforming policies to improve access to sexual and reproductive health (SRH) services whereas others focused on improving provider-level capacity to enhance SRH service quality and improving community-level SRH education. We identified factors across SEM levels that affected SA implementation, including individual- and community-level perceptions of using the SA and the recommendations that emerged from its use, organizational capacity to conduct SA activities, and how well these activities aligned with the existing political climate. Stakeholders perceived SA implementation to be country-driven and systematic in bringing attention to important SRH issues in their countries.

Conclusion

We identified key success factors for influencing the individual, organization, and system change required for implementing the SA. These include sustaining stakeholder engagement for all SA stages, monitoring and reporting on activities, and leveraging activities and outputs from each SA stage to obtain technical and financial support for subsequent stages. Results may be used to optimize ongoing implementation efforts to improve access to and the quality of SRH services.

Electronic supplementary material

The online version of this article (10.1186/s12978-017-0405-3) contains supplementary material, which is available to authorized users.

Sustainability and scalability of a volunteer-based primary care intervention (Health TAPESTRY): a mixed-methods analysis

Background

Chronic diseases are a significant public health concern, particularly in older adults. To address the delivery of health care services to optimally meet the needs of older adults with multiple chronic diseases, Health TAPESTRY (Teams Advancing Patient Experience: Strengthening Quality) uses a novel approach that involves patient home visits by trained volunteers to collect and transmit relevant health information using e-health technology to inform appropriate care from an inter-professional healthcare team. Health TAPESTRY was implemented, pilot tested, and evaluated in a randomized controlled trial (analysis underway). Knowledge translation (KT) interventions such as Health TAPESTRY should involve an investigation of their sustainability and scalability determinants to inform further implementation. However, this is seldom considered in research or considered early enough, so the objectives of this study were to assess the sustainability and scalability potential of Health TAPESTRY from the perspective of the team who developed and pilot-tested it.

Methods

Our objectives were addressed using a sequential mixed-methods approach involving the administration of a validated, sustainability survey developed by the National Health Service (NHS) to all members of the Health TAPESTRY team who were actively involved in the development, implementation and pilot evaluation of the intervention (Phase 1: n = 38). Mean sustainability scores were calculated to identify the best potential for improvement across sustainability factors. Phase 2 was a qualitative study of interviews with purposively selected Health TAPESTRY team members to gain a more in-depth understanding of the factors that influence the sustainability and scalability Health TAPESTRY. Two independent reviewers coded transcribed interviews and completed a multi-step thematic analysis. Outcomes were participant perceptions of the determinants influencing the sustainability and scalability of Health TAPESTRY.

Results

Twenty Health TAPESTRY team members (53% response rate) completed the NHS sustainability survey. The overall mean sustainability score was 64.6 (range 22.8–96.8). Important opportunities for improving sustainability were better staff involvement and training, clinical leadership engagement, and infrastructure for sustainability. Interviews with 25 participants (response rate 60%) showed that factors influencing the sustainability and scalability of Health TAPESTRY emerged across two dimensions: I) Health TAPESTRY operations (development and implementation activities undertaken by the central team); and II) the Health TAPESTRY intervention (factors specific to the intervention and its elements). Resource capacity appears to be an important factor to consider for Health TAPESTRY operations as it was identified across both sustainability and scalability factors; and perceived lack of interprofessional team and volunteer resource capacity and the need for stakeholder buy-in are important considerations for the Health TAPESTRY intervention. We used these findings to create actionable recommendations to initiate dialogue among Health TAPESTRY team members to improve the intervention.

Conclusions

Our study identified sustainability and scalability determinants of the Health TAPESTRY intervention that can be used to optimize its potential for impact. Next steps will involve using findings to inform a guide to facilitate sustainability and scalability of Health TAPESTRY in other jurisdictions considering its adoption. Our findings build on the limited current knowledge of sustainability, and advances KT science related to the sustainability and scalability of KT interventions.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2468-9) contains supplementary material, which is available to authorized users.

Factors that may be influencing the rise in prescription testosterone replacement therapy in adult men: a qualitative study

OBJECTIVE

To explore and describe the factors that may be influencing the rise of prescribing and use of testosterone replacement therapy (TRT) in adult men.

DESIGN

A rapid qualitative research design using semi-structured interviews with providers and patients.

SETTING

Ontario, Canada.

PARTICIPANTS

Nine men who have used TRT (referred to as "patients"), and six primary care clinicians and seven specialists (collectively referred to as "providers") who prescribed or administered TRT.

METHOD

Patients' and providers' perspectives were investigated through semi-structured interviews. A purposive sampling approach was used to recruit all participants. We conducted qualitative analysis using the framework approach for applied health research.

MAIN FINDINGS

Participants perceived the following factors to have influenced TRT prescriptions and use in adult men: provider factors (diagnostic ambiguity of age-related hypogonadism and beliefs about appropriateness of TRT) and patient factors (access to information on TRT and drug seeking behavior). They perceived that these factors have perpetuated a rise in prescription in the absence of clear clinical guidelines and unclear research evidence on the safety and efficacy of TRT.

CONCLUSION

The findings of this study highlight that much work still needs to be done to improve diagnostic accuracy and encourage appropriate TRT prescription in adult men. In addition, both patients and providers need more information about the risks and long-term effects of TRT in men.