Factors influencing the reporting of adverse medical device events: qualitative interviews with physicians about higher risk implantable devices

BACKGROUND

Postmarket surveillance of medical devices is reliant on physician reporting of adverse medical device events (AMDEs). Little is known about factors that influence whether and how physicians report AMDEs, an essential step in developing behaviour change interventions. This study explored factors that influence AMDE reporting.

METHODS

Qualitative interviews were conducted with physicians who differed by specialties that implant cardiovascular and orthopaedic devices prone to AMDEs, geography and years in practice. Participants were asked if and how they reported AMDEs, and the influencing factors. Themes were identified inductively using constant comparative technique, and reviewed and discussed by the research team on four occasions.

RESULTS

Twenty-two physicians of varying specialty, region, organisation and career stage perceived AMDE reporting as unnecessary, not possible or futile due to multiple factors. Physicians viewed AMDEs as an expected part of practice that they could manage by switching to different devices or developing work-around strategies for problematic devices. Physician beliefs and behaviour were reinforced by limited healthcare system capacity and industry responsiveness. The healthcare system lacked processes and infrastructure to detect, capture, share and act on information about AMDEs, and constrained device choice through purchasing contracts. The device industry did not respond to reports of AMDEs from physicians or improve their products based on such reports. As a result, participants said they used devices that were less than ideal for a given patient, leading to suboptimal patient outcomes.

CONCLUSIONS

There may be little point in solely educating or incentivising individual physicians to report AMDEs unless environmental conditions are conducive to doing so. Future research should explore policies that govern AMDEs and investigate how to design and implement postmarket surveillance systems.

"We can't get along without each other": Qualitative interviews with physicians about device industry representatives, conflict of interest and patient safety

Objectives

Physician relationships with device industry representatives have not been previously assessed. This study explored interactions with device industry representatives among physicians who use implantable cardiovascular and orthopedic devices to identify whether conflict of interest (COI) is a concern and how it is managed.

Design

A descriptive qualitative approach was used. Physicians who implant orthopedic and cardiovascular devices were identified in publicly available directories and web sites, and interviewed about their relationships with device industry representatives. Sampling was concurrent with data collection and analysis. Data were analyzed and discussed using constant comparative technique by all members of the research team.

Results

Twenty-two physicians (10 cardiovascular, 12 orthopedic) were interviewed. Ten distinct representative roles were identified: purchasing, training, trouble-shooting, supplying devices, assisting with device assembly and insertion, supporting operating room staff, mitigating liability, conveying information about recalls, and providing direct and indirect financial support. Participants recognized the potential for COI but representatives were present for the majority of implantations. Participants revealed a tension between physicians and representatives that was characterized as “symbiotic”, but required physicians to be vigilant about COI and patient safety, particularly because representatives varied regarding disclosure of device defects. They described a concurrent tension between hospitals, whose policies and business practices were focused on cost-control, and physicians who were required to comply with those policies and use particular devices despite concerns about their safety and effectiveness.

Conclusions

Given the potential for COI and threats to patient safety, further research is needed to establish the clinical implications of the role of, and relationship with device industry representatives; and whether and how hospitals do and should govern interaction with representatives, or support their staff in this regard.

Recommendations for patient engagement in guideline development panels: A qualitative focus group study of guideline-naïve patients

Background

Patient and consumer engagement in clinical practice guideline development is internationally advocated, but limited research explores mechanisms for successful engagement.

Objective

To investigate the perspectives of potential patient/consumer guideline representatives on topics pertaining to engagement including guideline development group composition and barriers to and facilitators of engagement.

Setting and participants

Participants were guideline-naïve volunteers for programs designed to link community members to academic research with diverse ages, gender, race, and degrees of experience interacting with health care professionals.

Methods

Three focus groups and one key informant interview were conducted and analyzed using a qualitative descriptive approach.

Results

Participants recommended small, diverse guideline development groups engaging multiple patient/consumer stakeholders with no prior relationships with each other or professional panel members. No consensus was achieved on the ideal balance of patient/consumer and professional stakeholders. Pre-meeting reading/training and an identified contact person were described as keys to successful early engagement; skilled facilitators, understandable speech and language, and established mechanisms for soliciting patient opinions were suggested to enhance engagement at meetings.

Conclusions

Most suggestions for effective patient/consumer engagement in guidelines require forethought and planning but little additional expense, making these strategies easily accessible to guideline developers desiring to achieve more meaningful patient and consumer engagement.

How do organisational characteristics influence teamwork and service delivery in lung cancer diagnostic assessment programmes? A mixed-methods study

OBJECTIVES

Diagnostic assessment programmes (DAPs) can reduce wait times for cancer diagnosis, but optimal DAP design is unknown. This study explored how organisational characteristics influenced multidisciplinary teamwork and diagnostic service delivery in lung cancer DAPs.

DESIGN

A mixed-methods approach integrated data from descriptive qualitative interviews and medical record abstraction at 4 lung cancer DAPs. Findings were analysed with the Integrated Team Effectiveness Model.

SETTING

4 DAPs at 2 teaching and 2 community hospitals in Canada.

PARTICIPANTS

22 staff were interviewed about organisational characteristics, target service benchmarks, and teamwork processes, determinants and outcomes; 314 medical records were reviewed for actual service benchmarks.

RESULTS

Formal, informal and asynchronous team processes enabled service delivery and yielded many perceived benefits at the patient, staff and service levels. However, several DAP characteristics challenged teamwork and service delivery: referral volume/workload, time since launch, days per week of operation, rural-remote population, number and type of full-time/part-time human resources, staff colocation, information systems. As a result, all sites failed to meet target benchmarks (from referral to consultation median 4.0 visits, median wait time 35.0 days). Recommendations included improved information systems, more staff in all specialties, staff colocation and expanded roles for patient navigators. Findings were captured in a conceptual framework of lung cancer DAP teamwork determinants and outcomes.

CONCLUSIONS

This study identified several DAP characteristics that could be improved to facilitate teamwork and enhance service delivery, thereby contributing to knowledge of organisational determinants of teamwork and associated outcomes. Findings can be used to update existing DAP guidelines, and by managers to plan or evaluate lung cancer DAPs. Ongoing research is needed to identify ideal roles for navigators, and staffing models tailored to case volumes.

Naturalistic study of guideline implementation tool use via evaluation of website access and physician survey

Background

Clinical guidelines support decision-making at the point-of-care but the onus is often on individual users such as physicians to implement them. Research shows that the inclusion of implementation tools in or with guidelines (GItools) is associated with guideline use. However, there is little research on which GItools best support implementation by individual physicians. The purpose of this study was to investigate naturalistic access and use of GItools produced by the American Academy of Neurology (AAN) to inform future tool development.

Methods

Website accesses over six months were summarized for eight AAN guidelines and associated GItools published between July 2012 and August 2013. Academy members were surveyed about use of tools accompanying the sport concussion guideline. Data were analyzed using summary statistics and the Chi-square test.

Results

The clinician summary was accessed more frequently (29.0%, p < 0.001) compared with the slide presentation (26.8%), patient summary (23.2%) or case study (20.9%), although this varied by guideline topic. For the sport concussion guideline, which was accompanied by a greater variety of GItools, the mobile phone quick reference check application was most frequently accessed, followed by the clinician summary, patient summary, and slide presentation. For the sports concussion guideline survey, most respondents (response rate 21.8%, 168/797) were aware of the guideline (88.1%) and had read the guideline (78.6%). For GItool use, respondents indicated reading the reference card (51.2%), clinician summary (45.2%), patient summary (28.0%), mobile phone application (26.2%), and coach/athletic trainer summary (20.2%). Patterns of sports concussion GItool use were similar between respondents who said they had and had not yet implemented the guideline.

Conclusions

Developers faced with resource limitations may wish to prioritize the development of printable or mobile application clinician summaries, which were accessed significantly more than other types of GItools. Further research is needed to understand how to optimize the design of such GItools.

The quantity and quality of complementary and alternative medicine clinical practice guidelines on herbal medicines, acupuncture and spinal manipulation: systematic review and assessment using AGREE II

BACKGROUND

Complementary and alternative medicine (CAM) use is often not disclosed by patients, and can be unfamiliar to health care professionals. This may lead to underuse of beneficial CAM therapies, and overuse of other CAM therapies with little proven benefit or known contraindications. No prior research has thoroughly evaluated the credibility of knowledge-based resources. The purpose of this research was to assess the quantity and quality of CAM guidelines.

METHODS

A systematic review was conducted to identify CAM guidelines. MEDLINE, EMBASE and CINAHL were searched in January 2016 from 2003 to 2015. The National Guideline Clearinghouse, National Center for Complementary and Integrative Health web site, and two CAM journals were also searched. Eligible guidelines published in English language by non-profit agencies on herbal medicine, acupuncture, or spinal manipulation for adults with any condition were assessed with the Appraisal of Guidelines, Research and Evaluation II (AGREE II) instrument.

RESULTS

From 3,126 unique search results, 17 guidelines (two herbal medicine, three acupuncture, four spinal manipulation, eight mixed CAM therapies) published in 2003 or later and relevant to several clinical conditions were eligible. Scaled domain percentages from highest to lowest were clarity of presentation (85.3 %), scope and purpose (83.3 %), rigour of development (61.2 %), editorial independence (60.1 %), stakeholder involvement (52.0 %) and applicability (20.7 %). Quality varied within and across guidelines. None of the 17 guidelines were recommended by both appraisers; 14 were recommended as Yes or Yes with modifications.

CONCLUSIONS

Guidelines that scored well could be used by patients and health care professionals as the basis for discussion about the use of these CAM therapies. In future updates, guidelines that achieved variable or lower scores could be improved according to specifications in the AGREE II instrument, and with insight from a large number of resources that are available to support guideline development and implementation. Future research should identify CAM therapies other than those reviewed here for which guidelines are available. Research is also needed on the safety and effectiveness of CAM therapies.

Meta-Review of the Quantity and Quality of Evidence for Knee Arthroplasty Devices

INTRODUCTION

Some cardiovascular devices are licensed based on limited evidence, potentially exposing patients to devices that are not safe or effective. Research is needed to ascertain if the same is true of other types of medical devices. Knee arthroplasty is a widely-used surgical procedure yet implant failures are not uncommon. The purpose of this study was to characterize available evidence on the safety and effectiveness of knee implants.

METHODS

A review of primary studies included in health technology assessments (HTA) on total (TKA) and unicompartmental knee arthroplasty (UKA) was conducted. MEDLINE, EMBASE, CINAHL, Cochrane Library and Biotechnology & BioEngineering Abstracts were searched from 2005 to 2014, plus journal tables of contents and 32 HTA web sites. Patients were aged 18 and older who underwent primary TKA or UKA assessed in cohort or randomized controlled studies. Summary statistics were used to report study characteristics.

RESULTS

A total of 265 eligible primary studies published between 1986 and 2014 involving 59,217 patients were identified in 10 HTAs (2 low, 7 moderate, 1 high risk of bias). Most evaluated TKA (198, 74.5%). The quality of evidence in primary studies was limited. Most studies were industry-funded (23.8%) or offered no declaration of funding or conflict of interest (44.9%); based on uncontrolled single cohorts (58.5%), enrolled fewer than 100 patients (66.4%), and followed patients for 2 years or less (UKA: single cohort 29.8%, comparative cohort 16.7%, randomized trial 25.0%; TKA: single cohort 25.0%, comparative cohort 31.4%, randomized trial 48.6%). Furthermore, most devices were evaluated in only one study (55.3% TKA implants, 61.1% UKA implants).

CONCLUSIONS

Patients, physicians, hospitals and payers rely on poor-quality evidence to support decisions about knee implants. Further research is needed to explore how decisions about the use of devices are currently made, and how the evidence base for device safety and effectiveness can be strengthened.

Identifying the conditions needed for integrated knowledge translation (IKT) in health care organizations: qualitative interviews with researchers and research users

Background

Collaboration among researchers and research users, or integrated knowledge translation (IKT), enhances the relevance and uptake of evidence into policy and practice. However, it is not widely practiced and, even when well-resourced, desired impacts may not be achieved. Given that large-scale investment is not the norm, further research is needed to identify how IKT can be optimized.

Methods

Interviews were conducted with researchers and research users (clinicians, managers) in a health care delivery (HCDO) and health care monitoring (HCMO) organization that differed in size and infrastructure, and were IKT-naïve. Basic qualitative description was used. Participants were asked about IKT activities and challenges, and recommendations for optimizing IKT. Data were analysed inductively using constant comparative technique.

Results

Forty-three interviews were conducted (28 HCDO, 15 HCMO) with 13 researchers, 8 clinicians, and 22 managers. Little to no IKT took place. Participants articulated similar challenges and recommendations revealing that a considerable number of changes were needed at the organizational, professional and individual levels. Given the IKT-absent state of participating organizations, this research identified a core set of conditions which must be addressed to prepare an environment conducive to IKT. These conditions were compiled into a framework by which organizations can plan for, or evaluate their capacity for IKT.

Conclusions

The IKT capacity framework is relevant for organizations in which there is no current IKT activity. Use of the IKT framework may result in more organizations that are ready to initiate and establish IKT, perhaps ultimately leading to more, and higher-quality collaboration for health system innovation. Further research is needed to confirm these findings in other organizations not yet resourced for, or undertaking IKT, and to explore the resource implications and mechanisms for establishing the conditions identified here as essential to preparing for IKT.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-016-1533-0) contains supplementary material, which is available to authorized users.

Characterizing patient-oriented tools that could be packaged with guidelines to promote self-management and guideline adoption: a meta-review

BACKGROUND

Self-management is an important component of care for patients or consumers (henceforth termed patients) with chronic conditions. Research shows that patients view guidelines as potential sources of self-management support. However, few guidelines provide such support. The primary purpose of this study was to characterize effective types of self-management interventions that could be packaged as resources in (i.e., appendices) or with guidelines (i.e., accompanying products).

METHODS

We conducted a meta-review of systematic reviews that evaluated self-management interventions. MEDLINE, EMBASE, and the Cochrane Library were searched from 2005 to 2014 for English language systematic reviews. Data were extracted on study characteristics, intervention (content, delivery, duration, personnel, single or multifaceted), and outcomes. Interventions were characterized by the type of component for different domains (inform, activate, collaborate). Summary statistics were used to report the characteristics, frequency, and impact of the types of self-management components. A Measurement Tool to Assess Systematic Reviews (AMSTAR) was used to assess the methodological quality of included reviews.

RESULTS

Seventy-seven studies were included (14 low, 44 moderate, 18 high risk of bias). Reviews addressed numerous clinical topics, most frequently diabetes (23, 30 %). Fifty-four focused on single (38 educational, 16 self-directed) and 21 on multifaceted interventions. Support for collaboration with providers was the least frequently used form of self-management. Most conditions featured multiple types of self-management components. The most frequently occurring type of self-management component across all studies was lifestyle advice (72 %), followed by psychological strategies (69 %), and information about the condition (49 %). In most reviews, the intervention both informed and activated patients (57, 76 %). Among the reviews that achieved positive results, 83 % of interventions involved activation alone, 94 % in combination with information, and 95 % in combination with information and collaboration. No trends in the characteristics and impact of self-management by condition were observed.

CONCLUSIONS

This study revealed numerous opportunities for enhancing guidelines with resources for both patients and providers to support self-management. This includes single resources that provide information and/or prompt activation. Further research is needed to more firmly establish the statistical association between the characteristics of self-management support and outcomes; and to and optimize the design of self-management resources that are included in or with guidelines, in particular, resources that prompt collaboration with providers.

Integrated knowledge translation (IKT) in health care: a scoping review

BACKGROUND

Integrated knowledge translation (IKT) refers to collaboration between researchers and decision-makers. While advocated as an approach for enhancing the relevance and use of research, IKT is challenging and inconsistently applied. This study sought to inform future IKT practice and research by synthesizing studies that empirically evaluated IKT and identifying knowledge gaps.

METHODS

We performed a scoping review. We searched MEDLINE, EMBASE, and the Cochrane Library from 2005 to 2014 for English language studies that evaluated IKT interventions involving researchers and organizational or policy-level decision-makers. Data were extracted on study characteristics, IKT intervention (theory, content, mode, duration, frequency, personnel, participants, timing from initiation, initiator, source of funding, decision-maker involvement), and enablers, barriers, and outcomes reported by studies. We performed content analysis and reported summary statistics.

RESULTS

Thirteen studies were eligible after screening 14,754 titles and reviewing 106 full-text studies. Details about IKT activities were poorly reported, and none were formally based on theory. Studies varied in the number and type of interactions between researchers and decision-makers; meetings were the most common format. All studies reported barriers and facilitators. Studies reported a range of positive and sub-optimal outcomes. Outcomes did not appear to be associated with initiator of the partnership, dedicated funding, partnership maturity, nature of decision-maker involvement, presence or absence of enablers or barriers, or the number of different IKT activities.

CONCLUSIONS

The IKT strategies that achieve beneficial outcomes remain unknown. We generated a summary of IKT approaches, enablers, barriers, conditions, and outcomes that can serve as the basis for a future review or for planning ongoing primary research. Future research can contribute to three identified knowledge gaps by examining (1) how different IKT strategies influence outcomes, (2) the relationship between the logic or theory underlying IKT interventions and beneficial outcomes, and (3) when and how decision-makers should be involved in the research process. Future IKT initiatives should more systematically plan and document their design and implementation, and evaluations should report the findings with sufficient detail to reveal how IKT was associated with outcomes.

Patient-mediated knowledge translation (PKT) interventions for clinical encounters: a systematic review

BACKGROUND

Patient-mediated knowledge translation (PKT) interventions engage patients in their own health care. Insight on which PKT interventions are effective is lacking. We sought to describe the type and impact of PKT interventions.

METHODS

We performed a systematic review of PKT interventions, defined as strategies that inform, educate and engage patients in their own health care. We searched MEDLINE, EMBASE and the Cochrane Library from 2005 to 2014 for English language studies that evaluated PKT interventions delivered immediately before, during or upon conclusion of clinical encounters to individual patients with arthritis or cancer. Data were extracted on study characteristics, PKT intervention (theory, content, delivery, duration, personnel, timing) and outcomes. Interventions were characterized by type of patient engagement (inform, activate, collaborate). We performed content analysis and reported summary statistics.

RESULTS

Of 694 retrieved studies, 16 were deemed eligible (5 arthritis, 11 cancer; 12 RCTs, 4 cohort studies; 7 low, 3 uncertain, 6 high risk of bias). PKT interventions included print material in 10 studies (brochures, booklets, variety of print material, list of websites), electronic material in 10 studies (video, computer program, website) and counselling in 2 studies. They were offered before, during and after consultation in 4, 1 and 4 studies, respectively; as single or multifaceted interventions in 10 and 6 studies, respectively; and by clinicians, health educators, researchers or volunteers in 4, 3, 5 and 1 study, respectively. Most interventions informed or activated patients. All studies achieved positive impact in one or more measures of patient knowledge, decision-making, communication and behaviour. This was true regardless of condition, PKT intervention, timing, personnel, type of engagement or delivery (single or multifaceted). No studies assessed patient harms, or interventions for providers to support PKT intervention delivery. Two studies evaluated the impact on providers of PKT interventions aimed at patients.

CONCLUSIONS

Single interventions involving print material achieved beneficial outcomes as did more complex interventions. Few studies were eligible, and no studies evaluated patient harms, or provider outcomes. Further research is warranted to evaluate these PKT interventions in more patients, or patients with different conditions; different types of PKT interventions for patients and for providers; and potential harms associated with interventions.

Trends in guideline implementation: a scoping systematic review

BACKGROUND

There is currently no reliable way to choose strategies that are appropriate for implementing guidelines facing different barriers. This study examined trends in guideline implementation by topic over a 10-year period to explore whether and how strategies may be suitable for addressing differing barriers.

METHODS

A scoping systematic review was performed. MEDLINE and EMBASE were searched from 2004 to 2013 for studies that evaluated the implementation of guidelines on arthritis, diabetes, colorectal cancer and heart failure. Data on study characteristics, reason for implementation (new guideline or quality improvement), implementation strategy used, rationale for selecting that strategy and reported impact were extracted and summarized. Interventions were mapped against a published taxonomy of guideline implementation strategies.

RESULTS

The search resulted in 1,709 articles; 156 were retrieved and 127 were excluded largely because they did not evaluate guideline implementation, leaving 32 eligible for review (4 arthritis, 3 colorectal cancer, 21 diabetes, 4 heart failure). Six of 7 randomized trials and 8 of 25 observational studies had a low risk of bias. Most studies promoted guideline use for quality improvement (78.0%). Few studies rationalized strategy choice (18.8%). Most employed multiple approaches and strategies, most often educational meetings and print material for professionals or patients. Few studies employed organizational, financial or regulatory approaches. Strategies employed that were unique to the published taxonomy included professional (print material, tailoring guidelines, self-audit training or material) and patient strategies (education, counselling, group interaction, print material, reminders). Most studies achieved positive impact (87.5%). This did not appear to be associated with guideline topic, use of theory or barrier assessment, or number or type of implementation approaches and strategies.

CONCLUSIONS

While few studies were eligible, limiting insight on how to choose implementation strategies that address guideline-specific barriers, this review identified other important findings. Education for professionals or patients and print material were the most commonly employed strategies for translating guidelines to practice. Mapping of strategies onto the published taxonomy identified gaps in guideline implementation that represent opportunities for future research and expanded the taxonomy.

Factors contributing to the effectiveness of physical activity counselling in primary care: a realist systematic review

OBJECTIVE

Physical activity (PA) counselling in primary care increases PA but is not consistently practiced. This study examined factors that optimise the delivery and impact of PA counselling.

METHODS

A realist systematic review based on the PRECEDE-PROCEED model and RAMESES principles was conducted to identify essential components of PA counselling. MEDLINE, EMBASE, Cochrane Library, PsycINFO, and Physical Education Index were searched from 2000 to 2013 for studies that evaluated family practice PA counselling.

RESULTS

Of 1546 articles identified, 10 were eligible for review (3 systematic reviews, 5 randomised controlled trials, 2 observational studies). Counselling provided by clinicians or counsellors alone that explored motivation increased self-reported PA at least 12 months following intervention. Multiple sessions may sustain increased PA beyond 12 months.

CONCLUSION

Given the paucity of eligible studies and limited detail reported about interventions, further research is needed to establish the optimal design and delivery of PA counselling. Research and planning should consider predisposing, reinforcing and enabling design features identified in these studies.

PRACTICE IMPLICATIONS

Since research shows that PA counselling promotes PA but is not widely practiced, primary care providers will require training and tools to operationalize PA counselling.

Do guidelines offer implementation advice to target users? A systematic review of guideline applicability

OBJECTIVE

Providers and patients are most likely to use and benefit from guidelines accompanied by implementation support. Guidelines published in 2007 and earlier assessed with the Appraisal of Guidelines, Research and Evaluation (AGREE) instrument scored poorly for applicability, which reflects the inclusion of implementation instructions or tools. The purpose of this study was to examine the applicability of guidelines published in 2008 or later and identify factors associated with applicability.

DESIGN

Systematic review of studies that used AGREE to assess guidelines published in 2008 or later.

DATA SOURCES

MEDLINE and EMBASE were searched from 2008 to July 2014, and the reference lists of eligible items. Two individuals independently screened results for English language studies that reviewed guidelines using AGREE and reported all domain scores, and extracted data. Descriptive statistics were calculated across all domains. Multilevel regression analysis with a mixed effects model identified factors associated with applicability.

RESULTS

Of 245 search results, 53 were retrieved as potentially relevant and 20 studies were eligible for review. The mean and median domain scores for applicability across 137 guidelines published in 2008 or later were 43.6% and 42.0% (IQR 21.8-63.0%), respectively. Applicability scored lower than all other domains, and did not markedly improve compared with guidelines published in 2007 or earlier. Country (UK) and type of developer (disease-specific foundation, non-profit healthcare system) appeared to be associated with applicability when assessed with AGREE II (not original AGREE).

CONCLUSIONS

Despite increasing recognition of the need for implementation tools, guidelines continue to lack such resources. To improve healthcare delivery and associated outcomes, further research is needed to establish the type of implementation tools needed and desired by healthcare providers and consumers, and methods for developing high-quality tools.

Developing a checklist for guideline implementation planning: review and synthesis of guideline development and implementation advice

Background

Developers, users and others have requested or advocated for guidance on how to plan for, and implement guidelines concurrent to their development given that existing resources are lacking such information. The purpose of this research was to develop a guideline implementation planning checklist.

Methods

Documents that described or evaluated the processes of planning or undertaking implementation were identified in several publications that had systematically identified such resources, and by searching medical literature databases (MEDLINE, EMBASE). Data that described implementation planning; how to develop guideline versions or tools that would support user implementation; and options and mechanisms for disseminating or implementing guidelines were independently extracted from eligible documents by the principal investigator and a trained research assistant. Data were integrated to create a unique list of guideline implementation planning processes and considerations.

Results

Thirty-five documents were eligible. Of these, 16 (45.7%) provided sparse information on implementation planning, 25 (71.4%) mentioned different versions or tools for implementation, and 30 (85.7%) listed options for dissemination or implementation. None provided instructions for operationalizing implementation strategies. Data were integrated into a multi-item Guideline Implementation Planning Checklist including considerations for implementation planning (12), development of implementation tools (8), types of implementation tools (12), and options for dissemination (11) and implementation (12).

Conclusions

Developers or users can apply the Guideline Implementation Planning Checklist to prepare for and/or undertake guideline implementation. Further development of the checklist is warranted to elaborate on all components. In ongoing research, we will consult with the international guideline community to do so. At the same time, guideline implementation is complex, so developers and users would benefit from training, and by including knowledge translation experts and brokers on implementation planning committees.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0205-5) contains supplementary material, which is available to authorized users.

The development of guideline implementation tools: a qualitative study

BACKGROUND

Research shows that guidelines featuring implementation tools (GItools) are more likely to be used than those without GItools, however few guidelines offer GItools and guidance on developing GItools is lacking. The objective of this study was to identify common processes and considerations for developing GItools.

METHODS

Interviews were conducted with developers of 4 types of GItools (implementation, patient engagement, point-of-care decision-making and evaluation) accompanying guidelines on various topics created in 2008 or later identified in the National Guideline Clearinghouse. Participants were asked to describe the GItool development process and related considerations. A descriptive qualitative approach was used to collect and analyze data.

RESULTS

Interviews were conducted with 26 GItool developers in 9 countries. Participants largely agreed on 11 broad steps, each with several tasks and considerations. Response variations identified issues lacking uniform approaches that may require further research including timing of GItool development relative to guideline development; decisions about GItool type, format and content; and whether and how to engage stakeholders. Although developers possessed few dedicated resources, they relied on partnerships to develop, implement and evaluate GItools.

INTERPRETATION

GItool developers employed fairly uniform and rigorous processes for developing GItools. By supporting GItool development, the GItool methods identified here may improve guideline implementation and use.

How does context influence collaborative decision-making for health services planning, delivery and evaluation?

Background

Collaboration among researchers (clinician, non-clinician) and decision makers (managers, policy-makers, clinicians), referred to as integrated knowledge translation (IKT), enhances the relevance and use of research, leading to improved decision-making, policies, practice, and health care outcomes. However IKT is not widely practiced due to numerous challenges. This research explored how context influenced IKT as a means of identifying how IKT could be strengthened.

Methods

This research investigated IKT in three health services programs for colon cancer screening, prostate cancer diagnosis, and the treatment of pancreatic cancer. Qualitative methods were used to explore contextual factors that influenced how IKT occurred, and its impact. Data were collected between September 1, 2012 and May 15, 2013 from relevant documents, observation of meetings, and interviews with researchers and decision-makers, analyzed using qualitative methods, and integrated.

Results

Data were analyzed from 39 documents, observation of 6 meetings, and 36 interviews. IKT included interaction at meetings, joint undertaking of research, and development of guidelines. IKT was most prevalent in one program with leadership, clear goals, dedicated funding and other infrastructural resources, and an embedded researcher responsible for, and actively engaged in IKT. This program achieved a variety of social, research and health service outcomes despite mixed individual views about the value of IKT and the absence of a programmatic culture of IKT. Participants noted numerous challenges including lack of time and incentives, and recommendations to support IKT. A conceptual framework of factors that influence IKT and associated outcomes was generated, and can be used by others to plan or evaluate IKT.

Conclusions

The findings can be applied by researchers, clinicians, managers or policy-makers to plan or improve collaborative decision-making for health services planning, delivery, evaluation or quality improvement. Further research is needed to explore whether these findings are widespread, and further understand how IKT can be optimized.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-014-0545-x) contains supplementary material, which is available to authorized users.

Multiple interacting factors influence adherence, and outcomes associated with surgical safety checklists: a qualitative study

Objectives

The surgical safety checklist (SSC) is meant to enhance patient safety but studies of its impact conflict. This study explored factors that influenced SSC adherence to suggest how its impact could be optimized.

Methods

Participants were recruited purposively by profession, region, hospital type and time using the SSC. They were asked to describe how the SSC was adopted, associated challenges, perceived impact, and suggestions for improving its use. Grounded theory and thematic analysis were used to collect and analyse data. Findings were interpreted using an implementation fidelity conceptual framework.

Results

Fifty-one participants were interviewed (29 nurses, 13 surgeons, 9 anaesthetists; 18 small, 14 large and 19 teaching hospitals; 8 regions; 31 had used the SC for ≤12 months, 20 for 13+ months). The SSC was inconsistently reviewed, and often inaccurately documented as complete. Adherence was influenced by multiple issues. Extensive modification to accommodate existing practice patterns eliminated essential interaction at key time points to discuss patient management. Staff were often absent or not paying attention. They did not feel it was relevant to their work given limited evidence of its effectiveness, and because they were not engaged in its implementation. Organizations provided little support for implementation, training, monitoring and feedback, which are needed to overcome these, and other individual and team factors that challenged SSC adherence. Responses were similar across participants with different characteristics.

Conclusions

Multiple processes and factors influenced SSC adherence. This may explain why, in studies evaluating SSC impact, outcomes were variable. Recommendations included continuing education, time for pilot-testing, and engaging all staff in SSC review. Others may use the implementation fidelity framework to plan SSC implementation or evaluate SSC adherence. Further research is needed to establish which SSC components can be modified without compromising its effectiveness.

Exploring mentorship as a strategy to build capacity for knowledge translation research and practice: a scoping systematic review

BACKGROUND

Knowledge translation (KT) supports use of evidence in healthcare decision making but is not widely practiced. Mentoring is a promising means of developing KT capacity. The purpose of this scoping systematic review was to identify essential components of mentoring that could be adapted for KT mentorship.

METHODS

Key social sciences and management databases were searched from January 2002 to December 2011 inclusive. Empirical research in non-healthcare settings that examined mentorship design and impact for improving job-specific knowledge and skill were eligible. Members of the study team independently selected eligible studies, and extracted and summarized data.

RESULTS

Of 2,101 search results, 293 were retrieved and 13 studies were eligible for review. All but one reported improvements in knowledge, skill, or behavior. Mentoring program components included combining preliminary workshop-based training with individual mentoring provided either in person or remotely; training of mentors; and periodic mentoring for at least an hour over a minimum period of six months. Barriers included the need for infrastructure for recruitment, matching, and training; lack of clarity in mentoring goals; and limited satisfaction with mentors and their availability. Findings were analyzed against a conceptual framework of factors that influence mentoring design and impact to identify issues warranting further research.

CONCLUSION

This study identified key mentoring components that could be adapted for KT mentorship. Overall, few studies were identified. Thus further research should explore whether and how mentoring should be tailored to baseline knowledge or skill and individual KT needs; evaluate newly developed or existing KT mentorship programs based on the factors identified here; and examine whether and how KT mentorship develops KT capacity. The conceptual framework could be used to develop or evaluate KT mentoring programs.

A framework of the desirable features of guideline implementation tools (GItools): Delphi survey and assessment of GItools

Background

Guidelines are the foundation for healthcare planning, delivery and quality improvement but are not consistently implemented. Few guidelines are accompanied by guideline implementation tools (GItools). Users have requested GItools, and developers have requested guidance on how to develop GItools. First it is necessary to characterize GItools. The purpose of this research was to generate a framework of desirable features of GItools.

Methods

Items representing desirable GItool features were generated by a cross-sectional survey of the international guideline community. Items were confirmed by 31 guideline developers, implementers and researchers in a two-round Delphi survey administered on the Internet. The resulting GItool framework was applied with a sample of GItools accompanying guidelines identified in the National Guideline Clearinghouse.

Results

The cross-sectional survey was completed by 96 respondents from Australia, Canada, the United Kingdom, the United States, The Netherlands, and various other countries. Seven of nine items were rated by the majority as desirable. A total of 31 panelists from 10 countries including Australia, Canada, Germany, New Zealand, Peru, Saudi Arabia, Spain, the United Kingdom, and the United States took part in a two-round Delphi survey. Ten items achieved consensus as desirable GItool features in round #1, and two additional items in round #2. A total of 13 GItools for Resource Planning, Implementation and Evaluation were identified among 149 guidelines on a variety of clinical topics (8.7%). Many GItools did not possess features considered desirable.

Conclusions

Inclusion of higher quality GItools in guidelines is needed to support user adoption of guidelines. The GItool framework can serve as the basis for evaluating and adapting existing GItools, or developing new GItools. Further research is needed to validate the framework, develop and implement instruments by which developers can apply the framework, and specify which guidelines should be accompanied by GItools.

How can diagnostic assessment programs be implemented to enhance inter-professional collaborative care for cancer?

BACKGROUND

Inter-professional collaborative care (ICC) for cancer leads to multiple system, organizational, professional, and patient benefits, but is limited by numerous challenges. Empirical research on interventions that promote or enable ICC is sparse so guidance on how to achieve ICC is lacking. Research shows that ICC for diagnosis could be improved. Diagnostic assessment programs (DAPs) appear to be a promising model for enabling ICC. The purpose of this study was to explore how DAP structure and function enable ICC, and whether that may be associated with organizational and clinical outcomes.

METHODS

A case study approach will be used to explore ICC among eight DAPs that vary by type of cancer (lung, breast), academic status, and geographic region. To describe DAP function and outcomes, and gather information that will enable costing, recommendations expressed in DAP standards and clinical guidelines will be assessed through retrospective observational study. Data will be acquired from databases maintained by participating DAPs and the provincial cancer agency, and confirmed by and supplemented with review of medical records. We will conduct a pilot study to explore the feasibility of estimating the incremental cost-effectiveness ratio using person-level data from medical records and other sources. Interviews will be conducted with health professionals, staff, and referring physicians from each DAP to learn about barriers and facilitators of ICC. Qualitative methods based on a grounded approach will be used to guide sampling, data collection and analysis.

DISCUSSION

Findings may reveal opportunities for unique structures, interventions or tools that enable ICC that could be developed, implemented, and evaluated through future research. This information will serve as a formative needs assessment to identify the nature of ongoing or required improvements, which can be directly used by our decision maker collaborators, and as a framework by policy makers, cancer system managers, and DAP managers elsewhere to strategically plan for and implement diagnostic cancer services.

Quality of narrative operative reports in pancreatic surgery

BACKGROUND

Quality in health care can be evaluated using quality indicators (QIs). Elements contained in the surgical operative report are potential sources for QI data, but little is known about the completeness of the narrative operative report (NR). We evaluated the completeness of the NR for patients undergoing a pancreaticoduodenectomy.

METHODS

We reviewed NRs for patients undergoing a pancreaticoduodenectomy over a 1-year period. We extracted 79 variables related to patient and narrator characteristics, process of care measures, surgical technique and oncology-related outcomes by document analysis. Data were coded and evaluated for completeness.

RESULTS

We analyzed 74 NRs. The median number of variables reported was 43.5 (range 13-54). Variables related to surgical technique were most complete. Process of care and oncology-related variables were often omitted. Completeness of the NR was associated with longer operative duration.

CONCLUSION

The NRs were often incomplete and of poor quality. Important elements, including process of care and oncology-related data, were frequently missing. Thus, the NR is an inadequate data source for QI. Development and use of alternative reporting methods, including standardized synoptic operative reports, should be encouraged to improve documentation of care and serve as a measure of quality of surgical care.