Changing physicians' competence and performance: finding the balance between the individual and the organization

Interventions for the uptake of evidence-based recommendations in acute stroke settings

BACKGROUND

There is a growing body of research evidence to guide acute stroke care. Receiving care in a stroke unit improves access to recommended evidence-based therapies and patient outcomes. However, even in stroke units, evidence-based recommendations are inconsistently delivered by healthcare workers to patients with stroke. Implementation interventions are strategies designed to improve the delivery of evidence-based care.

OBJECTIVES

To assess the effects of implementation interventions (compared to no intervention or another implementation intervention) on adherence to evidence-based recommendations by health professionals working in acute stroke units. Secondary objectives were to assess factors that may modify the effect of these interventions, and to determine if single or multifaceted strategies are more effective in increasing adherence with evidence-based recommendations.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, CINAHL, Joanna Briggs Institute and ProQuest databases to 13 April 2022. We searched the grey literature and trial registries and reviewed reference lists of all included studies, relevant systematic reviews and primary studies; contacted corresponding authors of relevant studies and conducted forward citation searching of the included studies. There were no restrictions on language and publication date.

SELECTION CRITERIA

We included randomised trials and cluster-randomised trials. Participants were health professionals providing care to patients in acute stroke units; implementation interventions (i.e. strategies to improve delivery of evidence-based care) were compared to no intervention or another implementation intervention. We included studies only if they reported on our primary outcome which was quality of care, as measured by adherence to evidence-based recommendations, in order to address the review aim.

DATA COLLECTION AND ANALYSIS

Two review authors independently selected studies for inclusion, extracted data and assessed risk of bias and certainty of evidence using GRADE. We compared single implementation interventions to no intervention, multifaceted implementation interventions to no intervention, multifaceted implementation interventions compared to single implementation interventions and multifaceted implementation interventions to another multifaceted intervention. Our primary outcome was adherence to evidence-based recommendations.

MAIN RESULTS

We included seven cluster-randomised trials with 42,489 patient participants from 129 hospitals, conducted in Australia, the UK, China, and the Netherlands. Health professional participants (numbers not specified) included nursing, medical and allied health professionals. Interventions in all studies included implementation strategies targeting healthcare workers; three studies included delivery arrangements, no studies used financial arrangements or governance arrangements. Five trials compared a multifaceted implementation intervention to no intervention, two trials compared one multifaceted implementation intervention to another multifaceted implementation intervention. No included studies compared a single implementation intervention to no intervention or to a multifaceted implementation intervention. Quality of care outcomes (proportions of patients receiving evidence-based care) were included in all included studies. All studies had low risks of selection bias and reporting bias, but high risk of performance bias. Three studies had high risks of bias from non-blinding of outcome assessors or due to analyses used. We are uncertain whether a multifaceted implementation intervention leads to any change in adherence to evidence-based recommendations compared with no intervention (risk ratio (RR) 1.73; 95% confidence interval (CI) 0.83 to 3.61; 4 trials; 76 clusters; 2144 participants, I2 =92%, very low-certainty evidence). Looking at two specific processes of care, multifaceted implementation interventions compared to no intervention probably lead to little or no difference in the proportion of patients with ischaemic stroke who received thrombolysis (RR 1.14, 95% CI 0.94 to 1.37, 2 trials; 32 clusters; 1228 participants, moderate-certainty evidence), but probably do increase the proportion of patients who receive a swallow screen within 24 hours of admission (RR 6.76, 95% CI 4.44 to 10.76; 1 trial; 19 clusters; 1,804 participants; moderate-certainty evidence). Multifaceted implementation interventions probably make little or no difference in reducing the risk of death, disability or dependency compared to no intervention (RR 0.93, 95% CI 0.85 to 1.02; 3 trials; 51 clusters ; 1228 participants; moderate-certainty evidence), and probably make little or no difference to hospital length of stay compared with no intervention (difference in absolute change 1.5 days; 95% CI -0.5 to 3.5; 1 trial; 19 clusters; 1804 participants; moderate-certainty evidence). We do not know if a multifaceted implementation intervention compared to no intervention result in changes to resource use or health professionals' knowledge because no included studies collected these outcomes.

AUTHORS' CONCLUSIONS

We are uncertain whether a multifaceted implementation intervention compared to no intervention improves adherence to evidence-based recommendations in acute stroke settings, because the certainty of evidence is very low.

Using implementation mapping to develop strategies for preventing non-communicable diseases in Japanese small- and medium-sized enterprises

Introduction

Workplace programs to prevent non-communicable diseases (NCDs) in the workplace can help prevent the incidence of chronic diseases among employees, provide health benefits, and reduce the risk of financial loss. Nevertheless, these programs are not fully implemented, particularly in small- and medium-sized enterprises (SMEs). The purpose of this study was to develop implementation strategies for health promotion activities to prevent NCDs in Japanese SMEs using Implementation Mapping (IM) to present the process in a systematic, transparent, and replicable manner.

Methods

Qualitative methods using interviews and focus group discussions with 15 SMEs and 20 public health nurses were conducted in a previous study. This study applied the Consolidated Framework for Implementation Research and IM to analyze this dataset to develop implementation strategies suitable for SMEs in Japan.

Results

In task 2 of the IM, we identified performance objectives, determinants, and change objectives for each implementation stage: adoption, implementation, and maintenance; to identify the required actors and actions necessary to enhance implementation effectiveness. Twenty-two performance objectives were identified in each implementation stage. In task 3 of the IM, the planning group matched behavioral change methods (e.g., modeling and setting of graded tasks, framing, self-re-evaluation, and environmental re-evaluation) with determinants to address the performance objectives. We used a consolidated framework for implementation research to select the optimal behavioral change technique for performance objectives and determinants and designed a practical application. The planning team agreed on the inclusion of sixteen strategies from the final strategies list compiled and presented to it for consensus, for the overall implementation plan design.

Discussion

This paper provides the implementation strategies for NCDs prevention for SMEs in Japan following an IM protocol. Although the identified implementation strategies might not be generalizable to all SMEs planning implementation of health promotion activities, because they were tailored to contextual factors identified in a formative research. However, identified performance objectives and implementation strategies can help direct the next steps in launching preventive programs against NCDs in SMEs.

Research Ready Grant Program (RRGP) protocol: a model for collaborative multidisciplinary practice-research partnerships

Background

Little attention has been given to the process of implementing or evaluating a structured academic–clinician (university–health service) research capacity-building (RCB) model within healthcare settings. We have developed a model for collaborative multidisciplinary practice–research partnerships called the Research Ready Grant Program (RRGP). The RRGP is informed by Cooke’s (BMC Fam Pract 6:44, 2005) RCB framework and principles. The aim of the study outlined in this protocol is to conduct a process and outcome evaluation of the programme. We will explore how the RRGP's structured mentor model contributes to RCB of clinician-led multidisciplinary research teams. We will identify key factors at the organization, team and individual levels that affect research capacity of health professionals working in one regional health service district. This protocol describes the RRGP design and outlines the methods we will employ to evaluate an RCB programme, the RRGP, delivered in a regional health service in Australia.

Methods

The study will adopt an exploratory concurrent mixed-methods approach designed to evaluate the process of implementing an RCB model across one regional hospital and health service. Both quantitative and qualitative data collection methods over a 12-month period will be implemented. Data triangulation will be applied to capture the complex issues associated with implementing collaborative multidisciplinary practice–research partnerships.

Discussion

The RRGP is an innovative RCB model for clinicians in their workplace. It is expected that the programme will facilitate a culture of collaborative multidisciplinary research and strengthen hospital–university partnerships.

Quality of chronic care in general practices in Salzburg, Austria, and South Tyrol, Italy: a comparative process of care intervention study

BACKGROUND

Quality indicators to assess the quality of primary care have only been applied on a national or regional level in European countries, and there have been no comparisons between regions of different countries. In the interventional pre-post-study "Improvement of Quality by Benchmarking - IQuaB" (level of evidence: 3), we aimed to improve and compare quality of process care in 57 participating general practices in Salzburg, Austria, and South Tyrol, Italy.

METHODS

The intervention consisted of self-audit, benchmarking and quality circles. Quality indicators for eight common chronic diseases (e. g., diabetes) were extracted from the electronic health records in 2012, 2013 and 2014. Based on 19 quality indicators, a supra-regional quality score was calculated and compared using Mann-Whitney U tests.

RESULTS

A relatively weak baseline performance was identified in both regions. In all three assessments, the median quality score increased in both regions and was significantly higher in South Tyrol than in Salzburg. During the study period the median supra-regional quality score increased from 20.00 to 38.00 in the Salzburg sample and from 47.00 to 79.50 in the South Tyrolian sample. The differences between the two regions were significant at baseline and after intervention (2012: p=0.015, 2014: p=0.001).

DISCUSSION

Despite data extraction challenges in Austria, we are convinced that our data highlight real differences in (processual) quality of care between the two regions.

CONCLUSIONS

The reasons underlying the persisting differences between the two regions may include: (1) different functions in electronic health records, (2) benchmarking as an integral part of the electronic health record, (3) gate-keeping system and use of registration lists, (4) state-supported quality initiatives.

Optimising the delivery of remediation programmes for doctors: A realist review

CONTEXT

Medical underperformance puts patient safety at risk. Remediation, the process that seeks to 'remedy' underperformance and return a doctor to safe practice, is therefore a crucially important area of medical education. However, although remediation is used in health care systems globally, there is limited evidence for the particular models or strategies employed. The purpose of this study was to conduct a realist review to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety.

METHOD

We conducted a realist literature review consistent with RAMESES standards. We developed a programme theory of remediation by carrying out a systematic search of the literature and through regular engagement with a stakeholder group. We searched bibliographic databases (MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL, ERIC, ASSIA and DARE) and conducted purposive supplementary searches. Relevant sections of text relating to the programme theory were extracted and synthesised using a realist logic of analysis to identify context-mechanism-outcome configurations (CMOcs).

RESULTS

A 141 records were included. The majority of the studies were from North America (64%). 29 CMOcs were identified. Remediation programmes are effective when a doctor's insight and motivation are developed and behaviour change reinforced. Insight can be developed by providing safe spaces, using advocacy to promote trust and framing feedback sensitively. Motivation can be enhanced by involving the doctor in remediation planning, correcting causal attribution, goal setting and destigmatising remediation. Sustained change can be achieved by practising new behaviours and skills, and through guided reflection.

CONCLUSION

Remediation can work when it creates environments that trigger behaviour change mechanisms. Our evidence synthesis provides detailed recommendations on tailoring implementation and design strategies to improve remediation interventions for doctors.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

Education Research: NeuroBytes: A New Rapid, High-Yield e-Learning Platform for Continuing Professional Development in Neurology

OBJECTIVE

To determine whether NeuroBytes is a helpful e-Learning tool in neurology through usage, viewer type, estimated time and cost of development, and postcourse survey responses.

BACKGROUND

A sustainable Continuing Professional Development (CPD) system is vital in neurology due to the field's expanding therapeutic options and vulnerable patient populations. In an effort to offer concise, evidence-based updates to a wide range of neurology professionals, the American Academy of Neurology (AAN) launched NeuroBytes in 2018. NeuroBytes are brief (<5 minutes) videos that provide high-yield updates to AAN members.

METHODS

NeuroBytes was beta tested from August 2018 to December 2018 and launched for pilot circulation from January 2019 to April 2019. Usage was assessed by quantifying course enrollment and completion rates; feasibility by cost and time required to design and release a module; appeal by user satisfaction; and effect by self-reported change in practice.

RESULTS

A total of 5,130 NeuroBytes enrollments (1,026 ± 551/mo) occurred from January 11, 2019, to May 28, 2019, with a median of 588 enrollments per module (interquartile range, 194-922) and 37% course completion. The majority of viewers were neurologists (54%), neurologists in training (26%), and students (8%). NeuroBytes took 59 hours to develop at an estimated $77.94/h. Of the 1,895 users who completed the survey, 82% were "extremely" or "very likely" to recommend NeuroBytes to a colleague and 60% agreed that the depth of educational content was "just right."

CONCLUSIONS

NeuroBytes is a user-friendly, easily accessible CPD product that delivers concise updates to a broad range of neurology practitioners and trainees. Future efforts will explore models where NeuroBytes combines with other CPD programs to affect quality of training and clinical practice.

Informing National Health Service patients about participation in clinical research: A comparison of opt-in and opt-out approaches across the United Kingdom

OBJECTIVE

Recruitment to clinical research in the National Health Service remains challenging. One barrier is accessing patients to discuss research participation. Two general approaches are used in the United Kingdom to facilitate this: an 'opt-in' approach (when clinicians communicate research opportunities to patients) and an 'opt-out' approach (all patients have the right to be informed of relevant research opportunities). No evidence-based data are available, however, to inform the decision about which approach is preferable. This study aimed to collect information from 'opt-in' and 'opt-out' Trusts and identify which of the two approaches is optimal for ensuring National Health Service patients are given opportunities to discuss research participation.

METHOD

This sequential mixed methods study comprised three phases: (1) an Appreciative Inquiry across UK Trusts, (2) online surveys and (3) focus groups with National Health Service staff and patients at a representative mental health Trust.

RESULTS

The study was conducted between June and October 2019. Out of seven National Health Service Mental Health Trusts contacted (three 'opt-out' and four 'opt-in'), only four took part in phase 1 of the study and three of them were 'opt-out' Trusts. Benefits of an 'opt-out' approach included greater inclusivity of patients and the removal of research gatekeepers, while the involvement of research-active clinicians and established patient-clinician relationships were cited as important to 'opt-in' success. Phases 2 and 3 were conducted at a different Trust (Oxford Health NHS Foundation Trust) which was using an 'opt-in' approach. Of 333 staff and member survey responders, 267 (80.2%) favoured moving to an 'opt-out' approach (phase 2). Nineteen staff and 16 patients and carers participated in focus groups (phase 3). Concern was raised by staff regarding the lack of time for clinical research, with clinical work taking precedence over research; patients were concerned about a lack of research activity; all considered research to be beneficial and were supportive of a move to 'opt-out'.

CONCLUSION

Findings suggest that 'opt-out' is more beneficial than 'opt-in', with the potential to vastly increase patient access to research opportunities and to enable greater equality of information provision for currently marginalised groups. This should ensure that healthcare research is more representative of the entire population, including those with a mental health diagnosis.

We have the program, what now? Development of an implementation plan to bridge the research-practice gap prevalent in exercise oncology

Background

Exercise has emerged as a promising therapy for people with cancer. Novel programs have been developed to translate research into practice; however, implementation barriers have limited their success in part because successful translation of exercise oncology research into practice requires context-specific implementation plans. The aim of this study was to employ the implementation mapping protocol to develop an implementation plan to support programming of a co-located exercise clinic and cancer treatment center.

Methods

The Implementation Mapping protocol, which consists of five specific iterative tasks, was used. A stakeholder advisory group advised throughout the process.

Results

A comprehensive needs assessment was used to identify the organization’s general manager as the program adopter; oncologists, center leaders, and various administrative staff as program implementers; and the operations manager as the program maintainer. Twenty performance objectives were identified. The theoretical domains framework was used to identify likely determinants of change, which informed the selection of eight individual implementation strategies across the individual and organizational levels. Finally, an evaluation plan was developed which will be used to measure the success of the implementation plan in the project’s next phase.

Conclusion

The Implementation Mapping protocol provided a roadmap to guide development of a comprehensive implementation plan that considered all ecological domains, was informed by theory, and demonstrated an extensive understanding of the implementation context. Strong research-practitioner partnerships and effective stakeholder engagement were critical to development of the plan.

Adaptive design: adaptation and adoption of patient safety practices in daily routines, a multi-site study

Background

Most interventions to improve patient safety (Patient Safety Practices (PSPs)), are introduced without engaging front-line professionals. Administrative staff, managers and sometimes a few professionals, representing only one or two disciplines, decide what to change and how. Consequently, PSPs are not fully adapted to the professionals’ needs or to the local context and as a result, adoption is low. To support adoption, two theoretical concepts, Participatory Design and Experiential Learning were combined in a new model: Adaptive Design. The aim was to explore whether Adaptive Design supports adaptation and adoption of PSPs by engaging all professionals and creating time to (re) design, reflect and learn as a team. The Time Out Procedure (TOP) and Debriefing (plus) for improving patient safety in the operating theatre (OT) was used as PSP.

Methods

Qualitative exploratory multi-site study using participatory action research as a research design. The implementation process consisted of four phases: 1) start-up: providing information by presentations and team meetings, 2) pilot: testing the prototype with 100 surgical procedures, 3) small scale implementation: with one or two surgical disciplines, 4) implementation hospital-wide: including all surgical disciplines. In iterations, teams (re) designed, tested, evaluated, and if necessary adapted TOPplus. Gradually all professionals were included. Adaptations in content, process and layout of TOPplus were measured following each iteration. Adoption was monitored until final implementation in every hospital’s OT.

Results

10 Dutch hospitals participated. Adaptations varied per hospital, but all hospitals adapted both procedures. Adaptations concerned the content, process and layout of TOPplus. Both procedures were adopted in all OTs, but user participation and time to include all users varied between hospitals. Ultimately all users were actively involved and TOPplus was implemented in all OTs.

Conclusions

Engaging all professionals in a structured bottom-up implementation approach with a focus on learning, improves adaptation and adoption of a PSP. As a result, all 10 participating hospitals implemented TOPplus with all surgical disciplines in all OTs. Adaptive Design gives professionals the opportunity to adapt the PSP to their own needs and their specific local context. All hospitals adapted TOPplus, but without compromising the essential features for its effectiveness.

Perception of health-related case studies in the context of introduction to clinical medicine course: students' and teachers' perspective

BACKGROUND

Integrating theoretical and practical knowledge and stimulating students' active learning is the most important task of modern and high-quality healthcare education. By analyzing clinical cases, undergraduate medical students are trained to make accurate diagnoses, to choose appropriate therapy based on laboratory results and on adequate diagnostic tests.

AIM

To examine the effect of clinical cases presentations on short-term memory as well as on the student's and teachers' evaluation of this method of teaching and learning in undergraduate medical studies.

METHODS

A total of 107 students in term 4 and term 5 enrolled in Trinity Medical Sciences University in St. Vincent and the Grenadines participated in this cross-sectional study. At the end of the semester, the students and the faculty were asked to complete a survey to assess their perception of case presentations (10 items, 4-point Likert-type scale, strongly agree to strongly disagree). The results of pre- and post-presentation quizzes were evaluated using the Wilcoxon signed rank test for paired samples.

RESULTS

Term 4 and term 5 students significantly improved their achievement after intervention (Wilcoxon test Z = - 11.282, p < 0.001, and Wilcoxon test Z = - 10.167, p < 0.001, respectively). The analysis of progress among low- and high-performance students in both terms showed a significant increase in performance. Overall, median students' and teachers' attitude scores were positive.

CONCLUSION

Clinical case presentation has a learning potential and facilitates positive interaction between instructors and students and supporting students to become reflective and competent physicians.

The changing landscape of professional practice in podiatry, lessons to be learned from other professions about the barriers to change - a narrative review

BACKGROUND

The delivery of healthcare is changing and aligned with this, the podiatry profession continues to change with evidence informed practice and extending roles. As change is now a constant, this gives clinicians the opportunity to take ownership to drive that change forward. In some cases, practitioners and their teams have done so, where others have been reluctant to embrace change. It is not clear to what extent good practice is being shared, whether interventions to bring about change have been successful, or what barriers exist that have prevented change from occurring. The aim of this article is to explore the barriers to changing professional practice and what lessons podiatry can learn from other health care professions.

MAIN BODY

A literature search was carried out which informed a narrative review of the findings. Eligible papers had to (1) examine the barriers to change strategies, (2) explore knowledge, attitudes and roles during change interventions, (3) explore how the patients/service users contribute to the change process (4) include studies from predominantly primary care in developed countries.Ninety-two papers were included in the final review. Four papers included change interventions involving podiatrists. The barriers influencing change were synthesised into three themes (1) the organisational context, (2) the awareness, knowledge and attitudes of the professional, (3) the patient as a service user and consumer.

CONCLUSIONS

Minimal evidence exists about the barriers to changing professional practice in podiatry. However, there is substantial literature on barriers and implementation strategies aimed at changing professional practices in other health professions. Change in practice is often resisted at an organisational, professional or service user level. The limited literature about change in podiatry, a rapidly changing healthcare workforce and the wide range of contexts that podiatrists work, highlights the need to improve the ways in which podiatrists can share successful attempts to change practice.

Breaking Bad News: Impact of a Continuing Medical Education Workshop

Objective

To evaluate the impact of an interactive continuing medical education workshop designed to help physicians in breaking bad news to their patients.

Methodology

Analysis of post-workshop questionnaires from 539 physicians assessing the retention of the key concepts and the perception of the potential impact of the workshop on their practice immediately after the workshop and six months later.

Results

The most significant concepts retained by the respondents are: the need to take into consideration the whole patient (42.7% post-workshop and 45.6% of follow-up responses), the need to be prepared for the consultation (11.6% and 15%), the importance of better guiding the interview (18.8% and 13.6%), and the value of taking more time during the consultation (5.8% and 8.3%). Analysis of paired responses on the post-workshop and the follow-up questionnaires shows that 35% of the concepts retained are identical.

Conclusion

The majority of physicians retained the key concepts, both immediately following the workshop and in the longer term.

Remediating doctors' performance to restore patient safety: a realist review protocol

INTRODUCTION

Underperformance by doctors poses a risk to patient safety. Remediation is an intervention designed to remedy underperformance and return a doctor to safe practice. Remediation is widely used across healthcare systems globally, and has clear implications for both patient safety and doctor retention. Yet, there is a poor evidence base to inform remediation programmes. In particular, there is a lack of understanding as to why and how a remedial intervention may work to change a doctor's practice. The aim of this research is to identify why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to support patient safety.

METHODS AND ANALYSIS

Realist review is an approach to evidence synthesis that seeks to develop programme theories about how an intervention works to produce its effects. The initial search strategy will involve: database and grey literature searching, citation searching and contacting authors. The evidence search will be extended as the review progresses and becomes more focused on the development of specific aspects of the programme theory. The development of the programme theory will involve input from a stakeholder group consisting of professional experts in the remediation process and patient representatives. Evidence synthesis will use a realist logic of analysis to interrogate data in order to develop and refine the initial programme theory into a more definitive realist programme theory of how remediation works. The study will follow and be reported according to Realist And Meta-narrative Evidence Syntheses-Evolving Standards (RAMESES).

ETHICS AND DISSEMINATION

Ethical approval is not required. Our dissemination strategy will include input from our stakeholder group. Customised outputs will be developed using the knowledge-to-action cycle framework, and will be targeted to: policy-makers; education providers and regulators, the National Health Service, doctors and academics.

PROSPERO REGISTRATION NUMBER

CRD42018088779.

Rethinking Remediation: A Model to Support the Detailed Diagnosis of Clinicians' Performance Problems and the Development of Effective Remediation Plans

The successful remediation of clinicians demonstrating poor performance in the workplace is essential to ensure the provision of safe patient care. Clinicians may develop performance problems for numerous reasons, including health, personal factors, the workplace environment, or outdated knowledge/skills. Performance problems are often complex involving multifactorial issues, encompassing knowledge, skills, and professional behaviors. It is important that (where possible and appropriate) clinicians are supported through effective remediation to return them to safe clinical practice. A review of the literature demonstrated that research into remediation is in its infancy, with little known about the effectiveness of remediation programs currently. Current strategies for the development of remediation programs are mostly "intuitive"; a few draw upon established theories to inform their approach. Similarly, although it has been established that identification of the nature/scope of performance problems through assessment is an essential first step within remediation, the need for a more widespread "diagnosis" of why the problems exist is emerging. These reasons for poor performance, particularly in the context of experienced practicing clinicians, are likely to have an impact on the potential success of remediation and should be considered within the "diagnosis." A new model for diagnosing the performance problems of the clinicians has been developed, using behavioral change theories to explore known barriers to successful remediation, such as insight, motivation, attitude, self-efficacy, and the working environment, in addition to addressing known deficits regarding knowledge and skills. This novel approach is described in this article. An initial feasibility study has demonstrated the acceptability and practical implementation of our model.

Physician Perceptions of Performance Feedback in a Quality Improvement Activity

Physician performance and peer comparison feedback can affect physician care quality and patient outcomes. This study aimed to understand family physician perspectives of the value of performance feedback in quality improvement (QI) activities. This study analyzed American Board of Family Medicine open-ended survey data collected between 2004 and 2014 from physicians who completed a QI module that provided pre- and post-QI project individual performance data and peer comparisons. Physicians made 3480 comments in response to a question about this performance feedback, which were generally positive in nature (86%). Main themes that emerged were importance of accurate feedback data, enhanced detail in the content of feedback, and ability to customize peer comparison groups to compare performance to peers with similar patient populations or practice characteristics. Meaningful and tailored performance feedback may be an important tool for physicians to improve their care quality and should be considered an integral part of QI project design.

Enhancing medical students' reflectivity in mentoring groups for professional development - a qualitative analysis

BACKGROUND

Professional competence is important in delivering high quality patient care, and it can be enhanced by reflection and reflective discourse e.g. in mentoring groups. However, students are often reluctant though to engage in this discourse. A group mentoring program involving all preclinical students as well as faculty members and co-mentoring clinical students was initiated at Witten-Herdecke University. This study explores both the attitudes of those students towards such a program and factors that might hinder or enhance how students engage in reflective discourse.

METHODS

A qualitative design was applied using semi-structured focus group interviews with preclinical students and semi-structured individual interviews with mentors and co-mentors. The interview data were analyzed using thematic content analysis.

RESULTS

Students' attitudes towards reflective discourse on professional challenges were diverse. Some students valued the new program and named positive outcomes regarding several features of professional development. Enriching experiences were described. Others expressed aversive attitudes. Three reasons for these were given: unclear goals and benefits, interpersonal problems within the groups hindering development and intrapersonal issues such as insecurity and traditional views of medical education. Participants mentioned several program setup factors that could enhance how students engage in such groups: explaining the program thoroughly, setting expectations and integrating the reflective discourse in a meaningful way into the curriculum, obliging participation without coercion, developing a sense of security, trust and interest in each other within the groups, randomizing group composition and facilitating group moderators as positive peer and faculty role models and as learning group members.

CONCLUSIONS

A well-designed and empathetic setup of group mentoring programs can help raise openness towards engaging in meaningful reflective discourse. Reflection on and communication of professional challenges can, in turn, improve professional development, which is essential for high quality patient care.

Interventions for the uptake of evidence‐based recommendations in acute stroke settings

This is a protocol for a Cochrane Review (Intervention). The objectives are as follows:

To assess the effects of implementation interventions for promoting the uptake of evidence‐based recommendations in acute stroke unit environments. Secondary objectives are to describe any factors that may modify the effect of implementation interventions; determine factors that may influence the uptake of recommendations in acute stroke units; and determine if single or multifaceted intervention strategies (two or more interventions) are more effective in improving uptake of evidence, patient outcomes, system outcomes or professionals' knowledge, attitudes or intentions in this setting.

Training interventions for improving telephone consultation skills in clinicians

BACKGROUND

Since 1879, the year of the first documented medical telephone consultation, the ability to consult by telephone has become an integral part of modern patient-centred healthcare systems. Nowadays, upwards of a quarter of all care consultations are conducted by telephone. Studies have quantified the impact of medical telephone consultation on clinicians' workload and detected the need for quality improvement. While doctors routinely receive training in communication and consultation skills, this does not necessarily include the specificities of telephone communication and consultation. Several studies assessed the short-term effect of interventions aimed at improving clinicians' telephone consultation skills, but there is no systematic review reporting patient-oriented outcomes or outcomes of interest to clinicians.

OBJECTIVES

To assess the effects of training interventions for clinicians' telephone consultation skills and patient outcomes.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, five other electronic databases and two trial registers up to 19 May 2016, and we handsearched references, checked citations and contacted study authors to identify additional studies and data.

SELECTION CRITERIA

We considered randomised controlled trials, non-randomised controlled trials, controlled before-after studies and interrupted time series studies evaluating training interventions compared with any control intervention, including no intervention, for improving clinicians' telephone consultation skills with patients and their impact on patient outcomes.

DATA COLLECTION AND ANALYSIS

Two review authors independently selected studies for inclusion, extracted data and assessed the risk of bias of eligible studies using standard Cochrane and EPOC guidance and the certainty of evidence using GRADE. We contacted study authors where additional information was needed. We used standard methodological procedures expected by Cochrane for data analysis.

MAIN RESULTS

We identified one very small controlled before-after study performed in 1989: this study used a validated tool to assess the effects of a training intervention on paediatric residents' history-taking and case management skills. It reported no difference compared to no intervention, but authors did not report any quantitative analyses and could not supply additional data. We rated this study as being at high risk of bias. Based on GRADE, we assessed the certainty of the evidence as very low, and consequently it is uncertain whether this intervention improves clinicians' telephone skills.We did not find any study assessing the effect of training interventions for improving clinicians' telephone communication skills on patient primary outcomes (health outcomes measured by validated tools or biomedical markers or patient behaviours, patient morbidity or mortality, patient satisfaction, urgency assessment accuracy or adverse events).

AUTHORS' CONCLUSIONS

Telephone consultation skills are part of a wider set of remote consulting skills whose importance is growing as more and more medical care is delivered from a distance with the support of information technology. Nevertheless, no evidence specifically coming from telephone consultation studies is available, and the training of clinicians at the moment has to be guided by studies and models based on face-to-face communication, which do not consider the differences between these two communicative dimensions. There is an urgent need for more research assessing the effect of different training interventions on clinicians' telephone consultation skills and their effect on patient outcomes.

UK Policy on Doctor Remediation: Trajectories and Challenges

Around the world, policy-makers, academics, and health service professionals have become increasingly aware of the importance of remediation, the process by which poor performance is "remedied," as part of the changing landscape of medical regulation. It is, therefore, an opportune time to critique the UK experience with remediation policy. This article frames, for the first time, the UK remediation policy as developing from a central policy aim that was articulated in the 1990s: to accelerate the identification of underperformance and, subsequently, remedy any problems identified as soon as possible. In pursuit of this aim, three policy trajectories have emerged: professionalizing and standardizing remediation provision; linking remediation with other forms of regulation, namely relicensure (known in the UK as medical revalidation); and fostering obligations for doctors to report themselves and others for remediation needs. The operationalization of policy along these trajectories, and the challenges that have arisen, has relevance for anyone seeking to understand or indeed improve remediation practices within any health care system. It is argued here that the UK serves as an example of the more general challenges posed by seeking to integrate remediation policy within broader frameworks of medical governance, in particular systems of relicensure, and the need to develop a solid evidence base for remediation practices.

Balancing student/trainee learning with the delivery of patient care in the healthcare workplace: a protocol for realist synthesis

INTRODUCTION

A national survey was recently conducted to explore medical education research priorities in Scotland. The identified themes and underlying priority areas can be linked to current medical education drivers in the UK. The top priority area rated by stakeholders was: 'Understanding how to balance service and training conflicts'. Despite its perceived importance, a preliminary scoping exercise revealed the least activity with respect to published literature reviews. This protocol has therefore been developed so as to understand how patient care, other service demands and student/trainee learning can be simultaneously facilitated within the healthcare workplace. The review will identify key interventions designed to balance patient care and student/trainee learning, to understand how and why such interventions produce their effects. Our research questions seek to address how identified interventions enable balanced patient care-trainee learning within the healthcare workplace, for whom, why and under what circumstances.

METHODS AND ANALYSIS

Pawson's five stages for undertaking a realist review underpin this protocol. These stages may progress in a non-linear fashion due to the iterative nature of the review process. We will: (1) clarify the scope of the review, identifying relevant interventions and existing programme theories, understanding how interventions act to produce their intended outcomes; (2) search journal articles and grey literature for empirical evidence from 1998 (introduction of the European Working Time Directive) on the UK multidisciplinary team working concerning these interventions, theories and outcomes, using databases such as ERIC, Scopus and CINAHL; (3) assess study quality; (4) extract data; and (5) synthesise data, drawing conclusions.

ETHICS AND DISSEMINATION

A formal ethical review is not required. These findings should provide an important understanding of how workplace-based interventions influence the balance of trainee learning and service provision. They should benefit various stakeholders involved in workplace-based learning interventions, and inform the medical education research agenda in the UK.

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service

BACKGROUND

Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education.

METHODS/DESIGN

The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up.

DISCUSSION

It is anticipated that this clinical research engagement and leadership capacity building program will enable and enhance clinically relevant research to be led and conducted by health professionals in the health setting. This approach will also encourage identification of areas of clinical uncertainty and need that can be addressed through clinical research within the health setting.

Identifying the competencies of doctors in China

BACKGROUND

China adopted a Flexnerian model as its medical institutions developed over the recent past but the political, social, and economic environment has changed significantly since then. This has generated the need for educational reform, which in other countries, has largely been driven by competencies-oriented models such as those developed in Canada, and the United States. Our study sought to establish the competencies model, relevant to China, which will support educational reform efforts.

METHODS

Data was collected using a cross-sectional survey of 1776 doctors from seven provinces in China. The surveys were translated and adapted from the Occupational Information Network General Work Activity questionnaire (O*NET-GWA) and Work Style questionnaire (O*NET-WS) developed under the auspices of the US Department of Labor. Exploratory factor analysis and confirmatory factor analysis ascertained the latent dimensions of the questionnaires, as well as the factor structures of the competencies model for the Chinese doctors.

RESULTS

In exploratory factor analysis, the questionnaires were able to account for 64.25 % of total variance. All responses had high internal consistency and reliability. In confirmatory factor analysis, the loadings of six constructs were between 0.53 ~ 0.89 and were significant, Construct reliability (CR) were between 0.79 ~ 0.93 respectively. The results showed good convergent validity. The resultant models fit the data well (GFI was 0.92, RMSEA was 0.07) and the six-factor competencies framework for Chinese doctors emerged.

CONCLUSIONS

The Chinese doctors' competencies framework includes six elements: (a) technical procedural skills; (b) diagnosis and management; (c) teamwork and administration; (d) communication; (e) professional behavior; and (f) professional values. These findings are relevant to China, consistent with its current situation, and similar to those developed in other countries.

The effect of continuing professional development on public complaints: a case-control study

OBJECTIVES

This study aimed to investigate the relationship between participation in different types of continuing professional development (CPD), and incidences and types of public complaint against physicians.

METHODS

Cases included physicians against whom complaints were made by members of the public to the medical regulatory body in Ontario, Canada, the College of Physicians and Surgeons of Ontario (CPSO), during 2008 and 2009. The control cohort included physicians against whom no complaints were documented during the same period. We focused on complaints related to physician communication, quality of care and professionalism. The CPD data included all Royal College of Physicians and Surgeons of Canada (RCPSC) and College of Family Physicians of Canada (CFPC) CPD programme activities reported by the case and control physicians. Multivariate logistic regression models were used to determine if the independent variable, reported participation in CPD, was associated with the dependent variable, the complaints-related status of the physician in the year following reported CPD activities.

RESULTS

A total of 2792 physicians were included in the study. There was a significant relationship between participation in CPD, type of CPD and type of complaint received. Analysis indicated that physicians who reported overall participation in CPD activities were significantly less likely (odds ratio 0.604; p = 0.028) to receive quality of care-related complaints than those who did not report participating in CPD. Additionally, participation in group-based CPD was less likely (OR 0.681; p = 0.041) to result in quality of care-related complaints.

CONCLUSIONS

The findings demonstrate a positive relationship between participation in the national CPD programmes of the CFPC and RCPSC, and lower numbers of public complaints received by the CPSO. As certification bodies and regulators alike are increasingly mandating CPD, they are encouraged to continually evaluate the effectiveness of their programmes to maximise programme impact on physician performance at the population level.

How do physicians and trainers experience outcome-based education in "Rational prescribing"?

Background

Continuing medical education (CME) is compulsory in Iran, but has shown limitations in terms of educational style and format. Outcome-based education (OBE) has been proposed internationally to create links to physicians’ actual practices. We designed an outcome-based educational intervention for general physicians in primary care (GPs). Positive outcomes on GPs’ knowledge, skills and performance in the field of rational prescribing were found and have been reported.

The specific purpose of this study was to explore the perceptions of the GPs and trainers, who participated in the outcome-based education on rational prescribing.

Methods

All nine trainers in the educational programme and 12 general physicians (out of 58) were invited to individual interviews four months after participation in the CME program. Semi-structured open-ended interviews were carried out. Qualitative content analysis was used to explore the text and to interpret meaning and intention.

Results

There was a widespread agreement that the programme improved the participants’ knowledge and skills to a higher extent than previously attended programmes. Trainers emphasized the effect of outcome-based education on their educational planning, teaching and assessment methods, while the general physicians’ challenges were how to adapt their learning in the real work environment considering social and economical barriers. Self-described attitudes and reported practice changed towards more rational prescribing.

Conclusions

Outcome-based CME seems attractive and additionally useful for general physicians in Iran and could be an effective approach when creating CME programmes to improve general physicians’ performance. Similar approaches could be considered in other contexts both regionally and globally.

Predictors of physician performance on competence assessment: Findings from CPEP, the Center for Personalized Education for Physicians

PURPOSE

To identify factors associated with physician performance in a comprehensive competence assessment.

METHOD

The authors conducted a retrospective analysis of 683 physicians referred for assessment at the Center for Personalized Education for Physicians from 2000 to 2010, who were evaluated as either safe or unsafe to return to practice. Multivariate logistic regression was used to determine factors predictive of unsafe assessment outcome. Covariates included personal characteristics (e.g., age), practice context (e.g., solo practice), and referral information (e.g., previous board license action).

RESULTS

Older physicians were more likely to have unsafe assessment outcomes (odds ratio [OR] = 1.07; P < .001). Board-certified individuals were less likely to have poor assessment outcomes (OR = 0.40; P = .003) than uncertified individuals. Physicians in solo practice were more likely (OR = 2.15; P = .037) to be deemed unsafe than physicians in other settings. Physicians with a practice scope that matched their training were less likely (OR = 0.29; P = .023) to have unsafe assessment outcomes than those whose did not. Physicians with current or previous board action (suspension, revocation, limitation, or stipulation) were more likely to be deemed unsafe (OR = 2.47; P = .003) than those without.

CONCLUSIONS

Findings suggest that important predictors of physician performance on competence assessment include personal characteristics, practice context, and reasons for assessment referral. These findings have implications for development of policies and programs designed to assess risk of poor physician performance and quality of care improvement efforts through organizational/practice design or remedial education.

The effect of an active implementation of a disease management programme for chronic obstructive pulmonary disease on healthcare utilization--a cluster-randomised controlled trial

BACKGROUND

The growing population living with chronic conditions calls for efficient healthcare-planning and effective care. Implementing disease-management-programmes is one option for responding to this demand. Knowledge is scarce about the effect of implementation processes and their effect on patients; only few studies have reported the effectiveness of disease-management-programmes targeting patients with chronic obstructive pulmonary disease (COPD). The objective of this paper was to determine the effect on healthcare-utilization of an active implementation model for a disease-management-programme for patients with one of the major multimorbidity diseases, COPD.

METHODS

The standard implementation of a new disease-management-programme for COPD was ongoing during the study-period from November 2008 to November 2010 in the Central Denmark Region. We wanted to test a strategy using Breakthrough Series, academic detailing and lists of patients with COPD. It targeted GPs and three hospitals serving approx. 60,000 inhabitants aged 35 or older and included interventions directed at professionals, organisations and patients. The study was a non-blinded block- and cluster-randomised controlled trial with GP-practices as the unit of randomisation. In Ringkoebing-Skjern Municipality, Denmark, 16 GP-practices involving 38 GPs were randomised to either the intervention-group or the control-group. A comparable neighbouring municipality acted as an external-control-group which included nine GP-practices with 25 GPs. An algorithm based on health-registry-data on lung-related contacts to the healthcare-system identified 2,736 patients who were alive at the end of the study-period. The population included in this study counted 1,372 (69.2%) patients who responded to the baseline questionnaire and confirmed their COPD diagnosis; 458 (33.4%) patients were from the intervention-group, 376 (27.4%) from the control-group and 538(39.2%) from the external-control-group. The primary outcome was adherence to the disease-management-programme measured at patient-level by use of specific services from general practice. Secondary outcomes were use of out-of-hours-services, outpatient-clinic, and emergency-department and hospital-admissions.

RESULTS

The intervention practices provided more planned preventive consultations, additional preventive consultations and spirometries than non-intervention practices. A comparison of the development in the intervention practices with the development in the control-practices showed that the intervention resulted in more planned preventive-consultations, fewer conventional consultations and fewer patients admitted without a lung-related-diagnosis.

CONCLUSIONS

Use of the active implementation model for the disease-management-programme for COPD changed the healthcare utilization in accordance with the programme.

TRIAL REGISTRATION

Clinicaltrials.gov identifier: NCT01228708.

Evaluating an implementation strategy in cardiovascular prevention to improve prescribing of statins in Germany: an intention to treat analysis

BACKGROUND

The prescription of statins is an evidence-based treatment to reduce the risk of cardiovascular events in patients with elevated cardiovascular risk or with a cardiovascular disorder (CVD). In spite of this, many of these patients do not receive statins.

METHODS

We evaluated the impact of a brief educational intervention in cardiovascular prevention in primary care physicians' prescribing behaviour regarding statins beyond their participation in a randomised controlled trial (RCT). For this, prescribing data of all patients > 35 years who were counselled before and after the study period were analysed (each n > 75,000). Outcome measure was prescription of Hydroxymethylglutaryl-CoA Reductase Inhibitors (statins) corresponding to patients' overall risk for CVD. Appropriateness of prescribing was examined according to different risk groups based on the Anatomical Therapeutic Chemical Classification System (ATC codes).

RESULTS

There was no consistent association between group allocation and statin prescription controlling for risk status in each risk group before and after study participation. However, we found a change to more significant drug configurations predicting the prescription of statins in the intervention group, which can be regarded as a small intervention effect.

CONCLUSION

Our results suggest that an active implementation of a brief evidence-based educational intervention does not lead to prescription modifications in everyday practice. Physician's prescribing behaviour is affected by an established health care system, which is not easy to change.

TRIAL REGISTRATION

ISRCTN71348772.

Qualitative evaluation of a local coronary heart disease treatment pathway: practical implications and theoretical framework

Background

Coronary heart disease (CHD) is a common medical problem in general practice. Due to its chronic character, shared care of the patient between general practitioner (GP) and cardiologist (C) is required. In order to improve the cooperation between both medical specialists for patients with CHD, a local treatment pathway was developed. The objective of this study was first to evaluate GPs’ opinions regarding the pathway and its practical implications, and secondly to suggest a theoretical framework of the findings by feeding the identified key factors influencing the pathway implementation into a multi-dimensional model.

Methods

The evaluation of the pathway was conducted in a qualitative design on a sample of 12 pathway developers (8 GPs and 4 cardiologists) and 4 pathway users (GPs). Face-to face interviews, which were aligned with previously conducted studies of the department and assumptions of the theory of planned behaviour (TPB), were performed following a semi-structured interview guideline. These were audio-taped, transcribed verbatim, coded, and analyzed according to the standards of qualitative content analysis.

Results

We identified 10 frequently mentioned key factors having an impact on the implementation success of the CHD treatment pathway. We thereby differentiated between pathway related (pathway content, effort, individual flexibility, ownership), behaviour related (previous behaviour, support), interaction related (patient, shared care/colleagues), and system related factors (context, health care system). The overall evaluation of the CHD pathway was positive, but did not automatically lead to a change of clinical behaviour as some GPs felt to have already acted as the pathway recommends.

Conclusions

By providing an account of our experience creating and implementing an intersectoral care pathway for CHD, this study contributes to our knowledge of factors that may influence physicians’ decisions regarding the use of a local treatment pathway. An improved adaptation of the pathway in daily practice might be best achieved by a combined implementation strategy addressing internal and external factors. A simple, direct adaptation regards the design of the pathway material (e.g. layout, PC version), or the embedding of the pathway in another programme, like a Disease Management Programme (DMP). In addition to these practical implications, we propose a theoretical framework to understand the key factors’ influence on the pathway implementation, with the identified factors along the microlevel (pathway related factors), the mesolevel (interaction related factors), and system- related factors along the macrolevel.

Perceptions of changes in practice following peer review in the National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project

PURPOSE

The purpose of this paper is to examine perceptions of local service change and concepts of change amongst participants in a UK nationwide randomised controlled trial of informal, structured, reciprocated, multidisciplinary peer review with feedback to promote quality improvement: the National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project (NCROP).

DESIGN/METHODOLOGY/APPROACH

The paper takes the form of a qualitative study, involving semi-structured interviews with 43 hospital respiratory consultants, nurses and general managers at 24 intervention and 11 control NCROP sites. Thematic analysis resulted in adoption of Joss and Kogan's quality indicators as an analytic framework.

FINDINGS

The paper finds that peer review was associated with positive changes, which may lead to sustained service improvement. Differences existed in perceptions of change among clinicians and between clinicians and managers. "Generic changes" (e.g. changes in interpersonal relations or cultural changes), were often not perceived as change.

RESEARCH LIMITATIONS/IMPLICATIONS

The study highlights the significance of generic change in evaluations of change processes. Most participants were clinicians limiting inter-professional comparisons. Some clinical staff failed to recognise changes they accomplished or their significance, perceiving change differently to others within their professional group. These findings have implications for policy and research. They should be considered when developing frameworks for assessing quality improvements and staff engagement with change.

ORIGINALITY/VALUE

This is the first qualitative study exploring participants' experience of peer review for quality improvement in healthcare. The study adds to previous research into UK health service improvement, which has had a more restricted focus on inter-professional differences.

A cross-sectional study to identify organisational processes associated with nurse-reported quality and patient safety

OBJECTIVES

The purpose of this study was to identify organisational processes and structures that are associated with nurse-reported patient safety and quality of nursing.

DESIGN

This is an observational cross-sectional study using survey methods.

SETTING

Respondents from 31 Norwegian hospitals with more than 85 beds were included in the survey.

PARTICIPANTS

All registered nurses working in direct patient care in a position of 20% or more were invited to answer the survey. In this study, 3618 nurses from surgical and medical wards responded (response rate 58.9). Nurses' practice environment was defined as organisational processes and measured by the Nursing Work Index Revised and items from Hospital Survey on Patient Safety Culture.

OUTCOME MEASURES

Nurses' assessments of patient safety, quality of nursing, confidence in how their patients manage after discharge and frequency of adverse events were used as outcome measures.

RESULTS

Quality system, nurse-physician relation, patient safety management and staff adequacy were process measures associated with nurse-reported work-related and patient-related outcomes, but we found no associations with nurse participation, education and career and ward leadership. Most organisational structures were non-significant in the multilevel model except for nurses' affiliations to medical department and hospital type.

CONCLUSIONS

Organisational structures may have minor impact on how nurses perceive work-related and patient-related outcomes, but the findings in this study indicate that there is a considerable potential to address organisational design in improvement of patient safety and quality of care.

Patient or treatment centre? Where are efforts invested to improve cancer patients' psychosocial outcomes?

The psychosocial outcomes of cancer patients may be influenced by individual-level, social and treatment centre predictors. This paper aimed to examine the extent to which individual, social and treatment centre variables have been examined as predictors or targets of intervention for psychosocial outcomes of cancer patients. Medline was searched to find studies in which the psychological outcomes of cancer patient were primary variables. Papers published in English between 1999 and 2009 that reported primary data relevant to psychosocial outcomes for cancer patients were included, with 20% randomly selected for further coding. Descriptive studies were coded for inclusion of individual, social or treatment centre variables. Intervention studies were coded to determine if the unit of intervention was the individual patient, social unit or treatment centre. After random sampling, 412 publications meeting the inclusion criteria were identified, 169 were descriptive and 243 interventions. Of the descriptive papers 95.0% included individual predictors, and 5.0% social predictors. None of the descriptive papers examined treatment centre variables as predictors of psychosocial outcomes. Similarly, none of the interventions evaluated the effectiveness of treatment centre interventions for improving psychosocial outcomes. Potential reasons for the overwhelming dominance of individual predictors and individual-focused interventions in psychosocial literature are discussed.

Appreciative Inquiry for quality improvement in primary care practices

PURPOSE

To test the effect of an Appreciative Inquiry (AI) quality improvement strategy on clinical quality management and practice development outcomes. Appreciative inquiry enables the discovery of shared motivations, envisioning a transformed future, and learning around the implementation of a change process.

METHODS

Thirty diverse primary care practices were randomly assigned to receive an AI-based intervention focused on a practice-chosen topic and on improving preventive service delivery (PSD) rates. Medical-record review assessed change in PSD rates. Ethnographic field notes and observational checklist analysis used editing and immersion/crystallization methods to identify factors affecting intervention implementation and practice development outcomes.

RESULTS

The PSD rates did not change. Field note analysis suggested that the intervention elicited core motivations, facilitated development of a shared vision, defined change objectives, and fostered respectful interactions. Practices most likely to implement the intervention or develop new practice capacities exhibited 1 or more of the following: support from key leader(s), a sense of urgency for change, a mission focused on serving patients, health care system and practice flexibility, and a history of constructive practice change.

CONCLUSIONS

An AI approach and enabling practice conditions can lead to intervention implementation and practice development by connecting individual and practice strengths and motivations to the change objective.

Performance feedback: an exploratory study to examine the acceptability and impact for interdisciplinary primary care teams

Background

This mixed methods study was designed to explore the acceptability and impact of feedback of team performance data to primary care interdisciplinary teams.

Methods

Seven interdisciplinary teams were offered a one-hour, facilitated performance feedback session presenting data from a comprehensive, previously-conducted evaluation, selecting highlights such as performance on chronic disease management, access, patient satisfaction and team function.

Results

Several recurrent themes emerged from participants' surveys and two rounds of interviews within three months of the feedback session. Team performance measurement and feedback was welcomed across teams and disciplines. This feedback could build the team, the culture, and the capacity for quality improvement. However, existing performance indicators do not equally reflect the role of different disciplines within an interdisciplinary team. Finally, the effect of team performance feedback on intentions to improve performance was hindered by a poor understanding of how the team could use the data.

Conclusions

The findings further our understanding of how performance feedback may engage interdisciplinary team members in improving the quality of primary care and the unique challenges specific to these settings. There is a need to develop a shared sense of responsibility and agenda for quality improvement. Therefore, more efforts to develop flexible and interactive performance-reporting structures (that better reflect contributions from all team members) in which teams could specify the information and audience may assist in promoting quality improvement.

Barriers and enablers in the implementation of a provider-based intervention to stimulate culturally appropriate hypertension education

OBJECTIVE

to identify barriers and enablers influencing the implementation of an intervention to stimulate culturally appropriate hypertension education (CAHE) among health care providers in primary care.

METHODS

the intervention was piloted in three Dutch health centers. It consists of a toolkit for CAHE, training, and feedback meetings for hypertension educators. Data were collected from 16 hypertension educators (nurse practitioners and general practice assistants) during feedback meetings and analyzed using qualitative content analysis.

RESULTS

perceived barriers to the implementation of the intervention fell into three main categories: political context (health care system financing); organizational factors (ongoing organizational changes, work environment, time constraints and staffing) and care provider-related factors (routines, attitudes, computer and educational skills, and cultural background). Few barriers were specifically related to the delivery of CAHE (e.g. resistance to registering ethnicity). Enabling strategies addressing these barriers consisted of reorganizing practice procedures, team coordination, and providing reminders and additional instructions to hypertension educators.

CONCLUSION AND PRACTICE IMPLICATIONS

the adoption of a tool for CAHE by care providers can be accomplished if barriers are identified and addressed. The majority of these barriers are commonly associated with the implementation of health care innovations in general and do not indicate resistance to providing culturally appropriate care.

Incentive payments to general practitioners aimed at increasing opportunistic testing of young women for chlamydia: a pilot cluster randomised controlled trial

BACKGROUND

Financial incentives have been used for many years internationally to improve quality of care in general practice. The aim of this pilot study was to determine if offering general practitioners (GP) a small incentive payment per test would increase chlamydia testing in women aged 16 to 24 years, attending general practice.

METHODS

General practice clinics (n = 12) across Victoria, Australia, were cluster randomized to receive either a $AUD5 payment per chlamydia test or no payment for testing 16 to 24 year old women for chlamydia. Data were collected on the number of chlamydia tests and patient consultations undertaken by each GP over two time periods: 12 month pre-trial and 6 month trial period. The impact of the intervention was assessed using a mixed effects logistic regression model, accommodating for clustering at GP level.

RESULTS

Testing increased from 6.2% (95% CI: 4.2, 8.4) to 8.8% (95% CI: 4.8, 13.0) (p = 0.1) in the control group and from 11.5% (95% CI: 4.6, 18.5) to 13.4% (95% CI: 9.5, 17.5) (p = 0.4) in the intervention group. Overall, the intervention did not result in a significant increase in chlamydia testing in general practice. The odds ratio for an increase in testing in the intervention group compared to the control group was 0.9 (95% CI: 0.6, 1.2). Major barriers to increased chlamydia testing reported by GPs included a lack of time, difficulty in remembering to offer testing and a lack of patient awareness around testing.

CONCLUSIONS

A small financial incentive alone did not increase chlamydia testing among young women attending general practice. It is possible small incentive payments in conjunction with reminder and feedback systems may be effective, as may higher financial incentive payments. Further research is required to determine if financial incentives can increase testing in Australian general practice, the type and level of financial scheme required and whether incentives needs to be part of a multi-faceted package.

TRIAL REGISTRATION

Australian New Zealand Clinical Trial Registry ACTRN12608000499381.

Can rational prescribing be improved by an outcome-based educational approach? A randomized trial completed in Iran

INTRODUCTION

An outcome-based education approach has been proposed to develop more effective continuing medical education (CME) programs. We have used this approach in developing an outcome-based educational intervention for general physicians working in primary care (GPs) and evaluated its effectiveness compared with a concurrent CME program in the field of rational prescribing.

METHODS

A cluster randomized controlled design was used. All 159 GPs working in 6 cities, in 2 regions in East Azerbaijan province in Iran, were invited to participate. The cities were matched and randomly divided into an intervention arm, for an outcome-based education on rational prescribing, and a control arm for a traditional CME program on the same topic. GPs' prescribing behavior was assessed 9 months before, and 3 months after the CME programs.

RESULTS

In total, 112 GPs participated. The GPs in the intervention arm significantly reduced the total number of prescribed drugs and the number of injections per prescription. The GPs in the intervention arm also increased their compliance with specific requirements for a correct prescription, such as explanation of specific time and manner of intake and precautions necessary when using drugs, with significant intervention effects of 13, 36, and 42 percentage units, respectively. Compared with the control arm, there was no significant improvement when prescribing antibiotics and anti-inflammatory agents.

DISCUSSION

Rational prescribing improved in some of the important outcome-based indicators, but several indicators were still suboptimal. The introduction of an outcome-based approach in CME seems promising when creating programs to improve GPs' prescribing behavior.

A cluster-randomized controlled trial evaluating the effect of culturally-appropriate hypertension education among Afro-Surinamese and Ghanaian patients in Dutch general practice: study protocol

Background

Individuals of African descent living in western countries have increased rates of hypertension and hypertension-related complications. Poor adherence to hypertension treatment (medication and lifestyle changes) has been identified as one of the most important modifiable causes for the observed disparities in hypertension related complications, with patient education being recommended to improve adherence. Despite evidence that culturally-appropriate patient education may improve the overall quality of care for ethnic minority patients, few studies have focused on how hypertensive individuals of African descent respond to this approach. This paper describes the design of a study that compares the effectiveness of culturally-appropriate hypertension education with that of the standard approach among Surinamese and Ghanaian hypertensive patients with an elevated blood pressure in Dutch primary care practices.

Methods/Design

A cluster-randomized controlled trial will be conducted in four primary care practices in Amsterdam, all offering hypertension care according to Dutch clinical guidelines. After randomization, patients in the usual care sites (n = 2) will receive standard hypertension education. Patients in the intervention sites (n = 2) will receive three culturally-appropriate hypertension education sessions, culturally-specific educational materials and targeted lifestyle support. The primary outcome will be the proportion of patients with a reduction in systolic blood pressure ≥ 10 mmHg at eight months after the start of the trial. The secondary outcomes will be the proportion of patients with self-reported adherence to (i) medication and (ii) lifestyle recommendations at eight months after the start of the trial. The study will enrol 148 patients (74 per condition, 37 per site). Eligibility criteria for patients of either sex will be: current diagnosis of hypertension, self-identified Afro-Surinamese or Ghanaian, ≥ 20 years, and baseline blood pressure ≥ 140/90 mmHg. Primary and secondary outcomes will be measured at baseline and at 3 1/2, 6 1/2, and eight months. Other measurements will be performed at baseline and eight months.

Discussion

The findings will provide new knowledge on how to improve blood pressure control and patient adherence in ethnic minority persons with a high risk of negative hypertension-related health outcomes.

Trial registration

ISRCTN35675524

Beyond the evidence-based practice paradigm to achieve best practice in rehabilitation medicine: a clinical review

OBJECTIVE

Best practice is a practice that, on rigorous evaluation, demonstrates success, has had an impact, and can be replicated. It is differentiated from its constituent parts, evidence-based practice and knowledge translation, by its general meaning and global purview. The purpose of this clinical review is to provide transparency to the concept and achievement of best practice in the context of rehabilitation medicine. The authors will review and analyze the roles of evidence-based practice and knowledge translation in rehabilitation medicine as they work to support best practice. Challenge areas will be discussed, including an evidential hierarchy in need of update, a lack of "high-level" research evidence, and delays in translating evidence to practice. Last, the authors will argue that rehabilitation medicine is well-positioned to effect change by promoting inclusion of emerging research methodologies and analytic techniques that better capture context-specific rehabilitation evidence, into the evidential hierarchy. Achieving best practice is dependent on this, as well as alignment of all key stakeholders, ranging from the patient, researchers and clinicians, to policymakers, payers, and others.

Planning New Pharmacist Services that Last: The Prescription Shop's Travel Medicine Clinic

Community pharmacists across Canada are encountering opportunities to implement innovative patient care services. The provision of these services on a sustainable basis, however, is challenging and pharmacists face a number of barriers. Analysis of the planning process followed during development of the financially viable Prescription Shop travel medicine clinic was undertaken to offer guidance to pharmacists. The analysis was organized according to a traditional business model describing 3 phases of product development. A theoretical pharmacy practice change framework was adapted via insights gained from the implementation and day-today operation of the clinic. Results identified questions that are critical to address during each phase to ensure the selection, design and sustainable implementation of pharmacists' patient care services.

Learning based on patient case reviews: an interview study

BACKGROUND

Recent theories on adult learning recommend that learning is situated in real-life contexts. Learning is considered a continuous process in which every new experience builds on, and integrates with, previously accumulated experiences. Reviewing and reflecting on patient cases is in line with this learning approach. There has, however, been remarkably little research into how patient cases might be applied in professional education. The purpose of this article is to present family physicians' perceptions of the learning process initiated by reviewing patient cases.

METHODS

Thirteen family physicians, who had all participated in a large project on cancer diagnosis in family practice (the CAP-project), currently carried out at the Research Unit for General Practice, University of Aarhus were interviewed on their experiences of reviewing patient cases. In the CAP-project family physicians (n = 467, 81%) in the County of Aarhus (640 000 inhabitants) completed 2,212 (83%) detailed questionnaires on all newly diagnosed patients with cancer encountered in their practices during a one year period (2004-2005). In order to complete the questionnaire the family physicians were required to perform a systematic case review of each patient: they had to consult their records to provide dates of symptom-presentation, investigations and treatments initiated, and reflect on previous encounters with the patients to give detailed information on his/hers knowledge of the patients' care seeking behaviour, mental health and risk factors.The purpose of this article is to present indebt interview-data on family physicians' perceptions of the learning process initiated by reviewing patient cases, and their evaluations of using patient case reviews as a learning method in family practice.

RESULTS

The process of reflection initiated by reviewing patient cases enabled family physicians to reconsider their clinical work procedures which potentially supported the transition from individual competence to personal capability. According to the physicians, they were not only able to identify needed changes, some reported that they were able to transform these ideas into action and do things more effectively. According to our data this transition takes place, because the learning processes initiated were based on real life experiences which equally initiated reflections on what to improve, as well as how to improve their work.

CONCLUSION

Patient case reviews initiate reflective processes providing feedback about performance in real life situations. Family physicians are in favour of patient case reviews as a learning method, because it embraces the complexities they encounter in their daily practice and is based on personal experiences.

A qualitative study of the relationship between clinician attributes, organization, and patient characteristics on implementation of a disease management program

The purpose of this study was to examine the challenges of integrating an asthma disease management (DM) program into a primary care setting from the perspective of primary care practitioners. A second goal was to examine whether barriers differed between urban-based and nonurban-based practices. Using a qualitative design, data were gathered using focus groups in primary care pediatric practices. A purposeful sample included an equal number of urban and nonurban practices. Participants represented all levels in the practice setting. Important themes that emerged from the data were coded and categorized. A total of 151 individuals, including physicians, advanced practice clinicians, registered nurses, other medical staff, and nonmedical staff participated in 16 focus groups that included 8 urban and 8 nonurban practices. Content analyses identified 4 primary factors influencing the implementation of a DM program in a primary care setting. They were related to providers, the organization, patients, and characteristics of the DM program. This study illustrates the complexity of the primary care environment and the challenge of changing practice in these settings. The results of this study identified areas in a primary care setting that influence the adoption of a DM program. These findings can assist in identifying effective strategies to change clinical behavior in primary care practices.