Facilitators and barriers to a nationwide implementation of competency-based postgraduate medical curricula: a qualitative study

Laying train tracks en route: How institutional education leaders navigate complexity during mandated curriculum change

INTRODUCTION

Institutional education leaders serve key roles in leading major curricular change within residency education, yet little is known about how they accomplish these goals on the ground. Change management principles have predominantly been developed and described in the hierarchical context of management science and corporate settings. However, the non-hierarchical, complex and adaptive features of health professions education may render these traditional change management models inadequate. We explored how institutional educational leaders navigate the complex residency education system in implementing a major curricular change.

METHODS

Using constructivist grounded theory, we conducted and iteratively analysed semi-structured interviews with 11 institutional education leaders from across Canada who were responsible for leading the nationally mandated curricular change to competency-based residency education. Thematic analysis was performed iteratively using constant comparison.

RESULTS

Leaders managing the change process focused on two priorities: steering the direction of the change process as it evolved and maintaining the momentum amongst stakeholders to move forward steadily. Four common threats and opportunities impacted the focus on direction and momentum: multiplicity of contexts, innovation, resistance and distractions. In response, leaders utilised various tactics and harnessed diverse leadership styles to manage these challenges accordingly.

CONCLUSIONS

We identified a change framework that offers a more contextually nuanced understanding of curricular change in residency education that has not been described in the change management literature generated by the management sector. Institutional education leaders focused on maintaining the direction and momentum, while constantly assessing and adapting to evolving, uncertain and complex conditions. Our findings provide a simple and practical foundation to support leadership education in curricular change as well as researchers in developing further change theories in complex adaptive health professions education systems.

The CanMEDS Competency Framework in laboratory medicine: a phenomenographic study exploring how professional roles are applied outside the clinical environment

Background

The CanMEDS Competency Framework is an internationally recognized model used to outline the proficiencies of a physician. It has predominantly been studied in clinical environments but not all medical specialties take part in direct patient contact. In laboratory medicine, the role of the physician is to promote and enhance patient diagnostics by managing and overseeing the functions of a diagnostic laboratory.

Methods

This phenomenographic study explores the lived experiences of biochemistry, microbiology, and pathology residency program directors to better understand how they utilize the CanMEDS competencies. Eight laboratory medicine program directors from across Canada were individually interviewed using a semi-structured interview, and the data was analysed using inductive thematic analysis.

Results

The findings show that the current framework is disconnected from the unique context of laboratory medicine with some competencies appearing unrelatable using the current standardized definitions and expectations. Nevertheless, participants considered the framework to be an appropriate blueprint of the competencies necessary for their professional environment, but to make it accessible more autonomy is required to adapt the framework to their needs.

Conclusion

Newer renditions of the CanMEDS Competency Framework should better consider the realities of non-clinical disciplines.

Exploring residents' perceptions of competency-based medical education across Canada: A national survey study

Background: As competency-based medical education (CBME) is implemented across Canada, little is known about residents' perceptions of this model. This study examined how Canadian residents understand CBME and their lived experiences with implementation. Methods: We administered a survey in 2018 with Likert-type and open-ended questions to 375 residents across Canada, of whom 270 were from traditional programs ("pre-CBME") and 105 were in a CBME program. We used the Mann-Whitney test to examine differences across samples, and analyzed qualitative data thematically. Results: Three themes were identified across both groups: program outcome concerns, changes, and emotional responses. In relation to program concerns, both groups were concerned about the administrative burden, challenges with the assessment process, and feedback quality. Only pre-CBME residents were concerned about faculty engagement and buy-in. In terms of changes, both groups discussed a more formalized assessment process with mixed reactions. Residents in the pre-CBME sample reported greater concerns for faculty time constraints, assessment completion, and quality of learning experiences, whilst those in CBME programs reported being more proactive in their learning and greater selfreflection. Residents expressed strong emotional narrative responses including greater stress and frustration in a CBME environment. Conclusion: Findings demonstrate that residents have mixed feelings and experiences regarding CBME. Their positive experiences align with the aim of developing more self-directed learners. However, the concerns suggest the need to address specific shortcomings to increase buy-in, while the emotional responses associated with CBME may require a cultural shift within residency programs to guard against burnout.

Exploring stakeholder perspectives regarding the implementation of competency-based medical education: a qualitative descriptive study

Introduction

Competency-based medical education (CBME) offers perceived advantages and benefits for postgraduate medical education (PGME) and the training of competent physicians. The purpose of our study was to gain insights from those involved in implementing CBME in two residency programs to inform ongoing implementation practices.

Methods

We conducted a qualitative descriptive study to explore the perspectives of multiple stakeholders involved in the implementation of CBME in two residency programs (the first cohort) to launch the Royal College's Competence by Design model at one Canadian university. Semi-structured interviews were conducted with 17 participants across six stakeholder groups including residents, department chairs, program directors, faculty, medical educators, and program administrators. Data collection and analysis were iterative and reflexive to enhance the authenticity of the results.

Results

The participants' perspectives organized around three key themes including: a) contextualizing curriculum and assessment practices with educational goals of CBME, b) coordinating new administrative requirements to support implementation, and c) adaptability toward a competency-based program structure, each with sub-themes.

Conclusion

By eliciting the perspectives of different stakeholder groups who experienced the implementation processes, we developed a common understanding regarding facilitators and challenges for program directors, program administrators and educational leaders across PGME. Results from our study contribute to the scholarly conversation regarding the key aspects related to CBME implementation and serve to inform its ongoing development and application in various educational contexts.

The state of infectious disease training in Germany before introduction of the new board certification in internal medicine and infectious diseases: past experience and future expectations

PURPOSE

Recently, the German Medical Association introduced a new board certification in Internal Medicine and Infectious Diseases (ID). Accompanying, current experience with ID training and expectations for the new curriculum were assessed.

METHODS

After the development of a digital survey covering four main areas with 59 questions, it was distributed via the German Society for Infectious Diseases (DGI) and other networks following a snowball principle. Participation was carried out digitally in a web-based application.

RESULTS

Between December 2021 and February 2022, 300 datasets were included. 38.9% (114/293) of respondents had completed the additional training in ID. Of those, 54.0% (61/113) were concerned about recognition of previous training certification in the future after the establishment of the new sub-specialization. Overall, 78.5% (135/172) of respondents were satisfied or rather satisfied with the qualification gained through their training, but 8.7% (15/172) felt poorly prepared by their ID training. With regard to the inclusion of microbiology or antimicrobial stewardship (AMS) training into the new ID training curriculum, 84.6% (254/300) and 87.7% (263/300) of participants, respectively, desired an integration. Only 30.8% (53/172) felt sufficiently supported by their employer regarding childcare and 51.7% (89/172) reported missing support for scientific commitment.

CONCLUSION

Overall, ID training in Germany seems satisfactory so far, but there is uncertainty about future recognition. Participants find that AMS and microbiology training should be integrated into new ID training curricula. New concepts regarding the compatibility of childcare and career as well as the support of scientific commitment seem essential to attract young professionals to the field.

Fitness-for-purpose of the CanMEDS competencies for workplace-based assessment in General Practitioner's Training: a Delphi study

BACKGROUND

In view of the exponential use of the CanMEDS framework along with the lack of rigorous evidence about its applicability in workplace-based medical trainings, further exploring is necessary before accepting the framework as accurate and reliable competency outcomes for postgraduate medical trainings. Therefore, this study investigated whether the CanMEDS key competencies could be used, first, as outcome measures for assessing trainees' competence in the workplace, and second, as consistent outcome measures across different training settings and phases in a postgraduate General Practitioner's (GP) Training.

METHODS

In a three-round web-based Delphi study, a panel of experts (n = 25-43) was asked to rate on a 5-point Likert scale whether the CanMEDS key competencies were feasible for workplace-based assessment, and whether they could be consistently assessed across different training settings and phases. Comments on each CanMEDS key competency were encouraged. Descriptive statistics of the ratings were calculated, while content analysis was used to analyse panellists' comments.

RESULTS

Out of twenty-seven CanMEDS key competencies, consensus was not reached on six competencies for feasibility of assessment in the workplace, and on eleven for consistency of assessment across training settings and phases. Regarding feasibility, three out of four key competencies under the role "Leader", one out of two competencies under the role "Health Advocate", one out of four competencies under the role "Scholar", and one out of four competencies under the role "Professional" were deemed as not feasible for assessment in a workplace setting. Regarding consistency, consensus was not achieved for one out of five competencies under "Medical Expert", two out of five competencies under "Communicator",one out of three competencies under "Collaborator", one out of two under "Health Advocate", one out of four competencies under "Scholar", one out of four competencies under "Professional". No competency under the role "Leader" was deemed to be consistently assessed across training settings and phases.

CONCLUSIONS

The findings indicate a mismatch between the initial intent of the CanMEDS framework and its applicability in the context of workplace-based assessment. Although the CanMEDS framework could offer starting points, further contextualization of the framework is required before implementing in workplace-based postgraduate medical trainings.

Multicentre implementation of a nursing competency framework at a provincial scale: A qualitative description of facilitators and barriers

RATIONALE

Nurses are responsible for engaging in continuing professional development throughout their careers. This implies that they use tools such as competency frameworks to assess their level of development, identify their learning needs, and plan actions to achieve their learning goals. Although multiple competency frameworks and guidelines for their development have been proposed, the literature on their implementation in clinical settings is sparser. If the complexity of practice creates a need for context-sensitive competency frameworks, their implementation may also be subject to various facilitators and barriers.

AIMS AND OBJECTIVES

To document the facilitators and barriers to implementing a nursing competency framework on a provincial scale.

METHODS

This multicentre study was part of a provincial project to implement a nursing competency framework in Quebec, Canada, using a three-step process based on evidence from implementation science. Nurses' participation consisted in the self-assessment of their competencies using the framework. For this qualitative descriptive study, 58 stakeholders from 12 organizations involved in the first wave of implementation participated in group interviews to discuss their experience with the implementation process and their perceptions of facilitators and barriers. Data were subjected to thematic analysis.

RESULTS

Analysis of the data yielded five themes: finding the 'right unit' despite an unfavourable context; taking and protecting time for self-assessment; creating value around competency assessment; bringing the project as close to the nurses as possible; making the framework accessible.

CONCLUSION

This study was one of the first to document the large-scale, multi-site implementation of a nursing competency framework in clinical settings. This project represented a unique challenge because it involved two crucial changes: adopting a competency-based approach focused on educational outcomes and accountability to the public and valorizing a learning culture where nurses become active stakeholders in their continuing professional development.

The use of technology in postgraduate medical education within radiology: a scoping review

Postgraduate radiology training has traditionally followed didactic approaches; however, complex reasoning skills and critical thinking are essential in the field of radiology. Therefore, the shortages of radiologists in Africa have necessitated the need to review the use of technology in postgraduate education to improve efficient training and service. This scoping review was conducted to map the evidence on the role of technology in postgraduate radiology education and practice. A systematic scoping review search strategy was undertaken to review material published between January 2005 and August 2020 on the use of technology in radiology education. Data from the included studies were extracted and analyzed for emerging themes and presented in response to the research question. Seven articles described studies from the African continent. The most popular technological intervention was telemedicine, and several niche areas of technology implementation were identified (blended learning, flipped learning, digital teaching files). Furthermore, the most challenging aspects relating to technology use remain fiscal and credentialing constraints. Technology plays a role in postgraduate radiology education through networks, synchronous and asynchronous applications. It has the potential to increase support to doctoral students in the African context and alleviate some stressors associated with traditional, face-to-face didactic programs.

Development and validation of the ADVANCER framework for naturopathic education and practice: A delphi study

BACKGROUND

There has been little attempt to date to narrow the education-practice gap in naturopathic medicine. A framework that brings naturopathic medicine education and practice closer together could help codify the knowledge of naturopathic medicine by providing simultaneous guidance on curriculum development and clinical decision-making in the discipline.

OBJECTIVE

To develop, refine and validate the Advancing Naturopathic Education and Practice (ADVANCER) framework.

METHODS

Published literature and pertinent government, professional association and institutional websites were scoped to identify key constructs for the ADVANCER framework. The constructs were grouped into ten domains, with each domain defined and translated into teaching and clinical practice outcomes. A two-round e-Delphi method, comprising international experts in naturopathic medicine education, was used to refine and validate the framework definitions and outcomes.

RESULTS

Sixteen academics, from five different countries, participated in the Delphi study. In round one, nine of the ten domains of the ADVANCER framework were rated as either very important or extremely important by 81.2% of participants. Only 68.8% of participants rated the tenth domain as either very important or extremely important. Participant feedback on each domain were pooled and reviewed, and where suggested changes were recommended by more than one participant, respective definitions and outcomes of each domain were amended. In round two, at least 90% of participants rated each domain of the amended ADVANCER framework as either very important or extremely important, meaning consensus to retain these domains, definitions and outcomes had been reached.

CONCLUSIONS

The study findings indicate that the ADVANCER framework is conceptually sound and potentially applicable to diverse institutions and countries. An important next step of this research is to establish whether implementation of the ADVANCER framework within naturopathic medicine education and practice is feasible, effective and sustainable.

Development and validation of the Readiness to Train Assessment Tool (RTAT)

BACKGROUND

In recent years, health centers in the United States have embraced the opportunity to train the next generation of health professionals. The uniqueness of the health centers as teaching settings emphasizes the need to determine if health professions training programs align with health center priorities and the nature of any adjustments that would be needed to successfully implement a training program. We sought to address this need by developing and validating a new survey that measures organizational readiness constructs important for the implementation of health professions training programs at health centers where the primary role of the organizations and individuals is healthcare delivery.

METHODS

The study incorporated several methodological steps for developing and validating a measure for assessing health center readiness to engage with health professions programs. A conceptual framework was developed based on literature review and later validated by 20 experts in two focus groups. A survey-item pool was generated and mapped to the conceptual framework and further refined and validated by 13 experts in three modified Delphi rounds. The survey items were pilot-tested with 212 health center employees. The final survey structure was derived through exploratory factor analysis. The internal consistency reliability of the scale and subscales was evaluated using Chronbach's alpha.

RESULTS

The exploratory factor analysis revealed a 41-item, 7-subscale solution for the survey structure, with 72% of total variance explained. Cronbach's alphas (.79-.97) indicated high internal consistency reliability. The survey measures: readiness to engage, evidence strength and quality of the health professions training program, relative advantage of the program, financial resources, additional resources, implementation team, and implementation plan.

CONCLUSIONS

The final survey, the Readiness to Train Assessment Tool (RTAT), is theoretically-based, valid and reliable. It provides an opportunity to evaluate health centers' readiness to implement health professions programs. When followed with appropriate change strategies, the readiness evaluations could make the implementation of health professions training programs, and their spread across the United States, more efficient and cost-effective. While developed specifically for health centers, the survey may be useful to other healthcare organizations willing to assess their readiness to implement education and training programs.

Which Aspects of the CanMEDS Competencies are Most Valued in Radiologists? Perspectives of Trainees From Other Specialties

PURPOSE

Radiologists work primarily in collaboration with other healthcare professionals. As such, these stakeholder perspectives are of value to the development and assessment of educational outcomes during the transition to competency-based medical education. Our aim in this study was to determine which aspects of the Royal College CanMEDS competencies for diagnostic radiology are considered most important by future referring physicians.

METHODS

Institutional ethics approval was obtained. After pilot testing, an anonymous online survey was sent to all residents and clinical fellows at our university. Open-ended questions asked respondents to describe the aspects of radiologist service they felt were most important. Thematic analysis of the free-text responses was performed using a grounded theory approach. The resulting themes were mapped to the 2015 CanMEDS Key Competencies.

RESULTS

115 completed surveys were received from residents and fellows from essentially all specialties and years of training (out of 928 invited). Major themes were 1) timeliness and accessibility of service, 2) quality of reporting, and 3) acting as a valued team member. The competencies identified as important by resident physicians were largely consistent with the CanMEDS framework, although not all key competencies were covered in the responses.

CONCLUSIONS

This study illustrates how CanMEDS roles and competencies may be exemplified in a concrete and specialty-specific manner from the perspective of key stakeholders. Our survey results provide further insight into specific objectives for teaching and assessing these competencies in radiology residency training, with the ultimate goal of improving patient care through strengthened communication and working relationships.

Defining competency for Royal Australian and New Zealand College of Obstetricians and Gynaecologists training: An exploratory study of Victorian Integrated Training Program coordinators' understanding of competency

BACKGROUND

Competency-based medical education (CBME) is increasingly employed by postgraduate training programs worldwide, including obstetrics and gynaecology. Focusing on assessment of outcomes rather than time-in-training, and utilising a well-defined curricular framework, CBME aims to train doctors capable of meeting the needs of modern society. When this study was undertaken, in 2019, the Royal Australian and New Zealand College of Obstetricians and Gynaecologists (RANZCOG) had a time-based curriculum and was due to undergo a curriculum review starting in 2020.

AIMS

To explore Victorian RANZCOG Integrated Training Program (ITP) coordinators' understanding of the concept of competency and how it is taught and assessed within RANZCOG training.

MATERIALS AND METHODS

A qualitative, grounded theory design using semi-structured interviews was employed. Victorian RANZCOG ITP coordinators from inner and outer metropolitan, and regional sites, were approached to participate. Transcripts were coded and analysed using thematic analysis.

RESULTS

Themes identified were: Competence, Vision and Innovation, Structures, ITP Coordinator Role and Teaching and Learning. Competence was defined as a combination of independent practice and understanding of ones' own limits, in addition to required clinical skills and knowledge. Enablers and barriers to achieving competency were identified and associated with structures, human and logistical factors. Victorian ITP coordinators believed the current training program has positive elements but could be further improved.

CONCLUSIONS

Several areas for future research were identified regarding understanding of competency, relevant if RANZCOG is to introduce a CBME framework. Replicating this research across all RANZCOG jurisdictions in Australia and New Zealand would be prudent to determine if the themes are universal.

Driving lesson or driving test? : A metaphor to help faculty separate feedback from assessment

Although there is consensus in the medical education world that feedback is an important and effective tool to support experiential workplace-based learning, learners tend to avoid the feedback associated with direct observation because they perceive it as a high-stakes evaluation with significant consequences for their future. The perceived dominance of the summative assessment paradigm throughout medical education reduces learners' willingness to seek feedback, and encourages supervisors to mix up feedback with provision of 'objective' grades or pass/fail marks. This eye-opener article argues that the provision and reception of effective feedback by clinical supervisors and their learners is dependent on both parties' awareness of the important distinction between feedback used in coaching towards growth and development (assessment for learning) and reaching a high-stakes judgement on the learner's competence and fitness for practice (assessment of learning). Using driving lessons and the driving test as a metaphor for feedback and assessment helps supervisors and learners to understand this crucial difference and to act upon it. It is the supervisor's responsibility to ensure that supervisor and learner achieve a clear mutual understanding of the purpose of each interaction (i.e. feedback or assessment). To allow supervisors to use the driving lesson-driving test metaphor for this purpose in their interactions with learners, it should be included in faculty development initiatives, along with a discussion of the key importance of separating feedback from assessment, to promote a feedback culture of growth and support programmatic assessment of competence.

How To Get Your Clinical Teaching Team Ready For Curriculum Change: A Practical Guide

Our health care system is constantly adapting to change at an increasingly rapid pace. Unavoidably, this also applies to the field of medical education. As a result, clinical teaching teams face the challenging task of successfully implementing the proposed changes in daily practice. It goes without saying that implementing change takes time and that you need to be patient. However, a successful change process needs more than that. Change models or strategies could offer a helping hand. The questionnaire Specialty training's Organizational Readiness for curriculum Change (STORC) is a tool aiming to do just that. With a focus on readiness for change, this questionnaire tries to support implementation efforts in PGME. Additionally, since change is a team effort, it focusses on clinical teaching teams particularly. In this paper, we offer a practical guide for clinical teaching teams on how to deal with any concerns or hurdles detected in any of the core elements of readiness for change, in order to smoothen and support the educational change processes these teams are confronted with.

How clinical teaching teams deal with educational change: 'we just do it'

BACKGROUND

In postgraduate medical education, program directors are in the lead of educational change within clinical teaching teams. As change is part of a social process, it is important to not only focus on the program director but take their other team members into account. The purpose of this study is to provide an in-depth insight into how clinical teaching teams manage and organize curriculum change processes, and implement curriculum change in daily practice.

METHODS

An explorative qualitative semi-structured interview study was conducted between October 2016 and March 2017. A total of six clinical teaching teams (n = 6) participated in this study, i.e. one program director, one clinical staff member, and one trainee from each clinical teaching team (n = 18). Data were analysed and structured by means of thematic analysis.

RESULTS

The analysis yielded to five factors that positively impact change: shared commitment, reinvention, ownership, supportive structure and open culture. Factors that negatively impact change were: resistance, behaviour change, balance between different tasks, lack of involvement, lack of consensus, and unsafe culture and hierarchy. Overall, no clear change strategy could be recognized.

CONCLUSIONS

Insight was gathered in factors facilitating and hindering the implementation of change. It seems particularly important for clinical teaching teams to be able to create a sense of ownership among all team members by making a proposed change valuable for their local context as well as to be capable of working together as a team. Cultural factors seem to be particularly relevant in a team's ability to accomplish this.

Theories of learning and teaching methods used in postgraduate education in the health sciences: a scoping review

OBJECTIVE

The objective of this scoping review was to determine the theories of learning and methods used in teaching in postgraduate education in the health sciences. The longer-term objective was to use the information gathered to design a workshop for teachers of postgraduate students.

INTRODUCTION

Whilst undergraduate teaching in the health sciences has received considerable attention in the literature in terms of methods used, innovative ideas and outcomes, the same cannot be said of postgraduate education. A considerable amount of postgraduate teaching takes place in the workplace and often in the form of informal teaching. The increasing complexity of health problems calls for innovative teaching.

INCLUSION CRITERIA

Papers included in this review were those that considered postgraduate education in the health science disciplines, including but not limited to medicine, nursing, occupational therapy, physiotherapy, pharmacy and dentistry, and that described theories of learning and/or teaching methods used in teaching.

METHODS

Five databases were searched for the period 2001 through 2016. PubMed yielded the most records (3142). No relevant papers were identified through hand searching of the references of the included papers. A data extraction table was developed and used to extract relevant information from included papers.

RESULTS

Sixty-one papers were included in the review. Most of the included papers were from the USA, with 17 published in 2015. Descriptive study designs were the most frequently identified study design. Most of the papers were from the medical disciplines. Twenty-seven papers did not refer to a teaching and learning theory, a further group referred to a theory but often towards the end of the paper, and seven papers had as their focus the importance of theories in medical education. The theories named were of a wide variety. Likewise, a wide range of teaching methods were identified.

CONCLUSIONS

It is clear that a range of theories and teaching methods are used in postgraduate health science education, with educators feeling the need to explore more innovative methods.

Exploring Nunavut Public Health System's Readiness to Implement Obesity Prevention Policies and Programs in the Canadian Arctic

Background

Rapid changes in the food and built environments in the Canadian Arctic have contributed to a dramatic increase in the prevalence rates of obesity. The objective of this study was to explore the determinants of Nunavut public health system's commitment to implement obesity prevention policies and programs in the territory to reduce the burden of obesity-related diseases.

Methods

In total, 93 program managers, program officers, and policy analysts who are responsible for program and policy development and implementation within the Nunavut Department of Health (NDH) were asked to complete the validated Organizational Readiness for Implementing Change (ORIC) questionnaire. Organization-level readiness (commitment) was determined based on aggregated individual-level data using bivariate correlations and multivariate linear regression analyses.

Results

Of the 93 questionnaires that were distributed only 67 (72%) were returned fully completed. Organization-level commitment to implement obesity prevention policies and programs was low. Only 2.9% of respondents strongly agreed that NDH was committed to implementing obesity prevention policies and programs. The study showed a strong positive correlation between NDH's commitment and perceived value (r = .73), perceived efficacy (r = .50), and resource availability (r = .25). There was no correlation between commitment and knowledge. In the multivariate linear regression model, perceived value was the only significant predictor of NDH's commitment to implement obesity prevention policies and programs (β = 0.66).

Conclusions

Successful adoption and implementation of obesity prevention policies and programs in the Canadian Arctic largely depend on the perception of value and benefits of and belief in the change efforts among employees of the Nunavut Department of Health. Convincing policy makers of the value of preventive policies and programs is an important and necessary first step towards decreasing the prevalence of obesity in the Inuit population.

Changes in Perceived Supervision Quality After Introduction of Competency-Based Orthopedic Residency Training: A National 6-Year Follow-Up Study

OBJECTIVE

To evaluate the perceived quality of the learning environment, before and after introduction of competency-based postgraduate orthopedic education.

DESIGN

From 2009 to 2014, we conducted annual surveys among Dutch orthopedic residents. The validated Dutch Residency Educational Climate Test (D-RECT, 50 items on 11 subscales) was used to assess the quality of the learning environment. Scores range from 1 (poor) to 5 (excellent).

SETTING

Dynamic cohort follow-up study.

PARTICIPANTS

All Dutch orthopedic residents were surveyed during annual compulsory courses.

RESULTS

Over the 6-year period, 641 responses were obtained (response rate 92%). Scores for "supervision" (95% CI for difference 0.06-0.28, p = 0.002) and "coaching and assessment" (95% CI 0.11-0.35, p < 0.001) improved significantly after introduction of competency-based training. There was no significant change in score on the other subscales of the D-RECT.

CONCLUSIONS

After the introduction of some of the core components of competency-based postgraduate orthopedic education the perceived quality of "supervision" and "coaching and assessment" improved significantly.

Effects of implementing time-variable postgraduate training programmes on the organization of teaching hospital departments

INTRODUCTION

As competency-based education has gained currency in postgraduate medical education, it is acknowledged that trainees, having individual learning curves, acquire the desired competencies at different paces. To accommodate their different learning needs, time-variable curricula have been introduced making training no longer time-bound. This paradigm has many consequences and will, predictably, impact the organization of teaching hospitals. The purpose of this study was to determine the effects of time-variable postgraduate education on the organization of teaching hospital departments.

METHODS

We undertook exploratory case studies into the effects of time-variable training on teaching departments' organization. We held semi-structured interviews with clinical teachers and managers from various hospital departments.

RESULTS

The analysis yielded six effects: (1) time-variable training requires flexible and individual planning, (2) learners must be active and engaged, (3) accelerated learning sometimes comes at the expense of clinical expertise, (4) fast-track training for gifted learners jeopardizes the continuity of care, (5) time-variable training demands more of supervisors, and hence, they need protected time for supervision, and (6) hospital boards should support time-variable training.

CONCLUSIONS

Implementing time-variable education affects various levels within healthcare organizations, including stakeholders not directly involved in medical education. These effects must be considered when implementing time-variable curricula.

A High-Definition Video Teaching Module for Thyroidectomy Surgery

OBJECTIVE

With the changing landscape of postgraduate surgical education to competency-based curricula, there emerges a need for alternative forms of training. Video teaching modules have been shown to be effective tools in surgical education, complementing traditional postgraduate curricula. There is a lack of validated modules described in the literature, specifically for teaching thyroidectomy. The primary objective of this study was to develop and validate a high definition video-based teaching module instructing thyroidectomy surgery to Otolaryngology-Head and Neck Surgery trainees.

DESIGN

This prospective study included intermediate to senior Otolaryngology-Head and Neck Surgery residents. Each participant first performed a thyroid lobectomy, serving as the initial assessment. After a washout period of at least 3 weeks, each participant was given the teaching module. The 15-minute module was developed using a 3-camera system and detailed a step-by-step approach to the surgery. After exposure to the module, each trainee performed the same procedure. Recordings of both procedures were deidentified and reviewed by a blinded, independent evaluator. Scoring was done using the Observational Clinical Human Reliability Assessment (OCHRA) system.

SETTING

University of Alberta Hospital and Royal Alexandra Hospital, Edmonton, Alberta, Canada.

PARTICIPANTS

A total of 6 intermediate to senior Otolaryngology-Head and Neck Surgery residents entered and completed the study.

RESULTS

The mean error rate was 8.8 errors per procedure before module exposure and 4.5 errors per procedure after exposure, representing a 49% decrease in error occurrence (p < 0.05). The mean staff takeover event rate was 10.5 takeovers per procedure prior to module exposure and 5.0 takeovers per procedure after exposure, representing a 52% decrease in error occurrence (p < 0.05).

CONCLUSION

High-definition video teaching modules are a useful complement to traditional surgical training. In a climate where new innovations for teaching thyroid surgery are needed, properly constructed and validated video teaching modules can serve as important tools in supplementing traditional surgical training.

Flexibility in Postgraduate Medical Training in the Netherlands

Postgraduate medical training in the Netherlands has become increasingly individualized. In this article, the authors describe current practices for three residency programs at the University Medical Center Utrecht: anesthesiology, pediatrics, and ophthalmology. These programs are diverse yet share characteristics allowing for individualized residency training. New residents enter each program throughout the year, avoiding a large simultaneous influx of inexperienced doctors. The usual duration of each is five years. However, the actual duration of rotations or of the program as a whole can be reduced because of residents' previous medical experience or demonstration of early mastery of relevant competencies. If necessary, the duration of training can also increase.Although working hours are already restricted by the European Working Time Directive, most residents choose to train on a part-time basis. The length of their program then is extended proportionally. The extension period added for those residents training part-time can be used to develop specific competencies, complete an elective rotation or research, or explore a focus area. If the resident meets all training objectives before the extension period is completed, the program director can choose to shorten the program length. Recently, entrustable professional activities have been introduced to strengthen workplace-based assessment. The effects on program duration have yet to be demonstrated.Flexible postgraduate training is feasible. Although improving work-life balance for residents is a necessity, attention must be paid to ensuring that they gain the necessary experience and competencies and maintain continuity of care to ensure that high-quality patient care is provided.

Amant LMM. Epidemiology of competence: a scoping review to understand the risks and supports to competence of four health professions

OBJECTIVES

This study examined the risks and supports to competence discussed in the literature related to occupational therapists, pharmacists, physical therapists and physicians, using epidemiology as a conceptual model.

DESIGN

Articles from a scoping literature review, published from 1975 to 2014 inclusive, were included if they were about a risk or support to the professional or clinical competence of one of four health professions. Descriptive and regression analyses identified potential associations between risks and supports to competence and the location of study, type of health profession, competence life-cycle and the domain(s) of competence (organised around the CanMEDS framework).

RESULTS

A total of 3572 abstracts were reviewed and 943 articles analysed. Most focused on physicians (n=810, 86.0%) and 'practice' (n=642, 68.0%). Fewer articles discussed risks to competence (n=418, 44.3%) than supports (n=750, 79.5%). The top four risks, each discussed in over 15% of articles, were: transitions in practice, being an international graduate, lack of clinical exposure/experience (ie, insufficient volume of procedures or patients) and age. The top two supports (over 35%) were continuing education participation and educational information/programme features. About 60% of all the articles discussed medical expert and about 25% applied to all roles. Articles focusing on residents had a greater probability of reporting on risks.

CONCLUSIONS

Articles about physicians were dominant. The majority of articles were written in the last decade and more discussed supports than risks to competence. An epidemiology-based conceptual model offers a helpful organising framework for exploring and explaining the competence of health professions.

What stage are low-income and middle-income countries (LMICs) at with patient safety curriculum implementation and what are the barriers to implementation? A two-stage cross-sectional study

OBJECTIVES

The improvement of safety in healthcare worldwide depends in part on the knowledge, skills and attitudes of staff providing care. Greater patient safety content in health professional education and training programmes has been advocated internationally. While WHO Patient Safety Curriculum Guides (for Medical Schools and Multi-Professional Curricula) have been widely disseminated in low-income and middle-income countries (LMICs) over the last several years, little is known about patient safety curriculum implementation beyond high-income countries. The present study examines patient safety curriculum implementation in LMICs.

METHODS

Two cross-sectional surveys were carried out. First, 88 technical officers in Ministries of Health and WHO country offices were surveyed to identify the pattern of patient safety curricula at country level. A second survey followed that gathered information from 71 people in a position to provide institution-level perspectives on patient safety curriculum implementation.

RESULTS

The majority, 69% (30/44), of the countries were either considering whether to implement a patient safety curriculum or actively planning, rather than actually implementing, or embedding one. Most organisations recognised the need for patient safety education and training and felt a safety curriculum was compatible with the values of their organisation; however, important faculty-level barriers to patient safety curriculum implementation were identified. Key structural markers, such as dedicated financial resources and relevant assessment tools to evaluate trainees' patient safety knowledge and skills, were in place in fewer than half of organisations studied.

CONCLUSIONS

Greater attention to patient safety curriculum implementation is needed. The barriers to patient safety curriculum implementation we identified in LMICs are not unique to these regions. We propose a framework to act as a global standard for patient safety curriculum implementation. Educating leaders through the system in order to embed patient safety culture in education and clinical settings is a critical first step.

The Role of Generic Competencies in the Entrustment of Professional Activities: A Nationwide Competency-Based Curriculum Assessed

BACKGROUND

Entrustable professional activities (EPAs) seek to translate essential physician competencies into clinical practice. Until now, it is not known whether EPA-based curricula offer enhanced assessment and feedback to trainees.

OBJECTIVE

This study examined program directors' and senior residents' justifications for entrustment decisions and what role generic, cross-specialty competencies (such as communication skills, collaboration, and understanding health care systems) play in these decisions.

METHODS

Entrustment decisions for all Dutch obstetrics and gynecology residents between January 2010 and April 2014 were retrieved from their electronic portfolios. Justifications for entrustment were divided into 4 categories: the resident's experience, his or her technical performance, the presence of a generic competency, and training. Template analysis was used to analyze in depth the types of justifications, which play a role in entrustment decisions.

RESULTS

A total of 5139 entrustment decisions for 375 unique residents were extracted and analyzed. In 59% of all entrustment decisions, entrusting a professional task to a resident was justified by the experience of the resident. Generic competencies were mentioned in 0.5% of all entrustment decisions. Template analysis revealed that the amount of exposure and technical skills are leading factors, while the quality of the performance was not reported to be of any influence.

CONCLUSIONS

Entrustment decisions only rarely are based on generic competencies, despite the introduction of competency frameworks and EPAs. For program directors, a leading factor in entrustment decisions is a resident's exposure to an activity, and the quality of a resident's performance appears to play only a minor role.

Qualitative Study Exploring Implementation of a Point-of-Care Competency-Based Lumbar Puncture Program Across Institutions

OBJECTIVE

To explore the factors that facilitated or hindered successful implementation of a multi-centered infant lumbar puncture (LP) competency-based education program that required interns to demonstrate skills readiness on a task trainer before performing their first clinical LP.

METHODS

In 2013, investigators conducted a qualitative study utilizing semistructured interviews and focus groups of site directors (SDs) from the International Network for Simulation-Based Pediatric Innovation, Research, and Education (INSPIRE) who were responsible for implementing the LP competency-based education program. Transcripts were analyzed using grounded theory to identify and verify emergent themes and subthemes.

RESULTS

Thematic saturation was attained after interviewing 19 SDs in 12 interviews and 3 focus groups. The most significant strategies and barriers were organized into 4 main themes: 1) alignment of different visions to obtain buy-in, 2) balance between providing education versus patient care, 3) acceptance of novel teaching paradigms, and 4) communication logistics. The ability to overcome barriers was influenced by institutional culture on trainee education, patient safety and research; the level of relational coordination between different groups of stakeholders; and the ability of SDs to identify and diversify entrepreneurial strategies.

CONCLUSIONS

INSPIRE SDs reveal the challenges of implementing a network-wide competency-based educational initiative that determines interns' readiness to perform LPs in clinical settings. Strategizing to align the common goals of graduate medical training, patient care and research instructs clinician educators and leaders on how to successfully change educational culture in academic medicine.

Dealing with the complex dynamics of teaching hospitals

Innovation and change in postgraduate medical education programs affects teaching hospital organizations, since medical education and clinical service are interrelated.Recent trends towards flexible, time-independent and individualized educational programs put pressure on this relationship. This pressure may lead to organizational uncertainty, unbalance and friction making it an important issue to analyze.The last decade was marked by a transition towards outcome-based postgraduate medical education. During this transition competency-based programs made their appearance. Although competency-based medical education has the potential to make medical education more efficient, the effects are still under debate. And while this debate continues, the field of medical education is already introducing next level innovations: flexible and individualized training programs. Major organizational change, like the transition to flexible education programs, can easily lead to friction and conflict in teaching hospital organizations.This article analyses the organizational impact of postgraduate medical education innovations, with a particular focus on flexible training and competency based medical education. The characteristics of teaching hospital organizations are compared with elements of innovation and complexity theory.With this comparison the article argues that teaching hospital organizations have complex characteristics and behave in a non-linear way. This perspective forms the basis for further discussion and analysis of this unexplored aspect of flexible and competency based education.

Bureaucrapathologies: Galloping Regulosis, Assessment Degradosis, and Other Unintended Organizational Maladies in Post-Graduate Medical Education

As decadelong observers of evolving administrative regulations governing academic medicine, the authors have identified several organizational disorders they define as "bureaucrapathologies," pathological conditions caused by dysfunctional bureaucratic processes that generate excesses of wasted time, effort, and other resources. Appearing wherever bureaucratic organizations exist, they have become particularly egregious in health care, research, and education. In past decades, graduate medical education has been beset by proliferating assessment requirements accompanied by corresponding documentation requirements imposed by academic educational regulatory agencies (specifically the Accreditation Council on Graduate Medical). Although originating from the best of intentions, these largely untested, unvalidated, and unfunded mandates generate burdensome personnel, time, and resource requirements. As they trickle down organizational levels, the intentions of the originators are inevitably degraded. As motivations and incentives of lower level administrators and faculty differ considerably from those at higher levels, we inevitably encounter debatable assessment practices yielding results of dubious reliability and validity. These processes invariably lead to proliferating reports and paperwork. All of this raises serious questions about the benefits vs. harms of these enterprises. In our view, these pathogenic processes can be recognized as diagnosable subtypes of bureaucrapathology. Here the authors briefly describe two, Galloping Regulosis and Assessment Degradosis, which reflect on their pathogenesis and offer preliminary thoughts for potential remedies. Several other recently identified bureaucrapathological syndromes awaiting future delineation are noted.

Guidelines: the do's, don'ts and don't knows of feedback for clinical education

INTRODUCTION

The guidelines offered in this paper aim to amalgamate the literature on formative feedback into practical Do's, Don'ts and Don't Knows for individual clinical supervisors and for the institutions that support clinical learning.

METHODS

The authors built consensus by an iterative process. Do's and Don'ts were proposed based on authors' individual teaching experience and awareness of the literature, and the amalgamated set of guidelines were then refined by all authors and the evidence was summarized for each guideline. Don't Knows were identified as being important questions to this international group of educators which if answered would change practice. The criteria for inclusion of evidence for these guidelines were not those of a systematic review, so indicators of strength of these recommendations were developed which combine the evidence with the authors' consensus.

RESULTS

A set of 32 Do and Don't guidelines with the important Don't Knows was compiled along with a summary of the evidence for each. These are divided into guidelines for the individual clinical supervisor giving feedback to their trainee (recommendations about both the process and the content of feedback) and guidelines for the learning culture (what elements of learning culture support the exchange of meaningful feedback, and what elements constrain it?)

CONCLUSION

Feedback is not easy to get right, but it is essential to learning in medicine, and there is a wealth of evidence supporting the Do's and warning against the Don'ts. Further research into the critical Don't Knows of feedback is required. A new definition is offered: Helpful feedback is a supportive conversation that clarifies the trainee's awareness of their developing competencies, enhances their self-efficacy for making progress, challenges them to set objectives for improvement, and facilitates their development of strategies to enable that improvement to occur.

Implementation of an education development project in pathology to improve student competency-lessons learnt

Context:

Basic medical sciences and clinical teachings are not coordinated in the present medical education system. They are not taught keeping in mind the outcomes required at the time of actual handling of patients in the community.

Aims:

An educational development project was implemented in the Department of Pathology with the aim that it will result in the student learning to link the pathophysiology of the disease to clinical scenarios and become fully competent for lifelong medical practice.

Subjects and Methods:

The pathology teaching of the second professional batch was modified by starting with defining the desired outcomes/competencies in the student's knowledge, skills, and attitude which were then addressed by lectures, demonstrations, practical classes and small group activities where case scenarios and laboratory reports were included. The outcome was assessed by Objectively Structured Clinical/Practical Examination and multiple choice questions. Force field analysis, faculty and student interviews, and questionnaires were used to assess the factors affecting its implementation and impact.

Results:

Totally 80 students of the 2^nd Professional MBBS were exposed to a competency-based education development project. It was found that the system was appreciated by faculty and students, especially the integration with clinical scenarios. There were many factors which influenced the execution of this program, including motivation level of students and faculty, time, logistics and meticulous planning.

Conclusions:

There was a significant improvement in student's performance and satisfaction. Many factors including prior planning were a major determinant for the success of this education development project.

Specialty Training's Organizational Readiness for curriculum Change (STORC): development of a questionnaire in a Delphi study

BACKGROUND

In postgraduate medical education (PGME), programs have been restructured according to competency-based frameworks. The scale and implications of these adjustments justify a comprehensive implementation plan. Organizational Readiness for Change (ORC) is seen as a critical precursor for a successful implementation of change initiatives. Though, ORC in health care settings is mostly assessed in small scale settings and in relation to new policies and practices rather than educational change. Therefore our aim with this work was to develop an instrument to asses Specialty Training's Organizational Readiness for curriculum Change (STORC).

METHODS

A Delphi procedure was conducted to examine the applicability of a preliminary questionnaire in PGME, which was based on existing instruments designed for business and health care organizations. The 41 panellists (19 trainees and 22 supervisors from 6 specialties) from four different countries who were confronted with an apparent curriculum change, or would be in the near future, were asked to rate the relevance of a 89-item web-based questionnaire with regard to changes in specialty training on a 5-point Likert scale. Furthermore, they were invited to make qualitative comments on the items.

RESULTS

In two rounds the 89-item preliminary questionnaire was reduced to 44 items. Items were either removed, kept, adapted or added based on individual item scores and qualitative comments. In the absence of a gold standard, this Delphi procedure was considered complete when the overall questionnaire rating exceeded 4.0 (scale 0-5). The overall item score reached 4.1 in the second round, meeting our criteria for completion of this Delphi procedure.

CONCLUSIONS

This Delphi study describes the initial validating step in the development of an instrument to asses Specialty Training's Organisational Readiness for curriculum Change (STORC). Since ORC is measured on various subscales and presented as such, its strength lies in analysing these subscales. The latter makes it possible for educational leaders to identify and anticipate on hurdles in the implementation process and subsequently optimize efforts for successful curriculum change.

Reviewing residents' competence: a qualitative study of the role of clinical competency committees in performance assessment

PURPOSE

Clinical competency committees (CCCs) are now required in graduate medical education. This study examined how residency programs understand and operationalize this mandate for resident performance review.

METHOD

In 2013, the investigators conducted semistructured interviews with 34 residency program directors at five public institutions in California, asking about each institution's CCCs and resident performance review processes. They used conventional content analysis to identify major themes from the verbatim interview transcripts.

RESULTS

The purpose of resident performance review at all institutions was oriented toward one of two paradigms: a problem identification model, which predominated; or a developmental model. The problem identification model, which focused on identifying and addressing performance concerns, used performance data such as red-flag alerts and informal information shared with program directors to identify struggling residents.In the developmental model, the timely acquisition and synthesis of data to inform each resident's developmental trajectory was challenging. Participants highly valued CCC members' expertise as educators to corroborate the identification of struggling residents and to enhance credibility of the committee's outcomes. Training in applying the milestones to the CCC's work was minimal.Participants were highly committed to performance review and perceived the current process as adequate for struggling residents but potentially not for others.

CONCLUSIONS

Institutions orient resident performance review toward problem identification; a developmental approach is uncommon. Clarifying the purpose of resident performance review and employing efficient information systems that synthesize performance data and engage residents and faculty in purposeful feedback discussions could enable the meaningful implementation of milestones-based assessment.

How faculty members experience workplace-based assessment rater training: a qualitative study

CONTEXT

Direct observation of clinical skills is a common approach in workplace-based assessment (WBA). Despite widespread use of the mini-clinical evaluation exercise (mini-CEX), faculty development efforts are typically required to improve assessment quality. Little consensus exists regarding the most effective training methods, and few studies explore faculty members' reactions to rater training.

OBJECTIVES

This study was conducted to qualitatively explore the experiences of faculty staff with two rater training approaches - performance dimension training (PDT) and a modified approach to frame of reference training (FoRT) - to elucidate how such faculty development can be optimally designed.

METHODS

In a qualitative study of a multifaceted intervention using complex intervention principles, 45 out-patient resident faculty preceptors from 26 US internal medicine residency programmes participated in a rater training faculty development programme. All participants were interviewed individually and in focus groups during and after the programme to elicit how the training influenced their approach to assessment. A constructivist grounded theory approach was used to analyse the data.

RESULTS

Many participants perceived that rater training positively influenced their approach to direct observation and feedback, their ability to use entrustment as the standard for assessment, and their own clinical skills. However, barriers to implementation and change included: (i) a preference for holistic assessment over frameworks; (ii) challenges in defining competence; (iii) difficulty in changing one's approach to assessment, and (iv) concerns about institutional culture and buy-in.

CONCLUSIONS

Rater training using PDT and a modified approach to FoRT can provide faculty staff with assessment skills that are congruent with principles of criterion-referenced assessment and entrustment, and foundational principles of competency-based education, while providing them with opportunities to reflect on their own clinical skills. However, multiple challenges to incorporating new forms of training exist. Ongoing efforts to improve WBA are needed to address institutional and cultural contexts, and systems of care delivery.

Perceived effects of innovations in postgraduate medical education: a Q study focusing on workplace-based assessment

PURPOSE

Anticipating users' perceptions of the effects an innovation will have in daily practice prior to implementation may lead to a more optimal innovation process. In this study, the authors aimed to identify the kinds of perceptions that exist concerning the effects of workplace-based assessment (WBA), an innovation that is widely used in medical education, among its users.

METHOD

In 2012, the authors used Q methodology to ascertain the principal user perceptions of effects of WBA in practice. Participating obstetrics-gynecology residents and attending physicians (including residency program directors) at six hospitals in the Netherlands performed individual Q sorts to rank 36 statements concerning WBA and WBA tools according to their level of agreement. The authors conducted by-person factor analysis to uncover patterns in the rankings of the statements. They used the statistical results and participant comments about their sorts to interpret and describe distinct perceptions.

RESULTS

The analysis of 65 Q sorts (completed by 22 residents and 43 attendings) identified five distinct user perceptions regarding the effects of WBA in practice, which the authors labeled enthusiasm, compliance, effort, neutrality, and skepticism. These perceptions were characterized by differences in views on three main issues: the intended goals of the innovation, its applicability (ease of applying it to practice), and its actual impact.

CONCLUSIONS

User perceptions of the effects of innovations in medical education can be typified and should be anticipated. This study's insights into five principal user perceptions can support the design and implementation of innovations in medical education.

The CanMEDS framework: relevant but not quite the whole story

BACKGROUND

Despite acknowledgement that the Canadian Medical Educational Directives for Specialists (CanMEDS) framework covers the relevant competencies of physicians, many educators and medical professionals struggle to translate the CanMEDS roles into comprehensive training programmes for specific specialties.

AIM

To gain insight into the applicability of the CanMEDS framework to guide the design of educational programmes for specific specialties by exploring stakeholders' perceptions of specialty specific competencies and examining differences between those competencies and the CanMEDS framework.

METHODS

This case study is a sequel to a study among ObsGyn specialists. It explores the perspectives of patients, midwives, nurses, general practitioners, and hospital boards on gynaecological competencies and compares these with the CanMEDS framework.

RESULTS

Clinical expertise, reflective practice, collaboration, a holistic view, and involvement in practice management were perceived to be important competencies for gynaecological practice. Although all the competencies were covered by the CanMEDS framework, there were some mismatches between stakeholders' perceptions of the importance of some competencies and their position in the framework.

CONCLUSION

The CanMEDS framework appears to offer relevant building blocks for specialty specific postgraduate training, which should be combined with the results of an exploration of specialty specific competencies to arrive at a postgraduate curriculum that is in alignment with professional practice.

The national portfolio for postgraduate family medicine training in South Africa: a descriptive study of acceptability, educational impact, and usefulness for assessment

BACKGROUND

Since 2007 a portfolio of learning has become a requirement for assessment of postgraduate family medicine training by the Colleges of Medicine of South Africa. A uniform portfolio of learning has been developed and content validity established among the eight postgraduate programmes. The aim of this study was to investigate the portfolio's acceptability, educational impact, and perceived usefulness for assessment of competence.

METHODS

Two structured questionnaires of 35 closed and open-ended questions were delivered to 53 family physician supervisors and 48 registrars who had used the portfolio. Categorical and nominal/ordinal data were analysed using simple descriptive statistics. The open-ended questions were analysed with ATLAS.ti software.

RESULTS

Half of registrars did not find the portfolio clear, practical or feasible. Workshops on portfolio use, learning, and supervision were supported, and brief dedicated time daily for reflection and writing. Most supervisors felt the portfolio reflected an accurate picture of learning, but just over half of registrars agreed. While the portfolio helped with reflection on learning, participants were less convinced about how it helped them plan further learning. Supervisors graded most rotations, suggesting understanding the summative aspect, while only 61% of registrars reflected on rotations, suggesting the formative aspects are not yet optimally utilised. Poor feedback, the need for protected academic time, and pressure of service delivery impacting negatively on learning.

CONCLUSION

This first introduction of a national portfolio for postgraduate training in family medicine in South Africa faces challenges similar to those in other countries. Acceptability of the portfolio relates to a clear purpose and guide, flexible format with tools available in the workplace, and appreciating the changing educational environment from university-based to national assessments. The role of the supervisor in direct observations of the registrar and dedicated educational meetings, giving feedback and support, cannot be overemphasized.

How do social networks and faculty development courses affect clinical supervisors' adoption of a medical education innovation? An exploratory study

PURPOSE

To examine the impact of social networks and a two-day faculty development course on clinical supervisors' adoption of an educational innovation.

METHOD

During 2007-2010, 571 residents and 613 clinical supervisors in four specialties in the Netherlands were invited to complete a Web-based questionnaire. Residents rated their clinical supervisors' adoption of an educational innovation, the use of structured and constructive (S&C) feedback. Clinical supervisors self-assessed their adoption of this innovation and rated their communication intensity with other clinical supervisors in their department. For each supervisor, a centrality score was calculated, representing the extent to which the supervisor was connected to departmental colleagues. The authors analyzed the effects of supervisor centrality and participation in a two-day Teach-the-Teacher course on the degree of innovation adoption using hierarchical linear modeling, adjusting for age, gender, and attitude toward the S&C feedback innovation.

RESULTS

Respondents included 370 (60%) supervisors and 357 (63%) residents. Although Teach-the-Teacher course participation (n=172; 46.5%) was significantly related to supervisors' self-assessments of adoption (P=.001), it had no effect on residents' assessments of supervisors' adoption (P=.371). Supervisor centrality was significantly related to innovation adoption in both residents' assessments (P=.023) and supervisors' self-assessments (P=.024).

CONCLUSIONS

A clinical supervisor's social network may be as important as faculty development course participation in determining whether the supervisor adopts an educational innovation. Faculty development initiatives should use faculty members' social networks to improve the adoption of educational innovations and help build and maintain communities of practice.