Continuing the competency debate: reflections on definitions and discourses

Hyperglobalist, sceptical, and transformationalist perspectives on globalization in medical education

PURPOSE

Globalisation has been hotly debated in recent decades and has seemingly had a profound impact on medical education. This review synthesises the medical education literature using key perspectives from globalisation theory by Holton (Making globalisation).

METHODS

Holton (Making globalisation) recognised three key perspectives in globalisation theory-hyperglobalist, sceptical, and transformationalist. This article critically reviews the literature on globalisation in the field of medical education using this theoretical framework.

RESULTS

Hyperglobalist and sceptical perspectives dominated early periods of medical education literature on globalisation, projecting it either as a mainly positive or mainly negative force, respectively. Most forecasts grounded in these perspectives have not materialised in medical education policy and practice. Since 2010, the volume of scholarship about globalisation has increased and has been predominantly transformationalist in perspective, recognising a reality that has both positive and negative consequences.

CONCLUSIONS

The medical education literature has mirrored the broader social science literature, in moving over time from hyperglobalist and sceptical positions, towards a 'third wave' of globalisation thinking that is transformationalist. Medical education practitioners and policymakers should be mindful of these perspectives and trends as they navigate the opportunities and challenges presented by globalisation.

Safeguarding fairness in assessments-How teachers develop joint practices

INTRODUCTION

In light of reforms demanding increased transparency of student performance assessments, this study offers an in-depth perspective of how teachers develop their assessment practice. Much is known about factors that influence assessments, and different solutions claim to improve the validity and reliability of assessments of students' clinical competency. However, little is known about how teachers go about improving their assessment practices. This study aims to contribute empirical findings about how teachers' assessment practice may change when shared criteria for assessing students' clinical competency are developed and implemented.

METHODS

Using a narrative-in-action research approach grounded in narrative theory about human sense-making, one group including nine health professions teachers was studied over a period of 1 year. Drawing upon data from observations, interviews, formal documents and written reflections from these teachers, we performed a narrative analysis to reveal how these teachers made sense of experiences associated with the development and implementation of joint grading criteria for assessing students' clinical performances.

RESULTS

The findings present a narrative showing how a shared assessment practice took years to develop and was based on the teachers changed approach to scrutiny. The teachers became highly motivated to use grading criteria to ensure fairness in assessments, but more importantly, to fulfil their moral obligation towards patients. The narrative also demonstrates how these teachers reasoned about dilemmas that arose when they applied standardised assessment criteria.

DISCUSSION

The narrative analysis shows clearly how teachers' development and application of assessment standards are embedded in local practices. Our findings highlight the importance of teachers' joint discussions on how to interpret criteria applied in formative and summative assessments of students' performances. In particular, teachers' different approaches to assessing 'pieces of skills' versus making holistic judgements on students' performances, regardless of whether the grading criteria are clear and well-articulated on paper, should be acknowledged. Understanding the journey that these teachers made gives new perspectives as to how faculty can be supported when assessments of professionalism and clinical competency are developed.

Conceptualization of Competency-Based Medical Education Terminology in Family Medicine Postgraduate Medical Education and Continuing Professional Development: A Scoping Review

PURPOSE

To examine the extent, range, and nature of how competency-based medical education (CBME) implementation terminology is used (i.e., the conceptualization of CBME-related terms) within the family medicine postgraduate medical education (PGME) and continuing professional development (CPD) literature.

METHOD

This scoping review's methodology was based on Arksey and O'Malley's framework and subsequent recommendations by Tricco and colleagues. The authors searched 5 databases and the gray literature for U.S. and Canadian publications between January 2000 and April 2017. Full-text English-language articles on CBME implementation that focused exclusively on family medicine PGME and/or CPD programs were eligible for inclusion. A standardized data extraction form was used to collect article demographic data and coding concepts data. Data analysis used mixed methods, including quantitative frequency analysis and qualitative thematic analysis.

RESULTS

Of 470 unique articles identified, 80 (17%) met the inclusion criteria and were selected for inclusion in the review. Only 12 (15%) of the 80 articles provided a referenced definition of the coding concepts (i.e., referred to an article/organization as the definition's source), resulting in 19 highly variable-and 12 unique- referenced definitions of key terms used in CBME implementation (competence, competency, competency-based medical education). Thematic analysis of the referenced definitions identified 15 dominant themes, among which the most common were (1) a multidimensional and dynamic concept that encompasses a variety of skill components and (2) being able to use communication, knowledge, technical skills, clinical reasoning, judgment, emotions, attitudes, personal values, and reflection in practice.

CONCLUSIONS

The construction and dissemination of shared definitions is essential to CBME's successful implementation. The low number of referenced definitions and lack of consensus on such definitions suggest more attention needs to be paid to conceptual rigor. The authors recommend those involved in family medicine education work with colleagues across medical specialties to develop a common taxonomy.

Knowledge, skills and beetles: respecting the privacy of private experiences in medical education

In medical education, we assess knowledge, skills, and a third category usually called values or attitudes. While knowledge and skills can be assessed, this third category consists of 'beetles', after the philosopher Wittgenstein's beetle-in-a-box analogy. The analogy demonstrates that private experiences such as pain and hunger are inaccessible to the public, and that we cannot know whether we all experience them in the same way. In this paper, we claim that unlike knowledge and skills, private experiences of medical learners cannot be objectively measured, assessed, or directly accessed in any way. If we try to do this anyway, we risk reducing them to knowledge and skills-thereby making curriculum design choices based on what can be measured rather than what is valuable education, and rewarding zombie-like student behaviour rather than authentic development. We conclude that we should no longer use the model of representation to assess attitudes, emotions, empathy, and other beetles. This amounts to, first of all, shutting the door on objective assessment and investing in professional subjective assessment. Second, changing the way we define 'fuzzy concepts' in medical education, and stimulating conversations about ambiguous terms. Third, we should reframe the way we think of competences and realize only part of professional development lies within our control. Most importantly, we should stop attempting to measure the unmeasurable, as it might have negative consequences.

From prescription to guidance: a European framework for generic competencies

In postgraduate medical education, required competencies are described in detail in existing competency frameworks. This study proposes an alternative strategy for competency-based medical education design, which is supported by change management theories. We demonstrate the value of allowing room for re-invention and creative adaptation of innovations. This new strategy was explored for the development of a new generic competency framework for a harmonised European curriculum in Obstetrics and Gynaecology. The generic competency framework was developed through action research. Data were collected by four European stakeholder groups (patients, nurses, midwives and hospital boards), using a variety of methods. Subsequently, the data were analysed further in consensus discussions with European specialists and trainees in Obstetrics and Gynaecology. These discussions ensured that the framework provides guidance, is specialty-specific, and that implementation in all European countries could be feasible. The presented generic competency framework identifies four domains: 'Patient-centred care', 'Teamwork', 'System-based practice' and 'Personal and professional development'. For each of these four domains, guiding competencies were defined. The new generic competency framework is supported by European specialists and trainees in Obstetrics and Gynaecology, as well as by their European stakeholders. According to change management theories, it seems vital to allow room for re-invention and creative adaptation of the competency framework by medical professionals. Therefore, the generic competency framework offers guidance rather than prescription. The presented strategy for competency framework development offers leads for implementation of competency-based medical education as well as for development of innovations in postgraduate medical education in general.

Toward a shared language for competency-based medical education

The paradigm shift brought about by the advent of competency-based medical education (CBME) can be characterized as an adaptive change. Currently, its development and implementation suffer from the lack of a lingua franca. A shared language is needed to support collaboration and dissemination across the world community of medical educators. The International CBME Collaborators held a second summit in 2013 to explore this and other contemporary CBME issues. We present the resulting International CBME Collaborator's glossary of CBME terms. Particular attention is given to the terms competency, entrustable professional activity (EPA), and milestone and their interrelationships. Medical education scholars and enthusiasts of the competency-based approach are encouraged to adopt these terms and definitions, although no doubt the vocabulary of CBME will continue to evolve.

The Role of Generic Competencies in the Entrustment of Professional Activities: A Nationwide Competency-Based Curriculum Assessed

BACKGROUND

Entrustable professional activities (EPAs) seek to translate essential physician competencies into clinical practice. Until now, it is not known whether EPA-based curricula offer enhanced assessment and feedback to trainees.

OBJECTIVE

This study examined program directors' and senior residents' justifications for entrustment decisions and what role generic, cross-specialty competencies (such as communication skills, collaboration, and understanding health care systems) play in these decisions.

METHODS

Entrustment decisions for all Dutch obstetrics and gynecology residents between January 2010 and April 2014 were retrieved from their electronic portfolios. Justifications for entrustment were divided into 4 categories: the resident's experience, his or her technical performance, the presence of a generic competency, and training. Template analysis was used to analyze in depth the types of justifications, which play a role in entrustment decisions.

RESULTS

A total of 5139 entrustment decisions for 375 unique residents were extracted and analyzed. In 59% of all entrustment decisions, entrusting a professional task to a resident was justified by the experience of the resident. Generic competencies were mentioned in 0.5% of all entrustment decisions. Template analysis revealed that the amount of exposure and technical skills are leading factors, while the quality of the performance was not reported to be of any influence.

CONCLUSIONS

Entrustment decisions only rarely are based on generic competencies, despite the introduction of competency frameworks and EPAs. For program directors, a leading factor in entrustment decisions is a resident's exposure to an activity, and the quality of a resident's performance appears to play only a minor role.

Implementation of competency-based medical education: are we addressing the concerns and challenges?

CONTEXT

Competency-based medical education (CBME) has emerged as a core strategy to educate and assess the next generation of physicians. Advantages of CBME include: a focus on outcomes and learner achievement; requirements for multifaceted assessment that embraces formative and summative approaches; support of a flexible, time-independent trajectory through the curriculum; and increased accountability to stakeholders with a shared set of expectations and a common language for education, assessment and regulation.

OBJECTIVES

Despite the advantages of CBME, numerous concerns and challenges to the implementation of CBME frameworks have been described, including: increased administrative requirements; the need for faculty development; the lack of models for flexible curricula, and inconsistencies in terms and definitions. Additionally, there are concerns about reductionist approaches to assessment in CBME, lack of good assessments for some competencies, and whether CBME frameworks include domains of current importance. This study will outline these issues and discuss the responses of the medical education community.

METHODS

The concerns and challenges expressed are primarily categorised as: (i) those related to practical, administrative and logistical challenges in implementing CBME frameworks, and (ii) those with more conceptual or theoretical bases. The responses of the education community to these issues are then summarised.

CONCLUSIONS

The education community has begun to address the challenges involved in implementing CBME. Models and guidance exist to inform implementation strategies across the continuum of education, and focus on the more efficient use of resources and technology, and the use of milestones and entrustable professional activities-based frameworks. Inconsistencies in CBME definitions and frameworks remain a significant obstacle. Evolution in assessment approaches from in vitro task-based methods to in vivo integrated approaches is responsive to many of the theoretical and conceptual concerns about CBME, but much work remains to be done to bring rigour and quality to work-based assessment.

Outcome based education enacted: teachers' tensions in balancing between student learning and bureaucracy

This paper reports on how teachers within health sciences education translate outcome-based education (OBE) into practice when they design courses. The study is an empirical contribution to the debate about outcome- and competency-based approaches in health sciences education. A qualitative method was used to study how teachers from 14 different study programmes designed courses before and after OBE was implemented. Using an interpretative approach, analysis of documents and interviews was carried out. The findings show that teachers enacted OBE either to design for more competency-oriented teaching-learning, or to further detail knowledge and thus move towards reductionism. Teachers mainly understood the outcome-based framework as useful to support students' learning, although the demand for accountability created tension and became a bureaucratic hindrance to design for development of professional competence. The paper shows variations of how teachers enacted the same outcome-based framework for instructional design. These differences can add a richer understanding of how outcome- or competency-based approaches relate to teaching-learning at a course level.

The 'missing person' in roles-based competency models: a historical, cross-national, contrastive case study

CONTEXT

The use of roles such as medical expert, advocate or communicator to define competencies is currently popular in health professions education. CanMEDS is one framework that has been subject to great uptake across multiple countries and professions. The examination of the historical and cultural choices of names for roles generates insight into the nature and construction of roles. One role that has appeared in and disappeared from roles-based frameworks is that of the 'person'.

METHODS

In order to examine the implications of explicitly including or excluding the role of the 'physician as person' in a competency framework, we conducted a contrastive analysis of the development of frameworks in Canada and the Netherlands. We drew upon critical social science theoretical understandings of the power of language in our analysis.

RESULTS

In Canada, the 'person' role was a late addition to the precursory work that informed CanMEDS, and was then excluded from the final set of CanMEDS role names. In the Netherlands, a 'reflector' role was added in some Dutch schools and programmes when CanMEDS was adopted. This was done in order to explicitly emphasise the importance of the 'person' of the trainee.

CONCLUSIONS

In analysing choices of names for roles, we have the opportunity to see how cultural and historical contexts affect conceptions of the roles of doctors. The taking up and discarding of the 'person' role in Canada and the Netherlands suggest that as medical educators we may need to further consider the ways in which we wish the trainee as a person to be made visible in the curriculum and in assessment tools.