1
|
Kawaguchi S, Myers J, Li M, Kurahashi AM, Sirianni G, Siemens I. Entrustable Professional Activities in Palliative Medicine: A Faculty and Learner Development Activity. J Palliat Med 2024. [PMID: 39007218 DOI: 10.1089/jpm.2023.0682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/16/2024] Open
Abstract
Background: Faculty development (FD) is critical to the implementation of competency-based medical education (CBME) and yet evidence to guide the design of FD activities is limited. Our aim with this study was to describe and evaluate an FD activity as part of CBME implementation. Methods: Palliative medicine faculty were introduced to entrustable professional activities (EPAs) and gained experience estimating a learner's level of readiness for entrustment by directly observing a simulated encounter. The variation that was found among assessments was discussed in facilitated debrief sessions. Attitudes and confidence levels were measured 1 week and 6 months following debriefs. Results: Participants were able to use the EPA framework when estimating the learner's readiness level for entrustment. Significant improvements in attitudes and level of confidence for several knowledge, skill, and behavior domains were maintained over time. Conclusions: Simulated direct observation and facilitated debriefs contributed to preparing both faculty and learners for CBME and EPA implementation.
Collapse
Affiliation(s)
- Sarah Kawaguchi
- Division of Palliative Care, Division of Palliative Care, Department of Family and Community Medicine, Sinai Health System, University of Toronto, Toronto, Canada
| | - Jeff Myers
- Division of Palliative Care, Division of Palliative Care, Department of Family and Community Medicine, Sinai Health System, University of Toronto, Toronto, Canada
| | - Melissa Li
- Division of Palliative Care, Division of Palliative Care, Department of Family and Community Medicine, Toronto Western Hospital, University Health Network, University of Toronto, Toronto, Canada
| | - Allison M Kurahashi
- The Temmy Latner Centre for Palliative Care, Sinai Health System, Toronto, Canada
| | - Giovanna Sirianni
- Division of Palliative Care, Division of Palliative Care, Department of Family and Community Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Canada
| | - Isaac Siemens
- Division of Palliative Care, Division of Palliative Care, Department of Family and Community Medicine, Sinai Health System, University of Toronto, Toronto, Canada
| |
Collapse
|
2
|
Faiella W, Styles K. Navigating Competency-Based Cardiology Training: Challenges and Successes. Can J Cardiol 2024; 40:1347-1349. [PMID: 38211887 DOI: 10.1016/j.cjca.2024.01.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 12/17/2023] [Accepted: 01/07/2024] [Indexed: 01/13/2024] Open
Affiliation(s)
- Whitney Faiella
- Queen Elizabeth II Health Sciences Centre, Division of Cardiology, Dalhousie University, Halifax, Nova Scotia, Canada.
| | - Kim Styles
- Queen Elizabeth II Health Sciences Centre, Division of Cardiology, Dalhousie University, Halifax, Nova Scotia, Canada
| |
Collapse
|
3
|
Li M, Kurahashi AM, Kawaguchi S, Siemens I, Sirianni G, Myers J. When words are your scalpel, what and how information is exchanged may be differently salient to assessors. MEDICAL EDUCATION 2024. [PMID: 38850193 DOI: 10.1111/medu.15458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 05/12/2024] [Accepted: 05/24/2024] [Indexed: 06/10/2024]
Abstract
PURPOSE Variable assessments of learner performances can occur when different assessors determine different elements to be differently important or salient. How assessors determine the importance of performance elements has historically been thought to occur idiosyncratically and thus be amenable to assessor training interventions. More recently, a main source of variation found among assessors was two underlying factors that were differently emphasised: medical expertise and interpersonal skills. This gave legitimacy to the theory that different interpretations of the same performance may represent multiple truths. A faculty development activity introducing assessors to entrustable professional activities in which they estimated a learner's level of readiness for entrustment provided an opportunity to qualitatively explore assessor variation in the context of an interaction and in a setting in which interpersonal skills are highly valued. METHODS Using a constructivist grounded theory approach, we explored variation in assessment processes among a group of palliative medicine assessors who completed a simulated direct observation and assessment of the same learner interaction. RESULTS Despite identifying similar learner strengths and areas for improvement, the estimated level of readiness for entrustment varied substantially among assessors. Those who estimated the learner as not yet ready for entrustment seemed to prioritise what information was exchanged and viewed missed information as performance gaps. Those who estimated the learner as ready for entrustment seemed to prioritise how information was exchanged and viewed the same missed information as personal style differences or appropriate clinical judgement. When presented with a summary, assessors expressed surprise and concern about the variation. CONCLUSION A main source of variation among our assessors was the differential salience of performance elements that align with medical expertise and interpersonal skills. These data support the theory that when assessing an interaction, differential salience for these two factors may be an important and perhaps inevitable source of assessor variation.
Collapse
Affiliation(s)
- Melissa Li
- Division of Palliative Care, Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| | | | - Sarah Kawaguchi
- Division of Palliative Care, Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Isaac Siemens
- Division of Palliative Care, Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Giovanna Sirianni
- Division of Palliative Care, Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Jeff Myers
- Division of Palliative Care, Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| |
Collapse
|
4
|
Birman NA, Vashdi DR, Miller-Mor Atias R, Riskin A, Zangen S, Litmanovitz I, Sagi D. Unveiling the paradoxes of implementing post graduate competency based medical education programs. MEDICAL TEACHER 2024:1-8. [PMID: 38803298 DOI: 10.1080/0142159x.2024.2356826] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Accepted: 05/14/2024] [Indexed: 05/29/2024]
Abstract
PURPOSE Competency-based medical education (CBME) has gained prominence as an innovative model for post-graduate medical education, yet its implementation poses significant challenges, especially with regard to its sustainability. Drawing on paradox theory, we suggest that revealing the paradoxes underlying these challenges may contribute to our understanding of post graduate competency-based medical education (PGCBME) implementation processes and serve as a first-step in enhancing better implementation. Thus, the purpose of the current study is to identify the paradoxes associated with PGCBME implementation. METHOD A qualitative study was conducted, as part of a larger action research, using in-depth semi-structured interviews with fellows and educators in eight Neonatal wards. RESULTS Analysis revealed that the PGCBME program examined in this study involves three different levels of standardization, each serving as one side of paradoxical tensions; (1) a paradox between the need for standardized assessment tools and for free-flow flexible assessment tools, (2) a paradox between the need for a standardized implementation process across all wards and the need for unique implementation protocols in each ward; and 3) a paradox between the need for a standardized meaning of competency proficiency and the need for flexible and personal competency achievement indicators. CONCLUSIONS Implementing PGCBME programs involves many challenges, some of which are paradoxical, i.e. two contradictory challenges in which solving one challenge exacerbates another. Revealing these paradoxes is important in navigating them successfully.
Collapse
Affiliation(s)
- Noa A Birman
- University of Haifa, The Herta and Paul Amir Faculty of Social Sciences, School of Political Science, Department of Public Administration, Haifa, Israel
| | - Dana R Vashdi
- University of Haifa, The Herta and Paul Amir Faculty of Social Sciences, School of Political Science, Department of Public Administration, Haifa, Israel
| | - Rotem Miller-Mor Atias
- University of Haifa, The Herta and Paul Amir Faculty of Social Sciences, School of Political Science, Department of Public Administration, Haifa, Israel
| | - Arieh Riskin
- Technion Israel Institute of Technology, The Ruth and Bruce Rappaport Faculty of Medicine, Haifa, Israel
| | - Shmuel Zangen
- Ben- Gurion University of the Negev, Faculty of Health Sciences, Be'er-Sheva, Israel
| | - Ita Litmanovitz
- Tel Aviv University, Faculty of Medicine & Health Sciences, Tel-Aviv, Israel
| | - Doron Sagi
- The Israel Center for Medical Simulation, Sheba Medical Center, Tel-Hashomer, Ramat-Gan, Israel
| |
Collapse
|
5
|
Braund H, Dalgarno N, O’Dell R, Taylor DR. Making assessment a team sport: a qualitative study of facilitated group feedback in internal medicine residency. CANADIAN MEDICAL EDUCATION JOURNAL 2024; 15:14-26. [PMID: 38827914 PMCID: PMC11139793 DOI: 10.36834/cmej.75250] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/05/2024]
Abstract
Purpose Competency-based medical education relies on feedback from workplace-based assessment (WBA) to direct learning. Unfortunately, WBAs often lack rich narrative feedback and show bias towards Medical Expert aspects of care. Building on research examining interactive assessment approaches, the Queen's University Internal Medicine residency program introduced a facilitated, team-based assessment initiative ("Feedback Fridays") in July 2017, aimed at improving holistic assessment of resident performance on the inpatient medicine teaching units. In this study, we aim to explore how Feedback Fridays contributed to formative assessment of Internal Medicine residents within our current model of competency-based training. Method A total of 53 residents participated in facilitated, biweekly group assessment sessions during the 2017 and 2018 academic year. Each session was a 30-minute facilitated assessment discussion done with one inpatient team, which included medical students, residents, and their supervising attending. Feedback from the discussion was collected, summarized, and documented in narrative form in electronic WBA forms by the program's assessment officer for the residents. For research purposes, verbatim transcripts of feedback sessions were analyzed thematically. Results The researchers identified four major themes for feedback: communication, intra- and inter-personal awareness, leadership and teamwork, and learning opportunities. Although feedback related to a broad range of activities, it showed strong emphasis on competencies within the intrinsic CanMEDS roles. Additionally, a clear formative focus in the feedback was another important finding. Conclusions The introduction of facilitated team-based assessment in the Queen's Internal Medicine program filled an important gap in WBA by providing learners with detailed feedback across all CanMEDS roles and by providing constructive recommendations for identified areas for improvement.
Collapse
Affiliation(s)
- Heather Braund
- Office of Professional Development and Educational Scholarship, Ontario, Canada
- Faculty of Education, Queen’s University, Ontario, Canada
| | - Nancy Dalgarno
- Office of Professional Development and Educational Scholarship, Ontario, Canada
- Department of Biomedical and Molecular Sciences, Faculty of Health Sciences, Queen’s University, Ontario, Canada
| | - Rachel O’Dell
- Department of Internal Medicine, Faculty of Health Sciences, Queen’s University, Ontario, Canada
| | - David R Taylor
- Academy for Teachers and Educators, Department of Medicine, Queen’s University, Ontario, Canada
| |
Collapse
|
6
|
Atkinson AR, Abbott C, Oswald A, Boucher A, Cavalcanti RB, Frank JR, Snell LS. Strategies to Enable Transformation in Medical Education: Faculty and Trainee Development in Competence By Design. PERSPECTIVES ON MEDICAL EDUCATION 2024; 13:85-94. [PMID: 38343557 PMCID: PMC10854465 DOI: 10.5334/pme.960] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 09/29/2023] [Indexed: 02/15/2024]
Abstract
Transformative changes in health professions education need to incorporate effective faculty development, but few very large-scale faculty development designs have been described. The Royal College of Physicians and Surgeons of Canada's Competence by Design project was launched to transform the delivery of postgraduate medical education in Canada using a competency-based model. In this paper we outline the goals, principles, and rationale of the Royal College's national strategy for faculty and resident development initiatives to support the implementation of Competence by Design. We describe the activities and resources for both faculty and trainees that facilitated the redesign of training programs for each specialty and subspecialty at the national level, as well as supporting the implementation of the redesign at the local level. This undertaking was not without its challenges: we thus reflect on those challenges, enablers, and the lessons learned, and discuss a continuous quality improvement approach that was taken to iteratively inform the implementation process moving forward.
Collapse
Affiliation(s)
- Adelle R. Atkinson
- System of Specialties, Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
| | - Cynthia Abbott
- Division of Rheumatology, Department of Medicine, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Anna Oswald
- Competency Based Medical Education, University of Alberta, Edmonton, AB, Canada
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
| | - Andree Boucher
- Department of Medicine (Division of endocrinology), Université de Montréal, Montréal, QC, Canada
| | - Rodrigo B. Cavalcanti
- Department of Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- The HoPingKong Centre, University Health, Network, Toronto, ON, Canada
| | - Jason R. Frank
- Department of Emergency Medicine, and Director, Centre for Innovation in Medical Education Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Linda S. Snell
- Royal College of Physicians and Surgeons of Canada, Ottawa, ON, Canada
- Medicine and Health Sciences Education, Institute of Health Sciences Education and Department of Medicine,McGill University, Montreal, QC, Canada
| |
Collapse
|
7
|
Scheepers RA, Boxem AJ, Blezer MMJ. Junior doctors receiving supervisor and peer support are more work-engaged professionals who express their voice for quality improvement. MEDICAL TEACHER 2024; 46:204-210. [PMID: 37506220 DOI: 10.1080/0142159x.2023.2240000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2023]
Abstract
PURPOSE In daily practice, junior doctors can contribute to quality improvement by providing innovative suggestions for change, referred to as voice behavior. Junior doctors are more likely to engage in voice behavior when they receive sufficient support from supervisors and peers. Such support has also been associated with less burnout and more work engagement. However, whether less burned-out and more work-engaged junior doctors demonstrate more voice behaviors in the face of sufficient supervisor and peer support is unclear. Therefore, we studied whether and how associations of supervisor and peer support with junior doctors' voice behaviors are mediated by burnout and work engagement. MATERIALS & METHODS Participants were 301 junior doctors that completed a web-based survey including validated questionnaires on supervisor and peer support, burnout, work engagement, and voice behavior. RESULTS Supervisor and peer support were associated with lower levels of burnout and higher levels of work engagement. Work engagement, but not burnout, mediated the associations of supervisor and peer support with voice behaviors. CONCLUSIONS Junior doctors who received more supervisor or peer support were more work-engaged and reported more voice behaviors. Thus, supervisor and peer support should be cultivated to facilitate junior doctors' roles as work-engaged professionals in quality improvement.
Collapse
Affiliation(s)
- Renée A Scheepers
- Department of Socio-Medical Sciences, Erasmus School of Health Policy and Management, Erasmus University of Rotterdam, The Netherlands
| | - Aline J Boxem
- Department of Pediatrics and the Generation R Study Group (Na-29), Erasmus Medical Center, University Medical Center, Rotterdam, The Netherlands
| | - Meike M J Blezer
- Foundation of the Young Doctor, Utrecht, The Netherlands
- Department of General Practice, Intellectual Disability Medicine of the Erasmus Medical Center, Rotterdam, The Netherlands
| |
Collapse
|
8
|
Van Ostaeyen S, De Langhe L, De Clercq O, Embo M, Schellens T, Valcke M. Automating the Identification of Feedback Quality Criteria and the CanMEDS Roles in Written Feedback Comments Using Natural Language Processing. PERSPECTIVES ON MEDICAL EDUCATION 2023; 12:540-549. [PMID: 38144670 PMCID: PMC10742245 DOI: 10.5334/pme.1056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2023] [Accepted: 10/03/2023] [Indexed: 12/26/2023]
Abstract
Introduction Manually analysing the quality of large amounts of written feedback comments is time-consuming and demands extensive resources and human effort. Therefore, this study aimed to explore whether a state-of-the-art large language model (LLM) could be fine-tuned to identify the presence of four literature-derived feedback quality criteria (performance, judgment, elaboration and improvement) and the seven CanMEDS roles (Medical Expert, Communicator, Collaborator, Leader, Health Advocate, Scholar and Professional) in written feedback comments. Methods A set of 2,349 labelled feedback comments of five healthcare educational programs in Flanders (Belgium) (specialistic medicine, general practice, midwifery, speech therapy and occupational therapy) was split into 12,452 sentences to create two datasets for the machine learning analysis. The Dutch BERT models BERTje and RobBERT were used to train four multiclass-multilabel classification models: two to identify the four feedback quality criteria and two to identify the seven CanMEDS roles. Results The classification models trained with BERTje and RobBERT to predict the presence of the four feedback quality criteria attained macro average F1-scores of 0.73 and 0.76, respectively. The F1-score of the model predicting the presence of the CanMEDS roles trained with BERTje was 0.71 and 0.72 with RobBERT. Discussion The results showed that a state-of-the-art LLM is able to identify the presence of the four feedback quality criteria and the CanMEDS roles in written feedback comments. This implies that the quality analysis of written feedback comments can be automated using an LLM, leading to savings of time and resources.
Collapse
Affiliation(s)
| | - Loic De Langhe
- Language and Translation Technology Team at Ghent University, Belgium
| | - Orphée De Clercq
- Language and Translation Technology Team at Ghent University, Belgium
| | - Mieke Embo
- Department of Educational Sciences at Ghent University and in the Expertise Network Health and Care at the Artevelde University of Applied Sciences, Belgium
| | - Tammy Schellens
- Department of Educational Sciences at Ghent University, Belgium
| | - Martin Valcke
- Department of Educational Sciences at Ghent University, Belgium
| |
Collapse
|
9
|
Schultz KW, Kolomitro K, Koppula S, Bethune CH. Competency-based faculty development: applying transformations from lessons learned in competency-based medical education. CANADIAN MEDICAL EDUCATION JOURNAL 2023; 14:95-102. [PMID: 38045069 PMCID: PMC10689999 DOI: 10.36834/cmej.75768] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/05/2023]
Abstract
Faculty development in medical education is often delivered in an ad hoc manner instead of being a deliberately sequenced program matched to data-informed individual needs. In this article, the authors, all with extensive experience in Faculty Development (FD), present a competency-based faculty development (CBFD) framework envisioned to enhance the impact of FD. Steps and principles in the CBFD framework reflect the lessons learned from competency-based medical education (CBME) with its foundational goal to better train physicians to meet societal needs. The authors see CBFD as a similar framework, this one to better train faculty to meet educational needs. CBFD core elements include articulated competencies for the varied educational roles faculty fulfill, deliberately designed curricula structured to build those competencies, and an assessment program and process to support individualized faculty learning and professional growth. The framework incorporates ideas about where and how CBFD should be delivered, the use of coaching to promote reflection and identity formation and the creation of communities of learning. As with CBME, the CBFD framework has included the important considerations of change management, including broad stakeholder engagement, continuous quality improvement and scholarship. The authors have provided examples from the literature as well as challenges and considerations for each step.
Collapse
Affiliation(s)
| | | | - Sudha Koppula
- Department of Family Medicine, University of Alberta, Edmonton, Alberta
| | - Cheri H Bethune
- Northern Ontario School of Medicine, Ontario, Canada
- College of Family Physicians of Canada, Ontario, Canada
| |
Collapse
|
10
|
Hauer KE, Park YS, Bullock JL, Tekian A. "My Assessments Are Biased!" Measurement and Sociocultural Approaches to Achieve Fairness in Assessment in Medical Education. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2023; 98:S16-S27. [PMID: 37094278 DOI: 10.1097/acm.0000000000005245] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Assessing learners is foundational to their training and developmental growth throughout the medical education continuum. However, growing evidence shows the prevalence and impact of harmful bias in assessments in medical education, accelerating the urgency to identify solutions. Assessment bias presents a critical problem for all stages of learning and the broader educational system. Bias poses significant challenges to learners, disrupts the learning environment, and threatens the pathway and transition of learners into health professionals. While the topic of assessment bias has been examined within the context of measurement literature, limited guidance and solutions exist for learners in medical education, particularly in the clinical environment. This article presents an overview of assessment bias, focusing on clinical learners. A definition of bias and its manifestations in assessments are presented. Consequences of assessment bias are discussed within the contexts of validity and fairness and their impact on learners, patients/caregivers, and the broader field of medicine. Messick's unified validity framework is used to contextualize assessment bias; in addition, perspectives from sociocultural contexts are incorporated into the discussion to elaborate the nuanced implications in the clinical training environment. Discussions of these topics are conceptualized within the literature and the interventions used to date. The article concludes with practical recommendations to overcome bias and to develop an ideal assessment system. Recommendations address articulating values to guide assessment, designing assessment to foster learning and outcomes, attending to assessment procedures, promoting continuous quality improvement of assessment, and fostering equitable learning and assessment environments.
Collapse
Affiliation(s)
- Karen E Hauer
- K.E. Hauer is associate dean for competency assessment and professional standards, and professor, Department of Medicine, University of California, San Francisco School of Medicine, San Francisco, California; ORCID: http://orcid.org/0000-0002-8812-4045
| | - Yoon Soo Park
- Y.S. Park is associate professor and associate head, Department of Medical Education, University of Illinois at Chicago College of Medicine, Chicago, Illinois; ORCID: http://orcid.org/0000-0001-8583-4335
| | - Justin L Bullock
- J.L. Bullock is a fellow, Department of Medicine, Division of Nephrology, University of Washington School of Medicine, Seattle, Washington; ORCID: http://orcid.org/0000-0003-4240-9798
| | - Ara Tekian
- A. Tekian is professor and associate dean for international education, Department of Medical Education, University of Illinois at Chicago College of Medicine, Chicago, Illinois; ORCID: http://orcid.org/0000-0002-9252-1588
| |
Collapse
|
11
|
Bentley H, Darras KE, Forster BB, Probyn L, Sedlic A, Hague CJ. Knowledge and Perceptions of Competency-Based Medical Education in Diagnostic Radiology Post-Graduate Medical Education: Identifying Priorities and Developing a Framework for Professional Development Activities. Can Assoc Radiol J 2023; 74:487-496. [PMID: 36384331 DOI: 10.1177/08465371221137087] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/23/2023] Open
Abstract
Introduction: We evaluated knowledge and perceptions of an established Competency-Based Medical Education (CBME) model developed by the Royal College of Physicians and Surgeons of Canada, Competence by Design (CBD), and identified evidence-informed priorities for professional development activities (PDAs). Materials and Methods: Teaching faculty and residents at a single, large diagnostic radiology post-graduate medical education (PGME) program were eligible to participate in this cross-sectional, survey-based study. Knowledge of CBD was evaluated through multiple choice questions (MCQs), which assessed participants' understanding of major principles and terms associated with CBD. Participants' perceptions of the anticipated impact of CBD on resident education and patient care were evaluated and priorities for PDAs were identified, which informed a framework for CBD PDAs. Results: Fifty faculty and residents participated. The faculty and resident response rates were 11.6% (n = 29/249) and 55.3% (n = 21/38), respectively. The mean ± standard deviation overall score on MCQs was 39.0% ± 20.4%. The majority of participants perceived the impact of CBD on resident education to be equivocal and to not impact patient care. Knowledge of CBD was not statistically significantly associated with participants' perceptions of the impact of CBD on either resident education or patient care (P > .05). Delivery of high-quality feedback was the greatest priority identified for PDAs. Discussion: Our results and proposed CBD PDAs framework may help to guide diagnostic radiology PGME programs in designing evidence-informed PDAs, which may meaningfully contribute to the successful implementation of CBD in diagnostic radiology PGME. As diagnostic radiology PGME programs throughout the world increasingly implement CBME models, evidence-informed PDAs will become of increasing importance.
Collapse
Affiliation(s)
- Helena Bentley
- Department of Radiology, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Kathryn E Darras
- Department of Radiology, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
- Department of Radiology, Vancouver General Hospital, Vancouver, BC, Canada
| | - Bruce B Forster
- Department of Radiology, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
- Department of Radiology, Vancouver General Hospital, Vancouver, BC, Canada
| | - Linda Probyn
- Department of Medical Imaging, Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Anto Sedlic
- Department of Radiology, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
- Department of Radiology, Vancouver General Hospital, Vancouver, BC, Canada
| | - Cameron J Hague
- Department of Radiology, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
- Department of Radiology, St Paul's Hospital, Vancouver, BC, Canada
| |
Collapse
|
12
|
Giddens JF, Mullaney S. Incorporating the AACN Essentials 'spheres of care' into nursing curricula. J Prof Nurs 2023; 47:9-14. [PMID: 37295918 DOI: 10.1016/j.profnurs.2023.03.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 03/23/2023] [Accepted: 03/25/2023] [Indexed: 06/12/2023]
Abstract
In 2021 the American Association of Colleges of Nursing (AACN) published new education standards for nursing programs offering degrees at the baccalaureate-level and higher. The new standards, The Essentials: Core Competencies for Professional Nursing Education (AACN, 2021), represent an educational shift and an opportunity to transform the nursing profession through a better-prepared workforce. One important new standard that must be incorporated for entry-level (Level 1) programs is preparation for practice within four spheres of care. This article will provide clarity and context to the concept of "spheres of care" with suggestions regarding ways to incorporate this educational expectation within the curriculum.
Collapse
Affiliation(s)
- Jean Foret Giddens
- Virginia Commonwealth University School of Nursing, United States of America.
| | - Susan Mullaney
- Center for Clinician Advancement United Health Group, United States of America
| |
Collapse
|
13
|
Yilmaz Y, Chan MK, Richardson D, Atkinson A, Bassilious E, Snell L, Chan TM. Defining new roles and competencies for administrative staff and faculty in the age of competency-based medical education. MEDICAL TEACHER 2023; 45:395-403. [PMID: 36471921 DOI: 10.1080/0142159x.2022.2136517] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
PURPOSE These authors sought to define the new roles and competencies required of administrative staff and faculty in the age of CBME. METHOD A modified Delphi process was used to define the new CBME roles and competencies needed by faculty and administrative staff. We invited international experts in CBME (volunteers from the ICBME Collaborative email list), as well as faculty members and trainees identified via social media to help us determine the new competencies required of faculty and administrative staff in the CBME era. RESULTS Thirteen new roles were identified. The faculty-specific roles were: National Leader/Facilitator in CBME; Institutional/University lead for CBME; Assessment Process & Systems Designer; Local CBME Leads; CBME-specific Faculty Developers or Trainers; Competence Committee Chair; Competence Committee Faculty Member; Faculty Academic Coach/Advisor or Support Person; Frontline Assessor; Frontline Coach. The staff-specific roles were: Information Technology Lead; CBME Analytics/Data Support; Competence Committee Administrative Assistant. CONCLUSIONS The authors present a new set of faculty and staff roles that are relevant to the CBME context. While some of these new roles may be incorporated into existing roles, it may be prudent to examine how best to ensure that all of them are supported within all CBME contexts in some manner.
Collapse
Affiliation(s)
- Yusuf Yilmaz
- McMaster Education Research, Innovation, and Theory (MERIT), and Office of Continuing Professional Development, Faculty of Health Sciences, McMaster University, Hamilton, Canada
- Department of Medical Education, Faculty of Medicine, Ege University, Izmir, Turkey
| | - Ming-Ka Chan
- Department of Pediatrics and Child Health, University of Manitoba, Winnipeg, Canada
| | - Denyse Richardson
- Department of Medicine, Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
| | - Adelle Atkinson
- Department of Pediatrics, University of Toronto, Toronto, Canada
| | - Ereny Bassilious
- Department of Pediatrics, Faculty of Health Sciences, McMaster University, Hamilton, Canada
| | - Linda Snell
- Medicine and Health Sciences Education, Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada
| | - Teresa M Chan
- McMaster Education Research, Innovation, and Theory (MERIT), and Office of Continuing Professional Development, Faculty of Health Sciences, McMaster University, Hamilton, Canada
- Divisions of Emergency Medicine, Department of Medicine, McMaster University, Hamilton, Canada
| |
Collapse
|
14
|
Gagnon N, Bernier C, Houde S. How best can faculty development support teachers in clinical settings? Br J Hosp Med (Lond) 2022; 83:1-8. [DOI: 10.12968/hmed.2021.0671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Faculty development is key to ensuring quality clinical teaching, but standardising teaching practices in multiple settings is a challenge. This article presents an example of a 3-year faculty development programme for teaching clinical reasoning skills, implemented by the Faculty of Medicine and Health Sciences, University of Sherbrooke, Quebec, Canada for its faculty members at multiple teaching sites. A follow-up study 1–5 months after the final workshop, using a self-assessment questionnaire, indicates that almost half of the participants transferred some of their newly acquired knowledge into their teaching practices. This article discusses factors to consider when developing a faculty development culture, at both a programme and faculty level, to support quality teaching and learning.
Collapse
Affiliation(s)
- Nathalie Gagnon
- Department of Family Medicine and Emergency Medicine, Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, Québec, Canada
| | - Carolle Bernier
- Department of Family Medicine and Emergency Medicine, Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, Québec, Canada
| | - Sylvie Houde
- Centre de Pédagogie des Sciences de la Santé, Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, Québec, Canada
| |
Collapse
|
15
|
The Revised AACN Essentials: Implications for Nursing Regulation. JOURNAL OF NURSING REGULATION 2022. [DOI: 10.1016/s2155-8256(22)00009-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
16
|
The effect of gender dyads on the quality of narrative assessments of general surgery trainees. Am J Surg 2021; 224:179-184. [PMID: 34911639 DOI: 10.1016/j.amjsurg.2021.12.001] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Revised: 11/30/2021] [Accepted: 12/01/2021] [Indexed: 01/13/2023]
Abstract
BACKGROUND Prior studies have shown that gender can influence how learners are assessed and the feedback they receive. We investigated the quality of faculty narrative comments in general surgery trainee evaluation using trainee-assessor gender dyads. METHODS Narrative assessments of surgical trainees at the University of British Columbia were collected and rated using the McMaster Narrative Comment Rating Scale (MNCRS). Variables from the MNCRS were inputted into a generalized linear mixed model to explore the impact of gender dyads on the quality of narrative feedback. RESULTS 2,469 assessments were collected. Women assessors tended to give higher-quality comments (p's < 0.05) than men assessors. Comments from men assessors to women trainees were significantly more positive than comments from men assessors to men trainees (p = 0.02). Men assessors also tended to give women trainees more reinforcing than corrective comments than to men trainees (p < 0.01). CONCLUSIONS There are significant differences in the quality of faculty feedback to trainees by gender dyads. A range of solutions to improve and reduce differences in feedback quality are discussed.
Collapse
|
17
|
Van Melle E, Hall AK, Schumacher DJ, Kinnear B, Gruppen L, Thoma B, Caretta-Weyer H, Cooke LJ, Frank JR. Capturing outcomes of competency-based medical education: The call and the challenge. MEDICAL TEACHER 2021; 43:794-800. [PMID: 34121596 DOI: 10.1080/0142159x.2021.1925640] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
There is an urgent need to capture the outcomes of the ongoing global implementation of competency-based medical education (CBME). However, the measurement of downstream outcomes following educational innovations, such as CBME is fraught with challenges stemming from the complexities of medical training, the breadth and variability of inputs, and the difficulties attributing outcomes to specific educational elements. In this article, we present a logic model for CBME to conceptualize an impact pathway relating to CBME and facilitate outcomes evaluation. We further identify six strategies to mitigate the challenges of outcomes measurement: (1) clearly identify the outcome of interest, (2) distinguish between outputs and outcomes, (3) carefully consider attribution versus contribution, (4) connect outcomes to the fidelity and integrity of implementation, (5) pay attention to unanticipated outcomes, and (6) embrace methodological pluralism. Embracing these challenges, we argue that careful and thoughtful evaluation strategies will move us forward in answering the all-important question: Are the desired outcomes of CBME being achieved?
Collapse
Affiliation(s)
- Elaine Van Melle
- Royal College of Physicians and Surgeons of Canada, Ottawa, Canada
- Department of Family Medicine, Queen's University, Kingston, Canada
| | - Andrew K Hall
- Royal College of Physicians and Surgeons of Canada, Ottawa, Canada
- Department of Emergency Medicine, Queen's University, Kingston,Canada
| | - Daniel J Schumacher
- Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Benjamin Kinnear
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Larry Gruppen
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, MI, USA
| | - Brent Thoma
- Royal College of Physicians and Surgeons of Canada, Ottawa, Canada
- Department of Emergency Medicine, University of Saskatchewan, Saskatoon, Canada
| | - Holly Caretta-Weyer
- Department of Emergency Medicine, Stanford University School of Medicine, Palo Alto, CA, USA
| | - Lara J Cooke
- Royal College of Physicians and Surgeons of Canada, Ottawa, Canada
- Department of Clinical Neurosciences, Division of Neurology, Cumming School of Medicine, University of Calgary, Calgary, Canada
| | - Jason R Frank
- Royal College of Physicians and Surgeons of Canada, Ottawa, Canada
- Department of Emergency Medicine, University of Ottawa, Ottawa, Canada
| |
Collapse
|