1
|
Plewa MC, Ledrick DJ, Jenkins K, Orqvist A, McCrea M. Can USMLE and COMLEX-USA Scores Predict At-Risk Emergency Medicine Residents' Performance on In-Training Examinations? Cureus 2024; 16:e58684. [PMID: 38651085 PMCID: PMC11033967 DOI: 10.7759/cureus.58684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/21/2024] [Indexed: 04/25/2024] Open
Abstract
PURPOSE The United States Medical Licensing Examination (USMLE) and Comprehensive Osteopathic Medical Licensing Examination (COMLEX) scores are standard methods used to determine residency candidates' medical knowledge. The authors were interested in using the USMLE and COMLEX part 2 scores in our emergency medicine (EM) residency program to identify at-risk residents who may have difficulty on the in-training exam (ITE) and to determine the cutoff values under which an intern could be given an individualized study plan to ensure medical knowledge competency. METHODS The authors abstracted the USMLE and COMLEX part 2 scores and the American Board of Emergency Medicine (ABEM) ITE scores for a cohort of first-year EM residents graduating years 2010-2022, converting raw scores to percentiles, and compared part 2 and ABEM ITE scores with Pearson's correlation, a Bland-Altman analysis of bias and 95% limits of agreement, and ROC analysis to determine optimal the cut-off values for predicting ABEM ITE < 50th percentile and the estimated test characteristics. RESULTS Scores were available for 152 residents, including 93 USMLE and 88 COMLEX exams. The correlations between part 2 scores and ABEM ITE were r = 0.36 (95%CI: 0.17, 0.52; p < 0.001) for USMLE and r = 0.50 (95%CI: 0.33, 0.64; p < 0.001) for COMLEX. Bias and limits of agreement for both part 2 scores were -14 ± 63% for USMLE and 13 ± 50% for COMLEX in predicting the ABEM ITE scores. USMLE < 37th percentile and COMLEX < 53rd percentile identified 42% (N = 39) and 27% (N = 24) of EM residents, respectively, as at risk, with a sensitivity of 61% and 49% and specificity of 71% and 92%, respectively. CONCLUSION USMLE and COMLEX part 2 scores have a very limited role in identifying those at risk of low ITE performance, suggesting that other factors should be considered to identify interns in need of medical knowledge remediation.
Collapse
Affiliation(s)
- Michael C Plewa
- Emergency Medicine, Mercy Health - St. Vincent Medical Center, Toledo, USA
| | - David J Ledrick
- Emergency Medicine, Mercy Health - St. Vincent Medical Center, Toledo, USA
| | - Kenneth Jenkins
- Emergency Medicine, Ohio University Heritage College of Osteopathic Medicine, Athens, USA
| | - Aaron Orqvist
- Emergency Medicine, Mercy Health - St. Vincent Medical Center, Toledo, USA
| | - Michael McCrea
- Emergency Medicine, Mercy Health - St. Vincent Medical Center, Toledo, USA
| |
Collapse
|
2
|
Shaker L, Amilcar C, Kothari N, Murano T. KNOWLEDGE, ATTITUDES AND PERCEPTIONS OF REMEDIATION AMONG TRAINEES IN GRADUATE MEDICAL EDUCATION PROGRAMS. J Emerg Med 2023; 65:e41-e49. [PMID: 37355420 DOI: 10.1016/j.jemermed.2023.04.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 02/06/2023] [Accepted: 04/10/2023] [Indexed: 06/26/2023]
Abstract
BACKGROUND Remediation of medical trainees is a universal challenge, yet studies show that many residents will need remediation to improve performance. Current literature discusses the importance and processes of remediation and investigates how to recognize residents needing remediation. However, little is known about trainees' attitudes and perception of remediation. OBJECTIVES To assess trainees' knowledge of remediation as well as their attitudes and perceptions toward remediation and its process. We hypothesized that trainees have limited knowledge and a negative perception of remediation. METHODS A cross-sectional anonymous electronic survey was sent to all graduate medical education trainees at a single institution. RESULTS The survey was completed by 132/1095 (12.1%) trainees. Of the respondents, 7.6% were not familiar with the term "remediation." Trainees' knowledge of remediation processes was variable, and they reported overwhelmingly negative thoughts and attitudes toward remediation. Shame was felt by 97/132 (73.5%), 71/132 (53.8%) felt disadvantaged, and 121/132 (91.7%) viewed the term "remediation" negatively. Most trainees felt using a more positive term would improve perceptions, and 124/132 (93.9%) felt residents should be involved in creating individualized remediation plans. Open-ended responses on reactions to being placed on remediation included disappointment, shame, incompetency, anxiety and worry, embarrassment, unhappiness, suicidality, worthlessness, sense of failure, and doubting one's capabilities as a physician. CONCLUSION Trainees have limited knowledge and understanding of remediation and strong negative perceptions and attitudes toward the remediation process. Trainees suggested that reframing of remediation using more positive terminology and including residents in creating individualized plans, may improve attitudes and perceptions of this process.
Collapse
Affiliation(s)
- Lana Shaker
- Hackensack University Medical Center, Hackensack, New Jersey
| | - Cindy Amilcar
- Department of Emergency Medicine, University of Texas Health-McGovern Medical School, Houston, Texas
| | - Neil Kothari
- Office of Graduate Medical Education, Rutgers New Jersey Medical School, Newark, New Jersey
| | - Tiffany Murano
- Department of Emergency Medicine, Columbia University Vagelos College of Physicians and Surgeons, New York, New York
| |
Collapse
|
3
|
Hauer KE, Williams PM, Byerley JS, Swails JL, Barone MA. Blue Skies With Clouds: Envisioning the Future Ideal State and Identifying Ongoing Tensions in the UME-GME Transition. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2023; 98:162-170. [PMID: 35947473 DOI: 10.1097/acm.0000000000004920] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The transition from medical school to residency in the United States consumes large amounts of time for students and educators in undergraduate and graduate medical education (UME, GME), and it is costly for both students and institutions. Attempts to improve the residency application and Match processes have been insufficient to counteract the very large number of applications to programs. To address these challenges, the Coalition for Physician Accountability charged the Undergraduate Medical Education to Graduate Medical Education Review Committee (UGRC) with crafting recommendations to improve the system for the UME-GME transition. To guide this work, the UGRC defined and sought stakeholder input on a "blue-skies" ideal state of this transition. The ideal state views the transition as a system to support a continuum of professional development and learning, thus serving learners, educators, and the public, and engendering trust among them. It also supports the well-being of learners and educators, promotes diversity, and minimizes bias. This manuscript uses polarity thinking to analyze 3 persistent key tensions in the system that require ongoing management. First, the formative purpose of assessment for learning and growth is at odds with the use of assessment data for ranking and sorting candidates. Second, the function of residents as learners can conflict with their role as workers contributing service to health care systems. Third, the current residency Match process can position the desire for individual choice-among students and their programs-against the workforce needs of the profession and the public. This Scholarly Perspective presents strategies to balance the upsides and downsides inherent to these tensions. By articulating the ideal state of the UME-GME transition and anticipating tensions, educators and educational organizations can be better positioned to implement UGRC recommendations to improve the transition system.
Collapse
Affiliation(s)
- Karen E Hauer
- K.E. Hauer is associate dean for competency assessment and professional standards and professor, Department of Medicine, University of California, San Francisco School of Medicine, San Francisco, California; ORCID: http://orcid.org/0000-0002-8812-4045
| | - Pamela M Williams
- P.M. Williams is associate dean for student affairs and professor, Department of Family Medicine, Uniformed Services University of the Health Sciences, F. Edward Hébert School of Medicine, Bethesda, Maryland
| | - Julie S Byerley
- J.S. Byerley was interim dean, University of North Carolina Adams School of Dentistry, and professor of pediatrics, University of North Carolina School of Medicine, Chapel Hill, North Carolina, at the time of writing and is now president and dean, Geisinger Commonwealth School of Medicine, Scranton, Pennsylvania
| | - Jennifer L Swails
- J.L. Swails is residency program director, codirector of interprofessional education, and associate professor, Department of Medicine, McGovern Medical School, University of Texas Health Science Center, Houston, Texas; ORCID: http://orcid.org/0000-0002-6102-831X
| | - Michael A Barone
- M.A. Barone is vice president, competency-based assessment, NBME, Philadelphia, Pennsylvania, and adjunct associate professor of pediatrics, Johns Hopkins University School of Medicine, Baltimore, Maryland; ORCID: http://orcid.org/0000-0002-4724-784X
| |
Collapse
|
4
|
Cheong CWS, Quah ELY, Chua KZY, Lim WQ, Toh RQE, Chiang CLL, Ng CWH, Lim EG, Teo YH, Kow CS, Vijayprasanth R, Liang ZJ, Tan YKI, Tan JRM, Chiam M, Lee ASI, Ong YT, Chin AMC, Wijaya L, Fong W, Mason S, Krishna LKR. Post graduate remediation programs in medicine: a scoping review. BMC MEDICAL EDUCATION 2022; 22:294. [PMID: 35443679 PMCID: PMC9020048 DOI: 10.1186/s12909-022-03278-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Accepted: 03/16/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Recognizing that physicians may struggle to achieve knowledge, skills, attitudes and or conduct at one or more stages during their training has highlighted the importance of the 'deliberate practice of improving performance through practising beyond one's comfort level under guidance'. However, variations in physician, program, contextual and healthcare and educational systems complicate efforts to create a consistent approach to remediation. Balancing the inevitable disparities in approaches and settings with the need for continuity and effective oversight of the remediation process, as well as the context and population specific nature of remediation, this review will scrutinise the remediation of physicians in training to better guide the design, structuring and oversight of new remediation programs. METHODS Krishna's Systematic Evidence Based Approach is adopted to guide this Systematic Scoping Review (SSR in SEBA) to enhance the transparency and reproducibility of this review. A structured search for articles on remediation programs for licenced physicians who have completed their pre-registration postings and who are in training positions published between 1st January 1990 and 31st December 2021 in PubMed, Scopus, ERIC, Google Scholar, PsycINFO, ASSIA, HMIC, DARE and Web of Science databases was carried out. The included articles were concurrently thematically and content analysed using SEBA's Split Approach. Similarities in the identified themes and categories were combined in the Jigsaw Perspective and compared with the tabulated summaries of included articles in the Funnelling Process to create the domains that will guide discussions. RESULTS The research team retrieved 5512 abstracts, reviewed 304 full-text articles and included 101 articles. The domains identified were characteristics, indications, frameworks, domains, enablers and barriers and unique features of remediation in licenced physicians in training programs. CONCLUSION Building upon our findings and guided by Hauer et al. approach to remediation and Taylor and Hamdy's Multi-theories Model, we proffer a theoretically grounded 7-stage evidence-based remediation framework to enhance understanding of remediation in licenced physicians in training programs. We believe this framework can guide program design and reframe remediation's role as an integral part of training programs and a source of support and professional, academic, research, interprofessional and personal development.
Collapse
Affiliation(s)
- Clarissa Wei Shuen Cheong
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Elaine Li Ying Quah
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Keith Zi Yuan Chua
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Wei Qiang Lim
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Rachelle Qi En Toh
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Christine Li Ling Chiang
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Caleb Wei Hao Ng
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Elijah Gin Lim
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Yao Hao Teo
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Cheryl Shumin Kow
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Raveendran Vijayprasanth
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Zhen Jonathan Liang
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Yih Kiat Isac Tan
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Javier Rui Ming Tan
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Min Chiam
- Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Alexia Sze Inn Lee
- Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
| | - Yun Ting Ong
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
| | - Annelissa Mien Chew Chin
- Medical Library, National University of Singapore Libraries, Blk MD6, Centre, 14 Medical Dr, #05-01 for Translational Medicine, Singapore, 117599 Singapore
| | - Limin Wijaya
- Duke-NUS Medical School, 8 College Road, Singapore, 169857 Singapore
- Department of Infectious Diseases, Singapore General Hospital, Outram Road, Singapore, 169608 Singapore
| | - Warren Fong
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Duke-NUS Medical School, 8 College Road, Singapore, 169857 Singapore
- Department of Rheumatology and Immunology, Singapore General Hospital, 16 College Road, Block 6 Level 9, Singapore, 169854 Singapore
| | - Stephen Mason
- Palliative Care Institute Liverpool, Academic Palliative & End of Life Care Centre, Cancer Research Centre, University of Liverpool, 200 London Road, Liverpool, L3 9TA UK
| | - Lalit Kumar Radha Krishna
- Yong Loo Lin School of Medicine, National University Singapore, 1E Kent Ridge Road, 119228 NUHS Tower Block, Level, Singapore, 11 Singapore
- Division of Supportive Palliative and Care, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 16961 Singapore
- Division of Cancer Education, National Cancer Centre Singapore, 11 Hospital Crescent, Singapore, 169610 Singapore
- Duke-NUS Medical School, 8 College Road, Singapore, 169857 Singapore
- Palliative Care Institute Liverpool, Academic Palliative & End of Life Care Centre, Cancer Research Centre, University of Liverpool, 200 London Road, Liverpool, L3 9TA UK
- Centre for Biomedical Ethics, National University of Singapore, Blk MD11, 10 Medical Drive, #02-03, Singapore, 117597 Singapore
- PalC, The Palliative Care Centre for Excellence in Research and Education, PalC c/o Dover Park Hospice, 10 Jalan Tan Tock Seng, Singapore, 308436 Singapore
| |
Collapse
|
5
|
Williams CR, Hubal R, Wolcott MD, Kruse A. Interactive Narrative Simulation as a Method for Preceptor Development. PHARMACY (BASEL, SWITZERLAND) 2021; 10:pharmacy10010005. [PMID: 35076570 PMCID: PMC8788483 DOI: 10.3390/pharmacy10010005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 12/20/2021] [Accepted: 12/24/2021] [Indexed: 11/30/2022]
Abstract
(1) Background: This proof-of-concept study assessed an interactive web-based tool simulating three challenging non-academic learning situations—student professionalism, cross-cultural interactions, and student well-being—as a means of preceptor development. (2) Methods: Three scripts focused on professionalism, cross-cultural interactions, and student well-being were developed and implemented using a commercial narrative tool with branching dialog. Delivered online, this tool presented each challenge to participants. Participants had up to four response options at each turn of the conversation; the choice of response influenced the subsequent conversation, including coaching provided at the resolution of the situation. Participants were invited to complete pre-activity, immediate post-activity, and one-month follow-up questionnaires to assess satisfaction, self-efficacy, engagement, and knowledge change with the tool. Knowledge was assessed through situational judgment tests (SJTs). (3) Results: Thirty-two pharmacist preceptors participated. The frequency of participants reflecting on challenging learning situations increased significantly one-month post-simulation. Participants affirmatively responded that the tool was time-efficient, represented similar challenges they encountered in precepting, was easily navigable, and resulted in learning. Self-efficacy with skills in managing challenging learning situations increased significantly immediately post-simulation and at a one-month follow-up. Knowledge as measured through SJTs was not significantly changed. (4) Conclusions: Preceptors found an interactive narrative simulation a relevant, time-efficient approach for preceptor development for challenging non-academic learning situations. Post-simulation, preceptors more frequently reflected on challenging learning situations, implying behavior change. Self-efficacy and self-report of knowledge increased. Future research is needed regarding knowledge assessments.
Collapse
Affiliation(s)
- Charlene R. Williams
- The Eshelman School of Pharmacy, The University of North Carolina Chapel Hill, Asheville, NC 28804, USA
- Correspondence: ; Tel.: +1-828-250-3906
| | - Robert Hubal
- The Eshelman School of Pharmacy, The University of North Carolina Chapel Hill, Chapel Hill, NC 27599, USA; (R.H.); (M.D.W.); (A.K.)
| | - Michael D. Wolcott
- The Eshelman School of Pharmacy, The University of North Carolina Chapel Hill, Chapel Hill, NC 27599, USA; (R.H.); (M.D.W.); (A.K.)
| | - Abbey Kruse
- The Eshelman School of Pharmacy, The University of North Carolina Chapel Hill, Chapel Hill, NC 27599, USA; (R.H.); (M.D.W.); (A.K.)
| |
Collapse
|
6
|
Price T, Wong G, Withers L, Wanner A, Cleland J, Gale T, Prescott-Clements L, Archer J, Bryce M, Brennan N. Optimising the delivery of remediation programmes for doctors: A realist review. MEDICAL EDUCATION 2021; 55:995-1010. [PMID: 33772829 DOI: 10.1111/medu.14528] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 03/16/2021] [Accepted: 03/19/2021] [Indexed: 05/15/2023]
Abstract
CONTEXT Medical underperformance puts patient safety at risk. Remediation, the process that seeks to 'remedy' underperformance and return a doctor to safe practice, is therefore a crucially important area of medical education. However, although remediation is used in health care systems globally, there is limited evidence for the particular models or strategies employed. The purpose of this study was to conduct a realist review to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety. METHOD We conducted a realist literature review consistent with RAMESES standards. We developed a programme theory of remediation by carrying out a systematic search of the literature and through regular engagement with a stakeholder group. We searched bibliographic databases (MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL, ERIC, ASSIA and DARE) and conducted purposive supplementary searches. Relevant sections of text relating to the programme theory were extracted and synthesised using a realist logic of analysis to identify context-mechanism-outcome configurations (CMOcs). RESULTS A 141 records were included. The majority of the studies were from North America (64%). 29 CMOcs were identified. Remediation programmes are effective when a doctor's insight and motivation are developed and behaviour change reinforced. Insight can be developed by providing safe spaces, using advocacy to promote trust and framing feedback sensitively. Motivation can be enhanced by involving the doctor in remediation planning, correcting causal attribution, goal setting and destigmatising remediation. Sustained change can be achieved by practising new behaviours and skills, and through guided reflection. CONCLUSION Remediation can work when it creates environments that trigger behaviour change mechanisms. Our evidence synthesis provides detailed recommendations on tailoring implementation and design strategies to improve remediation interventions for doctors.
Collapse
Affiliation(s)
- Tristan Price
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| | - Geoff Wong
- Nuffield Department of Primary Care, Health Sciences, University of Oxford, Oxford, UK
| | | | - Amanda Wanner
- NIHR Collaboration for Leadership in Applied Health Research and Care South West Peninsula (PenCLAHRC), Community and Primary Care Research Group, University of Plymouth, Plymouth, UK
| | - Jennifer Cleland
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore City, Singapore
| | - Tom Gale
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| | | | - Julian Archer
- Faculty of Medicine, Nursing and Healthcare, Monash University, Melbourne, Vic., Australia
| | - Marie Bryce
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| | - Nicola Brennan
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| |
Collapse
|
7
|
Lanier C, Muller-Juge V, Dominicé Dao M, Gaspoz JM, Junod Perron N, Audétat MC. Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: Change is necessary! PLoS One 2021; 16:e0254336. [PMID: 34283854 PMCID: PMC8291751 DOI: 10.1371/journal.pone.0254336] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Accepted: 06/28/2021] [Indexed: 11/19/2022] Open
Abstract
AIMS OF THE STUDY Residents in difficulty are a major cause for concern in medical education, with a prevalence of 7-15%. They are often detected late in their training and cannot make use of remediation plans. Nowadays, most training hospitals in Switzerland do not have a specific program to identify and manage residents in difficulty. The aim of the study was to explore the challenges perceived by physicians regarding the process of identifying, diagnosing, and supporting residents in difficulty in a structured and programmatic way. We explored perceptions of physicians at different hierarchical levels (residents (R), Chief residents (CR), attending physicians (A), Chief Physician (CP)) in order to better understand these challenges. METHODS We conducted an exploratory qualitative study between December 2015 and July 2016. We asked volunteers from the Primary Care Division of the Geneva University Hospitals to partake to three focus groups (with CR, A, R) and one interview with the division's CP. We transcribed, coded, and qualitatively analyzed the three focus groups and the interview, using a content thematic approach and Fishbein's conceptual framework. RESULTS We identified similarities and differences in the challenges of the management of residents in difficulty on a programmatic way amongst physicians of different hierarchical levels. Our main findings: Supervisors (CR, A, CP) have good identification skills of residents in difficulty, but they did not put in place systematic remediation strategies.Supervisors (CR, A) were concerned about managing residents in difficulty. They were aware of the possible adverse effects on patient care, but "feared to harm" resident's career by documenting a poor institutional assessment.Residents "feared to share" their own difficulties with their supervisors. They thought that it would impact their career negatively.The four physician's hierarchical level reported environmental constraints (lack of funding, time constraint, lack of time and resources…). CONCLUSION Our results add two perspectives to specialized recommendations regarding the implementation of remediation programs for residents in difficulty. The first revolves around the need to identify and fully understand not only the beliefs but also the implicit norms and the feeling of self-efficacy that are shared by teachers and that are likely to motivate them to engage in the management of residents in difficulty. The second emphasizes the importance of analyzing these elements that constitute the context for a change and of identifying, in close contact with the heads of the institutions, which factors may favor or hinder it. This research action process has fostered awareness and discussions at different levels. Since then, various actions and processes have been put in place at the Faculty of Medicine in Geneva.
Collapse
Affiliation(s)
- Cédric Lanier
- Family Medicine Unit (UIGP), University of Geneva, Geneva, Switzerland
- * E-mail:
| | | | - Melissa Dominicé Dao
- Department of Community Medicine, Primary Care and Emergency Medicine, Geneva University Hospitals, Geneva, Switzerland
| | | | - Noëlle Junod Perron
- Unit of Development and Research in Medical Education (UDREM), University of Geneva, Geneva, Switzerland
| | - Marie-Claude Audétat
- Family Medicine Unit (UIGP), University of Geneva, Geneva, Switzerland
- Unit of Development and Research in Medical Education (UDREM), University of Geneva, Geneva, Switzerland
| |
Collapse
|
8
|
Price T, Brennan N, Wong G, Withers L, Cleland J, Wanner A, Gale T, Prescott-Clements L, Archer J, Bryce M. Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review. HEALTH SERVICES AND DELIVERY RESEARCH 2021. [DOI: 10.3310/hsdr09110] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Background
An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.
Objectives
To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.
Design
A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.
Data sources
Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.
Review methods
Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.
Results
A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.
Limitations
Limitations were the low quality of included literature and limited number of UK-based studies.
Future work
Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.
Study registration
This study is registered as PROSPERO CRD42018088779.
Funding
This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Tristan Price
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | - Nicola Brennan
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | | | - Jennifer Cleland
- Medical Education Research and Scholarship Unit (MERSU), Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Amanda Wanner
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | - Thomas Gale
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | | | - Julian Archer
- Medicine, Nursing and Health Sciences Education Portfolio, Monash University, Melbourne, VIC, Australia
| | - Marie Bryce
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| |
Collapse
|
9
|
Minshew LM, Williams CR, Dinkins MM, Haltom WR, Brown KPD, McLaughlin JE. Developing a process to manage challenges encountered by experiential education administrators. CURRENTS IN PHARMACY TEACHING & LEARNING 2021; 13:318-326. [PMID: 33715791 DOI: 10.1016/j.cptl.2020.11.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Revised: 10/16/2020] [Accepted: 11/24/2020] [Indexed: 06/12/2023]
Abstract
INTRODUCTION This study explored preceptor and student related issues reported in pharmacy experiential education settings and solutions that experiential education administrators (EEAs) applied to inform a process to manage these challenges. METHODS This mixed-methods study was conducted in two phases. In phase one, five EEAs from three schools of pharmacy collected quantitative and qualitative data over a two-year period on issues reported by students and preceptors and the solutions EEAs employed. Descriptive statistics and content analysis were used to analyze quantitative and qualitative data, respectively. Interviews with six EEAs from four schools were completed in phase two. An additional school was added in phase two. Open coding, pattern coding, and summative analysis were completed on interview data. RESULTS Preceptors and students reported 156 and 65 issues, respectively. The most common issues reported were student reliability/responsibility (22, 14%) and preceptor communication (13, 20%). The most frequently applied solutions were coach preceptor (51, 24%) and meet with student (20, 24%). Interviews revealed more information about the strategies EEAs used. Approaches included reactive responses such as talking to and coaching preceptors or students. Preventative strategies were desired, such as tracking data and training. CONCLUSIONS Results informed two approaches that EEAs can employ to resolve student and preceptor issues. In the proactive process, issues are tracked to inform student and preceptor development. The reactive approach involves meeting with the preceptor or student, gathering information from both parties, coaching the preceptor or student, and involving other administrators as needed for serious concerns.
Collapse
Affiliation(s)
- Lana M Minshew
- UNC Eshelman School of Pharmacy, CB # 7355, 321 Beard Hall, 301 Pharmacy lane, Chapel Hill, NC 27599, United States.
| | - Charlene R Williams
- UNC Eshelman School of Pharmacy, CB #2125, 114D Karpen Hall, One University Heights, Asheville, NC 28804, United States.
| | - Melissa M Dinkins
- Wingate University School of Pharmacy, 515 N Main Street, Wingate, NC 28714, United States.
| | - Wesley R Haltom
- Wingate University School of Pharmacy, 515 N Main Street, Wingate, NC 28714, United States.
| | - K Paige D Brown
- Campbell University College of Pharmacy & Health Sciences, PO Box 1090, Buies Creek, NC 27506, United States.
| | - Jacqueline E McLaughlin
- UNC Eshelman School of Pharmacy, Campus Box 7574, 321 B Beard Hall, 301 Pharmacy Lane, Chapel Hill, NC 27599, United States.
| |
Collapse
|
10
|
To H, Cargill A, Tobin S, Nestel D. Remediation for surgical trainees: recommendations from a narrative review. ANZ J Surg 2021; 91:1117-1124. [PMID: 33538072 DOI: 10.1111/ans.16637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 01/13/2021] [Accepted: 01/15/2021] [Indexed: 11/27/2022]
Abstract
BACKGROUND Remediation involves formalized support for surgical trainees with significant underperformance to return to expected standards. There is a need to understand current evidence of remediation for surgical trainees to inform practice and justify investment of resources. METHODS Following the principles of a systematic review, we conducted a narrative analysis to make recommendations for remediation of underperforming surgical trainees. RESULTS From a review of 55 articles on remediation of trainees in medical and surgical sub-specialities, we have identified system and process level recommendations. Remediation is reported as long-term, complex and resource-intensive. Establishing a defined and standardized remediation framework enables co-ordination of multi-modal interventions. System level recommendations aim to consolidate protocols via developing better assessment, intervention and re-evaluation modalities whilst also strengthening support to supervisors conducting the remediation. Process level recommendations should be tailored for the specific needs of each trainee, aiming to be proactive with interventions within a programmatic framework. Regular reassessment is required, and long-term follow-up shows that remediation efforts are often successful. CONCLUSION While remediation within a programmatic framework is complex, it is often a successful approach to return surgical trainees to their expected standard. Future directions involve applying learning theories, encouraging research methods and to develop integrated collaborate protocols and support to synergize efforts.
Collapse
Affiliation(s)
- Henry To
- The University of Melbourne, Melbourne, Victoria, Australia
| | - Ashleigh Cargill
- Department of Surgery, St Vincent's Hospital, Melbourne, Victoria, Australia
| | - Stephen Tobin
- School of Medicine, Western Sydney University, Sydney, New South Wales, Australia
| | - Debra Nestel
- Department of Surgery (Austin), The University of Melbourne, Melbourne, Victoria, Australia.,Monash Institute for Health and Clinical Education, Monash University, Melbourne, Victoria, Australia
| |
Collapse
|
11
|
Briceland LL, Caimano CR, Rosa SW, Veselov M, Jablanski C. Exploring the impact of engaging student pharmacists in developing individualized experiential success plans. JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY 2021. [DOI: 10.1002/jac5.1342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Laurie L. Briceland
- Pharmacy Practice Department Albany College of Pharmacy and Health Sciences Albany New York USA
| | - Courtney R. Caimano
- Pharmacy Practice Department Albany College of Pharmacy and Health Sciences Albany New York USA
| | - Sandra W. Rosa
- Pharmacy Practice Department Albany College of Pharmacy and Health Sciences Colchester Vermont USA
| | - Megan Veselov
- Pharmacy Practice Department Albany College of Pharmacy and Health Sciences Albany New York USA
| | - Cindy Jablanski
- Pharmacy Practice Department Albany College of Pharmacy and Health Sciences Colchester Vermont USA
| |
Collapse
|
12
|
Siriwardena AN. Understanding and remedying the performance of doctors in training. MEDICAL EDUCATION 2020; 54:1090-1092. [PMID: 32896005 DOI: 10.1111/medu.14370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 08/26/2020] [Accepted: 08/28/2020] [Indexed: 06/11/2023]
|
13
|
Al-Sheikhly D, Östlundh L, Arayssi T. Remediation of learners struggling with communication skills: a systematic review. BMC MEDICAL EDUCATION 2020; 20:215. [PMID: 32646405 PMCID: PMC7350558 DOI: 10.1186/s12909-020-02074-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 05/12/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND Communication skills is a core area of competency for healthcare practitioners. However, trainees deficient in those skills are not identified early enough to address the deficiency. Furthermore, faculty often struggle to identify effective remediation strategies for those who fail to meet expectations. We undertook a systematic review to determine which assessment methods are appropriate to identify learners that struggle with communication skills and the strategies used to remediate them. METHODS The literature was searched from January 1998 through to May 2019 using academic databases and grey literature. Trainees were defined as healthcare practitioners in undergraduate, graduate and continuing education. Characteristics of studies, assessment and intervention strategies and outcomes were synthesized qualitatively and summarized in tables. RESULTS From an initial 1636 records, 16 (1%) studies met the review criteria. Majority of the learners were medical students. A few studies (44%) included students from other disciplines, residents and physicians in practice. The remediation programs, in the studies, ranged from 1 week to 1 year. Around half of the studies focused solely on learners struggling with communication skills. The majority of studies used a format of a clinical OSCE to identify struggling learners. None of the studies had a single intervention strategy with the majority including an experiential component with feedback. CONCLUSIONS A few studies collectively described the diagnosis, remediation intervention and the assessment of the outcomes of remediation of communication skills. For a remediation strategy to be successful it is important to ensure: (i) early identification and diagnosis, (ii) the development of an individualized plan and (iii) providing reassessment with feedback to the learner.
Collapse
Affiliation(s)
- Deema Al-Sheikhly
- Division of Continuing Professional Development, Weill Cornell Medicine - Qatar, Doha, Qatar.
| | - Linda Östlundh
- National Medical Library, United Arab Emirates University, Al-Ain, UAE
| | - Thurayya Arayssi
- Medical Education and Continuing Professional Development, Weill Cornell Medicine - Qatar, Doha, Qatar
| |
Collapse
|
14
|
Crannell WC, Brasel KJ. Dealing with the struggling learner. Surgery 2020; 167:523-527. [DOI: 10.1016/j.surg.2019.06.013] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Revised: 05/21/2019] [Accepted: 06/04/2019] [Indexed: 11/17/2022]
|
15
|
Hellwig T, Williams CR, Jen C, Raub JN, Scalese M, Smith WJ, Parbuoni KA. Current practices for identifying and managing challenging pharmacy residents: A needs assessment. Am J Health Syst Pharm 2020; 77:52-55. [DOI: 10.1093/ajhp/zxz257] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Affiliation(s)
- Thaddaus Hellwig
- South Dakota State University, College of Pharmacy and Allied Health Professions, Sioux Falls, SD
- Sanford USD Medical Center, Sioux Falls, SD
| | - Charlene R Williams
- Eshelman School of Pharmacy, University of North Carolina Chapel Hill, Asheville, NC
| | - Christi Jen
- HonorHealth Deer Valley Medical Center, Phoenix, AZ
- Department of Pharmacy Practice, University of Arizona College of Pharmacy, Phoenix, AZ
| | - Joshua N Raub
- Department of Pharmacy Services, Detroit Receiving Hospital, Detroit, MI
- Eugene Applebaum College of Pharmacy and Health Sciences, Wayne State University, Detroit, MI
| | - Michael Scalese
- Department of Pharmacy Practice, Prisma Health Richland, Columbia, SC
| | - Winter J Smith
- Department of Clinical Sciences, Ben and Maytee Fisch College of Pharmacy, The University of Texas at Tyler, Tyler, TX
| | - Kristine A Parbuoni
- Department of Pharmacy Practice and Science, University of Maryland School of Pharmacy, Baltimore, MD
- University of Maryland Medical Center, Baltimore, MD
| |
Collapse
|
16
|
Moffett P. Standardized Letters of Concern and Remediation Contracts: Templates for Program Directors. J Grad Med Educ 2019; 11:606-610. [PMID: 31636834 PMCID: PMC6795327 DOI: 10.4300/jgme-d-19-00065.1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2019] [Revised: 05/21/2019] [Accepted: 06/19/2019] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND Remediation of the struggling resident is a universal phenomenon, and the majority of program directors will remediate at least 1 resident during their tenure. OBJECTIVE The goal of this project was to create a standardized template for program directors to use at all stages of remediation. METHODS Between 2017 and 2018, the Council of Residency Directors in Emergency Medicine (CORD-EM) Remediation Committee searched for best practices in the medical literature and compiled a survey that was e-mailed to the CORD-EM listserv. After reviewing all information, a standardized remediation contract was created, reviewed by legal counsel, and distributed to members. RESULTS Forty-two percent (110 of 263) of program directors or assistant program directors on the CORD-EM listserv answered the initial survey and provided guidance on current remediation practices. The committee created formal and informal standard remediation contracts as both fillable templates and alterable documents. These were reviewed by CORD-EM general legal counsel and approved by the CORD-EM Board of Directors for distribution. The project took approximately 20 hours to complete over 8 months and involved a cost of $480 for legal fees. CONCLUSIONS With program director input and legal counsel review, the CORD-EM Remediation Committee produced standardized remediation contracts, which can be used by all emergency medicine programs after comparison to local institutional policy and local legal review. This process was feasible and can be replicated by other specialties.
Collapse
|
17
|
Advancing Simulation-Based Orthopaedic Surgical Skills Training: An Analysis of the Challenges to Implementation. Adv Orthop 2019; 2019:2586034. [PMID: 31565441 PMCID: PMC6745149 DOI: 10.1155/2019/2586034] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 07/10/2019] [Accepted: 08/03/2019] [Indexed: 01/18/2023] Open
Abstract
Simulation-based surgical skills training is recognized as a valuable method to improve trainees' performance and broadly perceived as essential for the establishment of a comprehensive curriculum in surgical education. However, there needs to be improvement in several areas for meaningful integration of simulation into surgical education. The purpose of this focused review is to summarize the obstacles to a comprehensive integration of simulation-based surgical skills training into surgical education and board certification and suggest potential solutions for those obstacles. First and foremost, validated simulators need to be rigorously assessed to ensure their feasibility and cost-effectiveness. All simulation-based courses should include clear objectives and outcome measures (with metrics) for the skills to be practiced by trainees. Furthermore, these courses should address a wide range of issues, including assessment of trainees' problem-solving and decision-making abilities and remediation of poor performance. Finally, which simulation-based surgical skills courses will become a standard part of the curriculum across training programs and which will be of value in board certification should be precisely defined. Sufficient progress in these areas will prevent excessive development of training and assessment tools with duplicative effort and large variability in quality.
Collapse
|
18
|
Egan DJ, Gentges J, Regan L, Smith JL, Williamson K, Murano T. An Emergency Medicine Remediation Consult Service: Access to Expert Remediation Advice and Resources. AEM EDUCATION AND TRAINING 2019; 3:193-196. [PMID: 31008432 PMCID: PMC6457352 DOI: 10.1002/aet2.10330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 02/11/2019] [Accepted: 02/19/2019] [Indexed: 06/09/2023]
Abstract
Resident remediation is a complex and common issue in emergency medicine programs and requires a specific knowledge base. The Remediation Task Force (RTF) of the Council of Residency Directors in Emergency Medicine (CORD-EM) was created to identify remediation best practices and to develop tools for program directors. Initially housed on a Wiki page, and now located within the CORD-EM website, the RTF provides resources including accepted universal language for documentation and sample remediation plans. The RTF also created a remediation consult service composed of experienced educators to provide real-time structured feedback and advice to submitted remediation scenarios with consultation outcomes and conclusions uploaded to the website. CORD-EM members now have easy access to online resources and expert advice for remediation queries through the consult service. The combination of online resources and access to real-time expert advice is an innovative approach to improving resident remediation and recognizing best practices.
Collapse
Affiliation(s)
- Daniel J. Egan
- Department of Emergency MedicineColumbia University Vagelos College of Physicians and SurgeonsNew YorkNY
| | - Joshua Gentges
- Department of Emergency MedicineOklahoma University School of Community MedicineTulsaOK
| | - Linda Regan
- Department of Emergency MedicineJohns Hopkins Medical InstitutionsBaltimoreMD
| | - Jessica L. Smith
- Department of Emergency MedicineAlpert Medical School of Brown UniversityProvidenceRI
| | - Kelly Williamson
- Department of Emergency MedicineUniversity of Illinois at ChicagoAdvocate Christ Medical CenterOak LawnIL
| | - Tiffany Murano
- Department of Emergency MedicineRutgers New Jersey Medical SchoolNewarkNJ
| |
Collapse
|
19
|
Nadir NA, Hart D, Cassara M, Noelker J, Moadel T, Kulkarni M, Sampson CS, Bentley S, Naik NK, Hernandez J, Krzyzaniak SM, Lai S, Podolej G, Strother C. Simulation-based Remediation in Emergency Medicine Residency Training: A Consensus Study. West J Emerg Med 2019; 20:145-156. [PMID: 30643618 PMCID: PMC6324703 DOI: 10.5811/westjem.2018.10.39781] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2018] [Revised: 10/19/2018] [Accepted: 10/26/2018] [Indexed: 11/24/2022] Open
Abstract
INTRODUCTION Resident remediation is a pressing topic in emergency medicine (EM) training programs. Simulation has become a prominent educational tool in EM training and been recommended for identification of learning gaps and resident remediation. Despite the ubiquitous need for formalized remediation, there is a dearth of literature regarding best practices for simulation-based remediation (SBR). METHODS We conducted a literature search on SBR practices using the terms "simulation," "remediation," and "simulation based remediation." We identified relevant themes and used them to develop an open-ended questionnaire that was distributed to EM programs with experience in SBR. Thematic analysis was performed on all subsequent responses and used to develop survey instruments, which were then used in a modified two-round Delphi panel to derive a set of consensus statements on the use of SBR from an aggregate of 41 experts in simulation and remediation in EM. RESULTS Faculty representing 30 programs across North America composed the consensus group with 66% of participants identifying themselves as simulation faculty, 32% as program directors, and 2% as core faculty. The results from our study highlight a strong agreement across many areas of SBR in EM training. SBR is appropriate for a range of deficits, including procedural, medical knowledge application, clinical reasoning/decision-making, communication, teamwork, and crisis resource management. Simulation can be used both diagnostically and therapeutically in remediation, although SBR should be part of a larger remediation plan constructed by the residency leadership team or a faculty expert in remediation, and not the only component. Although summative assessment can have a role in SBR, it needs to be very clearly delineated and transparent to everyone involved. CONCLUSION Simulation may be used for remediation purposes for certain specific kinds of competencies as long as it is carried out in a transparent manner to all those involved.
Collapse
Affiliation(s)
- Nur-Ain Nadir
- Kaiser Permanente Central Valley, Department of Emergency Medicine, Modesto, California
- University of Illinois-Peoria, Jump Simulation, Peoria, Illinois
| | - Danielle Hart
- University of Minnesota, Hennepin County Medical Center, Department of Emergency Medicine, Minneapolis, Minnesota
| | - Michael Cassara
- Donald and Barbara Zucker School of Medicine at Hofstra-Northwell, Department of Emergency Medicine, Manhasset, New York
| | - Joan Noelker
- Washington University in St. Louis, Department of Medicine, Division of Emergency Medicine, St. Louis, Missouri
| | - Tiffany Moadel
- Donald and Barbara Zucker School of Medicine at Hofstra-Northwell, Department of Emergency Medicine, Manhasset, New York
| | - Miriam Kulkarni
- St. John’s Riverside Hospital, Department of Emergency Medicine, Yonkers, New York
| | | | - Suzanne Bentley
- Icahn School of Medicine at Mount Sinai, Elmhurst Hospital Center, Department of Emergency Medicine and Medical Education, Simulation Center, Elmhurst, New York
| | - Neel K. Naik
- New York Presbyterian, Weill Cornell Medicine, Department of Emergency Medicine, New York, New York
| | - Jessica Hernandez
- University of Texas Southwestern Medical Center, Department of Emergency Medicine, Dallas, Texas
| | - Sara M. Krzyzaniak
- Kaiser Permanente Central Valley, Department of Emergency Medicine, Modesto, California
- University of Illinois-Peoria, Jump Simulation, Peoria, Illinois
| | - Steven Lai
- Ronald Reagan UCLA Medical Center, Olive View-UCLA Medical Center, Department of Emergency Medicine, Los Angeles, California
| | - Gregory Podolej
- Kaiser Permanente Central Valley, Department of Emergency Medicine, Modesto, California
- University of Illinois-Peoria, Jump Simulation, Peoria, Illinois
| | - Christopher Strother
- Icahn School of Medicine at Mount Sinai, Department of Emergency Medicine, Pediatrics, and Medical Education, New York, New York
| |
Collapse
|
20
|
LaDonna KA, Ginsburg S, Watling C. Shifting and Sharing: Academic Physicians' Strategies for Navigating Underperformance and Failure. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2018; 93:1713-1718. [PMID: 29794519 DOI: 10.1097/acm.0000000000002292] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
PURPOSE Medical practice is uncertain and complex. Consequently, even outstanding performers will inevitably experience moments of underperformance and failure. Coping relies on insight and resilience. However, how physicians develop and use these skills to navigate struggle remains underexplored. A better understanding may reveal strategies to support both struggling learners and stressed practitioners. METHOD In 2015, 28 academic physicians were interviewed about their experiences with underperformance or failure. Constructivist grounded theory informed data collection and analysis. RESULTS Participants' experiences with struggle ranged from patient errors and academic failures to frequent, smaller moments of interpersonal conflict and work-life imbalance. To buffer impact, participants sometimes shifted their focus to an aspect of their identity where they felt successful. Additionally, although participants perceived that insight develops by acknowledging and reflecting on error, they sometimes deflected blame for performance gaps. More often, participants seemed to accept personal responsibility while simultaneously sharing accountability for underperformance or failure with external forces. Paradoxically, participants perceived learners who used these strategies as lacking in insight. CONCLUSIONS Participants demonstrated the protective and functional value of distributing responsibility for underperformance and failure. Shifting and sharing may be an element of reflection and resilience; recognizing external factors may provide a way to gain perspective and to preserve the self. However, this strategy challenges educators' assumptions that learners who deflect are avoiding personal responsibility. The authors' findings raise questions about what it means to be resilient, and how assumptions about learners' responses to failure may affect strategies to support underperforming learners.
Collapse
Affiliation(s)
- Kori A LaDonna
- K.A. LaDonna is assistant professor, Department of Innovation in Medical Education and Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada. S. Ginsburg is professor, Department of Medicine, and scientist, Wilson Centre for Research in Education, University of Toronto, Toronto, Ontario, Canada. C. Watling is professor, Department of Clinical Neurological Sciences, scientist, Centre for Education Research and Innovation, and associate dean of postgraduate medical education, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada
| | | | | |
Collapse
|
21
|
|
22
|
Kaslow NJ, Grus CL, Allbaugh LJ, Shen-Miller D, Bodner KE, Veilleux J, Van Sickle K. Trainees with Competence Problems in the Professionalism Domain. ETHICS & BEHAVIOR 2018. [DOI: 10.1080/10508422.2018.1438897] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Nadine J. Kaslow
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine
| | | | - Lucy J. Allbaugh
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine
| | | | - Kimberly E. Bodner
- Thompson Center for Autism & Neurodevelopmental Disorders, University of Missouri
| | | | | |
Collapse
|
23
|
Grus CL, Shen-Miller D, Lease SH, Jacobs SC, Bodner KE, Van Sickle KS, Veilleux J, Kaslow NJ. Professionalism: A Competency Cluster Whose Time Has Come. ETHICS & BEHAVIOR 2018. [DOI: 10.1080/10508422.2017.1419133] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
| | | | | | - Sue C. Jacobs
- School of Community Health Sciences, Counseling, and Counseling Psychology, Oklahoma State University
| | - Kimberly E. Bodner
- Thompson Center for Autism & Neurodevelopmental Disorders, University of Missouri
| | | | | | - Nadine J. Kaslow
- Department of Psychiatry and Behavioral Science, Emory University
| |
Collapse
|
24
|
Kalet A, Chou CL, Ellaway RH. To fail is human: remediating remediation in medical education. PERSPECTIVES ON MEDICAL EDUCATION 2017; 6:418-424. [PMID: 29071550 PMCID: PMC5732108 DOI: 10.1007/s40037-017-0385-6] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
INTRODUCTION Remediating failing medical learners has traditionally been a craft activity responding to individual learner and remediator circumstances. Although there have been moves towards more systematic approaches to remediation (at least at the institutional level), these changes have tended to focus on due process and defensibility rather than on educational principles. As remediation practice evolves, there is a growing need for common theoretical and systems-based perspectives to guide this work. METHODS This paper steps back from the practicalities of remediation practice to take a critical systems perspective on remediation in contemporary medical education. In doing so, the authors acknowledge the complex interactions between institutional, professional, and societal forces that are both facilitators of and barriers to effective remediation practices. RESULTS The authors propose a model that situates remediation within the contexts of society as a whole, the medical profession, and medical education institutions. They also outline a number of recommendations to constructively align remediation principles and practices, support a continuum of remediation practices, destigmatize remediation, and develop institutional communities of practice in remediation. DISCUSSION Medical educators must embrace a responsible and accountable systems-level approach to remediation if they are to meet their obligations to provide a safe and effective physician workforce.
Collapse
Affiliation(s)
- Adina Kalet
- Program on Medical Education Innovation and Scholarship, New York University School of Medicine, New York, USA.
| | - Calvin L Chou
- Department of Clinical Medicine, Academy of Medical Educators University of California, San Francisco, USA
| | - Rachel H Ellaway
- Office of Health and Medical Education Scholarship at the Cumming School of Medicine, University of Calgary, Calgary, Canada
| |
Collapse
|
25
|
Kinnear B, Bensman R, Held J, O'Toole J, Schauer D, Warm E. Critical Deficiency Ratings in Milestone Assessment: A Review and Case Study. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2017; 92:820-826. [PMID: 28557948 DOI: 10.1097/acm.0000000000001383] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
PURPOSE The Accreditation Council for Graduate Medical Education (ACGME) requires programs to report learner progress using specialty-specific milestones. It is unclear how milestones can best identify critical deficiencies (CDs) in trainee performance. Specialties developed milestones independently of one another; not every specialty included CDs within milestones ratings. This study examined the proportion of ACGME milestone sets that include CD ratings, and describes one residency program's experiences using CD ratings in assessment. METHOD The authors reviewed ACGME milestones for all 99 specialties in November 2015, determining which rating scales contained CDs. The authors also reviewed three years of data (July 2012-June 2015) from the University of Cincinnati Medical Center (UCMC) internal medicine residency assessment system based on observable practice activities mapped to ACGME milestones. Data were analyzed by postgraduate year, assessor type, rotation, academic year, and core competency. The Mantel-Haenszel chi-square test was used to test for changes over time. RESULTS Specialties demonstrated heterogeneity in accounting for CDs in ACGME milestones, with 22% (22/99) of specialties having no language describing CDs in milestones assessment. Thirty-three percent (63/189) of UCMC internal medicine residents received at least one CD rating, with CDs accounting for 0.18% (668/364,728) of all assessment ratings. The authors identified CDs across multiple core competencies and rotations. CONCLUSIONS Despite some specialties not accounting for CDs in milestone assessment, UCMC's experience demonstrates that a significant proportion of residents may be rated as having a CD during training. Identification of CDs may allow programs to develop remediation and improvement plans.
Collapse
Affiliation(s)
- Benjamin Kinnear
- B. Kinnear is assistant professor and residency assistant program director, Medicine-Pediatrics, Department of Internal Medicine, University of Cincinnati College of Medicine, and Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio. R. Bensman is clinical fellow, Department of Pediatrics, Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio. J. Held is assistant professor and residency associate program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio. J. O'Toole is associate professor and residency associate program director, Medicine-Pediatrics, Department of Internal Medicine, University of Cincinnati College of Medicine, and Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio. D. Schauer is associate professor and residency associate program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio. E. Warm is Richard W. Vilter Professor of Medicine and residency program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio
| | | | | | | | | | | |
Collapse
|
26
|
Effect of Performance Deficiencies on Graduation and Board Certification Rates: A 10-yr Multicenter Study of Anesthesiology Residents. Anesthesiology 2017; 125:221-9. [PMID: 27119434 DOI: 10.1097/aln.0000000000001142] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
BACKGROUND This multicenter, retrospective study was conducted to determine how resident performance deficiencies affect graduation and board certification. METHODS Primary documents pertaining to resident performance were examined over a 10-yr period at four academic anesthesiology residencies. Residents entering training between 2000 and 2009 were included, with follow-up through February 2016. Residents receiving actions by the programs' Clinical Competency Committee were categorized by the area of deficiency and compared to peers without deficiencies. RESULTS A total of 865 residents were studied (range: 127 to 275 per program). Of these, 215 residents received a total of 405 actions from their respective Clinical Competency Committee. Among those who received an action compared to those who did not, the proportion graduating differed (93 vs. 99%, respectively, P < 0.001), as did the proportion achieving board certification (89 vs. 99%, respectively, P < 0.001). When a single deficiency in an Essential Attribute (e.g., ethical, honest, respectful behavior; absence of impairment) was identified, the proportion graduating dropped to 55%. When more than three Accreditation Council for Graduate Medical Education Core Competencies were deficient, the proportion graduating also dropped significantly. CONCLUSIONS Overall graduation and board certification rates were consistently high in residents with no, or isolated, deficiencies. Residents deficient in an Essential Attribute, or multiple competencies, are at high risk of not graduating or achieving board certification. More research is needed on the effectiveness and selective deployment of remediation efforts, particularly for high-risk groups.
Collapse
|
27
|
Davis LE, Miller ML, Raub JN, Gortney JS. Constructive ways to prevent, identify, and remediate deficiencies of "challenging trainees" in experiential education. Am J Health Syst Pharm 2016; 73:996-1009. [PMID: 27325881 DOI: 10.2146/ajhp150330] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023] Open
Affiliation(s)
- Lindsay E Davis
- College of Pharmacy-Glendale, Midwestern University, Glendale, AZBanner Estrella Medical Center, Phoenix, AZ
| | | | | | - Justine S Gortney
- Eugene Applebaum College of Pharmacy and Health Sciences, Wayne State University, Detroit, MI.
| |
Collapse
|
28
|
Williamson K, Quattromani E, Aldeen A. The problem resident behavior guide: strategies for remediation. Intern Emerg Med 2016; 11:437-49. [PMID: 26667256 DOI: 10.1007/s11739-015-1367-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/14/2015] [Accepted: 11/26/2015] [Indexed: 11/24/2022]
Abstract
In 2012, the ACGME supplemented the core competencies with outcomes-based milestones for resident performance within the six competency domains. These milestones address the knowledge, skills, abilities, attitudes, and experiences that a resident is expected to progress through during the course of training. Even prior to the initiation of the milestones, there was a paucity of EM literature addressing the remediation of problem resident behaviors and there remain few readily accessible tools to aid in the implementation of a remediation plan. The goal of the "Problem Resident Behavior Guide" is to provide specific strategies for resident remediation based on deficiencies identified within the framework of the EM milestones. The "Problem Resident Behavior Guide" is a written instructional manual that provides concrete examples of remediation strategies to address specific milestone deficiencies. The more than 200 strategies stem from the experiences of the authors who have professional experience at three different academic hospitals and emergency medicine residency programs, supplemented by recommendations from educational leaders as well as utilization of valuable education adjuncts, such as focused simulation exercises, lecture preparation, and themed ED shifts. Most recommendations require active participation by the resident with guidance by faculty to achieve the remediation expectations. The ACGME outcomes-based milestones aid in the identification of deficiencies with regards to resident performance without providing recommendations on remediation. The Problem Resident Behavior Guide can therefore have a significant impact by filling in this gap.
Collapse
Affiliation(s)
- Kelly Williamson
- Department of Emergency Medicine, Advocate Christ Medical Center, 4440 West 95th Street, 185 W, Oak Lawn, IL, 60453, USA.
| | - Erin Quattromani
- Division of Emergency Medicine, St. Louis University, St Louis, MO, USA
| | - Amer Aldeen
- Department of Emergency Medicine, Presence St. Joseph Medical Center, Joliet, IL, USA
| |
Collapse
|
29
|
Domen RE, Talbert ML, Johnson K, Post MD, Brissette MD, Conran RM, Hoffman RD, McCloskey CB, Raciti PM, Roberts CA, Rojiani AM, Tucker JA, Powell SZE. Assessment and Management of Professionalism Issues in Pathology Residency Training: Results From Surveys and a Workshop by the Graduate Medical Education Committee of the College of American Pathologists. Acad Pathol 2015; 2:2374289515592887. [PMID: 28725747 PMCID: PMC5479457 DOI: 10.1177/2374289515592887] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Professionalism issues are common in residency training and can be very difficult to recognize and manage. Almost one-third of the milestones for pathology recently instituted by the Accreditation Council for Graduate Medical Education encompass aspects of professionalism. Program directors are often unsure of how and when to remediate residents for unprofessional behavior. We used a case-based educational approach in a workshop setting to assist program directors in the management of unprofessional behavior in residents. Eight case scenarios highlighting various aspects of unprofessional behavior by pathology residents were developed and presented in an open workshop forum at the annual pathology program director’s meeting. Prior to the workshop, 2 surveys were conducted: (1) to collect data on program directors’ experience with identifying, assessing, and managing unprofessional behavior in their residents and (2) to get feedback from workshop registrants on how they would manage each of the 8 case scenarios. A wide range of unprofessional behaviors have been observed by pathology program directors. Although there is occasionally general agreement on how to manage specific behaviors, there remains wide variation in how to manage many of the presented unprofessional behaviors. Remediation for unprofessional behavior in pathology residents remains a difficult and challenging process. Additional education and research in this area are warranted.
Collapse
Affiliation(s)
- Ronald E Domen
- Division of Laboratory Medicine, Department of Pathology, Penn State Hershey Medical Center and College of Medicine, Hershey, PA, USA
| | - Michael L Talbert
- Department of Pathology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | | | - Miriam D Post
- Department of Pathology, Anschutz Medical Campus, University of Colorado-Denver, Aurora, CO, USA
| | | | | | - Robert D Hoffman
- Department of Pathology, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Cindy B McCloskey
- Department of Pathology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Patricia M Raciti
- Department of Pathology and Cell Biology, Columbia University Medical Center-New York Presbyterian Hospital, New York, NY, USA
| | | | - Amyn M Rojiani
- Department of Pathology, Georgia Regents University, Augusta, GA, USA
| | - J Allan Tucker
- Department of Pathology, University of South Alabama, Mobile, AL, USA
| | | |
Collapse
|
30
|
Affiliation(s)
- Damon R. Kuehl
- Department of Emergency Medicine; Carilion Clinic; Virginia Tech Carilion School of Medicine; Roanoke VA
| | - Michael A. Gisondi
- Department of Emergency Medicine; Northwestern University Feinberg School of Medicine; Chicago IL
| |
Collapse
|
31
|
Weizberg M, Smith JL, Murano T, Silverberg M, Santen SA. What does remediation and probation status mean? A survey of emergency medicine residency program directors. Acad Emerg Med 2015; 22:113-6. [PMID: 25565491 DOI: 10.1111/acem.12559] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2014] [Revised: 08/07/2014] [Accepted: 08/09/2014] [Indexed: 11/29/2022]
Abstract
OBJECTIVES Emergency medicine (EM) residency program directors (PDs) nationwide place residents on remediation and probation. However, the Accreditation Council for Graduate Medical Education and the EM PDs have not defined these terms, and individual institutions must set guidelines defining a change in resident status from good standing to remediation or probation. The primary objective of this study was to determine if EM PDs follow a common process to guide actions when residents are placed on remediation and probation. METHODS An anonymous electronic survey was distributed to EM PDs via e-mail using SurveyMonkey to determine the current practice followed after residents are placed on remediation or probation. The survey queried four designations: informal remediation, formal remediation, informal probation, and formal probation. These designations were compared for deficits in the domains of medical knowledge (MK) and non-MK remediation. The survey asked what process for designation exists and what actions are triggered, specifically if documentation is placed in a resident's file, if the graduate medical education (GME) office is notified, if faculty are informed, or if resident privileges are limited. Descriptive data are reported. RESULTS Eighty-one of 160 PDs responded. An official policy on remediation and/or probation was reported by 41 (50.6%) programs. The status of informal remediation is used by 73 (90.1%), 80 (98.8%) have formal remediation, 40 (49.4%) have informal probation, and 79 (97.5%) have formal probation. There was great variation among PDs in the management and definition of remediation and probation. Between 81 and 86% of programs place an official letter into the resident's file regarding formal remediation and probation. However, only about 50% notify the GME office when a resident is placed on formal remediation. There were no statistical differences between MK and non-MK remediation practices. CONCLUSIONS There is significant variation among EM programs regarding the process of remediation and probation. The definition of these terms and the actions triggered are variable across programs. Based on these findings, suggestions toward a standardized approach for remediation and probation in GME programs are provided.
Collapse
Affiliation(s)
| | | | - Tiffany Murano
- Department of Emergency Medicine; Rutgers New Jersey Medical School; Newark NJ
| | - Mark Silverberg
- Department of Emergency Medicine; SUNY Downstate/Kings County Hospital; Brooklyn NY
| | - Sally A. Santen
- Departments of Emergency Medicine & Medical Education; University of Michigan Medical School; Ann Arbor MI
| |
Collapse
|
32
|
Domen RE. Resident remediation, probation, and dismissal basic considerations for program directors. Am J Clin Pathol 2014; 141:784-90. [PMID: 24838321 DOI: 10.1309/ajcpsnpap5r5nhus] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022] Open
Abstract
OBJECTIVES To suggest a basic new approach for pathology training programs to consider when a resident requires remediation, probation, or dismissal. METHODS Remediation, probation, or dismissal of the poorly performing pathology resident is one of the most difficult and challenging aspects of any pathology training program. The poorly performing resident requires extra time and resources from the faculty and the program and can be disruptive for the entire program. Effective remediation requires faculty development, a well-constructed remediation or probation plan, and documentation. RESULTS Despite best efforts, not all remediation plans are successful and dismissal of the resident will need to be seriously considered. CONCLUSIONS Approaches to dealing with resident performance issues can be variable and need to be tailored to the issue being addressed.
Collapse
Affiliation(s)
- Ronald E. Domen
- Department of Pathology and Laboratory Medicine, Penn State Hershey Medical Center and College of Medicine, Hershey, PA
| |
Collapse
|
33
|
Platt MP, Davis EM, Grundfast K, Grillone G. Early detection of factual knowledge deficiency and remediation in otolaryngology residency education. Laryngoscope 2014; 124:E309-11. [PMID: 24408058 DOI: 10.1002/lary.24589] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2013] [Revised: 01/03/2014] [Accepted: 01/07/2014] [Indexed: 11/08/2022]
Abstract
OBJECTIVES/HYPOTHESIS Within otolaryngology residency training, the annual Otolaryngology Training Examination (OTE) is the primary method used to assess, quantify, and compare the factual knowledge acquired by each resident. The objective of this study was to develop a more frequent method for tracking of factual knowledge to prevent educational delay. STUDY DESIGN Retrospective analysis of educational scores. METHODS For each didactic lecture within a single otolaryngology residency training program, multiple choice questions were provided before and after each lecture. Questions were based on lecture objectives that were derived from the American Board of Otolaryngology curriculum. Scores were tracked over the course of 1 academic year and compared to the scores of residents on the OTE administered in that year to determine correlation with a validated measure of factual knowledge. The effect of remedial measures on improvement in OTE scores was determined. RESULTS Over the course of 1 academic year, there were 328 questions presented to 12 residents before and after 32 lectures in the didactic program. Ten residents completed an average of 244 questions. Overall OTE scores demonstrated a significant and very strong correlation to lecture question scores (Pearson r = 0.86, P = .002). Remedial measures for residents during the previous 5 years who had inadequate OTE scores were successful in improving scores (P = .002). CONCLUSIONS A structured didactic program that uses review questions to assess knowledge can be used to track acquisition of factual knowledge. Early identification of residents with deficiencies facilitates the development of individualized learning plans that result in successful remediation.
Collapse
Affiliation(s)
- Michael P Platt
- Department of Otolaryngology-Head and Neck Surgery, Boston University School of Medicine, Boston, Massachusetts, U.S.A
| | | | | | | |
Collapse
|
34
|
Recognizing Residents with a Deficiency in Operative Performance as a Step Closer to Effective Remediation. J Am Coll Surg 2013; 216:114-22. [DOI: 10.1016/j.jamcollsurg.2012.09.008] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2012] [Revised: 09/12/2012] [Accepted: 09/12/2012] [Indexed: 12/25/2022]
|