1
|
Versalle RL, Todd BR, Chen NW, Turner-Lawrence DE. Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance. MEDEDPORTAL : THE JOURNAL OF TEACHING AND LEARNING RESOURCES 2024; 20:11386. [PMID: 38476297 PMCID: PMC10928014 DOI: 10.15766/mep_2374-8265.11386] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 11/28/2023] [Indexed: 03/14/2024]
Abstract
Introduction The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. Methods From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Results Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). Discussion An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents.
Collapse
Affiliation(s)
- Rochelle L. Versalle
- Third-Year Resident, Department of Emergency Medicine, Oakland University William Beaumont School of Medicine
| | - Brett R. Todd
- Associate Professor, Department of Emergency Medicine, Oakland University William Beaumont School of Medicine
| | - Nai-Wei Chen
- Statistician, Division of Informatics and Biostatistics, Beaumont Institute
| | - Danielle E. Turner-Lawrence
- Associate Professor, Department of Emergency Medicine, Oakland University William Beaumont School of Medicine
| |
Collapse
|
2
|
Vrablik L, Wing R. Pediatric Polytrauma Fire Victim Simulation. MEDEDPORTAL : THE JOURNAL OF TEACHING AND LEARNING RESOURCES 2024; 20:11383. [PMID: 38414645 PMCID: PMC10897059 DOI: 10.15766/mep_2374-8265.11383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2023] [Accepted: 11/20/2023] [Indexed: 02/29/2024]
Abstract
Introduction Pediatric trauma has long been one of the primary contributors to pediatric mortality. There are multiple cases in the literature involving cyanide (CN) toxicity, carbon monoxide (CO) toxicity, and smoke inhalation with thermal injury, but none in combination with mechanical trauma. Methods In this 45-minute simulation case, emergency medicine residents and fellows were asked to manage a pediatric patient with multiple life-threatening traumatic and metabolic concerns after being extracted from a van accident with a resulting fire. Providers were expected to identify and manage the patient's airway, burns, hemoperitoneum, and CO and CN toxicities. Results Forty learners participated in this simulation, the majority of whom had little prior clinical experience managing the concepts highlighted in it. All agreed or strongly agreed that the case was relevant to their work. After participation, learner confidence in the ability to manage each of the learning objectives was high. One hundred percent of learners felt confident or very confident in managing CO toxicity and completing primary and secondary surveys, while 97% were similarly confident in identifying smoke inhalation injury, preparing for a difficult airway, and managing CN toxicity. Discussion This case was a well-received teaching tool for the management of pediatric trauma and metabolic derangements related to fire injuries. While this specific case represents a rare clinical experience, it is within the scope of expected knowledge for emergency medicine providers and offers the opportunity to practice managing multisystem trauma.
Collapse
Affiliation(s)
- Lauren Vrablik
- Third-Year Fellow, Division of Pediatric Emergency Medicine, Department of Emergency Medicine, Warren Alpert Medical School of Brown University
| | - Robyn Wing
- Associate Professor, Division of Pediatric Emergency Medicine, Departments of Emergency Medicine and Pediatrics, Warren Alpert Medical School of Brown University and Rhode Island Hospital/Hasbro Children's Hospital; Director of Pediatric Simulation, Lifespan Medical Simulation Center
| |
Collapse
|
3
|
Ali AA, Crimmins A, Chen H, Khoujah D. • Education • Simulation-based assessment for the emergency medicine milestones: a national survey of simulation experts and program directors. World J Emerg Med 2024; 15:301-305. [PMID: 39050213 PMCID: PMC11265633 DOI: 10.5847/wjem.j.1920-8642.2024.055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 02/29/2024] [Indexed: 07/27/2024] Open
Affiliation(s)
- Afrah A Ali
- Department of Emergency Medicine, University of Maryland School of Medicine, Baltimore 21201, USA
| | - Ashley Crimmins
- Department of Emergency Medicine, University of Maryland School of Medicine, Baltimore 21201, USA
| | - Hegang Chen
- Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore 21201, USA
| | - Danya Khoujah
- Department of Emergency Medicine, University of Maryland School of Medicine, Baltimore 21201, USA
- Department of Emergency Medicine, AdventHealth Tampa, Tampa 33606, USA
| |
Collapse
|
4
|
Abstract
Virtual simulation (VS) education involves the use of virtual reality, augmented reality, mixed reality and screen-based platforms, collectively referred to as extended reality, to provide education and assessment. This novel simulation modality supports experiential learning and increases access to practice opportunities, supplementing manikin-based simulation. VS has been used successfully for neonatal resuscitation training in high and low resource settings. Virtual simulators can be used to objectively assess learner performance in neonatal resuscitation knowledge and skills. When implementing VS for neonatal resuscitation training, key considerations include matching learning objectives with suitable technology, pre-session preparation, supporting learners, and debriefing. Additional research is needed to evaluate the impact of VS applications on clinical practice and patient outcomes.
Collapse
|
5
|
Kealey A, Naik VN. Competency-Based Medical Training in Anesthesiology: Has It Delivered on the Promise of Better Education? Anesth Analg 2022; 135:223-229. [PMID: 35839492 DOI: 10.1213/ane.0000000000006091] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Affiliation(s)
- Alayne Kealey
- From the Department of Anesthesia, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.,Department of Anesthesiology and Pain Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Viren N Naik
- Department of Anesthesiology and Pain Medicine, University of Ottawa, Ottawa, Ontario, Canada
| |
Collapse
|
6
|
Innocenti F, Tassinari I, Ralli ML, Bona A, Stefanone VT, Audisio R, Meo F, Grifoni C, Pini R. Improving technical and non-technical skills of emergency medicine residents through a program based on high-fidelity simulation. Intern Emerg Med 2022; 17:1471-1480. [PMID: 35181840 DOI: 10.1007/s11739-022-02940-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Accepted: 01/29/2022] [Indexed: 11/28/2022]
Abstract
We evaluated the effectiveness of a training program with high-fidelity simulation (HFS) to improve technical (TS) and non-technical skills (NTS) of residents in Emergency Medicine. We conducted a 2-year training program for the management of a critical patient based on HFS (6 sessions for every year, four teams who performed 4 scenarios per session). At the beginning of the training program, all participants received a presentation of Crisis Resource Management (CRM) principles. Each session covered a different topic in Emergency Medicine Curriculum. TSs were measured as the proportion of completed tasks in the following areas: airway, breathing, circulation, disability and exposure (ABCDE) assessment and management, completion of anamnesis based on AMPLE (allergy, medications, previous illness, last meal and event) scheme, diagnostic and therapeutic assessment. NTSs were rated by the Clinical Teamwork Scale (CTS). Scores' values and the percentage of correctly performed actions were presented as median with interquartile range. Friedmann non-parametric test was employed to evaluate the trend of TS and NTS over the following sessions. Among the TS, the assessment and management of ABCDE and completion of therapeutic tasks improved (all p < 0.05). The completion of diagnostic tasks (p = 0.050) tended toward significant improvement. The overall CTS score (first session 61 ± 17, last session 84 ± 16, p < 0.001) as well as Communication (first 13.7 ± 3.6, last 18.7 ± 3.5, p < 0.001), Situational Awareness (first 5.3 ± 1.8, last 6.4 ± 1.4, p = 0.012) and Role Responsibility subscores (first 9.7 ± 2.8, last 12.1 ± 3.7, p < 0.001) increased through the following sessions. Therefore, HFS has proven to be an effective instrument to improve TS and NTS among Emergency Medicine residents.
Collapse
Affiliation(s)
- Francesca Innocenti
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy.
| | - Irene Tassinari
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| | - Maria Luisa Ralli
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| | - Andrea Bona
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| | - Valerio Teodoro Stefanone
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| | - Rita Audisio
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| | - Federico Meo
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| | - Caterina Grifoni
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| | - Riccardo Pini
- High-Dependency Unit, Department of Clinical and Experimental Medicine, Careggi University Hospital, Largo Brambilla 3, 50134, Florence, Italy
| |
Collapse
|
7
|
Bondzi-Simpson A, Lindo CJ, Hoy M, Lui JT. The Otolaryngology boot camp: a scoping review evaluating commonalities and appraisal for curriculum design and delivery. J Otolaryngol Head Neck Surg 2022; 51:23. [PMID: 35659365 PMCID: PMC9167522 DOI: 10.1186/s40463-022-00583-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2021] [Accepted: 05/12/2022] [Indexed: 11/10/2022] Open
Abstract
OBJECTIVE Surgical boot camps are becoming increasingly popular in Otolaryngology-Head and Neck Surgery (OHNS) residency programs. Despite pioneering virtual reality and simulation-based surgical education, these boot camps have lacked critical appraisal. The objective of this article was to examine the adoption and utility of surgical boot camps in OHNS residency training programs around the world. DATA SOURCES Ovid Medline and PubMed databases were systematically searched in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for scoping reviews. Additionally, a grey literature search was performed. REVIEW METHODS Inclusion criteria were peer-reviewed publications and grey literature sources that reported on OHNS boot camps for the novice learner. The search was restricted to human studies published in English. Studies were excluded if they were not examining junior trainees. RESULTS A total of 551 articles were identified. Following removal of duplicates, screening, and full text review, 16 articles were included for analysis. Seven major boot camps were identified across various academic sites in the world. Most boot camps were one-day intensive camps incorporating a mixture of didactic, skill specific, and simulation sessions using an array of task trainers and high-fidelity simulators focusing on OHNS emergencies. Studies measuring trainee outcomes demonstrated improvement in trainee confidence, immediate knowledge, and skill acquisition. CONCLUSION Surgical boot camps appear to be an effective tool for short term knowledge and skill acquisition. Further studies should examine retention of skill and maintenance of confidence over longer intervals, as little is known about these lasting effects.
Collapse
Affiliation(s)
- Adom Bondzi-Simpson
- Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Division of General Surgery, Department of Surgery, University of Toronto, Toronto, ON, Canada
| | - C J Lindo
- Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Monica Hoy
- Section of Otolaryngology-Head and Neck Surgery, Department of Surgery, University of Calgary, Calgary, AB, Canada
| | - Justin T Lui
- Section of Otolaryngology-Head and Neck Surgery, Department of Surgery, University of Calgary, Calgary, AB, Canada.
| |
Collapse
|
8
|
Ongoing Simulation-Based Procedural Practice: An Imperative for Attending Physicians in Emergency Medicine. Am J Med Qual 2021; 37:183-184. [PMID: 34738982 DOI: 10.1097/jmq.0000000000000026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
9
|
Huang WC, Hsu SC, Yang CH, Lin CW, Suk FM, Hu KC, Wu YY, Chen HY, Hsu CW. A novel approach: Simulating multiple simultaneous encounters to assess multitasking ability in emergency medicine. PLoS One 2021; 16:e0257887. [PMID: 34582505 PMCID: PMC8478191 DOI: 10.1371/journal.pone.0257887] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Accepted: 09/13/2021] [Indexed: 12/01/2022] Open
Abstract
Study objective The purpose of this feasibility study is to develop and validate a new assessment tool and scoring system for multitasking competency for physicians in-training in a timed simulated setting. The multitasking competency includes ability to appropriately prioritize and implement tasks for different patients who present simultaneously. Methods We designed three single task stations with different levels of difficulty and priority. These skill stations were then combined to create a multitasking simulation scenario. Skill checklists and the global rating scale were utilized to assess the participants’ performance. A multitasking score, multitasking index, and priority score were developed to measure the multitasking ability of participants. Results Thirty-three first-year postgraduate physicians were recruited for this prospective study. The total performance scores were significantly higher for the single-tasking stations than for the multitasking scenario. In terms of the time needed to complete the tasks, the participants spent more time on the multitasking scenario than on the single-tasking scenario. There were significant correlations between the global rating scale and the multitasking score (rho = 0.693, p < 0.001) and between the global rating scale and the multitasking index (rho = 0.515, p < 0.001). The multitasking score, multitasking index, and priority score did not have any significant correlations with the total single-tasking score. Conclusion We demonstrated that the use of a simulated multitasking scenario could be an effective method of assessing multitasking ability and allow assessors to offer better quality feedback.
Collapse
Affiliation(s)
- Wen-Cheng Huang
- Department of Emergency, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Emergency Department, Department of Emergency and Critical Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- Center for Education in Medical Simulation, Taipei Medical University, Taipei, Taiwan
- Department of Education and Humanities in Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Shih-Chang Hsu
- Department of Emergency, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Emergency Department, Department of Emergency and Critical Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Chih-Hao Yang
- Department of Emergency, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Emergency Department, Department of Emergency and Critical Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Che-Wei Lin
- Department of Emergency, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Emergency Department, Department of Emergency and Critical Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- Center for Education in Medical Simulation, Taipei Medical University, Taipei, Taiwan
- Department of Education and Humanities in Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Fat-Moon Suk
- Division of Gastroenterology, Department of Internal Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- Department of Internal Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Kai-Chun Hu
- Department of Emergency, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Emergency Department, Department of Emergency and Critical Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Yun-Yu Wu
- Department of Emergency, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Emergency Department, Department of Emergency and Critical Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Hao-Yu Chen
- Center for Education in Medical Simulation, Taipei Medical University, Taipei, Taiwan
| | - Chin-Wang Hsu
- Department of Emergency, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Emergency Department, Department of Emergency and Critical Medicine, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- * E-mail:
| |
Collapse
|
10
|
Miranda FBG, Alves Pereira-Junior G, Mazzo A. Competences in the training of nurses to assist the airway of adult patients in urgency and emergency situations. Rev Lat Am Enfermagem 2021; 29:e3434. [PMID: 34231790 PMCID: PMC8253369 DOI: 10.1590/1518-8345.3380.3434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Accepted: 09/12/2020] [Indexed: 11/22/2022] Open
Abstract
Objective: construction and validation in appearance and content of the competence
frameworks and of the Entrustable Professional Activities to develop skills
in the training of nurses to assist the airway of adult patients in urgency
and emergency situations. Method: a descriptive and methodological study developed in four phases: in the
first, a workshop was held, composed of experts, for the construction of the
competence frameworks; in the second, the material was validated using the
Snowball Technique and the Delphi Technique, in the third, content analysis
and calculation of the Content Validation Index were conducted; and in the
fourth phase, the Entrustable Professional Activities were built, validated
in simulated workshops. Results: the competence frameworks were built and validated, with a resulting CVI≥0.85
in all the items. The Entrustable Professional Activities were validated by
experts regarding their applicability; of these, 44% stated they were
applicable in simulated environments, 100% that they were useful content and
with appropriate language, 22% suggested the insertion of new items to
assess competence, 11% reported the difficulty of assessing competence
individually in the clinical settings, and 11% of the experts referred to
the need for prior training of the teacher/facilitator to use it. Conclusion: the study resulted in the construction of competence frameworks and six
Entrustable Professional Activities relating them to the domains of
essential competences in the training of nurses to assist the airway of
adult patients in urgency and emergency situations. The participation of
experts in the construction and validation of this material was essential to
guarantee the theoretical and practical relevance of the result.
Collapse
Affiliation(s)
- Fernanda Berchelli Girão Miranda
- Universidade Federal de São Carlos, Departamento de Enfermagem, São Carlos, SP, Brazil.,Scholarship holder at the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), Brazil
| | | | - Alessandra Mazzo
- Universidade de São Paulo, Curso de Medicina de Bauru, Bauru, SP, Brazil
| |
Collapse
|
11
|
Gottlieb M, Jordan J, Siegelman JN, Cooney R, Stehman C, Chan TM. Direct Observation Tools in Emergency Medicine: A Systematic Review of the Literature. AEM EDUCATION AND TRAINING 2021; 5:e10519. [PMID: 34041428 PMCID: PMC8138102 DOI: 10.1002/aet2.10519] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Revised: 07/31/2020] [Accepted: 08/09/2020] [Indexed: 05/07/2023]
Abstract
OBJECTIVES Direct observation is important for assessing the competency of medical learners. Multiple tools have been described in other fields, although the degree of emergency medicine-specific literature is unclear. This review sought to summarize the current literature on direct observation tools in the emergency department (ED) setting. METHODS We searched PubMed, Scopus, CINAHL, the Cochrane Central Register of Clinical Trials, the Cochrane Database of Systematic Reviews, ERIC, PsycINFO, and Google Scholar from 2012 to 2020 for publications on direct observation tools in the ED setting. Data were dual extracted into a predefined worksheet, and quality analysis was performed using the Medical Education Research Study Quality Instrument. RESULTS We identified 38 publications, comprising 2,977 learners. Fifteen different tools were described. The most commonly assessed tools included the Milestones (nine studies), Observed Structured Clinical Exercises (seven studies), the McMaster Modular Assessment Program (six studies), Queen's Simulation Assessment Test (five studies), and the mini-Clinical Evaluation Exercise (four studies). Most of the studies were performed in a single institution, and there were limited validity or reliability assessments reported. CONCLUSIONS The number of publications on direct observation tools for the ED setting has markedly increased. However, there remains a need for stronger internal and external validity data.
Collapse
Affiliation(s)
- Michael Gottlieb
- Department of Emergency MedicineRush University Medical CenterChicagoILUSA
| | - Jaime Jordan
- Department of Emergency MedicineRonald Reagan UCLA Medical CenterLos AngelesCAUSA
| | | | - Robert Cooney
- Department of Emergency MedicineGeisinger Medical CenterDanvillePAUSA
| | | | - Teresa M. Chan
- Department of MedicineDivision of Emergency MedicineMcMaster UniversityHamiltonOntarioCanada
| |
Collapse
|
12
|
Manton JW, Kennedy KS, Lipps JA, Pfeil SA, Cornelius BW. Medical Emergency Management in the Dental Office (MEMDO): A Pilot Study Assessing a Simulation-Based Training Curriculum for Dentists. Anesth Prog 2021; 68:76-84. [PMID: 34185862 PMCID: PMC8258755 DOI: 10.2344/anpr-67-04-04] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Accepted: 07/20/2020] [Indexed: 11/11/2022] Open
Abstract
In the event of a medical emergency in the dental office, the dentist must be able to identify a patient in distress, assess the situation, and institute proper management. This study assessed the impact of a simulation-based medical emergency preparedness curriculum on a resident's ability to manage medical emergencies. This interventional and pre-post educational pilot study included 8 participants who completed a standard curriculum and 8 who completed a modified curriculum (N = 16). The intervention consisted of a comprehensive medical emergency preparedness curriculum that replaced lecture sessions in a standard curriculum. Participants completed performance assessments using scenario-based objective structured clinical examinations (OSCEs) that were recorded and evaluated by calibrated faculty reviewers using a customized scoring grid. The intervention group performed significantly better than the control group on their summative OSCEs, averaging 90.9 versus 61.2 points out of 128 (p = .0009). All participants from the intervention group passed their summative OSCE with scores >60%, while none from the control group received passing scores. Completion of a simulation-based medical emergency preparedness curriculum significantly improved resident performance during simulated medical emergencies.
Collapse
Affiliation(s)
- Jesse W Manton
- The Ohio State University, College of Dentistry, Division of Oral and Maxillofacial Surgery and Dental Anesthesiology
- The Ohio State University, College of Medicine, Department of Anesthesiology
| | - Kelly S Kennedy
- The Ohio State University, College of Dentistry, Division of Oral and Maxillofacial Surgery and Dental Anesthesiology
| | - Jonathan A Lipps
- The Ohio State University, College of Medicine, Department of Anesthesiology
| | - Sheryl A Pfeil
- The Ohio State University, College of Medicine, Medical Director-Clinical Skills Education and Assessment Center
- The Ohio State University, College of Medicine, Department of Internal Medicine Division of Gastroenterology, Hepatology and Nutrition, Columbus, Ohio
| | - Bryant W Cornelius
- The Ohio State University, College of Dentistry, Division of Oral and Maxillofacial Surgery and Dental Anesthesiology
- The Ohio State University, College of Medicine, Department of Anesthesiology
| |
Collapse
|
13
|
Taha AA, Jadalla A, Bin Ali W, Firkins J, Norman S, Azar N. Structured simulations improves students' knowledge acquisition and perceptions of teaching effectiveness: A quasi-experimental study. J Clin Nurs 2021; 30:3163-3170. [PMID: 33896066 DOI: 10.1111/jocn.15815] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 03/16/2021] [Accepted: 04/07/2021] [Indexed: 10/21/2022]
Abstract
AIMS To determine the effect of adding structured simulation to a traditional classroom lecture format on students' knowledge acquisition and their evaluation of faculty teaching effectiveness, compared to traditional classroom lectures alone. BACKGROUND There is a critical lack of high-quality clinical placements/experiences in nursing education, particularly in clinical specialty populations, such as paediatrics. Simulation has been shown to help students practice in a safe environment. However, less is known about the outcomes of embedding simulation in didactic class sessions or classroom lectures. Additionally, data on the impact of simulation as a teaching pedagogy on faculty teaching effectiveness is limited. DESIGN Post-test, nonequivalent control group quasi-experimental study. METHODS Students in two prelicensure nursing programs participated in a 10-week term paediatric nursing course taught by the same faculty member on two different campuses. The students at one campus, designated as the control group (n = 43), received four hours of traditional, lecture-only, instructions. The group at a second campus, the intervention group (n = 44), received the same lectures with added structured simulations. Students' knowledge acquisition and their evaluation of faculty teaching effectiveness were measured in both groups using the same standardised assessment measures. The CONSORT checklist was followed. RESULTS Students' knowledge acquisition scores and their evaluation scores of faculty teaching effectiveness were significantly higher in the intervention (simulation) group compared to the control group. A significantly higher number of students in the simulation group scored above the national average Nursing Care of Children score as compared to students in the control group. CONCLUSIONS Integrating simulation with didactic instruction enhanced students' knowledge acquisition and improved their opinion of faculty teaching effectiveness. RELEVANCE TO CLINICAL PRACTICE Augmenting lecture with simulation may provide students with learning experiences that they may not have during clinical rotation due to a lack of paediatric clinical placement sites and differences between sites.
Collapse
Affiliation(s)
- Asma A Taha
- School of Nursing, Oregon Health & Science University, Portland, OR, USA
| | - Ahlam Jadalla
- School of Nursing, California State University, Long Beach, CA, USA
| | - Wafaa Bin Ali
- College of Nursing-Jeddah, King Saud Bin Abdul Aziz University for Health Sciences, Jeddah, Saudi Arabia
| | - Jenny Firkins
- School of Nursing, Oregon Health & Science University, Portland, OR, USA
| | - Sharon Norman
- School of Nursing, Oregon Health & Science University, Portland, OR, USA
| | - Najood Azar
- Doctoral Department, School of Nursing, Azusa Pacific University, Monrovia, CA, USA
| |
Collapse
|
14
|
Koster MA, Soffler M. Navigate the Challenges of Simulation for Assessment: A Faculty Development Workshop. MEDEDPORTAL : THE JOURNAL OF TEACHING AND LEARNING RESOURCES 2021; 17:11114. [PMID: 33768146 PMCID: PMC7970643 DOI: 10.15766/mep_2374-8265.11114] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Accepted: 12/11/2020] [Indexed: 06/12/2023]
Abstract
INTRODUCTION Given barriers to learner assessment in the authentic clinical environment, simulated patient encounters are gaining attention as a valuable opportunity for competency assessment across the health professions. Simulation-based assessments offer advantages over traditional methods by providing realistic clinical scenarios through which a range of technical, analytical, and communication skills can be demonstrated. However, simulation for the purpose of assessment represents a paradigm shift with unique challenges, including preservation of a safe learning environment, standardization across learners, and application of valid assessment tools. Our goal was to create an interactive workshop to equip educators with the knowledge and skills needed to conduct assessments in a simulated environment. METHODS Participants engaged in a 90-minute workshop with large-group facilitated discussions and small-group activities for practical skill development. Facilitators guided attendees through a simulated grading exercise followed by in-depth analysis of three types of assessment tools. Participants designed a comprehensive simulation-based assessment encounter, including selection or creation of an assessment tool. RESULTS We have led two iterations of this workshop, including an in-person format at an international conference and a virtual format at our institution during the COVID-19 pandemic, with a total of 93 participants. Survey responses indicated strong overall ratings and impactfulness of the workshop. DISCUSSION Our workshop provides a practical, evidence-based framework to guide educators in the development of a simulation-based assessment program, including optimization of the environment, design of the simulated case, and utilization of meaningful, valid assessment tools.
Collapse
Affiliation(s)
- Megan A. Koster
- Instructor in Medicine, Harvard Medical School and Division of Pulmonary and Critical Care Medicine, Mount Auburn Hospital
| | - Morgan Soffler
- Instructor in Medicine, Harvard Medical School and Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center; Director of Simulation Research, Carl J. Shapiro Center for Education and Research, Beth Israel Deaconess Medical Center
| |
Collapse
|
15
|
[Simulation curricular content in postgraduate emergency medicine: A multicentre Delphi study]. CAN J EMERG MED 2020; 21:667-675. [PMID: 31084629 DOI: 10.1017/cem.2019.348] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVES There is increasing evidence to support integration of simulation into medical training; however, no national emergency medicine (EM) simulation curriculum exists. Using Delphi methodology, we aimed to identify and establish content validity for adult EM curricular content best suited for simulation-based training, to inform national postgraduate EM training. METHODS A national panel of experts in EM simulation iteratively rated potential curricular topics, on a 4-point scale, to determine those best suited for simulation-based training. After each round, responses were analyzed. Topics scoring <2/4 were removed and remaining topics were resent to the panel for further ratings until consensus was achieved, defined as Cronbach α ≥ 0.95. At conclusion of the Delphi process, topics rated ≥ 3.5/4 were considered "core" curricular topics, while those rated 3.0-3.5 were considered "extended" curricular topics. RESULTS Forty-five experts from 13 Canadian centres participated. Two hundred eighty potential curricular topics, in 29 domains, were generated from a systematic literature review, relevant educational documents and Delphi panellists. Three rounds of surveys were completed before consensus was achieved, with response rates ranging from 93-100%. Twenty-eight topics, in eight domains, reached consensus as "core" curricular topics. Thirty-five additional topics, in 14 domains, reached consensus as "extended" curricular topics. CONCLUSIONS Delphi methodology allowed for achievement of expert consensus and content validation of EM curricular content best suited for simulation-based training. These results provide a foundation for improved integration of simulation into postgraduate EM training and can be used to inform a national simulation curriculum to supplement clinical training and optimize learning.
Collapse
|
16
|
Jeffers JM, Golden W, Pahwa AK, Cooper S, Cooke D, Reisig R, Grybauskas C, Balighian E, Frosch E, Shatzer JH. The Process of Developing an Assessment Checklist for Simulated Infant Respiratory Distress Using a Modified Delphi Method: A Mixed Methods Study. Cureus 2020; 12:e7866. [PMID: 32489721 PMCID: PMC7255533 DOI: 10.7759/cureus.7866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2020] [Accepted: 04/28/2020] [Indexed: 11/27/2022] Open
Abstract
Introduction Assessing clinical performance, such as managing respiratory distress, in clinical trainees is challenging yet important. Our objective was to describe and evaluate an integrative and iterative approach to developing a checklist measuring simulated clinical performance for infant respiratory distress. Methods We implemented a five-step modified Delphi process with an embedded qualitative component. An implementation period occurred followed by a second qualitative data collection. Validity evidence was collected throughout the process. Results A 19-item assessment checklist was developed for managing infant respiratory distress by medical student learners in a simulation-based setting. The iterative process provided content validity while the qualitative data provided response process validity. Cohen kappa was 0.82 indicating strong rater agreement. The assessment checklist was found to be easy to use and measure what was intended. Conclusion We developed an accurate and reliable assessment checklist for medical student learners in a simulation-based learning setting with high interrater reliability and validity evidence. Given its ease of use, we encourage medical educators and researchers to utilize this method to develop and implement assessment checklists for their interventions.
Collapse
Affiliation(s)
- Justin M Jeffers
- Pediatrics, The Johns Hopkins University School of Medicine, Baltimore, USA
| | | | - Amit K Pahwa
- Medicine, Pediatrics, Johns Hopkins University, Baltimore, USA
| | - Stacy Cooper
- Pediatrics, Johns Hopkins University, Baltimore, USA
| | - David Cooke
- Pediatrics, Johns Hopkins University, Baltimore, USA
| | | | | | | | - Emily Frosch
- Psychiatry, Johns Hopkins University, Baltimore, USA
| | - John H Shatzer
- School of Education, Johns Hopkins University, Baltimore, USA
- Medical Informatics, The Johns Hopkins University School of Medicine, Baltimore, USA
| |
Collapse
|
17
|
Bentley S, Stapleton SN, Moschella PC, Ray JM, Zucker SM, Hernandez J, Rosenman ED, Wong AH. Barriers and Solutions to Advancing Emergency Medicine Simulation-based Research: A Call to Action. AEM EDUCATION AND TRAINING 2020; 4:S130-S139. [PMID: 32072117 PMCID: PMC7011408 DOI: 10.1002/aet2.10406] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Revised: 10/04/2019] [Accepted: 10/24/2019] [Indexed: 05/08/2023]
Abstract
Simulation technology has successfully improved patient safety and care quality through training and assessment of individuals, teams, and health care systems. Emergency medicine (EM) continues to be a leader and pioneer of simulation, including administration of simulation-based fellowships and training programs. However, EM simulation-based research has been limited by low rates of publication and poor methodologic rigor. The Society for Academic Emergency Medicine (SAEM) Simulation Academy is leading efforts to improve the quality of scholarship generated by the EM simulation community and to foster successful research careers for future generations of EM simulationists. Through a needs assessment survey of our membership and a year-long consensus-based approach, we identified two main clusters of barriers to simulation-based research: lack of protected time and dedicated resources and limited training and mentorship. As a result, we generated four position statements with implications for education, training, and research in EM simulation and as a call to action for the academic EM community. Recommendations include expansion of funding opportunities for simulation-based research, creation of multi-institutional simulation collaboratives, and development of mentorship and training pathways that promote rigor in design and methodology within EM simulation scholarship.
Collapse
Affiliation(s)
- Suzanne Bentley
- Departments of Emergency Medicine and Medical EducationIcahn School of Medicine at Mount SinaiNew YorkNY
- NYC Health + Hospital/ElmhurstElmhurstNY
| | | | | | - Jessica M. Ray
- Department of Emergency MedicineYale School of MedicineNew HavenCT
| | | | - Jessica Hernandez
- Department of Emergency MedicineUniversity of Texas Southwestern Medical CenterDallasTX
| | - Elizabeth D. Rosenman
- Department of Emergency MedicineUniversity of Washington School of MedicineSeattleWA
| | - Ambrose H. Wong
- Department of Emergency MedicineYale School of MedicineNew HavenCT
| |
Collapse
|
18
|
Fleming M, McMullen M, Beesley T, Egan R, Field S. Simulation-based evaluation of anaesthesia residents: optimising resource use in a competency-based assessment framework. BMJ SIMULATION & TECHNOLOGY ENHANCED LEARNING 2019; 6:339-343. [DOI: 10.1136/bmjstel-2019-000504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/15/2019] [Indexed: 11/03/2022]
Abstract
IntroductionSimulation training in anaesthesiology bridges the gap between theory and practice by allowing trainees to engage in high-stakes clinical training without jeopardising patient safety. However, implementing simulation-based assessments within an academic programme is highly resource intensive, and the optimal number of scenarios and faculty required for accurate competency-based assessment remains to be determined. Using a generalisability study methodology, we examine the structure of simulation-based assessment in regard to the minimal number of scenarios and faculty assessors required for optimal competency-based assessments.MethodsSeventeen anaesthesiology residents each performed four simulations which were assessed by two expert raters. Generalisability analysis (G-analysis) was used to estimate the extent of variance attributable to (1) the scenarios, (2) the assessors and (3) the participants. The D-coefficient and the G-coefficient were used to determine accuracy targets and to predict the impact of adjusting the number of scenarios or faculty assessors.ResultsWe showed that multivariate G-analysis can be used to estimate the number of simulations and raters required to optimise assessment. In this study, the optimal balance was obtained when four scenarios were assessed by two simulation experts.ConclusionSimulation-based assessment is becoming an increasingly important tool for assessing the competency of medical residents in conjunction with other assessment methods. G-analysis can be used to assist in planning for optimal resource use and cost-efficacy.
Collapse
|
19
|
Nadir NA, Hart D, Cassara M, Noelker J, Moadel T, Kulkarni M, Sampson CS, Bentley S, Naik NK, Hernandez J, Krzyzaniak SM, Lai S, Podolej G, Strother C. Simulation-based Remediation in Emergency Medicine Residency Training: A Consensus Study. West J Emerg Med 2019; 20:145-156. [PMID: 30643618 PMCID: PMC6324703 DOI: 10.5811/westjem.2018.10.39781] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2018] [Revised: 10/19/2018] [Accepted: 10/26/2018] [Indexed: 11/24/2022] Open
Abstract
INTRODUCTION Resident remediation is a pressing topic in emergency medicine (EM) training programs. Simulation has become a prominent educational tool in EM training and been recommended for identification of learning gaps and resident remediation. Despite the ubiquitous need for formalized remediation, there is a dearth of literature regarding best practices for simulation-based remediation (SBR). METHODS We conducted a literature search on SBR practices using the terms "simulation," "remediation," and "simulation based remediation." We identified relevant themes and used them to develop an open-ended questionnaire that was distributed to EM programs with experience in SBR. Thematic analysis was performed on all subsequent responses and used to develop survey instruments, which were then used in a modified two-round Delphi panel to derive a set of consensus statements on the use of SBR from an aggregate of 41 experts in simulation and remediation in EM. RESULTS Faculty representing 30 programs across North America composed the consensus group with 66% of participants identifying themselves as simulation faculty, 32% as program directors, and 2% as core faculty. The results from our study highlight a strong agreement across many areas of SBR in EM training. SBR is appropriate for a range of deficits, including procedural, medical knowledge application, clinical reasoning/decision-making, communication, teamwork, and crisis resource management. Simulation can be used both diagnostically and therapeutically in remediation, although SBR should be part of a larger remediation plan constructed by the residency leadership team or a faculty expert in remediation, and not the only component. Although summative assessment can have a role in SBR, it needs to be very clearly delineated and transparent to everyone involved. CONCLUSION Simulation may be used for remediation purposes for certain specific kinds of competencies as long as it is carried out in a transparent manner to all those involved.
Collapse
Affiliation(s)
- Nur-Ain Nadir
- Kaiser Permanente Central Valley, Department of Emergency Medicine, Modesto, California
- University of Illinois-Peoria, Jump Simulation, Peoria, Illinois
| | - Danielle Hart
- University of Minnesota, Hennepin County Medical Center, Department of Emergency Medicine, Minneapolis, Minnesota
| | - Michael Cassara
- Donald and Barbara Zucker School of Medicine at Hofstra-Northwell, Department of Emergency Medicine, Manhasset, New York
| | - Joan Noelker
- Washington University in St. Louis, Department of Medicine, Division of Emergency Medicine, St. Louis, Missouri
| | - Tiffany Moadel
- Donald and Barbara Zucker School of Medicine at Hofstra-Northwell, Department of Emergency Medicine, Manhasset, New York
| | - Miriam Kulkarni
- St. John’s Riverside Hospital, Department of Emergency Medicine, Yonkers, New York
| | | | - Suzanne Bentley
- Icahn School of Medicine at Mount Sinai, Elmhurst Hospital Center, Department of Emergency Medicine and Medical Education, Simulation Center, Elmhurst, New York
| | - Neel K. Naik
- New York Presbyterian, Weill Cornell Medicine, Department of Emergency Medicine, New York, New York
| | - Jessica Hernandez
- University of Texas Southwestern Medical Center, Department of Emergency Medicine, Dallas, Texas
| | - Sara M. Krzyzaniak
- Kaiser Permanente Central Valley, Department of Emergency Medicine, Modesto, California
- University of Illinois-Peoria, Jump Simulation, Peoria, Illinois
| | - Steven Lai
- Ronald Reagan UCLA Medical Center, Olive View-UCLA Medical Center, Department of Emergency Medicine, Los Angeles, California
| | - Gregory Podolej
- Kaiser Permanente Central Valley, Department of Emergency Medicine, Modesto, California
- University of Illinois-Peoria, Jump Simulation, Peoria, Illinois
| | - Christopher Strother
- Icahn School of Medicine at Mount Sinai, Department of Emergency Medicine, Pediatrics, and Medical Education, New York, New York
| |
Collapse
|
20
|
Hart D, Franzen D, Beeson M, Bhat R, Kulkarni M, Thibodeau L, Weizberg M, Promes S. Integration of Entrustable Professional Activities with the Milestones for Emergency Medicine Residents. West J Emerg Med 2019; 20:35-42. [PMID: 30643599 PMCID: PMC6324698 DOI: 10.5811/westjem.2018.11.38912] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2018] [Revised: 10/29/2018] [Accepted: 11/12/2018] [Indexed: 12/04/2022] Open
Abstract
INTRODUCTION Medical education is moving toward a competency-based framework with a focus on assessment using the Accreditation Council for Graduate Medical Education Milestones. Assessment of individual competencies through milestones can be challenging. While competencies describe characteristics of the person, the entrustable professional activities (EPAs) concept refers to work-related activities. EPAs would not replace the milestones but would be linked to them, integrating these frameworks. Many core specialties have already defined EPAs for resident trainees, but EPAs have not yet been created for emergency medicine (EM). This paper describes the development of milestone-linked EPAs for EM. METHODS Ten EM educators from across North America formed a consensus working group to draft EM EPAs, using a modified Glaser state-of-the-art approach. A reactor panel with EPA experts from the United States, Canada and the Netherlands was created, and an iterative process with multiple revisions was performed based on reactor panel input. Following this, the EPAs were sent to the Council of Residency Directors for EM (CORD-EM) listserv for additional feedback. RESULTS The product was 11 core EPAs that every trainee from every EM program should be able to perform independently by the time of graduation. Each EPA has associated knowledge, skills, attitudes and behaviors (KSAB), which are either milestones themselves or KSABs linked to individual milestones. We recognize that individual programs may have additional focus areas or work-based activities they want their trainees to achieve by graduation; therefore, programs are also encouraged to create additional program-specific EPAs. CONCLUSION This set of 11 core, EM-resident EPAs can be used as an assessment tool by EM residency programs, allowing supervising physicians to document the multiple entrustment decisions they are already making during clinical shifts with trainees. The KSAB list within each EPA could assist supervisors in giving specific, actionable feedback to trainees and allow trainees to use this list as an assessment-for-learning tool. Linking each KSAB to individual EM milestones allows EPAs to directly inform milestone assessment for clinical competency committees. These EPAs serve as another option for workplace-based assessment, and are linked to the milestones to create an integrated framework.
Collapse
Affiliation(s)
- Danielle Hart
- Hennepin County Medical Center, Department of Emergency Medicine, Minneapolis, Minnesota
| | - Douglas Franzen
- University of Washington, Department of Emergency Medicine, Seattle, Washington
| | - Michael Beeson
- Akron General, Department of Emergency Medicine, Akron, Ohio
| | - Rahul Bhat
- MedStar Georgetown University Hospital, Washington Hospital Center, Department of Emergency Medicine, Washington, District of Columbia
| | - Miriam Kulkarni
- St John’s Riverside Hospital, Department of Emergency Medicine, Yonkers, New York
| | - Lorraine Thibodeau
- Albany Medical Center, Department of Emergency Medicine, Albany, New York
| | - Moshe Weizberg
- Northwell Health, Department of Emergency Medicine, New York City, New York
| | - Susan Promes
- Penn State Health, Department of Emergency Medicine, Hershey, Pennsylvania
| |
Collapse
|
21
|
Siegelman JN. Gender Bias in Simulation-Based Assessments of Emergency Medicine Residents. J Grad Med Educ 2018; 10:411-415. [PMID: 30154972 PMCID: PMC6108359 DOI: 10.4300/jgme-d-18-00059.1] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2018] [Revised: 04/06/2018] [Accepted: 05/15/2018] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND Gender-related disparities persist in medicine and medical education. Prior work has found differences in medical education assessments based on gender. OBJECTIVE We hypothesized that gender bias would be mitigated in a simulation-based assessment. METHODS We conducted a retrospective cohort study of emergency medicine residents at a single, urban residency program. Beginning in spring 2013, residents participated in mandatory individual simulation assessments. Twelve simulated cases were included in this study. Rating forms mapped milestone language to specific observable behaviors. A Bayesian regression was used to evaluate the effect of resident and rater gender on assessment scores. Both 95% credible intervals (CrIs) and a Region of Practical Equivalence approach were used to evaluate the results. RESULTS Participants included 48 faculty raters (25 men [52%]) and 102 residents (47 men [46%]). The difference in scores between male and female residents (M = -0.58, 95% CrI -3.31-2.11), and male and female raters (M = 2.87, 95% CrI -0.43-6.30) was small and 95% CrIs overlapped with 0. The 95% CrI for the interaction between resident and rater gender also overlapped with 0 (M = 0.41, 95% CrI -3.71-4.23). CONCLUSIONS In a scripted and controlled system of assessments, there were no differences in scores due to resident or rater gender.
Collapse
|
22
|
Kovacs G, Levitan R, Sandeski R. Clinical Cadavers as a Simulation Resource for Procedural Learning. AEM EDUCATION AND TRAINING 2018; 2:239-247. [PMID: 30051097 PMCID: PMC6050063 DOI: 10.1002/aet2.10103] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2018] [Revised: 04/14/2018] [Accepted: 04/21/2018] [Indexed: 05/28/2023]
Abstract
"See one, do one, teach one" remains an unofficial, unsanctioned framework for procedural skill learning in medicine. Appropriately, medical educators have sought alternative simulation venues for students to safely learn their craft. With the end goal of ensuring competence, educational programming will require the use of valid simulation with appropriate fidelity. While cadavers have been used for teaching anatomy for hundreds of years, more recently they are being repurposed as a "high-fidelity" procedural skill learning simulation resource. Newly deceased, previously frozen, and soft-preserved cadavers, such as those used in Baltimore and Halifax, produce clinical cadavers with high physical and functional fidelity that can serve as simulators for performing many high-acuity procedures for which there is otherwise limited clinical or simulation opportunities to practice. While access and cost may limit the use of cadavers for simulation, there are opportunities for sharing resources to provide an innovative procedural learning experience using the oldest of medical simulation assets, the human body.
Collapse
Affiliation(s)
- George Kovacs
- Departments of Emergency MedicineAnaesthesia, Medical Neurosciences & Division of Medical EducationHalifaxNova ScotiaCanada
- Clinical Cadaver ProgramDalhousie UniversityHalifaxNova ScotiaCanada
- QEII Health Sciences CentreHalifaxNSCanada
| | - Richard Levitan
- Dartmouth Geisel School of MedicineDepartment of MedicineDartmouth‐Hitchcock Medical CenterLebanonNH
| | - Rob Sandeski
- Department of Medical NeurosciencesHalifaxNova ScotiaCanada
| |
Collapse
|