Cost and logistics for implementing the American College of Surgeons objective structured clinical examination

Comparability of Objective Structured Clinical Examinations (OSCEs) and Written Tests for Assessing Medical School Students' Competencies: A Scoping Review

Objective Structured Clinical Examinations (OSCEs) and written tests are commonly used to assess health professional students, but it remains unclear whether the additional human resources and expenses required for OSCEs, both in-person and online, are worthwhile for assessing competencies. This scoping review summarized literature identified by searching MEDLINE and EMBASE comparing 1) OSCEs and written tests and 2) in-person and online OSCEs, for assessing health professional trainees' competencies. For Q1, 21 studies satisfied inclusion criteria. The most examined health profession was medical trainees (19, 90.5%), the comparison was most frequently OSCEs versus multiple-choice questions (MCQs) (18, 85.7%), and 18 (87.5%) examined the same competency domain. Most (77.5%) total score correlation coefficients between testing methods were weak (r < 0.40). For Q2, 13 articles were included. In-person and online OSCEs were most used for medical trainees (9, 69.2%), checklists were the most prevalent evaluation scheme (7, 63.6%), and 14/17 overall score comparisons were not statistically significantly different. Generally low correlations exist between MCQ and OSCE scores, providing insufficient evidence as to whether OSCEs provide sufficient value to be worth their additional cost. Online OSCEs may be a viable alternative to in-person OSCEs for certain competencies where technical challenges can be met.

Mixed-Method Evaluation of a Cadaver Dissection Course for General Surgery Interns: An Innovative Approach for Filling the Gap Between Gross Anatomy and the Operating Room

OBJECTIVE

To evaluate an innovative whole cadaver dissection curriculum designed to focus on teaching procedure-relevant anatomy and surgical skills to surgery interns.

DESIGN

A mixed methods explanatory sequential design incorporating both quantitative and qualitative evaluations was used to evaluate the cadaver dissection course. Quantitative data were prospectively collected and retrospectively reviewed in order to compare anatomy knowledge and operative skills before and after the course. In the qualitative phase, open-ended telephone interviews were conducted in order to explore the major strengths and weaknesses of the course and gain a more in-depth understanding of resident perceptions and attitudes toward the course.

SETTING

All UCLA categorical surgery interns who have undergone the cadaver dissection curriculum between the years 2010 to 2016 were recruited for evaluation and interview.

PARTICIPANTS

From 2010 to 2016, 6 to 7 categorical surgery interns were enrolled in the cadaver dissection course each year.

RESULTS

Anatomy practical examination scores increased following implementation of the course from 50.5% to 83.5% (p < 0.01). Faculty ratings of operative skills improved as well (average Likert scale rating for technical skills improved from 4.1 ± 0.4 to 4.4 ± 0.3, p = 0.06). Almost all interviewees (96%) reported that the course improved their knowledge of anatomy, and 78% of respondents believed the course was conducive to improving technical skills.

CONCLUSIONS

We believe that cadaver dissection courses offer a superior educational model for teaching clinically relevant anatomy as well as surgical skills. We found improvements in anatomy knowledge and technical skills, and trainees expressed strongly favorable views of the program.

Comparative Analysis of Simulated versus Live Patient-Based FAST (Focused Assessment With Sonography for Trauma) Training

OBJECTIVE

To investigate whether simulated patient (SP)-based training has comparable efficacy as live patient (LP)-based training in teaching Focused Abdominal Sonography for Trauma (FAST) knowledge and skill competencies to surgical residents.

DESIGN

A randomized pretest/intervention/posttest controlled study design was employed to compare the participants' performance in written and practical examinations regarding FAST examination after SP-based versus LP-based training.

SETTING

University-based general residency program at a single institution.

PARTICIPANTS

A total of 29 general surgery residents of various training levels and sonographic experience were recruited by convenience sampling.

RESULTS

There was no correlation between subjects' baseline training level or sonographic experience with either the posttest-pretest score difference or the percentage of subjects getting all 4 windows with adequate quality. There was no significant difference between the improvement in written posttest-pretest scores for SP and LP group, which were 33 ± 9.6 and 31 ± 6.8 (p = 0.40), respectively. With regard to performance-based learning efficacy, a statistically higher proportion of subjects were able to obtain all 4 windows with adequate quality among the LP than the SP group (6/8 vs 1/8, p = 0.01).

CONCLUSION

SP- and LP-based FAST training for surgical residents were associated with similar knowledge-based competency acquisition, but residents receiving LP-based training were better at acquiring adequate FAST windows on live patients. Simulation training appeared to be a valid adjunct to LP practice but cannot replace LP training. Future investigations on how to improve simulation fidelity and its training efficacy for skill-based competencies are warranted.

A Video-Based Module for Teaching Communication Skills to Otolaryngology Residents

OBJECTIVE

To determine whether instructional videos modeling examples of "good" and "bad" patient communication skills are useful as an educational tool for improving resident-patient communication.

DESIGN

Retrospective study in which resident participants in the module gave survey responses indicating perceived utility of the exercise.

SETTING

Tertiary academic medical center.

PARTICIPANTS

A total of 11 otolaryngology trainees from postgraduate year 1-5 who attended the course over 2 separate sessions and provided feedback on the benefits of the module.

RESULTS

All 11 residents attended both sessions. Of 22 total survey responses, 21 found that the videos were "realistic and engaging" and were a true representation of commonly encountered clinical scenarios. Residents identified multiple themes and behaviors distinguishing "good" vs "bad" communication with patients and felt they could incorporate these into daily practice. A perceived weakness was the lack of opportunity for "role playing" with a video-based module as opposed to standardized patients.

CONCLUSIONS

Instructional videos, when realistic, are useful for modeling effective patient communication skills for residents. By watching the videos, residents are able to identify specific techniques they can incorporate into their daily practice.