Implementation and faculty perception of outpatient medical student workplace-based assessments

BACKGROUND

There is growing interest in use of entrustable professional activity (EPA)-grounded workplace-based assessments (WBAs) to assess medical students through direct observation in the clinical setting. However, there has been very little reflection on how these tools are received by the faculty using them to deliver feedback. Faculty acceptance of WBAs is fundamentally important to sustained utilisation in the clinical setting, and understanding faculty perceptions of the WBA as an adjunct for giving targeted feedback is necessary to guide future faculty development in this area.

APPROACH

Use of a formative EPA-grounded WBA was implemented in the ambulatory setting during the paediatrics clerkship following performance-driven training and frame-of-reference training with faculty. Surveys and semi-structured interviews with faculty members explored how faculty perceived the tool and its impact on feedback delivery.

EVALUATION

Faculty reported providing more specific, task-oriented feedback following implementation of the WBA, as well as greater timeliness of feedback and greater satisfaction with opportunities to provide feedback, although these later two findings did not reach significance. Themes from the interviews reflected the benefits of WBAs, persistent barriers to the provision of feedback and suggestions for improvement of the WBA.

IMPLICATIONS

EPA-grounded WBAs are feasible to implement in the outpatient primary care setting and improve feedback delivery around core EPAs. The WBAs positively impacted the way faculty conceptualise feedback and provide learners with more actionable, behaviour-based feedback. Findings will inform modifications to the WBA and future faculty development and training to allow for sustainable WBA utilisation in the core clerkship.

A Pediatric Resident Curriculum for the Use of Health Literacy Communication Tools

Background:

Objective:

Methods:

Key Results:

Conclusions:

Plain Language Summary:

Design and implementation of an interactive, competency-based pilot pediatric telemedicine curriculum

During the height of the COVID-19 pandemic, telemedicine visits surged to increase access and maintain continuity of care, while reducing transmission of disease. However, few curricula exist for training residents on how to care for patients via telemedicine, especially in pediatrics. We aimed to create and evaluate an interactive, competency-based pilot curriculum, to meet the urgent need to train residents in telemedicine. The curriculum was developed in 2020 and includes a didactic, cased-based discussions, and direct observation exercise. A model for precepting residents, adhering to new ACGME guidelines, was also created to further engage residents in telemedicine in the outpatient general pediatrics settings. To evaluate the curriculum, we assessed feasibility of a direct observation to provide feedback and we conducted pre and post surveys to assess for changes in residents' self-reported skills in performing telemedicine visits following implementation of the curriculum. 16 residents participated in the curriculum and 15 completed both the pre and post surveys (93%). Residents' self-reported efficacy in performing key components of telemedicine visits, including completion of telemedicine visit (p = 0.023), initiation of visits (p = 0.01), and documentation (p = 0.001) all improved significantly following implementation. Residents' perception of patient satisfaction with telemedicine and personal perception of ease of use of the telemedicine system increased, though neither were statistically significant. Uptake of the direct observation exercise was nearly universal, with all but one resident having a direct observation completed during their ambulatory month. This novel, interactive telemedicine pilot curriculum for residents addresses ACGME competencies and provides residents with a toolkit for engaging in telemedicine.

Transition-to-residency: pilot innovative, online case-based curriculum for medical students preparing for pediatric internships

Background: There is increasing recognition in medical education that greater emphasis must be placed on preparing graduating medical students for their new roles as interns. Few publications in the literature have described transition-to-residency curricula specifically for students interested in pediatrics or pediatric-related fieldsApproach: We developed novel online pediatric cases, embedded within an innovative, hybrid transition-to-residency course, to address high yield, multi-disciplinary topics within the context of several of the AAMC's identified Entrustable Professional ActivitiesEvaluation: The pilot cases were evaluated over two academic years (2018, 2019) at a single academic medical center as part of routine student course evaluation (N = 18/35) with the 2019 evaluation containing additional retrospective pre-post survey questions (N = 9/18) assessing self-reported changes in knowledge. Almost all students were very satisfied or satisfied with the modules overall (94%), the quality of the resources provided (100%), and the structure and clarity of the presentation of the material (100%). Among the students who completed the retrospective pre-post survey after participation in the online modules, significant self-reported improvements were noted in writing orders to the pediatrics floor (Z = -2.07, p = 0.04), providing anticipatory guidance (Z = -2.0,p = 0.046), formulating a differential diagnosis for common pediatric conditions (Z = -2.24, P = 0.03), and preparedness for managing common pediatric floor emergencies (Z = -2.33, P = 0.02).Reflection: We demonstrated feasibility of implementation of an interactive, online case-based curriculum, medical student satisfaction with content and delivery, and increased self-reported knowledge after completion of the pilot pediatric cases on the online, asynchronous learning platform.