Transition to Residency: The Successful Development and Implementation of a Nonclinical Elective in Perioperative Management

The Effects of an E-learning Module on Medical Trainees Rotating on a Perioperative Medicine Clinical Service

Introduction

Dedicated perioperative care can be cost-effective and improve patient outcomes. Training future physicians to practice perioperative medicine is an important responsibility of medical educators. An e-learning module delivered asynchronously during clinical rotations in perioperative medicine may help to better satisfy this responsibility.

Method

Articulate software was used to create an interactive, 1-hour e-module based on six educational objectives. The e-module was offered as an elective self-directed learning experience to trainees on perioperative medicine clinical rotations, including third- and fourth-year medical students as well as residents from internal medicine, anesthesiology, neurology, and physical medicine and rehabilitation training programs. We assessed the effectiveness of this learning strategy as a complement to real-time clinical experiences by measuring the knowledge, confidence, and satisfaction of trainees before and after completion of the e-module.

Results

Of 113 trainees invited to participate, 75 completed the module and were included in our analysis. Knowledge scores improved for student (p < .001), intern (p < .001), and resident (p < .001) subgroups. Confidence ratings also improved for student (p < .001), intern (p < .001), and resident (p < .001) subgroups. Trainees reported high satisfaction with the e-module, and 60 (87%) reported that it would alter their practice.

Discussion

An e-module presenting evidence-based, interactive education to trainees during clinical rotations in perioperative medicine was an effective learning strategy. Sharing e-learning tools across institutions may help to deliver standardized education on core clinical topics, including perioperative medicine.

Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review

BACKGROUND

Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding how mobile apps meet users' needs. No previous reviews have investigated the usability of mobile apps developed for health care education.

OBJECTIVE

The aim of this scoping review is to identify usability methods and attributes in usability studies of mobile apps for health care education.

METHODS

A comprehensive search was carried out in 10 databases, reference lists, and gray literature. Studies were included if they dealt with health care students and usability of mobile apps for learning. Frequencies and percentages were used to present the nominal data, together with tables and graphical illustrations. Examples include a figure of the study selection process, an illustration of the frequency of inquiry usability evaluation and data collection methods, and an overview of the distribution of the identified usability attributes. We followed the Arksey and O'Malley framework for scoping reviews.

RESULTS

Our scoping review collated 88 articles involving 98 studies, mainly related to medical and nursing students. The studies were conducted from 22 countries and were published between 2008 and 2021. Field testing was the main usability experiment used, and the usability evaluation methods were either inquiry-based or based on user testing. Inquiry methods were predominantly used: 1-group design (46/98, 47%), control group design (12/98, 12%), randomized controlled trials (12/98, 12%), mixed methods (12/98, 12%), and qualitative methods (11/98, 11%). User testing methods applied were all think aloud (5/98, 5%). A total of 17 usability attributes were identified; of these, satisfaction, usefulness, ease of use, learning performance, and learnability were reported most frequently. The most frequently used data collection method was questionnaires (83/98, 85%), but only 19% (19/98) of studies used a psychometrically tested usability questionnaire. Other data collection methods included focus group interviews, knowledge and task performance testing, and user data collected from apps, interviews, written qualitative reflections, and observations. Most of the included studies used more than one data collection method.

CONCLUSIONS

Experimental designs were the most commonly used methods for evaluating usability, and most studies used field testing. Questionnaires were frequently used for data collection, although few studies used psychometrically tested questionnaires. The usability attributes identified most often were satisfaction, usefulness, and ease of use. The results indicate that combining different usability evaluation methods, incorporating both subjective and objective usability measures, and specifying which usability attributes to test seem advantageous. The results can support the planning and conduct of future usability studies for the advancement of mobile learning apps in health care education.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/19072.

Comparative Evaluation of Choose Your Own Adventure and Traditional Linear Case Formats in Radiology Small Group Teaching

RATIONALE AND OBJECTIVES

We aim to compare Choose Your Own Adventure (CYOA) presentation format with linear case format as educational methods for teaching a radiology small group session to medical students.

MATERIALS AND METHODS

A radiology small group session was held for preclinical second-year medical students in the pulmonary course, whereby eight classrooms of students and eight radiology facilitators were each randomized to do either the linear case format or the nonlinear CYOA presentation format. All students in attendance were administered a survey at the end of the session, which assessed students' perceptions using five-point Likert-type questions. The survey also contained a four-question knowledge quiz on chest radiology. The facilitators were administered a qualitative survey as well. Between-group analyses were performed using Student's t-test.

RESULTS

Of the 144 students who attended the small group sessions, 143 students completed the survey (99.3%). The CYOA format group reported significantly greater engagement in the cases (4.5 ± 0.7 vs. 3.8 ± 0.7, p < 0.001), satisfaction with the format (4.6 ± 0.6 vs. 3.7 ± 0.9, p < 0.001), and enhancement of clinical decision making skills (4.5 ± 0.6 vs. 3.5 ± 0.9, p < 0.001). The linear format group reported a greater role for the facilitator to add value (4.6 ± 0.5 vs. 4.3 ± 1.1, p = 0.033). There was no significant difference between groups in performance on the knowledge quiz.

CONCLUSION

Medical students reported higher satisfaction, engagement, and enhanced clinical decision making skills with the CYOA presentation method compared to linear case format for radiology small group learning.

Facilitating Learner-Centered Transition to Residency: A Scoping Review of Programs Aimed at Intrinsic Competencies

Phenomenon: There is currently a move to provide residency programs with accurate competency-based assessments of their candidates, yet there is a gap in knowledge regarding the role and effectiveness of interventions in easing the transition to residency. The impact of key stakeholder engagement, learner-centeredness, intrinsic competencies, and assessment on the efficacy of this process has not been examined. The objective of this scoping review was to explore the nature of the existing scholarship on programs that aim to facilitate the transition from medical school to residency. Approach: We searched MEDLINE and EMBASE from inception to April 2020. Programs were included if they were aimed at medical students completing undergraduate medical training or first year residents and an evaluative component. Two authors independently screened all abstracts and full text articles in duplicate. Data were extracted and categorized by type of program, study design, learner-centeredness, key stakeholder engagement, the extent of information sharing about the learner to facilitate the transition to residency, and specific program elements including participants, and program outcomes. We also extracted data on intrinsic (non-Medical Expert) competencies, as defined by the CanMEDS competency framework. Findings: Of the 1,006 studies identified, 55 met the criteria for inclusion in this review. The majority of the articles that were eligible for inclusion were from the United States (n = 31, 57%). Most of the studies (n = 47, 85%) employed quantitative, or mixed method research designs. Positive outcomes that were commonly reported included increased self-confidence, competence in being prepared for residency, and satisfaction with the transition program. While a variety of learner-centered programs that focus on specific intrinsic competencies have been implemented, many (n = 29, 52%) did not report engaging learners as key stakeholders in program development. Insights: While programs that aim to ease the transition from medical school to residency can enhance both Medical Expert and other intrinsic competencies, there is much room for novel transition programs to define their goals more broadly and to incorporate multiple areas of professional development. The existing literature highlights various gaps in approaches to easing the transition from medical school to residency, particularly with respect to key stakeholder engagement, addressing intrinsic CanMEDS competencies, and focusing on individual learners' needs.

MedsOnCall Pager App: A Pilot Project for Practicing Safe Clinical Decision-making

Errors in clinical decision-making contribute to approximately half of in-hospital adverse events. The steep learning curve when students transition to residents is particularly susceptible to increased errors. Decision-making skills are a major contributor to preparedness for residency and educators agree that decision-making should be purposefully taught and tested. Despite this, little structured assessment of decision-making currently exists. This innovation report describes the development and piloting of the MedsOnCall (MOC) Pager App, a simulated pager program designed as a learning and assessment tool for senior medical students and junior residents to practice safe clinical decision-making as they transition between these two roles. Learners are randomly "paged" by the app about a list of virtual patients. To answer, they must integrate pertinent patient information efficiently. Learners then receive a page-management question that further probes their decision-making skills by asking them to consider the urgency and their level of confidence when determining the virtual patient's needs. The pilot version of the app was successfully alpha-tested in 2016 and 2017 with twenty fourth year medical students at our institution. Subjectively, students greatly enjoyed using the MOC Pager app to practice answering pages in a safe environment. The app was then adapted for the National Cardiac Surgery Bootcamp in 2017 for use by first-year residents. With demonstrated success as a pilot project, our group aims to rebuild the app for customizable use by multidisciplinary learners anywhere in the world simultaneously. We also plan to collect validity evidence, integrate in-app feedback capability, and disseminate the app on multiple platforms.