Adaptive Tutorials Versus Web-Based Resources in Radiology: A Mixed Methods Analysis of Efficacy and Engagement in Senior Medical Students

What works in radiology education for medical students: a systematic review and meta-analysis

BACKGROUND

Medical imaging related knowledge and skills are widely used in clinical practice. However, radiology teaching methods and resultant knowledge among medical students and junior doctors is variable. A systematic review and meta-analysis was performed to compare the impact of different components of radiology teaching methods (active versus passive teaching, eLearning versus traditional face-to-face teaching) on radiology knowledge / skills of medical students.

METHODS

PubMed and Scopus databases were searched for articles published in English over a 15-year period ending in June 2021 quantitatively comparing the effectiveness of undergraduate medical radiology education programs regarding acquisition of knowledge and/or skills. Study quality was appraised by the Medical Education Research Study Quality Instrument (MERSQI) scoring and analyses performed to assess for risk of bias. A random effects meta-analysis was performed to pool weighted effect sizes across studies and I2 statistics quantified heterogeneity. A meta-regression analysis was performed to assess for sources of heterogeneity.

RESULTS

From 3,052 articles, 40 articles involving 6,242 medical students met inclusion criteria. Median MERSQI score of the included articles was 13 out of 18 possible with moderate degree of heterogeneity (I2 = 93.42%). Thematic analysis suggests trends toward synergisms between radiology and anatomy teaching, active learning producing superior knowledge gains compared with passive learning and eLearning producing equivalent learning gains to face-to-face teaching. No significant differences were detected in the effectiveness of methods of radiology education. However, when considered with the thematic analysis, eLearning is at least equivalent to traditional face-to-face teaching and could be synergistic.

CONCLUSIONS

Studies of educational interventions are inherently heterogeneous and contextual, typically tailored to specific groups of students. Thus, we could not draw definitive conclusion about effectiveness of the various radiology education interventions based on the currently available data. Better standardisation in the design and implementation of radiology educational interventions and design of radiology education research are needed to understand aspects of educational design and delivery that are optimal for learning.

TRIAL REGISTRATION

Prospero registration number CRD42022298607.

Using Rubrics to Evaluate E-Learning Tools in Radiology Education

Recent trends in medical education with an emphasis on active learning strategies and blended learning techniques have resulted in a growing volume and utilization of online educational resources. Integration of online learning tools into medical curricula has been further necessitated during the COVID-19 pandemic. With access to abundant digital radiology education resources, it has become increasingly important for educators to be able to evaluate the efficacy of e-learning tools for use in radiology education. In this manuscript, the authors describe their successful search for a vetted method to evaluate e-learning tools in radiology education. The selected rubric was designed by educational developers supporting technology to be used as a formative tool in higher education. The rubric was applied in condensed and noncondensed formats to 2 existing popular highly subscribed radiology e-learning resources and results were displayed in narrative and visual formats. More widespread application of this rubric would be beneficial to the content creators and learners alike.

Teaching with Technology-Matching Pedagogy with Purpose in Radiology Education

The response to pandemic-related teaching disruption has revealed dynamic levels of learning and teaching flexibility and rapid technology adoption of radiology educators and trainees. Shutdowns and distancing requirements accelerated the adoption of technology as an educational tool, in some instances supplanting in-person education entirely. Despite the limitations of remote interaction, many educational advantages were recognized that can be leveraged in developing distance learning paradigms. The specific strategies employed should match modern learning science, enabling both students and educators to mutually grow as lifelong learners. As panel members of the "COVID: Faculty perspective" Task Force of the Association of University Radiologists Radiology Research Alliance, we present a review of key learning principles which educators can use to identify techniques that enhance resident learning and present an organized framework for applying technology-aided techniques aligned with modern learning principles. Our aim is to facilitate the purposeful integration of learning tools into the training environment by matching these tools to established educational frameworks. With these frameworks in mind, radiology educators have the opportunity to re-think the balance between traditional curricular design and modern digital teaching tools and models.

Student and Educator Experiences of an Integrated Medical Imaging Curriculum

INTRODUCTION

Medical imaging is integrated across all years in the medical programs at the Medical School, in our country. Little is known about this pedagogical approach from the perspective of those who participate in it. This study investigated how students and educators experience an integrated medical imaging curriculum.

METHODS

One-on-one interviews were conducted with nine educators and three undergraduate medical students and analyzed using a reflexive thematic approach. Educators included radiologists, non-radiologists clinicians, and scientists and health professionals from the medical program.

RESULTS

The integrated medical imaging curriculum appears to be incoherently experienced by educators and students as learning opportunities that were 'everywhere and nowhere'. Teaching events were 'repetitive and patchy' and featured a transmission-oriented pedagogy emphasizing 'exposure and absorption'. Educators expressed paradoxical views of their responsibility for teaching medical imaging reflected in this sentiment: 'I don't teach medical imaging… (but I do)'.

DISCUSSION

When medical imaging is integrated into learning resources and course work across the undergraduate program, it may lose its visibility and importance as a distinct learning area despite its crucial role in medical practice. An integrated curriculum may inadvertently separate knowing about medical imaging from learning to apply medical imaging knowledge in clinical practice.

CONCLUSIONS

Further work is required to construct an integrated medical imaging curriculum that explicitly emphasizes medical imaging learning outcomes, so they are experienced coherently and consistently by medical students and those who prepare them for practice as doctors.

TeachMe: a web-based teaching system for annotating abdominal lymph nodes

The detection and characterization of lymph nodes through interpreting abdominal medical images are significant for diagnosing and treating colorectal cancer recurrence. However, interpreting abdominal medical images manually is labor-intensive and time-consuming. The related radiology education has many limitations as well. In this context, we seek to build an extensive collection of abdominal medical images with ground truth labels for lymph nodes recognition research and help junior doctors to train their interpretation skills. Therefore, we develop TeachMe, which is a web-based teaching system for annotating abdominal lymph nodes. The system has a three-level annotation-review workflow to construct an expert database of abdominal lymph nodes and a feedback mechanism helping junior doctors to learn the tricks of interpreting abdominal medical images. TeachMe’s functionalities make itself stand out against other platforms. To validate these functionalities, we invite a medical team from Gastrointestinal Surgery Center, West China Hospital, to participate in the data collection workflow and experience the feedback mechanism. With the help of TeachMe, an expert dataset of abdominal lymph nodes has been created and an automated detection model for abdominal lymph nodes with incredible performances has been proposed. Moreover, through three rounds of practicing via TeachMe, our junior doctors’ interpretation skills have been improved.

Knowledge Retention of the NIH Stroke Scale among Stroke Unit Health Care Workers Using Video vs. E-Learning: Protocol for a Web-Based, Randomized Controlled Trial

The National Institutes of Health Stroke Scale (NIHSS) is commonly used to triage and monitor the evolution of stroke victims. Data regarding NIHSS knowledge in nurses and physicians working with stroke patients are scarce, and a progressive decline in specific knowledge regarding this challenging scale is to be expected even among NIHSS certified personnel. This protocol was designed according to the CONSORT-eHealth (Consolidated Standards of Reporting Trials) guidelines. It describes the design of a randomized controlled trial whose primary objective is to determine if nurses and physicians who work in stroke units improve their NIHSS knowledge more significantly after following a highly interactive e-learning module than after following the traditional didactic video. Univariate and multivariable linear regression will be used to analyze the primary outcome, which will be the difference between the score on a 50-question quiz answered before and immediately after following the allocated learning material. Secondary outcomes will include knowledge retention at one month, assessed using the same 50-question quiz, user satisfaction, user course duration perception, and probability of recommending the allocated learning method. The study is scheduled to begin during the first semester of 2022.

Medical imaging education opportunities for junior doctors and non-radiologist clinicians: A review

Medical imaging plays a critical role in clinical decision-making across disciplines, and as such, there is frequent need for non-radiologist clinicians to interact with medical imaging. This review examines the literature about the delivery of medical imaging education to non-radiologist clinicians, spanning junior doctors, advanced trainees and specialists. Knowledge of medical imaging among non-radiologist clinicians is paramount to the quality of patient care, with calls for formal implementation of radiology education into non-imaging specialty training programmes. Overall, there is a demand across non-imaging disciplines for greater formalised medical imaging education. Concerns are raised that too great a reliance on informal methods of teaching radiology, for example in ward settings, results in greater variation in the quality and volume of educational opportunities and risks the perpetuation of erroneous attitudes and practices. The evolution of the medical imaging workplace and increasing utilisation of remote reporting has distanced the collaborative relationship between radiologists and their non-imaging colleagues, diminishing opportunities for ad hoc learning and engagement in larger formalised educational collaborations. Ideally, radiologists should be directly involved in the development and delivery of medical imaging education to post-graduate doctors to not only benefit patient care but also foster inter-specialty relationships and respect. Evidence supports the value of structured radiological teaching opportunities, including tutorials, lectures and electronic resources, in improving medical imaging skills among non-radiologist clinicians. There is wide scope for growth in the e-learning arena to address this demand for quality and accessible imaging education for our non-radiology colleagues.

An Adaptive Blended Learning Approach in the Implementation of a Medical Neuroscience Laboratory Activities

Background

The COVID-19 pandemic revealed existing gaps in the medical educational system that is heavily dependent on the presence of medical students and teachers in laboratory and class for instruction. This affects continuity in the implementation of the neuroanatomy component of the medical neuroscience laboratory activities during COVID-19. We hypothesized that pivoting wet laboratory neuroanatomy activities to online using an adaptive flexible blended method might represent an effective approach in the implementation of laboratory neuroanatomy activities during a pandemic.

Methods

The current study describes an adaptive flexible blended learning approach that systematically mixes virtual face-to-face interaction activities with the online learning of brain structures, and the discussion of clinical cases. Learning materials are delivered through both synchronous and asynchronous modes, and Year 1 medical students learn neuroanatomy laboratory activities at different locations and different times. Student performances in the adaptive flexible blended learning approach were compared with the learning of similar activities during an in-person implementation of neuroscience laboratory activities.

Results

The results of using this adaptive flexible blended learning approach provided an autonomous independent learning, self-study approach that broadened student performance such that we have more students scoring between 80 and 89%, whereas the in-person learning resulted in most of the students scoring > 90% in the medical neuroscience laboratory activities.

Conclusion

An adaptive flexible blended learning approach that combined virtual face-to-face instruction using digital technology with online learning of neuroscience laboratory activities provided a unique educational experience for Year 1 medical students to learn neuroscience laboratory activities during the COVID-19 pandemic.

Asynchronous Distance Learning of the National Institutes of Health Stroke Scale During the COVID-19 Pandemic (E-Learning vs Video): Randomized Controlled Trial

BACKGROUND

The COVID-19 pandemic has considerably altered the regular medical education curriculum while increasing the need for health care professionals. Senior medical students are being incrementally deployed to the front line to address the shortage of certified physicians. These students, some of whom will be fast-tracked as physicians, may lack knowledge regarding the initial management of time-critical emergencies such as stroke.

OBJECTIVE

Our aim was to determine whether an e-learning module could improve asynchronous distance knowledge acquisition of the National Institutes of Health Stroke Scale (NIHSS) in senior medical students compared to the traditional didactic video.

METHODS

A randomized, data analyst-blinded web-based trial was conducted at the University of Geneva Faculty of Medicine between April and June 2020. Fifth year medical students followed a distance learning path designed to teach the NIHSS. The control group followed the traditional didactic video created by Patrick Lyden, while the e-learning group followed the updated version of a previously tested, highly interactive e-learning module. The main outcome was the score on a 50-question quiz displayed upon completion of the learning material. The difference in the proportion of correct answers for each specific NIHSS item was also assessed.

RESULTS

Out of 158 potential participants, 88 started their allocated learning path and 75 completed the trial. Participants who followed the e-learning module performed better than those who followed the video (38 correct answers, 95% CI 37-39, vs 35 correct answers, 95% CI 34-36, P<.001). Participants in the e-learning group scored better on five elements than the video group: key NIHSS concepts (P=.02), the consciousness - global item (P<.001), the facial palsy item (P=.04), the ataxia item (P=.03), and the sensory item (P=.04).

CONCLUSIONS

Compared to the traditional didactic video, a highly interactive e-learning module enhances asynchronous distance learning and NIHSS knowledge acquisition in senior medical students.

Medical Student Education Roadblock Due to COVID-19: Virtual Radiology Core Clerkship to the Rescue

Rationale and Objectives

Medical schools were upended by the COVID-19 pandemic, resulting in suspension of all in-person educational activities, and leaving clinical clerkships on hold indefinitely. A virtual curriculum and novel teaching methods were needed to fulfill curricular requirements. We developed a comprehensive virtual radiology clerkship and evaluated the efficacy of this novel method of teaching.

Materials and Methods

A 4-week virtual radiology clerkship was designed to accommodate medical students who had not yet completed the required clerkship. The design included online flipped classroom modules, large group didactic lectures, and small group homeroom activities. Student performance was assessed via a standardized online final exam. Feedback from students was collected using online surveys. Student performance was compared to the in-person radiology clerkship.

Results

One hundred and eleven medical students were enrolled in the virtual radiology clerkship. Final exam scores were similar to the in-person clerkship. Students indicated that small group homeroom activities had the highest overall satisfaction. Students recognized enthusiastic teachers regardless of class format. Exceptional course content and organization were also noted. Course weaknesses included didactic lecture content which was repetitive or too advanced, the limited opportunity to build personal connections with faculty, and scheduling conflicts with other competing school activities.

Conclusion

A completely virtual radiology core clerkship can be a successful educational experience for medical students during a time when remote learning is required. A small group learning environment is most successful for student engagement. Personal connections between faculty and students can be challenging in a virtual course.

Adaptive tutorials versus web-based resources in radiology: a mixed methods analysis in junior doctors of efficacy and engagement

BACKGROUND

Radiology education is limited in undergraduate Medicine programs. Junior doctors might not have the necessary background to effectively order and interpret diagnostic imaging investigations. Furthermore, junior doctors are often time-poor, balancing clinical commitments with ongoing learning, leadership and teaching responsibilities. Previous studies have demonstrated the efficacy of radiology-themed online adaptive tutorials for senior medical students. Such adaptive tutorials might therefore be an efficient and effective form of radiology education for junior doctors.

METHODS

A randomised controlled crossover trial was performed to evaluate the impact of adaptive tutorials on learning the indications for, and interpretation of, basic imaging studies, compared with peer-reviewed web-based resources. Ninety-one volunteer junior doctors, comprising 53 postgraduate year 1 (PGY 1) and 38 postgraduate year 2 (PGY 2), were randomly allocated into two groups. In the first phase of the trial, focusing on head CT, one group accessed adaptive tutorials while the other received web-based resources. In the second phase of the trial, focusing on chest CT, the groups crossed over. Following each phase of the trial, participants completed exam-style online assessments. At the conclusion of the study, participants also completed an online questionnaire regarding perceived engagement and efficacy of each type of educational resource.

RESULTS

Junior doctors completed the adaptive tutorials significantly faster than the relevant web-based resources for both head CT and chest CT (p = 0.03 and < 0.01 respectively). Mean quiz scores were higher in the groups receiving adaptive tutorials on head CT and chest CT (86.4% vs 83.5 and 77.7% vs 75% respectively). However, in contrast to previous studies in senior medical students, these differences were not statistically significant. Participants reported higher engagement and perceived value of adaptive tutorials, compared with web-based resources.

CONCLUSIONS

Adaptive tutorials are more time-efficient than existing web-based resources for learning radiology by junior doctors, while both types of resources were equally effective for learning in this cohort. Junior doctors found the adaptive tutorials more engaging and were more likely to recommend these resources to their colleagues.