Conceptualising spaced learning in health professions education: A scoping review

Enhancing cosmetic suturing skill acquisition in surgical residents through spaced learning training: a randomized controlled trial

BACKGROUND

Previous research has strongly supported the utility of spaced learning in enhancing memory, but its effectiveness in complex surgical procedures has largely been unexplored. The main objective of this study was to evaluate whether, in comparison to concentrated learning, spaced learning improves the short-term acquisition and long-term retention of cosmetic suturing skills as outcomes of surgical resident training courses.

METHODS

This randomized controlled trial was conducted from February 2023 to June 2023. Surgical residents were recruited from a teaching hospital in Guangzhou, China. The participants were randomly assigned at a 1:1 ratio to either the spaced training group (40 min of training followed by a 20-minute break) or the concentrated training group (3 h of continuous training), in which they received one-on-one training for cosmetic suturing skills. The short-term acquisition and long-term retention outcomes were evaluated by three independent raters using an objective scoring scale to assess the participants' cosmetic suturing skills before the training (pretraining test), within one hour after the training (posttraining test), and three months after the completion of the training (follow-up test). The score for each participant was calculated as the average of three independent scores.

RESULTS

The study included 23 surgical residents, 12 in the spaced training group and 11 in the concentrated training group. The pretraining test revealed no significant difference between the groups. However, in the post-training test, the spaced training group achieved a significantly higher total score than did the concentrated training group (74.06 ± 5.87 vs. 63.43 ± 10.73, p = 0.0070). Specifically, the suture technique scores were 28.46 ± 1.78 and 22.85 ± 3.75, respectively, which were significantly different (p = 0.0002). During the long-term follow-up test, the spaced training group consistently outperformed the concentrated training group by having significantly higher total (75.60 ± 4.78 vs. 60.68 ± 10.40, p = 0.0001), suture quality (32.26 ± 4.01 vs. 26.23 ± 4.16, p = 0.0019), suture technique (28.68 ± 2.63 vs. 22.18 ± 3.94, p = 0.0001), and suturing time scores (14.67 ± 1.15 vs. 12.27 ± 6.07, p = 0.0460).

CONCLUSIONS

Incorporating the principles of spaced learning into the instructional process of obtaining cosmetic suture skills for surgical residents not only significantly enhances short-term skill improvement but also contributes to the long-term retention of training outcomes.

Spaced Digital Education for Health Professionals: Systematic Review and Meta-Analysis

BACKGROUND

Spaced digital education applies digital tools to deliver educational content via multiple, repeated learning sessions separated by prespecified time intervals. Spaced digital education appears to promote acquisition and long-term retention of knowledge, skills, and change in clinical behavior.

OBJECTIVE

The aim of this review was to assess the effectiveness of spaced digital education in improving pre- and postregistration health care professionals' knowledge, skills, attitudes, satisfaction, and change in clinical behavior.

METHODS

This review followed Cochrane's methodology and PRISMA (Preferred Reporting Items of Systematic Reviews and Meta-Analyses) reporting guidelines. We searched MEDLINE, Embase, Web of Science, ERIC, PsycINFO, CINAHL, CENTRAL, and ProQuest Dissertation and Theses databases from January 1990 to February 2023. We included randomized controlled trials (RCTs), cluster RCTs, and quasi-RCTs comparing spaced digital education with nonspaced education, spaced nondigital education, traditional learning, or no intervention for pre- or postregistration health care professionals. Study selection, data extraction, study quality, and certainty of evidence were assessed by 2 independent reviewers. Meta-analyses were conducted using random effect models.

RESULTS

We included 23 studies evaluating spaced online education (n=17, 74%) or spaced digital simulation (n=6, 26%) interventions. Most studies assessed 1 or 2 outcomes, including knowledge (n=15, 65%), skills (n=9, 39%), attitudes (n=8, 35%), clinical behavior change (n=8, 35%), and satisfaction (n=7, 30%). Most studies had an unclear or a high risk of bias (n=19, 83%). Spaced online education was superior to massed online education for postintervention knowledge (n=9, 39%; standardized mean difference [SMD] 0.32, 95% CI 0.13-0.51, I2=66%, moderate certainty of evidence). Spaced online education (n=3, 13%) was superior to massed online education (n=2, 9%) and no intervention (n=1, 4%; SMD 0.67, 95% CI 0.43-0.91, I2=5%, moderate certainty of evidence) for postintervention clinical behavior change. Spaced digital simulation was superior to massed simulation for postintervention surgical skills (n=2, 9%; SMD 1.15, 95% CI 0.34-1.96, I2=74%, low certainty of evidence). Spaced digital education positively impacted confidence and satisfaction with the intervention.

CONCLUSIONS

Spaced digital education is effective in improving knowledge, particularly in substantially improving surgical skills and promoting clinical behavior change in pre- and postregistration health care professionals. Our findings support the use of spaced digital education interventions in undergraduate and postgraduate health profession education. Trial Registration: PROSPERO CRD42021241969.

TRIAL REGISTRATION

PROSPERO CRD42021241969; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=241969.

Optimizing Radiological Education: The Role of Learning Spacing via Test sets in Enhancing Diagnostic Proficiency in Breast Screening Readers

RATIONALE AND OBJECTIVES

Integrating learning spacing in medicine has shown promise in enhancing knowledge retention and diagnostic proficiency. While studies demonstrate the effectiveness of spaced learning in various fields, limited research exists on its application in radiological training. This study aims to investigate the impact of intervals in spaced training on radiologists' and trainees' diagnostic performance via mammogram test sets.

METHODS

54 radiologists and 101 radiology trainees completed 207 and 458 first-time readings of 9 mammogram test sets between 2019 and 2023. Each test set comprised of 60 mammograms (20 cancer and 40 normal), sourced retrospectively from BreastScreen Australia. Each radiologist evaluated mammograms using the BIRADS lexicon. Readers' performance was compared with truth data and evaluated in terms of specificity, case sensitivity, lesion sensitivity, ROC AUC and JAFROC FOM. The progress of readers' performances in following test sets after the first one was analyzed using Wilcoxon Signed Rank test. The association of participants' performances and the intervals among test sets' completions was investigated using Pearson's test.

RESULTS

Significant positive correlations were found between intervals and radiologists' improvement in specificity and JAFROC FOM (P < 0.05). The separation of 4 to 10 days showed the most improvement among radiologists across all metrics, while intervals exceeding 90 days related to highest increase in case sensitivity (5.15%), lesion sensitivity (6.55%), ROC AUC (3.05%) and JAFROC FOM (6.3%). Trainees completing test sets in one day showed positive correlations with their ROC AUC (R=0.45; P = 0.008) and JAFROC FOM (R=0.43; P = 0.02), while those taking a longer time to complete showed negative impacts on case sensitivity (P = 0.009) and ROC AUC (P = 0.02). Remarkable progress in trainees was found in case sensitivity (6.15%), lesion sensitivity (11.6%), ROC AUC (3.5%) and JAFROC FOM (4.35%) with test set intervals of 31-90 days.

CONCLUSIONS

Radiologists demonstrated superior performance when the training test sets were spaced over longer intervals, whereas trainees exhibited proficiency with shorter time separations. By optimizing the spacing of reviewing and practicing radiological concepts, mammogram readers can bolster memory retention and diagnostic decision-making skills.

The effect of spaced learning method on the evaluation score and education quality in nursing students

INTRODUCTION

Spaced learning is a teaching method aiming to stabilize long-term memory. The present study aims to evaluate the effect of the spaced learning method on the evaluation scores and education quality in the practical course of principles and techniques of nursing.

MATERIALS AND METHODS

In this quasi-experimental study, 51 nursing students in four semesters were selected by convenience sampling and randomly divided into experimental and control groups. We used the demographic characteristics form, student scores, and students' evaluations of the educational quality questionnaire (SEEQ) for data gathering. In the next step, the classes of the experimental groups were held with the spaced learning method, and the traditional methods were used for the control groups. After the end of each semester, the SEEQ questionnaire was given to the students of both groups, and their evaluation scores were extracted. The collected data were analyzed using SPSS version 26 using descriptive and inferential statistics.

RESULTS

After ensuring the independence of the data, the results showed that the difference in the mean evaluation score of the students in the two groups is not statistically significant (p > 0.05). However, the mean score of total SSEQ in the experimental group was significantly higher than the control group. Furthermore, except for the dimension of examination assignments and group interaction, the mean score of other SSEQ dimensions in the experimental group was statistically higher than the control group (p < 0.05).

CONCLUSION

Spaced learning is an easy, low-cost, and fun learning method that affects the teaching method compared to evaluation results and effortlessly has the potential to become an appropriate alternative to traditional teaching methods.

Effectiveness of spaced education pedagogy in enhancing Nurses' knowledge on emotional resilience-A quasi-experimental trial

INTRODUCTION

Building resilience among nurses has been postulated as one of the key strategies to support nurses and retain them in the profession. This study aimed to evaluate the effectiveness, of spaced education pedagogy in enhancing Nurses' knowledge on emotional resilience. Secondary objectives include evaluation of the usability and acceptability of delivery of the training via a mobile application in one's own mobile device.

DESIGN

A quasi-experimental study with single group pre-test and post-test trial was conducted.

METHODS

Full-time registered nurses working in an acute care hospital were invited to participate from June 2021 to June 2022. The group used the mobile application daily for 1 month. Pre-test measurement includes socio-demographic data and baseline resilience level before the intervention. Post-test measurement includes resilience level, usability and acceptability of mobile-assisted cognitive-behavioral therapy measured upon completion of the training. The mobile application enabled the delivery of resilience educational content in small quantities through a repeating manner, with a concurrent evaluation of learner's understanding.

RESULTS

When compared to their baseline (mean = 24.38, SD = 5.50), participants reported significant increase in the Connor-Davison Resilience Scale score (mean = 26.33, SD = 5.57) (t = -4.40, p < 0.001). Upon 1 month usage of the mobile application, a higher percentage of the participants reported intermediate to high level of resilience (57.4%), as compared to prior usage (54.7%). Respondents reported knowledge of most useful strategies for their daily lives including: (i) managing negative emotions (54.1%); (ii) psychoeducation about mental health and the risks of burnout (44.7%); (iii) achieving work and life balance (43.5%); and (iv) depiction of workplace scenarios to demonstrate what can be and cannot be controlled during times of change (43.5%). Participants reported usability of the mobile application with a mean SUS score 70.5 (SD = 13.0), which was considered "acceptable." Overall, 82.3% of the participants found the mobile application appealing, 64.7% reported they were likely to use the mobile application in the future and 72.9% would recommend it to other nurses.

CONCLUSION

The mobile application provided nurses with the availability and convenience to access resilience building learning content integrated with the spaced education pedagogy.

CLINICAL RELEVANCE

The use of mobile-assisted cognitive behavioral training can aid in increasing nurses' resilience level. Nurses provided acceptable usability ratings and satisfactory acceptance of receiving training via the mobile application, showing promising opportunities in the improvement of overall well-being.

Evaluating the online Resilience Skills Enhancement programme among undergraduate students: A double-blind parallel randomized controlled trial

Resilience training has beneficial effects on the ability of undergraduate students to withstand adversity and stress. However, there are inconsistencies in the content and delivery approaches for resilience training. Given the increasing shifts towards computer-assisted instruction, there is a need to develop and evaluate innovative approaches for resilience training. This study aimed to examine the efficacy of two versions of the Resilience Skills Enhancement (RISE) programme. A randomized controlled trial was used to evaluate the effects of blended learning (BL) and a self-guided RISE programme on the resilience, social support, and learning outcomes of undergraduate students. One hundred and fourteen students were recruited and randomly allocated to receive either BL or the self-guided RISE programme. The within-group analyses indicated significant improvements in resilience scores for the BL (F = 37.74, p < 0.001) and self-guided groups (F = 10.16, p < 0.001) with moderate (d = 0.62, 95% CI: 0.25, 1.00) to large effect sizes (d = 1.11, 95% CI: 0.71, 1.50) respectively. There were also significant differences across the three time points for social support scores for the BL (F = 4.50, p < 0.05) and self-guided groups (F = 4.59, p < 0.05). Students in the BL group had considerable improvements in self-efficacy of learning and performance (F = 5.42, p < 0.01) and meta-cognitive self-regulation scores (F = 5.91, p < 0.01). In the between-group analyses, both BL and self-guided RISE were comparable for resilience, social support, and learning scores (p > 0.05). The study provided preliminary evidence that both modes, BL and self-guided RISE programme lead to positive effects on the resilience, social support, and learning scores of students.

The effect of spaced E-Learning on knowledge of basic life support and satisfaction of nursing students: a quasi-experimental study

AIM

Cardiopulmonary resuscitation (CPR) training is essential for all students, especially nursing students. One of the educational approaches to creating long-term learning in inclusive is spaced learning. Spaced learning consists of three or more training sessions in which information is presented over time and at intervals. The present study was conducted to investigate the effect of basic life support (BLS) training through spaced E-learning on the knowledge and satisfaction of nursing students.

METHODS

In this quasi-experimental study with two groups, 106 undergraduate nursing students of Alborz University of Medical Sciences in Iran participated. The control group (n = 47) received BLS training with massed E-learning in one three-hour session, and the intervention group (n = 59) received spaced E-learning in three one-hour sessions. An electronic questionnaire including demographic information and a pre-test of BLS knowledge were sent to both groups. Also, immediately after receiving the training, two weeks later and one month later, they completed a post-test of BLS knowledge. Students were asked to indicate their level of satisfaction with the provided education by completing the SLS-OLE.

RESULTS

The post-test scores immediately after, two weeks later, and one month later of the intervention group were higher than the control group. The results of repeated measurement ANOVA showed that the score changes of knowledge are significant over time (p < 0.001), the number of sessions (p < 0.001), and the interactive effect of them (p < 0.001). There was no statistically significant difference in the level of satisfaction with education in both groups.

CONCLUSION

Based on the results, BLS training in both groups increased the knowledge of BLS. however, the increase in knowledge and its retention was higher in the intervention group that received the training in spaced learning.

Systematic review of distributed practice and retrieval practice in health professions education

To determine the effect of distributed practice (spacing out of study over time) and retrieval practice (recalling information from memory) on academic grades in health professions education and to summarise a range of interventional variables that may affect study outcomes. A systematic search of seven databases in November 2022 which were screened according to predefined inclusion criteria. The Medical Education Research Study Quality Instrument (MERSQI) and Newcastle-Ottawa Scale-Education (NOS-E) were used to critically appraise eligible articles. A summary of interventional variables includes article content type, strategy type, assessment type and delay and statistical significance. Of 1818 records retrieved, 56 were eligible for inclusion and included a total of 63 experiments. Of these studies, 43 demonstrated significant benefits of distributed practice and/or retrieval practice over control and comparison groups. Included studies averaged 12.23 out of 18 on the MERSQI and averaged 4.55 out of 6 on the NOS-E. Study designs were heterogeneous with a variety of interventions, comparison groups and assessment types. Distributed practice and retrieval practice are effective at improving academic grades in health professions education. Future study quality can be improved by validating the assessment instruments, to demonstrate the reliability of outcome measures. Increasing the number of institutions included in future studies may improve the diversity of represented study participants and may enhance study quality. Future studies should consider measuring and reporting time on task which may clarify the effectiveness of distributed practice and retrieval practice. The stakes of the assessments, which may affect student motivation and therefore outcomes, should also be considered.

Enhancing application and long-term retention of clinical knowledge using an extracurricular non-credit course

BACKGROUND AND PURPOSE

Curricular overload in doctor of pharmacy (PharmD) programs is necessitating innovative approaches to support student learning. The purpose of this study was to describe the design, delivery, and assessment of a non-credit extracurricular course that reinforced foundational concepts through the application of learning in case-based activities.

EDUCATIONAL ACTIVITY AND SETTING

A 14-week extracurricular course, designed using principles of spaced repetition and interleaving in the context of case-based exercises, was offered to third-year PharmD students. Content focused on Top 300 and over-the-counter medications, brown bag sessions/drug utilization review, and medication therapy management. Short-term course effectiveness was assessed through post-course focus groups. Longitudinal effectiveness was assessed nine months post-course using an online survey. Qualitative data were analyzed using a content analysis process with overarching themes identified. Clinical interventions identified in the post-course survey were analyzed descriptively.

FINDINGS

Twenty-four students completed the course and all assessments. Focus group themes were: (1) making connections to prior learning; (2) moving beyond memorizing facts; and (3) benefit from a low-stakes course. Students identified 162 course-linked clinical interventions during advanced pharmacy practice experiences (APPEs) in 16 different settings.

SUMMARY

Student learning can be enhanced through integration of evidence-based teaching strategies both within and across the curriculum. This can be accomplished not only through introduction of an extracurricular course but through modification of existing courses. Providing additional opportunities for reinforcing core clinical knowledge and applying clinical decision-making in a low-stakes environment was well-received by students and helped them make clinical interventions during APPEs.

The effect of spaced learning on the learning outcome and retention of nurse anesthesia students: a randomized-controlled study

BACKGROUND

Poor learning and retention are common problems of students, which may be alleviated by optimization of widely used educational methods such as lectures. This study aimed to investigate the effect of spaced learning on the learning outcome and retention of nurse anesthesia students.

METHODS

This was a randomized controlled study with a pre-and post-test design on 64 nurse anesthesia students who were divided into two groups of spaced lecture (n = 32) and conventional lecture (n = 32). The spaced lectures included three 30-minute training sessions with 10-minute intervals while the conventional sessions including 90 min of continuous training. Students' knowledge was measured using one valid and reliable questionnaire developed by the research team. All students in both groups took a pre-test, and their level of knowledge acquisition was evaluated immediately after the training. Their level of knowledge retention was tested two and four weeks after the lecture.

RESULTS

There was no significant difference between the two groups regarding demographic characteristics (p > 0.05). In the pre-test, the mean score of knowledge in the intervention group was lower than that in the control group, there was no significant difference (p = 0.177). But after the intervention, the mean scores of learning outcome and retention in the intervention group were significantly higher than those in the control group (p < 0.001, eta = 0.576). Also, the results showed that learning outcome and retention across the three academic semesters in the two groups are significantly different, and students with a higher academic semester obtained a significantly higher mean score of knowledge and retention (p < 0.001, eta = 0.604).

CONCLUSION

Spaced learning improves nurse anesthesia students' knowledge and retention more than conventional method. Future studies focusing on spaced learning should specifically examine the impact of duration and number of intervals, as well as the time gap between training and measurement of learning retention.

The spacing effect: Improving electrocardiogram interpretation

BACKGROUND

Accurate electrocardiogram (ECG) interpretation is critical for safe patient care, making this skill a necessary competency for medical school graduation. Improved long-term memory retention with repeated exposure to material is one of the most evidenced-based components of adult learning science. This curricular innovation aimed to determine if implementing spaced repetition and retrieval practice using ECG quizzes during the principal clinical year would improve ECG interpretation skills among medical students enrolled in a Longitudinal Integrated Clerkship (LIC).

APPROACH

The curricular innovation applied the spacing effect and retrieval practice. Cognitive science demonstrates enhanced long-term retention through repeated interval exposure to learned material. Studies of spaced retrieval indicate that memory retention is enhanced through tests involving effortful recall. LIC students in an intervention group were exposed to the spacing effect with periodic ECG quizzes throughout their clinical clerkship year.

EVALUATION

The results of the 17-item post-test for 140 students were analysed: LIC intervention, N = 54; block control, N = 62; and LIC control, N = 24. The ANOVA test was significant (p < 0.001). Games-Howell post hoc testing showed that the mean score in the LIC intervention group was significantly higher compared with the LIC control group (p < 0.001) and the block control group (p < 0.001). There was no significant difference between the LIC control and block control groups (p = 0.59).

IMPLICATIONS

Spaced repetition of material through ECG quizzes improved ECG interpretation skills on an ECG post-test and mitigates the forgetting curve, maintaining student competency in ECG interpretation.

Massed Training is Logistically Superior to Distributed Training in Acquiring Basic Endovascular Skills

OBJECTIVE

A "PROficiency based StePwise Endovascular Curricular Training" (PROSPECT) has proven its superiority over traditional training in a randomised controlled trial to acquire basic endovascular skills outside theatre, but real life adherence is low. This study aimed to compare the original distributed training format, where trainees learn at their own pace, with a massed training format offering the same content within a limited time span while exempt from clinical duties. Secondly, long term skills retention was evaluated.

METHODS

A multicentre, prospective study allocated participants to the distributed D-PROSPECT or to a massed, compact version (C-PROSPECT) based on logistics such as travel time, participant and instructor availability. A multiple choice question (MCQ) test (max. score 20) tested cognitive skills. Technical skills were assessed using a global rating scale (GRS) (max. score 55), examiner's checklist (max. score 85), and validated simulator metrics. Data were collected pre- and post-programme and at three, six, and 12 months after programme completion.

RESULTS

Over four years and in two countries, D-PROSPECT was implemented in two centres and C-PROSPECT in three. A total of 22 participants completed D-PROSPECT with a 41% dropout rate, and 21 completed C-PROSPECT with 0% dropout rate. All participants showed significant improvement for all performance parameters after programme completion: MCQ test (median 14.5 vs. 18; p < .001), GRS (median 20 vs. 41; p < .001), examiner's checklist (median 49 vs. 78.5; p < .001), and simulation metrics (p < .001). Scores of C- or D-PROSPECT participants were not significantly different. No significant differences were seen between groups during the retention period.

CONCLUSION

PROSPECT significantly improves the quality of simulated endovascular performances using a massed or distributed training format. A massed training format of PROSPECT may be preferred to decrease dropout during standardised training to obtain basic endovascular skills in existing surgical curricula.

The Effectiveness of Spaced Learning, Interleaving, and Retrieval Practice in Radiology Education: A Systematic Review

PURPOSE

Radiology is a highly complex field that requires mastery over an ever-expanding body of knowledge. Spaced learning, interleaving, and retrieval practice are evidence-based learning strategies that enhance long-term retention of information. The aim of this systematic review is to assess the effectiveness of these interventions in the setting of radiology education.

METHODS

The authors searched MEDLINE, Embase, PsycInfo, ERIC, and forward and backward citations for studies published between database inception and February 19, 2023. Eligibility criteria for included studies were randomized and quasi-randomized controlled trials that investigated the impact of spaced, interleaved, or retrieval practice on knowledge retention of medical trainees after education related to medical imaging as assessed by postinterventional examination scores.

RESULTS

Of 1,316 records reviewed, 8 studies met eligibility criteria. Two studies investigated spaced learning, two studies interleaving, and six studies retrieval practice, including two trials that evaluated interventions incorporating both spaced learning and retrieval practice. Five of eight studies reported statistically significant differences between interventional and control groups on either immediate or delayed postinterventional examinations.

CONCLUSIONS

Despite extensive evidence in support of spaced, interleaved, and retrieval practice within the broader literature, few studies have examined the effectiveness of these strategies in radiology education. Additional trials are required to evaluate the usefulness of incorporating these techniques into educational programs related to medical imaging.

Virtual spaced-learning method, during COVID-19 for Pharm D students

BACKGROUND

The coronavirus (COVID-19) outbreak basically changed teaching methods across the world, and learning was almost replaced by virtual learning during the pandemic. Also, the spacing effect is one of the most well-established phenomena in the science of learning. Using temporal intervals for re-exposing learners to information over time (spaced learning) leads to more effective retention of knowledge compared to having information presented at a single time (massed learning). Hence, we designed a virtual spaced learning method to reap the benefits of virtual learning and spaced learning concomitantly.

METHODS/APPROACH

An interventional semi- experimental survey among 66 Pharm D students was designed and implemented. Students were divided into two groups (spaced vs mass learning) in the national integrated virtual education platform (NAVID) as the matrix for teaching as well as evaluation. Classes were conducted in the following sequence: 1- answering the pre-test, 2- watching and listening to the educational content (separately for each group), 3- answering the post-test (n = 1). The pre/post-test consisted of 10 four-choice questions based on the Kirkpatrick Model extracted from the educational content.

RESULTS/OUTCOMES

Findings revealed that the average score was not significantly different between the post-tests of the spaced learning and mass learning (7.26 ± 2.26 vs 6.5 ± 2.5) methods utilizing the independent t- test (p ≥ 0.05).

CONCLUSIONS

Since no statistically significant improvement was observed in the virtual spaced learning group compared to the control group, it seems that clarifying the significant influence of the spaced learning strategy in pharmacy education requires longer period of study, or study on less complex or skill-based topics for further evaluation.

Cognitive perspectives on maintaining physicians' medical expertise: IV. Best practices and open questions in using testing to enhance learning and retention

Although tests and assessments-such as those used to maintain a physician's Board certification-are often viewed merely as tools for decision-making about one's performance level, strong evidence now indicates that the experience of being tested is a powerful learning experience in its own right: The act of retrieving targeted information from memory strengthens the ability to use it again in the future, known as the testing effect. We review meta-analytic evidence for the learning benefits of testing, including in the domain of medicine, and discuss theoretical accounts of its mechanism(s). We also review key moderators-including the timing, frequency, order, and format of testing and the content of feedback-and what they indicate about how to most effectively use testing for learning. We also identify open questions for the optimal use of testing, such as the timing of feedback and the sequencing of complex knowledge domains. Lastly, we consider how to facilitate adoption of this powerful study strategy by physicians and other learners.

Evidence-based teaching in contact lenses education: Teaching and learning strategies

INTRODUCTION

Contact lens (CL) practice is an ever-changing field with clinical knowledge, techniques and equipment continuously evolving. These new developments are backed with clinical trials and research to ensure that practitioners feel confident that there is an evidence base to support these advances. Evidence-based practice is now a crucial part of CL practice, and its importance also filters down to CL education. For example, lectures are one of the most popular tools for an educator but, is standing at the front of a lecture theatre full of students a more effective way of teaching than providing the same material for students to read by themselves? What evidence exists specific to CL education?

METHOD

An expert panel of educators completed a comprehensive literature review of current evidence of teaching methods in CL training, or if not available then what can be learnt from other health care professional training that could be potentially applicable to CL education.

RESULTS

Due to the amount of evidence available in the overall subject area relating to healthcare education, the initial plan of compiling evidence into one narrative review paper was discarded in favour of producing two linked papers. Here, the first paper details definitions of terminology, and also teaching methods. The second paper focuses on assessment and specific clinical training required to attain CL practice competency. In this first paper, no direct evidence of the spreading and benefit of new education strategies evidence such as flipped classrooms, spaced learning, test-enhanced learning, group work, CBL, PBL, TBL, and reflective practice in CL education was found. The only technique that was widely used in the CL field was case reports and the group discussion of them. Nevertheless, the authors found a consensus of opinion from other disciplines that are transferable to CL teaching and could help students meet the intended learning outcomes.

CONCLUSION

There is a small amount of evidence supporting CL education, but most of this seems to be related to the practical element of the training. However, there is a lot of evidence in the field of healthcare education from related disciplines which provides additional but important learning tools that may be effectively implemented in CL education.

Towards best practice in developing motor skills: a systematic review on spacing in VR simulator-based psychomotor training for surgical novices

OBJECTIVE

Repeated practice, or spacing, can improve various types of skill acquisition. Similarly, virtual reality (VR) simulators have demonstrated their effectiveness in fostering surgical skill acquisition and provide a promising, realistic environment for spaced training. To explore how spacing impacts VR simulator-based acquisition of surgical psychomotor skills, we performed a systematic literature review.

METHODS

We systematically searched the databases PubMed, PsycINFO, Psychology and Behavioral Sciences Collection, ERIC and CINAHL for studies investigating the influence of spacing on the effectiveness of VR simulator training focused on psychomotor skill acquisition in healthcare professionals. We assessed the quality of all included studies using the Medical Education Research Study Quality Instrument (MERSQI) and the risk of bias using the Cochrane Collaboration's risk of bias assessment tool. We extracted and aggregated qualitative data regarding spacing interval, psychomotor task performance and several other performance metrics.

RESULTS

The searches yielded 1662 unique publications. After screening the titles and abstracts, 53 publications were retained for full text screening and 7 met the inclusion criteria. Spaced training resulted in better performance scores and faster skill acquisition when compared to control groups with a single day (massed) training session. Spacing across consecutive days seemed more effective than shorter or longer spacing intervals. However, the included studies were too heterogeneous in terms of spacing interval, obtained performance metrics and psychomotor skills analysed to allow for a meta-analysis to substantiate our outcomes.

CONCLUSION

Spacing in VR simulator-based surgical training improved skill acquisition when compared to massed training. The overall number and quality of available studies were only moderate, limiting the validity and generalizability of our findings.

Factors Influencing the Implementation of Prone Positioning during the COVID-19 Pandemic: A Qualitative Study

Rationale: The adoption of prone positioning for patients with acute respiratory distress syndrome (ARDS) has historically been poor. However, in mechanically ventilated patients with coronavirus disease (COVID-19) ARDS, proning has increased. Understanding the factors influencing this change is important for further expanding and sustaining the use of prone positioning in appropriate clinical settings. Objectives: To characterize factors influencing the implementation of prone positioning in mechanically ventilated patients with COVID-19 ARDS. Methods: We conducted a qualitative study using semistructured interviews with 40 intensive care unit (ICU) team members (physicians, nurses, advanced practice providers, respiratory therapists, and physical therapists) working at two academic hospitals. We used the Consolidated Framework for Implementation Research, a widely used implementation science framework outlining important features of implementation, to structure the interview guide and thematic analysis of interviews. Results: ICU clinicians reported that during the COVID-19 pandemic, proning was viewed as standard early therapy for COVID-19 ARDS rather than salvage therapy for refractory hypoxemia. By caring for large volumes of proned patients, clinicians gained increased comfort with proning and now view proning as a low-risk, high-benefit intervention. Within ICUs, adequate numbers of trained staff members, increased team agreement around proning, and the availability of specific equipment (e.g., to limit pressure injuries) facilitated greater proning use. Hospital-level supports included proning teams, centralized educational resources specific to the management of COVID-19 (including a recommendation for prone positioning), and an electronic medical record proning order. Important implementation processes included informal dissemination of best practices through on-the-job learning and team interactions during routine bedside care. Conclusions: The implementation of prone positioning for COVID-19 ARDS took place in the context of evolving clinician viewpoints and ICU team cultures. Proning was facilitated by hospital support and buy-in and leadership from bedside clinicians. The successful implementation of prone positioning during the COVID-19 pandemic may serve as a model for the implementation of other evidence-based therapies in critical care.

Lack of Thoracentesis Competencies and Training in Danish Emergency Departments: A Danish Nationwide Study

Background

Dyspnea caused by pleural effusion is a common reason for admission to the emergency department (ED). In such cases, thoracentesis performed in the ED may allow for swift symptom relief, diagnostics, and early patient discharge. However, the competence level of thoracentesis and training in the ED are currently unclear. This study aimed to describe the current competencies and training in thoracentesis in Danish EDs.

Methods

We performed a nationwide cross-sectional study in Denmark. A questionnaire was distributed to all EDs in March 2022 including questions on competencies and thoracentesis training methods. Descriptive statistics were used.

Results

In total, 21 EDs replied (response rate 100%) between March and May 2022. Overall, 50% of consultant and 77% of physicians in emergency medicine specialist training were unable to perform thoracentesis independently. Only 2 of 21 EDs (10%) had a formalized training program. In these 2 EDs, there were no requirements of maintaining these competences. Informal training was reported by 14 out 21 (66%) EDs and consisted of ad-hoc bedside procedural demonstration and/or guidance. Among the 19 EDs without formalized training, 9 (47%) had no intention of establishing a formalized training program.

Conclusion

We found a major lack of thoracentesis competencies in Danish EDs among both consultant and physicians in emergency medicine specialist training. Moreover, the vast majority of EDs had no formalized thoracentesis training program.

Envisioning nutrition teaching as a three-course meal: a blended approach to knowledge, application and assessment

Medical students receive inadequate training in nutrition counselling, but the best way to teach this topic is unknown. To address this research gap, we developed a longitudinal blended programme - combining physical classroom experiences with online education - to teach nutrition counselling in a primary care clinical course. The learning experience comprised a pre-class online module to convey knowledge; a formative, ungraded standardised patient exercise on dietary modification to practise skills; and a written exam on nutrition knowledge and an Objective Structured Clinical Exam assessing nutrition counselling skills. We likened this three-part curriculum to a complete meal, with its self-paced online 'appetiser', in-class 'entrée' of clinical practice with patients, and 'dessert' of an assessment. We ascertained feasibility, discovered positive student reactions, and, via exam performance analysis, noted achievement of the learning objectives. This three-course meal model can be applied to any learning experience that teaches and assesses skills.

The Educational Impact of Web-Based, Faculty-Led Continuing Medical Education Programs in Type 2 Diabetes: A Survey Study to Analyze Changes in Knowledge, Competence, and Performance of Health Care Professionals

BACKGROUND

The treatment landscape for type 2 diabetes (T2D) is continually evolving; therefore, ongoing education of health care professionals (HCPs) is essential. There is growing interest in measuring the impact of educational activities, such as through use of the Moore framework; however, data on the benefits of continuing medical education (CME) in the management of T2D remain limited.

OBJECTIVE

This study aimed to evaluate HCP satisfaction; measure improvements in knowledge, competence, and performance following short, case-based, multidisciplinary web-based CME activities; and identify the remaining educational gaps.

METHODS

Two faculty-led, CME-accredited, web-based educational activities on T2D and obesity, touchIN CONVERSATION and touch MultiDisciplinary Team, were developed and made available on a free-to-access medical education website. Each activity comprised 3 videos lasting 10 to 15 minutes, which addressed learning objectives developed based on a review of published literature and faculty feedback. Participant satisfaction (Moore level 2) was evaluated using a postactivity questionnaire. For both activities, changes in knowledge and competence (Moore levels 3 and 4) were assessed using questionnaires completed by representative HCPs before or after participation in the activities. A second set of HCPs completed a questionnaire before and after engaging in activities that assessed changes in self-reported performance (Moore level 5).

RESULTS

Each activity was viewed by approximately 6000 participants within 6 months. The participants expressed high levels of satisfaction (>80%) with both activities. Statistically significant improvements from baseline in knowledge and competence were reported following participation in touchIN CONVERSATION (mean score, SD before vs after activity: 4.36, 1.40 vs 5.42, 1.37; P<.001), with the proportion of learners answering at least six of 7 questions correctly, increasing from 22% (11/50) to 60% (30/50). A nonsignificant improvement in knowledge and competence was observed following participation in touch MultiDisciplinary Team (mean score, SD 4.36, 1.24 vs 4.58, 1.07; P=.35); however, baseline knowledge and competence were relatively high, where 80% of the respondents (40/50) answered at least four of 6 questions correctly. A significant improvement in HCP self-reported performance was observed in a combined analysis of both activities (mean score, SD 2.65, 1.32 vs 3.15, 1.26; P=.03), with the proportion of learners selecting the answer representing the best clinical option for all 4 questions increasing from 32% (11/34) to 59% (20/34) after the activity. Several unmet educational needs were self-reported or identified from the analysis of incorrectly answered questions, including setting individualized glycemic targets and the potential benefits of sodium-glucose cotransporter 2 inhibitor therapies.

CONCLUSIONS

Short, case-based, web-based CME activities designed for HCPs to fit their clinical schedules achieved improvements in knowledge, competence, and self-reported performance in T2D management. Ongoing educational needs identified included setting individualized glycemic targets and the potential benefits of sodium-glucose cotransporter 2 inhibitor therapies.

The story behind the synthesis: writing an effective introduction to your scoping review

NA

Randomized Controlled Trial of Interactive Spaced Education to Support Constipation Management by Pediatric Primary Care Providers

INTRODUCTION

Integrating continuing medical education and quality improvement (QI) initiatives is challenging. We aimed to compare one method, Interactive Spaced Education (ISE/QI), with standard (sTD/Qi) education embedded within a constipation management Qi initiative.

METHODS

We conducted a randomized, controlled study to compare ISE/QI and STD/QI education. Pediatric primary care providers (PCPs) were recruited from a network of local private practices. The QI initiative was implemented with all providers before education interventions. ISE/QI participants received questions by email weekly, provided answers, received feedback, and repeated questions over a 4-month period. The STD/QI group received a Power Point with the same educational content. Pre- and post-surveys evaluated usability, self-assessed confidence, and practice changes while quizzes evaluated knowledge. Process control charts tracked subsequent visits to gastroenterology (GI).

RESULTS

Of the 212 eligible PCPs, 101 (48%) enrolled, with 49 PCPs in the ISE/QI arm and 52 in STD/QI education arm. Quiz scores improved in the ISE/QI arm with a strong effect size (Cohen d 1.76). Mean increase in confidence managing difficult cases was higher in the ISE/QI group (1.84 vs 1.21, P  = 0.030). ISE/QI participants were more likely to rate the activity better than most online education (odds ratio [OR] 18.1, P < 0.0001) and incorporate practice changes (OR 3.35, P = 0.0152). Visits to GI decreased among the entire population, but the effect on GI visits within each education arm was mixed.

CONCLUSIONS

ISE/QI improved knowledge and confidence managing difficult cases. ISE/QI participants reported higher likelihood to change practice, but no differences were seen in GI referrals.

How to Keep Training-After Residency Training

Lifelong learning in medicine is an important skill and ethical obligation, but many residents do not feel prepared to be effective self-directed learners when training ends. The learning sciences offer evidence to guide self-directed learning, but these insights have not been integrated into a practical and actionable plan for residents to improve their clinical knowledge and reasoning. We encourage residents to establish a self-directed learning plan, just as an athlete employs a training plan in the pursuit of excellence. We highlight four evidence-based learning principles (spaced practice, mixed practice, retrieval practice, and feedback) and four training strategies comprising a weekly training plan: case tracking, simulated cases, quizzing, and new evidence integration. We provide tips for residents to implement and refine their approach and discuss how residency programs can foster these routines and habits. By optimizing their scarce self-directed learning time with a training plan, residents may enhance patient care and their career satisfaction through their pursuit of clinical mastery.

Utilizing an optional cumulative examination in a skills-based lab course series to assess student performance and knowledge retention

INTRODUCTION

In the doctor of pharmacy curriculum, students are subjected to scenarios where success is contingent upon accurate retention of information learned during class. To provide incentive to students and simultaneously gauge student retention of course material, an optional honors examination was created for a skills laboratory course. The objectives of this research were to determine student pharmacist performance on the examination and to assess student pharmacist interest and motivation for taking (or not taking) the optional examination.

METHODS

An optional comprehensive honors examination was implemented simultaneously within a laboratory course series. Student performance was analyzed across cohorts and students were given a web-based survey prior to the examination to gauge initial interest and engagement. A second survey was conducted after the examination to identify motivation for taking the optional examination. Surveys were analyzed using quantitative and qualitative methods.

RESULTS

There were 238 responses to the initial survey (47%) and 183 (96%) responses to the post-examination survey. Common topics of motivation for taking the examination included enhancing transcripts, gauging their own retention, and assessing readiness for experiential activities. One hundred sixty-one students participated in the optional examination, and 65 achieved a score of 90% and the honors designation. The majority (96%) of students who chose to take the examination thought the activity was valuable to their education.

CONCLUSIONS

An optional comprehensive honors examination is one method of evaluating student retention of course material and provides an opportunity for students to set themselves apart from colleagues with an honors designation.

A Video- and Case-Based Curriculum on the Management of Alcohol Use Disorder for Internal Medicine Residents

INTRODUCTION

Alcohol use disorder (AUD) is commonly undertreated. Physicians cite discomfort with AUD medication as a barrier to treatment. While several curricula teach and assess screening and brief interventions, few teach and assess learner knowledge of treatment options.

METHODS

We created a video- and case-based curriculum for internal medicine residents delivered by 16 internal medicine faculty in three 30-minute sessions at four clinic sites. Learner knowledge, attitudes, and confidence were assessed before and after the curriculum. We used qualitative methods to evaluate learner reflections. We also assessed faculty satisfaction with the curriculum.

RESULTS

Of 153 residents receiving the curriculum, 35 (23%) completed both pre- and postsurveys. Median percent correct on knowledge questions improved from 67% pre- to 80% postcurriculum (p < .001). Confidence increased for all three items assessing it, with a notable increase in confidence with pharmacotherapy (2.9 pre- vs. 4.5 postcurriculum on a 7-point Likert scale with high scores indicating greater confidence, p < .001). Positive attitudes toward people with AUD increased from 3.4 pre- to 3.9 postcurriculum (p < .001) on a 7-point Likert scale. Learners continued to express concerns about prescribing logistics, the role of primary care, and management of ongoing use. Thirteen of 16 faculty (83%) completed the postcurricular survey; all said they would be happy to facilitate again.

DISCUSSION

Implementation of this curriculum for the management of AUD improved resident knowledge, attitudes, and confidence in AUD treatment. The curriculum was acceptable to faculty and is ideal for programs looking to expand teaching about AUD.

Academic Half-Day Education Experience in Post-graduate Medical Training: A Scoping Review of Characteristics and Learner Outcomes

Background

The academic half-day (AHD) has grown in popularity for medical education because it intends to provide learners with uninterrupted, immersive learning time that may promote participant attendance, engagement, and knowledge. Little is known about the extent of use, forms, or effectiveness of AHD in Post-graduate medical education. This scoping review summarizes existing literature and describes the learning outcomes, according to the Kirkpatrick model of learning evaluation, of AHD experiences on Post-graduate medical trainees.

Methods

Authors used Arksey and O'Malley's methodological framework, searching electronic scientific literature databases from the years of 1977-2019 with relevant key terms and identifying 735 papers. Two independent raters completed title/abstract screening and then extracted pertinent data from papers meeting specified criteria.

Results

Authors identified 38 relevant papers published in English, originating from programs in US (n = 19) and Canada (n = 19), spanning 4 disciplines: Medicine (n = 17, 45%), Pediatrics (n = 10, 26%), Critical Care/Surgery (n = 9, 24%), Radiology (n = 2, 5%). A majority (n = 33, 87%) described specific educational experiences; most focused on residents only (n = 27). The educational experiences included various teaching strategies; few were didactics only (n = 4) and most were multi-modal including simulation, case-based learning, problem-based learning, and/or self-directed online study. AHD size ranged from 5 to 364 participants (median 39). AHD length was 1.5-6 h (median 3). Required resources were inconsistently described. When evaluations of the specific educational experience were reported (n = 35 studies), the majority of studies used weak research designs (e.g., one group, pre/post-test, n = 19); few studies used strong research designs (e.g., randomized controlled trial, n = 2). Positive effects of AHD ranged across Kirkpatrick levels 1-3 learner outcomes.

Conclusions

The composition and content of AHD in Post-graduate medical education vary. Few studies of AHD use stringent research designs, and none include learner outcome measures at the highest Kirkpatrick level (i.e., level 4 results/patient outcomes). A consensus definition and further high-quality research on AHD in Post-graduate medical education is needed.

Implementation of a Longitudinal Critical Care Fellowship Ultrasound Curriculum

Background

The use of point-of-care ultrasound as a diagnostic and interventional tool is rapidly becoming standard of care in critical care medicine; a standardized training curriculum is needed to ensure provider proficiency.

Objective

This study aimed to describe a longitudinal critical care ultrasound (CCUS) curriculum in a pulmonary critical care medicine (PCCM) fellowship training program. It evaluated the curriculum’s impact on fellows’ knowledge, skills, and self-reported confidence and retention of these attributes.

Methods

We conducted a prospective observational study of a longitudinal CCUS training program within a single PCCM fellowship training program. Knowledge, skills, and confidence of 22 fellows were assessed at baseline; after initial training; and at 6, 12, and 18 months in five domains (ultrasound basics, vascular, lung/pleural, abdomen, and cardiac). We quantified changes in CCUS knowledge, confidence, and skills by fellowship class and assessed for longitudinal retention of these three attributes. The difference in scores between new first-year fellows undergoing formal training and second-year fellows with previous informal training was compared at matched time points.

Results

After the initial formal training, there was a significant increase in knowledge, skills, and confidence scores, which were maintained or continued to increase up to 18 months. Fellows with 1 year of formal training also had a higher level of knowledge and skills than fellows with 1 year of informal training, although they had similar levels of self-reported confidence in their skills.

Conclusion

A formal, longitudinal CCUS curriculum implemented in a PCCM fellowship program improves trainees’ knowledge and skills in various ultrasound domains in addition to their confidence in using ultrasound for patient care. A longitudinal curriculum results in retention of all three attributes and appeared to be more effective than an informal training program based on teaching during rounds, but this needs to be replicated in a larger cohort.

Dose-Response Relationship between High-Fidelity Simulation and Intensive Care Nursing Students' Learning Outcomes: An Italian Multimethod Study

Background: The best application modality of high-fidelity simulation in graduate critical care nursing courses is still rarely investigated in nursing research. This is an important issue since advanced nursing skills are necessary to effectively respond to critically ill patients' care needs. The aim of the study was to examine the influence of a modified teaching model based on multiple exposures to high-fidelity simulations on both the learning outcomes and the perceptions of graduate students enrolled in a critical care nursing course. Methods: A multimethod study involving a sample of graduate critical care nursing students was conducted. A theoretical teaching model focused on multiple exposures to high-fidelity simulations is currently applied as a teaching method in an Italian critical care nursing course. According to the Kirkpatrick model for evaluating training programs, the performance, self-efficacy, and self-confidence in managing critically ill patients were considered learning outcomes, while satisfaction with learning and students' lived experiences during the experimental phases were considered students' perceptions. Results: Multiple exposures to high-fidelity simulations significantly improved performance, self-efficacy, and self-confidence in managing virtual critically ill patients' care needs. The satisfaction level was high, while lived experiences of participants were positive and allowed for better explanation of quantitative results of this study. Conclusions: Multiple exposures to high-fidelity simulations can be considered a valuable teaching method that can improve the learning outcomes of graduate nurses enrolled in an intensive care course.

Enhanced Learning and Retention of Medical Knowledge Using the Mobile Flash card Application Anki

INTRODUCTION

As medical schools condense the basic science phase of undergraduate medical education, it has become increasingly important to identify methods and tools that facilitate learning, mastery, and application of medical knowledge. One increasingly popular tool that promotes engagement with content is Anki, a web-based flash card system. Using Anki, medical students can access pre-made flash cards specifically tailored to prepare students for the United States Medical Licensing Exam (USMLE) Step 1 exam. The objective of this study was to identify Anki use and its association to USMLE Step 1 performance.

METHODS

In March 2020, medical students in years 2, 3, and 4 who had completed USMLE Step 1 were administered a survey to measure Anki usage. The survey was locally developed and was reviewed by survey experts on campus. Survey responses were paired with USMLE Step 1 results for analyses. Descriptive and inferential statistics were used for analysis.

RESULTS

Anki usage was associated with higher USMLE Step 1 scores. Additionally, amongst those who used Anki, those with more consistent use had higher USMLE Step 1 scores and higher perceived levels of knowledge retention.

CONCLUSIONS

This research suggests that Anki is an effective educational tool that should be recommended to medical students alongside other evidenced-based study tools, such as the popular question bank USMLE World. Future research should attempt to identify a relationship between Anki usage and future clinical performance to demonstrate the implications that Anki has on clinical skills.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-021-01386-9.

The Spaced Learning Concept Significantly Improves Acquisition of Laparoscopic Suturing Skills in Students and Residents: A Randomized Control Trial

INTRODUCTION

 Spaced learning consists of blocks with highly condensed content that interrupted by breaks during which distractor activities, such as physical activity, are performed. The concept has been shown to be superior in complex motor skill acquisition like laparoscopic suturing and knot tying. Preliminary studies have solely been conducted with medical students. Therefore, it remained unanswered if the spaced learning concept would also work for pediatric surgery residents.

MATERIALS AND METHODS

 The study aimed to evaluate the effectiveness of spaced learning, students, and residents were asked to perform four surgeons' square knots on a bowel model within 30 minutes prior and post 3 hours of hands-on training. To examine the long-term skills, the same subjects were asked to perform a comparable, but more complex task 12 months later without receiving training in the meantime. Total time, knot stability, suture accuracy, knot quality, and laparoscopic performance were assessed. Additionally, motivation was accessed by using the questionnaire on current motivation. Differences were calculated using mixed analysis of variance, Mann-Whitney U test, and multivariate analysis of covariance.

RESULTS

 A total of 20 medical students and 14 residents participated in the study. After randomization, 18 were trained using the spaced learning concept and 16 via conventional methods. Both groups had comparable baseline characteristics and improved significantly after training in all assessed measures. The spaced learning concept improved procedure performance as well as knot quality and stability in both students and residents. However, residents that trained via spaced learning showed significantly better long-term results regarding knot quality and speed in comparison to students. Although anxiety was significantly reduced in both training groups over time, residents were significantly more interested regarding knot tying than students.

CONCLUSION

 This study dispels any remaining doubt that the spaced learning concept might only work for medical students. It appears that the spaced learning concept is very suitable for residents in acquiring complex motor skills. It is superior to conventional training, resulting in improved procedural performance as well as knot quality and speed. Hence, tailored training programs should not only be integrated early on in students' curricula but also in surgical training programs.

Initiating and integrating a personalized end of life care project in a community hospital intensive care unit: A qualitative study of clinician and implementation team perspectives

RATIONALE

The end of life (EOL) experience in the intensive care unit (ICU) can be psychologically distressing for patients, families, and clinicians. The 3 Wishes Project (3WP) personalizes the EOL experience by carrying out wishes for dying patients and their families. While the 3WP has been integrated in academic, tertiary care ICUs, implementing this project in a community ICU has yet to be described.

OBJECTIVES

To examine facilitators of, and barriers to, implementing the 3WP in a community ICU from the clinician and implementation team perspective.

METHODS

This qualitative descriptive study evaluated the implementation of the 3WP in a 20-bed community ICU in Southern Ontario, Canada. Patients were considered for the 3WP if they had a high likelihood of imminent death or planned withdrawal of life-sustaining therapy. Following the qualitative descriptive approach, semi-structured interviews were conducted with purposively sampled clinicians and implementation team. Data from transcribed interviews were analyzed in triplicate through qualitative content analysis.

RESULTS

Interviews with 12 participants indicated that the 3WP personalized and enriched the EOL experience. Interviewees indicated higher intensity education strategies were needed to enable spread as the project grew. Clinicians described many physical resources for the project but suggested more non-clinical project support for orientation, continuing education, and data collection. A majority of wishes focused on physical resources including keepsakes, which helped facilitate project spread when clinician capacity was attenuated by competing duties.

CONCLUSIONS

In this community hospital, ICU clinicians and implementation team members report perceived improved EOL care for patients, families, and clinicians following 3WP initiation and integration. Implementing individualized and meaningful wishes at EOL for dying patients in a community ICU requires adequate planning and time dedicated to optimizing clinician education. Adapting key features of an intervention to local expertise and capacity may facilitate spread during project initiation and integration.

Scoping Review of Distributed Practice in Nursing Education

AIM

The aim of this study was to describe the status of distributed practice in research of nursing education.

BACKGROUND

The science of learning has compiled evidence-based strategies that should be integral to nursing education. One long-standing strategy, distributed practice, involves spacing, placing cognitive breaks between study or practice sessions with priority information.

METHOD

Reviewing literature published over 20 years at every level of nursing education, the authors conducted a scoping review to determine the extent to which research of nursing education includes attention to distributed practice.

RESULTS

In the 13 articles meeting criteria, distributed practice was most common in continuing professional development, with an emphasis in learning psychomotor skills. Study authors used a variety of terms and descriptions in referring to the strategy.

CONCLUSION

By way of research, distributed practice appears underutilized in nursing education, especially at prelicensure and graduate levels, and could benefit from clear and consistent use of terminology.

Using Individual Residents' Learning Trajectories to Better Understand the Impact of Gaps in Practice

PURPOSE

To optimize learning, health professional training programs need to achieve the right balance between depth of practice (gaining more experience with particular skills) and breadth of practice (spreading experience across an array of activities). Better understanding how training for a particular skill set is impacted by periods of focus on a different skill set would allow improved curriculum and assessment design, thereby enhancing the efficiency of training and effectiveness of care. To this end, learning curves were used to compare performance in surgery after prolonged periods of practice to performance after gaps in surgical training.

METHOD

Daily operative assessments from the Dalhousie obstetrics and gynecology program were analyzed retrospectively and learning curves were generated. In addition to examining the variability in learning trajectories, the impact of gaps was systematically assessed by comparing resident scores after 2 successive months in which they were not assessed operatively to those collected after 2 successive months in which they were assessed at least once.

RESULTS

Four thousand four hundred sixteen scores for 33 residents over a 10-year period were analyzed. Trajectories and peak performances were identified. Residents performed better during their third sequential month of being assessed (mean = 4.40, 95% CI = 4.33-4.46) relative to during months following a period of being away from the operating room for at least 2 months (mean = 4.21, 95% CI = 4.13-4.29; P < .01; d = 0.7). However, maximum performance achieved was more strongly related to the number of times residents experienced a gap in training (r = 0.50) than to the number of times residents experienced 3 consecutive months of training (r = 0.25).

CONCLUSIONS

Distinct patterns of development exist for individual residents. Time away from surgical practice and assessment negatively impacted short-term performance, but may improve long-term learning trajectories. This speaks to the value of spaced education and is important for the design of longitudinal skills-based training programs.

Front-loading of anatomy content has no effect on long-term anatomy knowledge retention among physical therapy students: a prospective cohort study

BACKGROUND

Information learned over a longer period of time has been shown to result in better long-term knowledge retention than information learned over a shorter period of time. In order to address multiple curricular goals, the timing and spacing of anatomy content within the Doctor of Physical Therapy (DPT) program at our institution recently changed from a very spaced to a very compressed format. The purpose of the present study was to assess differences in anatomy knowledge retention that might have been impacted by this change. The research hypothesis was that students receiving spaced instruction would have significantly better anatomy knowledge retention than students receiving massed instruction.

METHODS

Participants consisted of two cohorts of DPT students that both received 45 contact hours of anatomy lecture and 90 contact hours of anatomy lab. The LONG cohort experienced anatomy through a lecture and lab taught over a 30-week, 2 semester period as separate courses. In contrast, the SHORT cohort took their anatomy lecture and lab concurrently over one 10-week semester. A pre-test was administered on the first day of their anatomy lecture course, and a post-test was administered to each cohort 18 months after completion of their last anatomy exam.

RESULTS

After controlling for age-related differences in the two groups, no significant differences in mean pre-test, post-test, or percentage improvement were found between cohorts (p = 0.516; 0.203; and 0.152, respectively).

CONCLUSION

These findings refute the hypothesis and show that both spaced and massed instruction in these cohorts resulted in the same level of long-term anatomy knowledge retention.

Multi-level longitudinal learning curve regression models integrated with item difficulty metrics for deliberate practice of visual diagnosis: groundwork for adaptive learning

Visual diagnosis of radiographs, histology and electrocardiograms lends itself to deliberate practice, facilitated by large online banks of cases. Which cases to supply to which learners in which order is still to be worked out, with there being considerable potential for adapting the learning. Advances in statistical modeling, based on an accumulating learning curve, offer methods for more effectively pairing learners with cases of known calibrations. Using demonstration radiograph and electrocardiogram datasets, the advantages of moving from traditional regression to multilevel methods for modeling growth in ability or performance are demonstrated, with a final step of integrating case-level item-response information based on diagnostic grouping. This produces more precise individual-level estimates that can eventually support learner adaptive case selection. The progressive increase in model sophistication is not simply statistical but rather brings the models into alignment with core learning principles including the importance of taking into account individual differences in baseline skill and learning rate as well as the differential interaction with cases of varying diagnosis and difficulty. The developed approach can thus give researchers and educators a better basis on which to anticipate learners' pathways and individually adapt their future learning.

Scoping reviews in medical education: A scoping review

OBJECTIVES

Over the last two decades, the number of scoping reviews in core medical education journals has increased by 4200%. Despite this growth, research on scoping reviews provides limited information about their nature, including how they are conducted or why medical educators undertake this knowledge synthesis type. This gap makes it difficult to know where the field stands and may hamper attempts to improve the conduct, reporting and utility of scoping reviews. Thus, this review characterises the nature of medical education scoping reviews to identify areas for improvement and highlight future research opportunities.

METHOD

The authors searched PubMed for scoping reviews published between 1/1999 and 4/2020 in 14 medical education journals. The authors extracted and summarised key bibliometric data, the rationales given for conducting a scoping review, the research questions and key reporting elements as described in the PRISMA-ScR. Rationales and research questions were mapped to Arksey and O'Malley's reasons for conducting a scoping review.

RESULTS

One hundred and one scoping reviews were included. On average, 10.1 scoping reviews (SD = 13.1, median = 4) were published annually with the most reviews published in 2019 (n = 42). Authors described multiple reasons for undertaking scoping reviews; the most prevalent being to summarise and disseminate research findings (n = 77). In 11 reviews, the rationales for the scoping review and the research questions aligned. No review addressed all elements of the PRISMA-ScR, with few authors publishing a protocol (n = 2) or including stakeholders (n = 20). Authors identified shortcomings of scoping reviews, including lack of critical appraisal.

CONCLUSIONS

Scoping reviews are increasingly conducted in medical education and published by most core journals. Scoping reviews aim to map the depth and breadth of emerging topics; as such, they have the potential to play a critical role in the practice, policy and research of medical education. However, these results suggest improvements are needed for this role to be fully realised.

Use of an Adaptive e-Learning Platform as a Formative Assessment Tool in the Cardiovascular System Course Component of an MBBS Programme

BACKGROUND

Technology-enhanced learning includes the adaptive e-learning platform, a data-driven method with computer algorithms, providing customised learning enhancing critical thinking of individual learners. "Firecracker" - an online adaptive e-learning platform, and assessment software, promotes critical thinking, helps prepare students for courses and high-stakes examinations, and evaluates progress relative to co-learners. The objectives of this study were to determine the usage rates of Firecracker, examine the performance of Firecracker formative quizzes, identify the correlation between Firecracker use and performance with that of performance at summative course assessments, and assess students' satisfaction with Firecracker usage.

METHODS

Study participants were Year-2 MBBS (Bachelor of Medicine, Bachelor of Surgery) students (n=91) of the Faculty of Medical Sciences, The University of the West Indies, Cave Hill Campus, Barbados. The Firecracker Administrator uploaded quizzes covering basic science content in the Cardiovascular System course. Access, usage, and performance on Firecracker formative quizzes were retrieved from the Firecracker dashboard. A questionnaire sought the views of study participants.

RESULTS

Seven sets of quizzes were administered over nine weeks, with weekly student completion rates ranging from 53% to 73%. Mean quiz scores ranged from 52% to 72%. Students completing >4 quiz sessions compared to those completing ≤4 demonstrated significantly better performance in Firecracker quizzes (P<0.01), final examinations (P<0.01) and in-course assessment plus final examination (P<0.05) scores. Correlations between overall Firecracker performance and in-course assessment marks (P<0.05); between total overall Firecracker performance and final examination (P<0.01); and overall Firecracker performance and total course marks (P<0.01) were all significant. Most students (70%) were happy using Firecracker and felt it complemented coursework (78%) and prepared them for course exams (58%) (P<0.01).

CONCLUSION

Overall, Firecracker was perceived very positively and welcomed by the students. Students were satisfied with the Firecracker as a formative assessment tool, and its use correlated with improved performance in the course examinations.

How massed practice improves visual expertise in reading panoramic radiographs in dental students: An eye tracking study

The interpretation of medical images is an error-prone process that may yield severe consequences for patients. In dental medicine panoramic radiography (OPT) is a frequently used diagnostic procedure. OPTs typically contain multiple, diverse anomalies within one image making the diagnostic process very demanding, rendering students’ development of visual expertise a complex task. Radiograph interpretation is typically taught through massed practice; however, it is not known how effective this approach is nor how it changes students’ visual inspection of radiographs. Therefore, this study investigated how massed practice–an instructional method that entails massed learning of one type of material–affects processing of OPTs and the development of diagnostic performance. From 2017 to 2018, 47 dental students in their first clinical semester diagnosed 10 OPTs before and after their regular massed practice training, which is embedded in their curriculum. The OPTs contained between 3 to 26 to-be-identified anomalies. During massed practice they diagnosed 100 dental radiographs without receiving corrective feedback. The authors recorded students’ eye movements and assessed the number of correctly identified and falsely marked low- and high prevalence anomalies before and after massed practice. Massed practice had a positive effect on detecting anomalies especially with low prevalence (p < .001). After massed practice students covered a larger proportion of the OPTs (p < .001), which was positively related to the detection of low-prevalence anomalies (p = .04). Students also focused longer, more frequently, and earlier on low-prevalence anomalies after massed practice (p_s < .001). While massed practice improved visual expertise in dental students with limited prior knowledge, there is still substantial room for improvement. The results suggest integrating massed practice with more deliberate practice, where, for example, corrective feedback is provided, and support is adapted to students’ needs.

Radiation oncology as part of medical education-current status and possible digital future prospects

Purpose

Education as part of medical education is currently changing rapidly. Not least because of the corona crisis, more and more digital teaching formats and innovative teaching concepts such as the flipped classroom model are finding their way into teaching. We analyzed the acceptance and effectiveness of traditional teaching methods as well as the interest in innovative e‑learning methods among medical students in the field of radiation oncology at the medical school of the Technical University of Munich.

Methods

We carried out an online-based survey as well as a knowledge test on all students from two terms who had completed the seminar series of radiation oncology. The survey comprised seven questions on the frequency of participation, acceptance, and judgment of the effectiveness in terms of learning and on a potential use of e‑learning methods using a six-point Likert scale. The test consisted of 10 multiple-choice questions.

Results

Traditional teaching methods are largely accepted by students and most students consider the current learning format to be effective in terms of the teaching effect in the field of radiation oncology. However, only about 50% of all knowledge questions were answered correctly. The possible use of e‑learning methods was judged critically or desired in roughly equal parts among the students.

Conclusion

Traditional seminars enjoy a high level of acceptance among students. Effectiveness with regard to the internalization of content taught, however, should be increased. After all, the future seems to lie in the integration of e‑learning in the form of educational videos and practical seminars.

Spaced education and student learning: Results from a medical school

BACKGROUND

It is critical for medical students to retain and apply their knowledge of basic sciences to become competent prescribing physicians. Poor long-term retention is a pervasive concern. We investigated the impact of 'spaced education' teaching modules to improve knowledge retention in medical students on a topic of public health: vitamin D and its role in health and disease. It is critical for medical students to retain and apply their knowledge of basic sciences to become competent prescribing physicians METHODS: In a self-matched design, 148 medical students were randomised and evaluated on vitamin D-related topics to assess reinforced and non-reinforced knowledge in a multiple-choice question format. Initial learning and long-term retention were assessed with an estimation of Cohen's effect size at 24 and 72 weeks, respectively.

RESULTS

The administration of spaced educational material significantly improved composite formative test scores at 24 weeks (p < 0.001, effect size = 1.33). Although the scores dipped, there was a retention of knowledge at 72 weeks (effect size = 0.48).

DISCUSSION

Spaced reinforcement and testing statistically improved knowledge retention among our medical students. Gaps in the present teaching could be bridged by motivating the students to extend their learning time by appropriate spacing intervals and to understand the relevance of course content in different scenarios as a physician. Further research could be instrumental in optimising interventions to enhance learning opportunities for medical students.